2024-06-02T23:36:24.978 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-02T23:36:24.979 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/snap-schedule} --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687 --verbose --name teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687/orig.config.yaml 2024-06-02T23:36:25.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T23:36:25.116 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/snap-schedule} email: ceph-qa@ceph.com first_in_suite: false job_id: '7738687' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2064 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 125/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: dfcc4b3c2c55532c4c04fa47551c9df1dffdf746 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBzXAXExlllZL3QBDT76maUBNp4S7jutATjA5KmN29fUOgbheK0nomxD7cJzFc4eEuq87/Fj/M172HIolnO0DIs= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMlQu/lo+6PKYxYzJhi2ScDyh7eQSlyPzuAGrWnCHFvLaqV8yhWYPfJAGa48OpFZTS+GnF5kSGSXlmfpCeteCI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-02_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-02T23:36:25.116 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa; will attempt to use it 2024-06-02T23:36:25.117 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks 2024-06-02T23:36:25.117 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-02T23:36:25.119 INFO:teuthology.task.internal:Checking packages... 2024-06-02T23:36:25.147 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-02T23:36:25.147 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T23:36:25.147 INFO:teuthology.packaging:ref: None 2024-06-02T23:36:25.147 INFO:teuthology.packaging:tag: None 2024-06-02T23:36:25.147 INFO:teuthology.packaging:branch: squid 2024-06-02T23:36:25.147 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:36:25.148 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-02T23:36:25.343 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2952.gdfcc4b3c 2024-06-02T23:36:25.345 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-02T23:36:25.357 INFO:teuthology.task.internal:no buildpackages task found 2024-06-02T23:36:25.357 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-02T23:36:25.381 INFO:teuthology.task.internal:Saving configuration 2024-06-02T23:36:25.398 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-02T23:36:25.406 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-02T23:36:25.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 23:31:16.517724', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBzXAXExlllZL3QBDT76maUBNp4S7jutATjA5KmN29fUOgbheK0nomxD7cJzFc4eEuq87/Fj/M172HIolnO0DIs='} 2024-06-02T23:36:25.454 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 23:31:16.519430', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMlQu/lo+6PKYxYzJhi2ScDyh7eQSlyPzuAGrWnCHFvLaqV8yhWYPfJAGa48OpFZTS+GnF5kSGSXlmfpCeteCI='} 2024-06-02T23:36:25.454 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-02T23:36:25.462 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-06-02T23:36:25.462 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-06-02T23:36:25.462 INFO:teuthology.run_tasks:Running task console_log... 2024-06-02T23:36:25.524 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f900264bbe0>, signals=[15]) 2024-06-02T23:36:25.525 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-02T23:36:25.535 INFO:teuthology.task.internal:Opening connections... 2024-06-02T23:36:25.536 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:36:25.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:36:25.614 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T23:36:25.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:36:25.687 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-02T23:36:25.698 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-06-02T23:36:25.716 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-06-02T23:36:25.717 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-06-02T23:36:25.773 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2024-06-02T23:36:25.773 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9" 2024-06-02T23:36:25.773 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2024-06-02T23:36:25.773 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2024-06-02T23:36:25.774 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9" 2024-06-02T23:36:25.774 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9" 2024-06-02T23:36:25.774 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T23:36:25.774 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2024-06-02T23:36:25.774 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon" 2024-06-02T23:36:25.774 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T23:36:25.774 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2024-06-02T23:36:25.774 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T23:36:25.774 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T23:36:25.774 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T23:36:25.775 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-06-02T23:36:25.795 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-06-02T23:36:25.812 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-06-02T23:36:25.812 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-06-02T23:36:25.870 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-06-02T23:36:25.870 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-06-02T23:36:25.870 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-06-02T23:36:25.870 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-06-02T23:36:25.870 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-06-02T23:36:25.870 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-06-02T23:36:25.870 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-02T23:36:25.870 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-06-02T23:36:25.871 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-06-02T23:36:25.871 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-02T23:36:25.871 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-06-02T23:36:25.871 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T23:36:25.871 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-02T23:36:25.871 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-02T23:36:25.871 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-06-02T23:36:25.894 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-02T23:36:25.908 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-02T23:36:25.921 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-02T23:36:25.921 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-06-02T23:36:25.924 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-06-02T23:36:25.940 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-02T23:36:25.947 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-02T23:36:25.947 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-06-02T23:36:25.981 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-06-02T23:36:26.134 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-02T23:36:26.190 INFO:teuthology.run_tasks:Running task kernel... 2024-06-02T23:36:26.233 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-06-02T23:36:26.234 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-06-02T23:36:26.234 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T23:36:26.234 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T23:36:26.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:36:26.251 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-06-02T23:36:26.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:36:26.252 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-06-02T23:36:26.308 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-437.el9.x86_64 2024-06-02T23:36:26.308 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.14.0-437.el9.x86_64 2024-06-02T23:36:26.308 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum install -y kernel 2024-06-02T23:36:26.311 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-437.el9.x86_64 2024-06-02T23:36:26.311 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.14.0-437.el9.x86_64 2024-06-02T23:36:26.311 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum install -y kernel 2024-06-02T23:36:28.485 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-06-02T23:36:28.589 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-06-02T23:36:30.194 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 31 MB/s | 19 MB 00:00 2024-06-02T23:36:30.522 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-06-02T23:36:34.412 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-06-02T23:36:34.506 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-06-02T23:36:36.012 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 17 kB 00:00 2024-06-02T23:36:36.140 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 17 kB 00:00 2024-06-02T23:36:37.704 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-06-02T23:36:38.060 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-06-02T23:36:42.846 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-06-02T23:36:43.050 INFO:teuthology.orchestra.run.smithi162.stdout:Last metadata expiration check: 0:00:01 ago on Sun 02 Jun 2024 11:36:42 PM UTC. 2024-06-02T23:36:43.283 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-06-02T23:36:44.877 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-02T23:36:44.877 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-02T23:36:44.975 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-06-02T23:36:44.980 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-06-02T23:36:44.980 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-06-02T23:36:44.980 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-06-02T23:36:44.980 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-06-02T23:36:44.981 INFO:teuthology.orchestra.run.smithi162.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-02T23:36:44.981 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-06-02T23:36:44.981 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-02T23:36:44.981 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-02T23:36:44.981 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-02T23:36:44.981 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:36:44.981 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-06-02T23:36:44.981 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-06-02T23:36:44.981 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-06-02T23:36:44.981 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:36:44.982 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 80 M 2024-06-02T23:36:44.982 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 124 M 2024-06-02T23:36:44.982 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-06-02T23:36:45.289 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-06-02T23:36:45.289 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-06-02T23:36:45.392 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-06-02T23:36:45.403 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout: kernel x86_64 5.14.0-452.el9 baseos 893 k 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core x86_64 5.14.0-452.el9 baseos 16 M 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules x86_64 5.14.0-452.el9 baseos 35 M 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-core x86_64 5.14.0-452.el9 baseos 29 M 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout:Install 4 Packages 2024-06-02T23:36:45.404 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:36:45.405 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 80 M 2024-06-02T23:36:45.405 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 124 M 2024-06-02T23:36:45.405 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-06-02T23:36:45.538 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 3.1 MB/s | 893 kB 00:00 2024-06-02T23:36:45.884 INFO:teuthology.orchestra.run.smithi096.stdout:(1/4): kernel-5.14.0-452.el9.x86_64.rpm 2.6 MB/s | 893 kB 00:00 2024-06-02T23:36:47.263 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 7.9 MB/s | 16 MB 00:02 2024-06-02T23:36:48.184 INFO:teuthology.orchestra.run.smithi096.stdout:(2/4): kernel-core-5.14.0-452.el9.x86_64.rpm 6.0 MB/s | 16 MB 00:02 2024-06-02T23:36:48.780 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): kernel-modules-core-5.14.0-452.el9.x86_6 8.9 MB/s | 29 MB 00:03 2024-06-02T23:36:49.089 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 9.0 MB/s | 35 MB 00:03 2024-06-02T23:36:49.089 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:36:49.089 INFO:teuthology.orchestra.run.smithi162.stdout:Total 20 MB/s | 80 MB 00:04 2024-06-02T23:36:49.625 INFO:teuthology.orchestra.run.smithi096.stdout:(3/4): kernel-modules-core-5.14.0-452.el9.x86_6 7.7 MB/s | 29 MB 00:03 2024-06-02T23:36:49.788 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-06-02T23:36:50.113 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-06-02T23:36:50.113 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-06-02T23:36:50.150 INFO:teuthology.orchestra.run.smithi096.stdout:(4/4): kernel-modules-5.14.0-452.el9.x86_64.rpm 7.5 MB/s | 35 MB 00:04 2024-06-02T23:36:50.151 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:36:50.151 INFO:teuthology.orchestra.run.smithi096.stdout:Total 17 MB/s | 80 MB 00:04 2024-06-02T23:36:50.849 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-06-02T23:36:51.072 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-06-02T23:36:51.072 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-06-02T23:36:51.205 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-06-02T23:36:51.205 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-06-02T23:36:52.145 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-06-02T23:36:52.146 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-06-02T23:36:53.494 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-06-02T23:36:54.142 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-02T23:36:54.238 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T23:36:54.567 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-06-02T23:36:55.253 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-core-5.14.0-452.el9.x86_64 1/4 2024-06-02T23:36:55.342 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T23:36:56.890 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T23:36:57.047 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T23:36:58.011 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T23:36:58.177 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T23:37:01.761 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T23:37:02.112 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:02.921 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T23:37:03.048 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:06.872 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:07.798 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:36.222 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:36.262 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:36.661 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:36.661 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-02T23:37:36.662 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T23:37:36.662 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T23:37:37.075 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:37.115 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:37.415 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:37.416 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:37:37.416 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-06-02T23:37:37.416 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-02T23:37:37.416 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-02T23:37:37.416 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-02T23:37:37.416 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-02T23:37:37.416 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:37:37.416 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-06-02T23:37:37.531 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:37.531 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-5.14.0-452.el9.x86_64 1/4 2024-06-02T23:37:37.531 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-core-5.14.0-452.el9.x86_64 2/4 2024-06-02T23:37:37.531 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-5.14.0-452.el9.x86_64 3/4 2024-06-02T23:37:37.798 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T23:37:37.888 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T23:37:37.888 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T23:37:37.888 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-02T23:37:37.888 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-02T23:37:37.889 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-02T23:37:37.889 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-06-02T23:37:37.889 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-06-02T23:37:37.889 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T23:37:37.940 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T23:37:37.941 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T23:37:37.941 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-06-02T23:37:37.982 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-06-02T23:37:37.982 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-06-02T23:37:37.982 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-06-02T23:37:37.982 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 68.el9 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8264254 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-06-02T23:37:37.983 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-06-02T23:37:37.984 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:37:37.984 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-02T23:37:37.984 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-02T23:37:37.984 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-02T23:37:37.984 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-06-02T23:37:37.984 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:37:37.984 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-06-02T23:37:37.985 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-02T23:37:37.985 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 5.14.0-452.el9.x86_64 2024-06-02T23:37:37.985 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-02T23:37:38.325 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-core-5.14.0-452.el9.x86_64 4/4 2024-06-02T23:37:38.325 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:37:38.325 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-06-02T23:37:38.325 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-5.14.0-452.el9.x86_64 2024-06-02T23:37:38.325 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core-5.14.0-452.el9.x86_64 2024-06-02T23:37:38.325 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-5.14.0-452.el9.x86_64 2024-06-02T23:37:38.325 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-core-5.14.0-452.el9.x86_64 2024-06-02T23:37:38.325 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:37:38.325 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-06-02T23:37:38.622 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-06-02T23:37:38.659 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T23:37:38.749 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T23:37:38.749 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T23:37:38.749 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-452.el9.x86_64 2024-06-02T23:37:38.750 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-06-02T23:37:38.750 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-06-02T23:37:38.750 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-06-02T23:37:38.750 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-06-02T23:37:38.750 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T23:37:38.801 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-5.14.0-452.el9.x86_64 2024-06-02T23:37:38.802 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-452.el9.x86_64 2024-06-02T23:37:38.802 DEBUG:teuthology.orchestra.run.smithi096:> sudo rpm -qi grub2-tools 2024-06-02T23:37:38.841 INFO:teuthology.orchestra.run.smithi096.stdout:Name : grub2-tools 2024-06-02T23:37:38.841 INFO:teuthology.orchestra.run.smithi096.stdout:Epoch : 1 2024-06-02T23:37:38.841 INFO:teuthology.orchestra.run.smithi096.stdout:Version : 2.06 2024-06-02T23:37:38.841 INFO:teuthology.orchestra.run.smithi096.stdout:Release : 68.el9 2024-06-02T23:37:38.841 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: x86_64 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Group : Unspecified 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Size : 8264254 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:License : GPLv3+ 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Packager : builder@centos.org 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Vendor : CentOS 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Summary : Support tools for GRUB. 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:Description : 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:37:38.842 INFO:teuthology.orchestra.run.smithi096.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-02T23:37:38.843 INFO:teuthology.orchestra.run.smithi096.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-02T23:37:38.843 INFO:teuthology.orchestra.run.smithi096.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-02T23:37:38.843 INFO:teuthology.orchestra.run.smithi096.stdout:hardware devices. 2024-06-02T23:37:38.843 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:37:38.843 INFO:teuthology.orchestra.run.smithi096.stdout:This subpackage provides tools for support of all platforms. 2024-06-02T23:37:38.843 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-02T23:37:38.844 INFO:teuthology.task.kernel:Updating grub on smithi096 to boot 5.14.0-452.el9.x86_64 2024-06-02T23:37:38.844 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-02T23:37:39.491 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-06-02T23:37:39.978 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-02T23:37:40.007 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-06-02T23:37:40.015 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-06-02T23:37:40.031 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.K1G2wnYTXz 2024-06-02T23:37:40.031 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.K1G2wnYTXz 2024-06-02T23:37:40.097 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.K1G2wnYTXz 2024-06-02T23:37:40.234 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.K1G2wnYTXz is 6KB 2024-06-02T23:37:40.283 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.K1G2wnYTXz 2024-06-02T23:37:40.297 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-06-02T23:37:40.358 INFO:teuthology.orchestra.run.smithi162.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-02T23:37:40.359 INFO:teuthology.orchestra.run.smithi162.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-02T23:37:40.359 INFO:teuthology.orchestra.run.smithi162.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-02T23:37:40.359 INFO:teuthology.orchestra.run.smithi162.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-02T23:37:40.360 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-02T23:37:40.515 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-06-02T23:37:40.838 INFO:teuthology.orchestra.run.smithi096.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-02T23:37:40.855 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-06-02T23:37:40.858 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-06-02T23:37:40.873 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.WEJd2vlhGx 2024-06-02T23:37:40.873 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WEJd2vlhGx 2024-06-02T23:37:40.938 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.WEJd2vlhGx 2024-06-02T23:37:41.067 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.WEJd2vlhGx is 6KB 2024-06-02T23:37:41.116 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.WEJd2vlhGx 2024-06-02T23:37:41.130 DEBUG:teuthology.orchestra.run.smithi096:> sudo /bin/ls /boot/loader/entries || true 2024-06-02T23:37:41.194 INFO:teuthology.orchestra.run.smithi096.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-02T23:37:41.194 INFO:teuthology.orchestra.run.smithi096.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-02T23:37:41.194 INFO:teuthology.orchestra.run.smithi096.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-02T23:37:41.194 INFO:teuthology.orchestra.run.smithi096.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64.conf 2024-06-02T23:37:41.195 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-452.el9.x86_64 2024-06-02T23:37:41.345 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-06-02T23:38:10.547 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-06-02T23:38:10.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-06-02T23:38:10.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:38:11.349 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-06-02T23:38:11.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-06-02T23:38:11.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:38:29.022 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-06-02T23:38:29.791 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-06-02T23:38:38.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-06-02T23:38:38.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:38:38.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-06-02T23:38:38.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:38:41.090 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-06-02T23:38:41.854 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-06-02T23:38:53.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-06-02T23:38:53.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:38:53.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-06-02T23:38:53.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:39:11.518 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-06-02T23:39:25.714 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-06-02T23:39:26.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-06-02T23:39:26.099 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-452.el9.x86_64"... 2024-06-02T23:39:26.100 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-06-02T23:39:26.114 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-452.el9.x86_64 2024-06-02T23:39:26.114 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-02T23:39:26.114 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-02T23:39:26.114 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-02T23:39:26.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-06-02T23:39:26.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:39:26.878 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-06-02T23:39:27.115 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-06-02T23:39:27.115 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-02T23:39:27.238 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-06-02T23:39:27.272 DEBUG:teuthology.parallel:result is None 2024-06-02T23:39:27.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-06-02T23:39:27.337 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-452.el9.x86_64"... 2024-06-02T23:39:27.337 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-06-02T23:39:27.351 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-452.el9.x86_64 2024-06-02T23:39:27.351 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-452.el9.x86_64 vs 5.14.0-452.el9.x86_64 2024-06-02T23:39:27.352 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-02T23:39:27.352 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-02T23:39:28.352 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-06-02T23:39:28.353 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-06-02T23:39:28.423 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2024-06-02T23:39:28.459 DEBUG:teuthology.parallel:result is None 2024-06-02T23:39:28.460 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-02T23:39:28.467 INFO:teuthology.task.internal:Creating test directory... 2024-06-02T23:39:28.467 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T23:39:28.470 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T23:39:28.485 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-02T23:39:28.495 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-02T23:39:28.505 INFO:teuthology.task.internal:Creating archive directory... 2024-06-02T23:39:28.505 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T23:39:28.526 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T23:39:28.561 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-02T23:39:28.568 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-02T23:39:28.568 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T23:39:28.600 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T23:39:28.646 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T23:39:28.652 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T23:39:28.656 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T23:39:28.662 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T23:39:28.663 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-02T23:39:28.670 INFO:teuthology.task.internal:Configuring sudo... 2024-06-02T23:39:28.670 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T23:39:28.672 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T23:39:28.696 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-02T23:39:28.719 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-02T23:39:28.719 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T23:39:28.737 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T23:39:28.752 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T23:39:28.831 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T23:39:28.881 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T23:39:28.961 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T23:39:29.003 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:39:29.003 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T23:39:29.067 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T23:39:29.110 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T23:39:29.148 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T23:39:29.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T23:39:29.265 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:39:29.265 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T23:39:29.326 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-06-02T23:39:29.329 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-06-02T23:39:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T23:39:29.410 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T23:39:29.661 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-02T23:39:29.668 INFO:teuthology.task.internal:Starting timer... 2024-06-02T23:39:29.668 INFO:teuthology.run_tasks:Running task pcp... 2024-06-02T23:39:29.681 INFO:teuthology.run_tasks:Running task selinux... 2024-06-02T23:39:29.688 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-06-02T23:39:29.689 DEBUG:teuthology.orchestra.run.smithi096:> sudo service auditd rotate 2024-06-02T23:39:29.757 INFO:teuthology.orchestra.run.smithi096.stdout:Rotating logs: 2024-06-02T23:39:29.759 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-06-02T23:39:29.828 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-06-02T23:39:29.830 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-02T23:39:29.831 DEBUG:teuthology.orchestra.run.smithi096:> /usr/sbin/getenforce 2024-06-02T23:39:29.849 INFO:teuthology.orchestra.run.smithi096.stdout:Permissive 2024-06-02T23:39:29.849 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-06-02T23:39:29.880 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-06-02T23:39:29.880 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi096.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-06-02T23:39:29.881 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T23:39:29.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:39:29.914 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-02T23:39:29.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:39:29.943 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-02T23:39:29.943 DEBUG:teuthology.orchestra.run.smithi096:> sudo /usr/sbin/setenforce permissive 2024-06-02T23:39:29.985 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-06-02T23:39:30.092 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-02T23:39:30.101 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-02T23:39:30.105 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-02T23:39:30.230 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-02T23:39:30.241 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-02T23:39:30.242 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-02T23:43:46.712 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-06-02T23:43:46.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-06-02T23:43:46.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:43:46.791 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-06-02T23:43:46.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-06-02T23:43:46.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-06-02T23:43:46.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T23:43:46.954 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-06-02T23:43:47.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-06-02T23:43:47.029 INFO:teuthology.run_tasks:Running task clock... 2024-06-02T23:43:47.040 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-02T23:43:47.040 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T23:43:47.040 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:43:47.042 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T23:43:47.043 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T23:43:47.072 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T23:43:47.087 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T23:43:47.098 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T23:43:47.112 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T23:43:47.112 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: ntpd: command not found 2024-06-02T23:43:47.124 INFO:teuthology.orchestra.run.smithi096.stdout:506 Cannot talk to daemon 2024-06-02T23:43:47.136 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-06-02T23:43:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T23:43:47.147 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-06-02T23:43:47.152 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T23:43:47.161 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T23:43:47.175 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T23:43:47.211 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:43:47.215 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:43:47.215 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2024-06-02T23:43:47.215 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:43:47.215 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:43:47.215 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:43:47.215 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:43:47.237 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-06-02T23:43:47.241 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T23:43:47.241 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-06-02T23:43:47.241 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:43:47.241 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:43:47.241 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:43:47.241 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T23:43:47.242 INFO:teuthology.run_tasks:Running task install... 2024-06-02T23:43:47.249 DEBUG:teuthology.task.install:project ceph 2024-06-02T23:43:47.249 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-02T23:43:47.250 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-02T23:43:47.250 INFO:teuthology.task.install:Using flavor: default 2024-06-02T23:43:47.255 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-02T23:43:47.255 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-02T23:43:47.256 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T23:43:47.256 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:43:47.258 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-02T23:43:47.258 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:43:47.407 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-02T23:43:47.408 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-02T23:43:47.473 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-02T23:43:47.473 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-02T23:43:47.518 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T23:43:47.518 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:43:47.518 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T23:43:47.545 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T23:43:47.545 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T23:43:47.579 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T23:43:47.579 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:43:47.579 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T23:43:47.606 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T23:43:47.606 DEBUG:teuthology.orchestra.run.smithi096:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T23:43:47.610 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T23:43:47.672 DEBUG:teuthology.orchestra.run.smithi096:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T23:43:47.685 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T23:43:47.747 DEBUG:teuthology.orchestra.run.smithi096:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T23:43:47.750 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-06-02T23:43:47.751 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-06-02T23:43:47.811 INFO:teuthology.orchestra.run.smithi096.stdout:check_obsoletes = 1 2024-06-02T23:43:47.813 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean all 2024-06-02T23:43:47.980 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-06-02T23:43:48.007 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T23:43:48.041 INFO:teuthology.orchestra.run.smithi096.stdout:45 files removed 2024-06-02T23:43:48.068 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T23:43:48.769 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 172 kB/s | 83 kB 00:00 2024-06-02T23:43:48.770 INFO:teuthology.orchestra.run.smithi096.stdout:ceph packages for x86_64 202 kB/s | 83 kB 00:00 2024-06-02T23:43:49.136 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-06-02T23:43:49.229 INFO:teuthology.orchestra.run.smithi096.stdout:ceph noarch packages 28 kB/s | 11 kB 00:00 2024-06-02T23:43:49.503 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-06-02T23:43:49.646 INFO:teuthology.orchestra.run.smithi096.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-06-02T23:43:49.939 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 21 MB/s | 8.1 MB 00:00 2024-06-02T23:43:50.271 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-06-02T23:43:51.888 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-06-02T23:43:52.022 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 30 MB/s | 19 MB 00:00 2024-06-02T23:43:56.063 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-06-02T23:43:57.463 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 17 kB 00:00 2024-06-02T23:43:58.901 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-06-02T23:43:59.297 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 6.2 MB 00:03 2024-06-02T23:44:01.089 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 17 kB 00:00 2024-06-02T23:44:02.707 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-06-02T23:44:04.073 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-06-02T23:44:06.425 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T23:44:06.426 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T23:44:06.437 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T23:44:06.438 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T23:44:06.438 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T23:44:06.439 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T23:44:06.441 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T23:44:06.443 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T23:44:06.444 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T23:44:06.507 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-06-02T23:44:06.526 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-06-02T23:44:06.526 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-06-02T23:44:06.526 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-06-02T23:44:06.526 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-06-02T23:44:06.526 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-02T23:44:06.527 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T23:44:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T23:44:06.529 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-02T23:44:06.530 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T23:44:06.531 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T23:44:06.532 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T23:44:06.533 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T23:44:06.534 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T23:44:06.535 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T23:44:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T23:44:06.537 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-06-02T23:44:06.538 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-06-02T23:44:06.539 INFO:teuthology.orchestra.run.smithi162.stdout:Install 148 Packages 2024-06-02T23:44:06.539 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 11 Packages 2024-06-02T23:44:06.539 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:44:06.539 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 225 M 2024-06-02T23:44:06.539 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-06-02T23:44:07.332 INFO:teuthology.orchestra.run.smithi162.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-06-02T23:44:07.757 INFO:teuthology.orchestra.run.smithi162.stdout:(2/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 8.0 MB/s | 5.4 MB 00:00 2024-06-02T23:44:07.824 INFO:teuthology.orchestra.run.smithi162.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 2.1 MB/s | 145 kB 00:00 2024-06-02T23:44:07.891 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-06-02T23:44:08.116 INFO:teuthology.orchestra.run.smithi162.stdout:(4/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 8.1 MB/s | 2.4 MB 00:00 2024-06-02T23:44:08.150 INFO:teuthology.orchestra.run.smithi162.stdout:(5/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.1 MB/s | 890 kB 00:00 2024-06-02T23:44:08.292 INFO:teuthology.orchestra.run.smithi162.stdout:(6/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 8.5 MB/s | 1.5 MB 00:00 2024-06-02T23:44:08.742 INFO:teuthology.orchestra.run.smithi162.stdout:(7/159): ceph-common-19.0.0-2946.g3d89accf.el9. 13 MB/s | 21 MB 00:01 2024-06-02T23:44:09.692 INFO:teuthology.orchestra.run.smithi162.stdout:(8/159): ceph-radosgw-19.0.0-2946.g3d89accf.el9 11 MB/s | 10 MB 00:00 2024-06-02T23:44:09.859 INFO:teuthology.orchestra.run.smithi162.stdout:(9/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x86 11 MB/s | 17 MB 00:01 2024-06-02T23:44:09.876 INFO:teuthology.orchestra.run.smithi162.stdout:(10/159): ceph-selinux-19.0.0-2946.g3d89accf.el 137 kB/s | 25 kB 00:00 2024-06-02T23:44:09.968 INFO:teuthology.orchestra.run.smithi162.stdout:(11/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x8 2.6 MB/s | 4.7 MB 00:01 2024-06-02T23:44:09.993 INFO:teuthology.orchestra.run.smithi162.stdout:(12/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 1.8 MB/s | 221 kB 00:00 2024-06-02T23:44:10.035 INFO:teuthology.orchestra.run.smithi162.stdout:(13/159): cephfs-shell-19.0.0-2946.g3d89accf.el 404 kB/s | 27 kB 00:00 2024-06-02T23:44:10.068 INFO:teuthology.orchestra.run.smithi162.stdout:(14/159): libcephfs-devel-19.0.0-2946.g3d89accf 423 kB/s | 32 kB 00:00 2024-06-02T23:44:10.136 INFO:teuthology.orchestra.run.smithi162.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 2.4 MB/s | 163 kB 00:00 2024-06-02T23:44:10.202 INFO:teuthology.orchestra.run.smithi162.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.9 MB/s | 127 kB 00:00 2024-06-02T23:44:10.228 INFO:teuthology.orchestra.run.smithi162.stdout:(17/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 3.8 MB/s | 747 kB 00:00 2024-06-02T23:44:10.233 INFO:teuthology.orchestra.run.smithi096.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T23:44:10.234 INFO:teuthology.orchestra.run.smithi096.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-02T23:44:10.245 INFO:teuthology.orchestra.run.smithi096.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-02T23:44:10.246 INFO:teuthology.orchestra.run.smithi096.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-02T23:44:10.247 INFO:teuthology.orchestra.run.smithi096.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-02T23:44:10.248 INFO:teuthology.orchestra.run.smithi096.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-02T23:44:10.249 INFO:teuthology.orchestra.run.smithi096.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-02T23:44:10.251 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-02T23:44:10.252 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-02T23:44:10.295 INFO:teuthology.orchestra.run.smithi162.stdout:(18/159): libradosstriper1-19.0.0-2946.g3d89acc 5.3 MB/s | 501 kB 00:00 2024-06-02T23:44:10.315 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-06-02T23:44:10.333 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================= 2024-06-02T23:44:10.334 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-06-02T23:44:10.334 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================= 2024-06-02T23:44:10.334 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-06-02T23:44:10.334 INFO:teuthology.orchestra.run.smithi096.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-02T23:44:10.334 INFO:teuthology.orchestra.run.smithi096.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-02T23:44:10.334 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-02T23:44:10.334 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-02T23:44:10.334 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-02T23:44:10.335 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-02T23:44:10.336 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrading: 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-02T23:44:10.337 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-02T23:44:10.338 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-02T23:44:10.339 INFO:teuthology.orchestra.run.smithi096.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-02T23:44:10.340 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-02T23:44:10.341 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-02T23:44:10.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-02T23:44:10.343 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-02T23:44:10.344 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-02T23:44:10.345 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout:Installing weak dependencies: 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout:======================================================================================= 2024-06-02T23:44:10.346 INFO:teuthology.orchestra.run.smithi096.stdout:Install 148 Packages 2024-06-02T23:44:10.347 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrade 11 Packages 2024-06-02T23:44:10.347 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:44:10.347 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 225 M 2024-06-02T23:44:10.347 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-06-02T23:44:10.362 INFO:teuthology.orchestra.run.smithi162.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 679 kB/s | 45 kB 00:00 2024-06-02T23:44:10.437 INFO:teuthology.orchestra.run.smithi162.stdout:(20/159): python3-ceph-common-19.0.0-2946.g3d89 1.8 MB/s | 135 kB 00:00 2024-06-02T23:44:10.512 INFO:teuthology.orchestra.run.smithi162.stdout:(21/159): python3-cephfs-19.0.0-2946.g3d89accf. 2.1 MB/s | 162 kB 00:00 2024-06-02T23:44:10.588 INFO:teuthology.orchestra.run.smithi162.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 4.2 MB/s | 321 kB 00:00 2024-06-02T23:44:10.671 INFO:teuthology.orchestra.run.smithi162.stdout:(23/159): python3-rbd-19.0.0-2946.g3d89accf.el9 3.5 MB/s | 300 kB 00:00 2024-06-02T23:44:10.747 INFO:teuthology.orchestra.run.smithi162.stdout:(24/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.3 MB/s | 99 kB 00:00 2024-06-02T23:44:10.814 INFO:teuthology.orchestra.run.smithi162.stdout:(25/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.2 MB/s | 85 kB 00:00 2024-06-02T23:44:11.067 INFO:teuthology.orchestra.run.smithi096.stdout:(1/159): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-06-02T23:44:11.089 INFO:teuthology.orchestra.run.smithi162.stdout:(26/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 6.2 MB/s | 5.3 MB 00:00 2024-06-02T23:44:11.156 INFO:teuthology.orchestra.run.smithi162.stdout:(27/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 9.0 MB/s | 3.1 MB 00:00 2024-06-02T23:44:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:(28/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.8 MB/s | 171 kB 00:00 2024-06-02T23:44:11.215 INFO:teuthology.orchestra.run.smithi162.stdout:(29/159): ceph-grafana-dashboards-19.0.0-2946.g 544 kB/s | 32 kB 00:00 2024-06-02T23:44:11.265 INFO:teuthology.orchestra.run.smithi162.stdout:(30/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.7 MB/s | 142 kB 00:00 2024-06-02T23:44:11.657 INFO:teuthology.orchestra.run.smithi162.stdout:(31/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 8.0 MB/s | 3.5 MB 00:00 2024-06-02T23:44:11.749 INFO:teuthology.orchestra.run.smithi162.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 2.7 MB/s | 249 kB 00:00 2024-06-02T23:44:11.824 INFO:teuthology.orchestra.run.smithi162.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 657 kB/s | 49 kB 00:00 2024-06-02T23:44:11.899 INFO:teuthology.orchestra.run.smithi162.stdout:(34/159): ceph-prometheus-alerts-19.0.0-2946.g3 219 kB/s | 16 kB 00:00 2024-06-02T23:44:11.983 INFO:teuthology.orchestra.run.smithi162.stdout:(35/159): ceph-volume-19.0.0-2946.g3d89accf.el9 3.1 MB/s | 264 kB 00:00 2024-06-02T23:44:12.133 INFO:teuthology.orchestra.run.smithi162.stdout:(36/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 5.0 MB/s | 763 kB 00:00 2024-06-02T23:44:12.200 INFO:teuthology.orchestra.run.smithi162.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 274 kB/s | 18 kB 00:00 2024-06-02T23:44:12.359 INFO:teuthology.orchestra.run.smithi096.stdout:(2/159): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 689 kB/s | 890 kB 00:01 2024-06-02T23:44:12.476 INFO:teuthology.orchestra.run.smithi162.stdout:(38/159): ceph-mgr-diskprediction-local-19.0.0- 6.1 MB/s | 7.4 MB 00:01 2024-06-02T23:44:12.533 INFO:teuthology.orchestra.run.smithi096.stdout:(3/159): ceph-immutable-object-cache-19.0.0-294 829 kB/s | 145 kB 00:00 2024-06-02T23:44:12.618 INFO:teuthology.orchestra.run.smithi162.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 193 kB/s | 80 kB 00:00 2024-06-02T23:44:12.759 INFO:teuthology.orchestra.run.smithi096.stdout:(4/159): ceph-base-19.0.0-2946.g3d89accf.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-06-02T23:44:13.017 INFO:teuthology.orchestra.run.smithi096.stdout:(5/159): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 5.8 MB/s | 1.5 MB 00:00 2024-06-02T23:44:13.376 INFO:teuthology.orchestra.run.smithi162.stdout:(40/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 14 MB/s | 48 MB 00:03 2024-06-02T23:44:13.401 INFO:teuthology.orchestra.run.smithi162.stdout:(41/159): libquadmath-11.4.1-3.el9.x86_64.rpm 249 kB/s | 195 kB 00:00 2024-06-02T23:44:13.509 INFO:teuthology.orchestra.run.smithi096.stdout:(6/159): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 9.5 MB/s | 4.7 MB 00:00 2024-06-02T23:44:13.560 INFO:teuthology.orchestra.run.smithi162.stdout:(42/159): libgfortran-11.4.1-3.el9.x86_64.rpm 741 kB/s | 803 kB 00:01 2024-06-02T23:44:13.976 INFO:teuthology.orchestra.run.smithi096.stdout:(7/159): ceph-common-19.0.0-2946.g3d89accf.el9. 6.4 MB/s | 21 MB 00:03 2024-06-02T23:44:13.977 INFO:teuthology.orchestra.run.smithi162.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 256 kB/s | 106 kB 00:00 2024-06-02T23:44:14.177 INFO:teuthology.orchestra.run.smithi162.stdout:(44/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 316 kB/s | 253 kB 00:00 2024-06-02T23:44:14.469 INFO:teuthology.orchestra.run.smithi162.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 275 kB/s | 135 kB 00:00 2024-06-02T23:44:14.669 INFO:teuthology.orchestra.run.smithi162.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 254 kB/s | 125 kB 00:00 2024-06-02T23:44:14.803 INFO:teuthology.orchestra.run.smithi162.stdout:(47/159): automake-1.16.2-8.el9.noarch.rpm 5.1 MB/s | 689 kB 00:00 2024-06-02T23:44:14.843 INFO:teuthology.orchestra.run.smithi096.stdout:(8/159): ceph-radosgw-19.0.0-2946.g3d89accf.el9 12 MB/s | 10 MB 00:00 2024-06-02T23:44:14.870 INFO:teuthology.orchestra.run.smithi162.stdout:(48/159): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-06-02T23:44:14.912 INFO:teuthology.orchestra.run.smithi162.stdout:(49/159): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-06-02T23:44:14.954 INFO:teuthology.orchestra.run.smithi162.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-06-02T23:44:14.995 INFO:teuthology.orchestra.run.smithi162.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-06-02T23:44:15.001 INFO:teuthology.orchestra.run.smithi096.stdout:(9/159): ceph-osd-19.0.0-2946.g3d89accf.el9.x86 11 MB/s | 17 MB 00:01 2024-06-02T23:44:15.018 INFO:teuthology.orchestra.run.smithi096.stdout:(10/159): ceph-selinux-19.0.0-2946.g3d89accf.el 143 kB/s | 25 kB 00:00 2024-06-02T23:44:15.046 INFO:teuthology.orchestra.run.smithi162.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-06-02T23:44:15.060 INFO:teuthology.orchestra.run.smithi096.stdout:(11/159): ceph-mds-19.0.0-2946.g3d89accf.el9.x8 957 kB/s | 2.4 MB 00:02 2024-06-02T23:44:15.086 INFO:teuthology.orchestra.run.smithi096.stdout:(12/159): cephfs-mirror-19.0.0-2946.g3d89accf.e 3.2 MB/s | 221 kB 00:00 2024-06-02T23:44:15.136 INFO:teuthology.orchestra.run.smithi096.stdout:(13/159): cephfs-shell-19.0.0-2946.g3d89accf.el 359 kB/s | 27 kB 00:00 2024-06-02T23:44:15.138 INFO:teuthology.orchestra.run.smithi162.stdout:(53/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-06-02T23:44:15.153 INFO:teuthology.orchestra.run.smithi096.stdout:(14/159): libcephfs-devel-19.0.0-2946.g3d89accf 473 kB/s | 32 kB 00:00 2024-06-02T23:44:15.163 INFO:teuthology.orchestra.run.smithi162.stdout:(54/159): python3-urllib3-1.26.5-5.el9.noarch.r 309 kB/s | 215 kB 00:00 2024-06-02T23:44:15.188 INFO:teuthology.orchestra.run.smithi162.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-06-02T23:44:15.212 INFO:teuthology.orchestra.run.smithi096.stdout:(15/159): libcephsqlite-19.0.0-2946.g3d89accf.e 2.7 MB/s | 163 kB 00:00 2024-06-02T23:44:15.230 INFO:teuthology.orchestra.run.smithi162.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 166 kB/s | 11 kB 00:00 2024-06-02T23:44:15.256 INFO:teuthology.orchestra.run.smithi162.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-06-02T23:44:15.281 INFO:teuthology.orchestra.run.smithi162.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-06-02T23:44:15.304 INFO:teuthology.orchestra.run.smithi096.stdout:(16/159): librados-devel-19.0.0-2946.g3d89accf. 1.3 MB/s | 127 kB 00:00 2024-06-02T23:44:15.323 INFO:teuthology.orchestra.run.smithi162.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-06-02T23:44:15.357 INFO:teuthology.orchestra.run.smithi162.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 765 kB/s | 25 kB 00:00 2024-06-02T23:44:15.370 INFO:teuthology.orchestra.run.smithi096.stdout:(17/159): libradosstriper1-19.0.0-2946.g3d89acc 7.4 MB/s | 501 kB 00:00 2024-06-02T23:44:15.399 INFO:teuthology.orchestra.run.smithi162.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-06-02T23:44:15.432 INFO:teuthology.orchestra.run.smithi162.stdout:(62/159): libtool-2.4.6-45.el9.x86_64.rpm 3.8 MB/s | 582 kB 00:00 2024-06-02T23:44:15.466 INFO:teuthology.orchestra.run.smithi162.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-06-02T23:44:15.491 INFO:teuthology.orchestra.run.smithi162.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-06-02T23:44:15.517 INFO:teuthology.orchestra.run.smithi162.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-06-02T23:44:15.617 INFO:teuthology.orchestra.run.smithi162.stdout:(66/159): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-06-02T23:44:15.650 INFO:teuthology.orchestra.run.smithi162.stdout:(67/159): python3-cryptography-36.0.1-4.el9.x86 558 kB/s | 1.2 MB 00:02 2024-06-02T23:44:15.718 INFO:teuthology.orchestra.run.smithi162.stdout:(68/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-06-02T23:44:15.751 INFO:teuthology.orchestra.run.smithi162.stdout:(69/159): postgresql-13.14-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-06-02T23:44:15.776 INFO:teuthology.orchestra.run.smithi162.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-06-02T23:44:15.835 INFO:teuthology.orchestra.run.smithi162.stdout:(71/159): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-06-02T23:44:15.862 INFO:teuthology.orchestra.run.smithi096.stdout:(18/159): librgw2-19.0.0-2946.g3d89accf.el9.x86 11 MB/s | 5.3 MB 00:00 2024-06-02T23:44:15.910 INFO:teuthology.orchestra.run.smithi162.stdout:(72/159): postgresql-server-13.14-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-06-02T23:44:15.929 INFO:teuthology.orchestra.run.smithi096.stdout:(19/159): python3-ceph-argparse-19.0.0-2946.g3d 677 kB/s | 45 kB 00:00 2024-06-02T23:44:15.935 INFO:teuthology.orchestra.run.smithi162.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 873 kB/s | 87 kB 00:00 2024-06-02T23:44:15.963 INFO:teuthology.orchestra.run.smithi096.stdout:(20/159): libcephfs2-19.0.0-2946.g3d89accf.el9. 903 kB/s | 747 kB 00:00 2024-06-02T23:44:15.969 INFO:teuthology.orchestra.run.smithi162.stdout:(74/159): postgresql-contrib-13.14-1.el9.x86_64 2.8 MB/s | 911 kB 00:00 2024-06-02T23:44:15.994 INFO:teuthology.orchestra.run.smithi162.stdout:(75/159): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-06-02T23:44:15.997 INFO:teuthology.orchestra.run.smithi096.stdout:(21/159): python3-ceph-common-19.0.0-2946.g3d89 2.0 MB/s | 135 kB 00:00 2024-06-02T23:44:16.019 INFO:teuthology.orchestra.run.smithi162.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-06-02T23:44:16.045 INFO:teuthology.orchestra.run.smithi162.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-06-02T23:44:16.070 INFO:teuthology.orchestra.run.smithi162.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-06-02T23:44:16.072 INFO:teuthology.orchestra.run.smithi096.stdout:(22/159): python3-rados-19.0.0-2946.g3d89accf.e 4.2 MB/s | 321 kB 00:00 2024-06-02T23:44:16.095 INFO:teuthology.orchestra.run.smithi162.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-06-02T23:44:16.120 INFO:teuthology.orchestra.run.smithi162.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-06-02T23:44:16.146 INFO:teuthology.orchestra.run.smithi162.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-06-02T23:44:16.147 INFO:teuthology.orchestra.run.smithi096.stdout:(23/159): python3-rbd-19.0.0-2946.g3d89accf.el9 3.9 MB/s | 300 kB 00:00 2024-06-02T23:44:16.172 INFO:teuthology.orchestra.run.smithi096.stdout:(24/159): python3-cephfs-19.0.0-2946.g3d89accf. 774 kB/s | 162 kB 00:00 2024-06-02T23:44:16.188 INFO:teuthology.orchestra.run.smithi162.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-06-02T23:44:16.206 INFO:teuthology.orchestra.run.smithi096.stdout:(25/159): python3-rgw-19.0.0-2946.g3d89accf.el9 1.7 MB/s | 99 kB 00:00 2024-06-02T23:44:16.263 INFO:teuthology.orchestra.run.smithi162.stdout:(83/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-06-02T23:44:16.331 INFO:teuthology.orchestra.run.smithi096.stdout:(26/159): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 537 kB/s | 85 kB 00:00 2024-06-02T23:44:16.338 INFO:teuthology.orchestra.run.smithi162.stdout:(84/159): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-06-02T23:44:16.364 INFO:teuthology.orchestra.run.smithi162.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 772 kB/s | 77 kB 00:00 2024-06-02T23:44:16.389 INFO:teuthology.orchestra.run.smithi162.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-06-02T23:44:16.417 INFO:teuthology.orchestra.run.smithi162.stdout:(87/159): python3-oauthlib-3.1.1-5.el9.noarch.r 984 kB/s | 222 kB 00:00 2024-06-02T23:44:16.439 INFO:teuthology.orchestra.run.smithi162.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-02T23:44:16.465 INFO:teuthology.orchestra.run.smithi162.stdout:(89/159): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-06-02T23:44:16.490 INFO:teuthology.orchestra.run.smithi162.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-02T23:44:16.506 INFO:teuthology.orchestra.run.smithi096.stdout:(27/159): rbd-mirror-19.0.0-2946.g3d89accf.el9. 10 MB/s | 3.1 MB 00:00 2024-06-02T23:44:16.515 INFO:teuthology.orchestra.run.smithi162.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-06-02T23:44:16.549 INFO:teuthology.orchestra.run.smithi162.stdout:(92/159): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-06-02T23:44:16.557 INFO:teuthology.orchestra.run.smithi096.stdout:(28/159): ceph-grafana-dashboards-19.0.0-2946.g 635 kB/s | 32 kB 00:00 2024-06-02T23:44:16.574 INFO:teuthology.orchestra.run.smithi162.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-06-02T23:44:16.582 INFO:teuthology.orchestra.run.smithi096.stdout:(29/159): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 681 kB/s | 171 kB 00:00 2024-06-02T23:44:16.600 INFO:teuthology.orchestra.run.smithi162.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-06-02T23:44:16.616 INFO:teuthology.orchestra.run.smithi096.stdout:(30/159): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 2.4 MB/s | 142 kB 00:00 2024-06-02T23:44:16.625 INFO:teuthology.orchestra.run.smithi162.stdout:(95/159): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-06-02T23:44:16.650 INFO:teuthology.orchestra.run.smithi162.stdout:(96/159): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-06-02T23:44:16.675 INFO:teuthology.orchestra.run.smithi162.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-06-02T23:44:16.700 INFO:teuthology.orchestra.run.smithi162.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-06-02T23:44:16.726 INFO:teuthology.orchestra.run.smithi162.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-06-02T23:44:16.751 INFO:teuthology.orchestra.run.smithi162.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-06-02T23:44:16.777 INFO:teuthology.orchestra.run.smithi162.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-06-02T23:44:16.802 INFO:teuthology.orchestra.run.smithi162.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-06-02T23:44:17.061 INFO:teuthology.orchestra.run.smithi162.stdout:(103/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-06-02T23:44:17.086 INFO:teuthology.orchestra.run.smithi162.stdout:(104/159): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-06-02T23:44:17.299 INFO:teuthology.orchestra.run.smithi096.stdout:(31/159): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-06-02T23:44:17.328 INFO:teuthology.orchestra.run.smithi162.stdout:(105/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-06-02T23:44:17.353 INFO:teuthology.orchestra.run.smithi162.stdout:(106/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-06-02T23:44:17.374 INFO:teuthology.orchestra.run.smithi096.stdout:(32/159): ceph-mgr-modules-core-19.0.0-2946.g3d 3.3 MB/s | 249 kB 00:00 2024-06-02T23:44:17.378 INFO:teuthology.orchestra.run.smithi162.stdout:(107/159): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-06-02T23:44:17.433 INFO:teuthology.orchestra.run.smithi096.stdout:(33/159): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 846 kB/s | 49 kB 00:00 2024-06-02T23:44:17.436 INFO:teuthology.orchestra.run.smithi162.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 447 kB/s | 26 kB 00:00 2024-06-02T23:44:17.495 INFO:teuthology.orchestra.run.smithi162.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 833 kB/s | 49 kB 00:00 2024-06-02T23:44:17.604 INFO:teuthology.orchestra.run.smithi162.stdout:(110/159): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-06-02T23:44:17.629 INFO:teuthology.orchestra.run.smithi162.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 504 kB/s | 67 kB 00:00 2024-06-02T23:44:17.663 INFO:teuthology.orchestra.run.smithi162.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-06-02T23:44:17.730 INFO:teuthology.orchestra.run.smithi162.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-06-02T23:44:17.763 INFO:teuthology.orchestra.run.smithi162.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-06-02T23:44:17.797 INFO:teuthology.orchestra.run.smithi162.stdout:(115/159): protobuf-compiler-3.14.0-13.el9.x86_ 868 kB/s | 863 kB 00:00 2024-06-02T23:44:17.814 INFO:teuthology.orchestra.run.smithi162.stdout:(116/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 518 kB/s | 43 kB 00:00 2024-06-02T23:44:17.830 INFO:teuthology.orchestra.run.smithi162.stdout:(117/159): python3-cachetools-4.2.4-1.el9.noarc 480 kB/s | 32 kB 00:00 2024-06-02T23:44:17.864 INFO:teuthology.orchestra.run.smithi162.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 300 kB/s | 15 kB 00:00 2024-06-02T23:44:17.867 INFO:teuthology.orchestra.run.smithi096.stdout:(34/159): ceph-test-19.0.0-2946.g3d89accf.el9.x 17 MB/s | 48 MB 00:02 2024-06-02T23:44:17.892 INFO:teuthology.orchestra.run.smithi096.stdout:(35/159): ceph-prometheus-alerts-19.0.0-2946.g3 36 kB/s | 16 kB 00:00 2024-06-02T23:44:17.898 INFO:teuthology.orchestra.run.smithi162.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-06-02T23:44:17.917 INFO:teuthology.orchestra.run.smithi096.stdout:(36/159): ceph-volume-19.0.0-2946.g3d89accf.el9 5.2 MB/s | 264 kB 00:00 2024-06-02T23:44:17.931 INFO:teuthology.orchestra.run.smithi162.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-06-02T23:44:17.951 INFO:teuthology.orchestra.run.smithi096.stdout:(37/159): cephfs-top-19.0.0-2946.g3d89accf.el9. 550 kB/s | 18 kB 00:00 2024-06-02T23:44:17.965 INFO:teuthology.orchestra.run.smithi162.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-06-02T23:44:17.976 INFO:teuthology.orchestra.run.smithi096.stdout:(38/159): cephadm-19.0.0-2946.g3d89accf.el9.noa 8.9 MB/s | 763 kB 00:00 2024-06-02T23:44:18.040 INFO:teuthology.orchestra.run.smithi162.stdout:(122/159): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-06-02T23:44:18.066 INFO:teuthology.orchestra.run.smithi162.stdout:(123/159): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-06-02T23:44:18.076 INFO:teuthology.orchestra.run.smithi096.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 642 kB/s | 80 kB 00:00 2024-06-02T23:44:18.091 INFO:teuthology.orchestra.run.smithi162.stdout:(124/159): python3-cheroot-8.6.0-4.el9.noarch.r 620 kB/s | 172 kB 00:00 2024-06-02T23:44:18.116 INFO:teuthology.orchestra.run.smithi162.stdout:(125/159): python3-jaraco-8.2.1-3.el9.noarch.rp 141 kB/s | 11 kB 00:00 2024-06-02T23:44:18.142 INFO:teuthology.orchestra.run.smithi162.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-06-02T23:44:18.152 INFO:teuthology.orchestra.run.smithi096.stdout:(40/159): libgfortran-11.4.1-3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2024-06-02T23:44:18.167 INFO:teuthology.orchestra.run.smithi162.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-06-02T23:44:18.177 INFO:teuthology.orchestra.run.smithi096.stdout:(41/159): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-06-02T23:44:18.192 INFO:teuthology.orchestra.run.smithi162.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-06-02T23:44:18.217 INFO:teuthology.orchestra.run.smithi162.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-06-02T23:44:18.227 INFO:teuthology.orchestra.run.smithi096.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-06-02T23:44:18.251 INFO:teuthology.orchestra.run.smithi162.stdout:(130/159): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-06-02T23:44:18.269 INFO:teuthology.orchestra.run.smithi096.stdout:(43/159): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-06-02T23:44:18.276 INFO:teuthology.orchestra.run.smithi162.stdout:(131/159): python3-logutils-0.3.5-21.el9.noarch 553 kB/s | 46 kB 00:00 2024-06-02T23:44:18.295 INFO:teuthology.orchestra.run.smithi096.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-06-02T23:44:18.302 INFO:teuthology.orchestra.run.smithi162.stdout:(132/159): python3-more-itertools-8.12.0-2.el9. 940 kB/s | 79 kB 00:00 2024-06-02T23:44:18.320 INFO:teuthology.orchestra.run.smithi096.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-06-02T23:44:18.327 INFO:teuthology.orchestra.run.smithi162.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-06-02T23:44:18.345 INFO:teuthology.orchestra.run.smithi096.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-06-02T23:44:18.352 INFO:teuthology.orchestra.run.smithi162.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-06-02T23:44:18.371 INFO:teuthology.orchestra.run.smithi096.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-06-02T23:44:18.377 INFO:teuthology.orchestra.run.smithi162.stdout:(135/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-06-02T23:44:18.403 INFO:teuthology.orchestra.run.smithi162.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-06-02T23:44:18.412 INFO:teuthology.orchestra.run.smithi096.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 10 MB/s | 689 kB 00:00 2024-06-02T23:44:18.428 INFO:teuthology.orchestra.run.smithi162.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-06-02T23:44:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-06-02T23:44:18.453 INFO:teuthology.orchestra.run.smithi162.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-06-02T23:44:18.471 INFO:teuthology.orchestra.run.smithi096.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-06-02T23:44:18.478 INFO:teuthology.orchestra.run.smithi162.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-06-02T23:44:18.496 INFO:teuthology.orchestra.run.smithi096.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-06-02T23:44:18.504 INFO:teuthology.orchestra.run.smithi162.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-06-02T23:44:18.522 INFO:teuthology.orchestra.run.smithi096.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-06-02T23:44:18.529 INFO:teuthology.orchestra.run.smithi162.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-06-02T23:44:18.547 INFO:teuthology.orchestra.run.smithi096.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-06-02T23:44:18.554 INFO:teuthology.orchestra.run.smithi162.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-06-02T23:44:18.579 INFO:teuthology.orchestra.run.smithi162.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-06-02T23:44:18.589 INFO:teuthology.orchestra.run.smithi096.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-06-02T23:44:18.613 INFO:teuthology.orchestra.run.smithi162.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-06-02T23:44:18.638 INFO:teuthology.orchestra.run.smithi162.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-06-02T23:44:18.640 INFO:teuthology.orchestra.run.smithi096.stdout:(55/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-06-02T23:44:18.664 INFO:teuthology.orchestra.run.smithi162.stdout:(146/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-06-02T23:44:18.681 INFO:teuthology.orchestra.run.smithi096.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-06-02T23:44:18.689 INFO:teuthology.orchestra.run.smithi162.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-06-02T23:44:18.731 INFO:teuthology.orchestra.run.smithi096.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-06-02T23:44:18.757 INFO:teuthology.orchestra.run.smithi096.stdout:(58/159): libaio-devel-0.3.111-13.el9.x86_64.rp 66 kB/s | 11 kB 00:00 2024-06-02T23:44:18.764 INFO:teuthology.orchestra.run.smithi162.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-06-02T23:44:18.791 INFO:teuthology.orchestra.run.smithi096.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-06-02T23:44:18.824 INFO:teuthology.orchestra.run.smithi096.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-06-02T23:44:18.850 INFO:teuthology.orchestra.run.smithi096.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-06-02T23:44:18.875 INFO:teuthology.orchestra.run.smithi096.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-06-02T23:44:18.900 INFO:teuthology.orchestra.run.smithi096.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-02T23:44:18.934 INFO:teuthology.orchestra.run.smithi096.stdout:(64/159): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 35 kB 00:00 2024-06-02T23:44:18.981 INFO:teuthology.orchestra.run.smithi162.stdout:(149/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 11 MB/s | 3.1 MB 00:00 2024-06-02T23:44:19.068 INFO:teuthology.orchestra.run.smithi096.stdout:(65/159): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-06-02T23:44:19.168 INFO:teuthology.orchestra.run.smithi096.stdout:(66/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-06-02T23:44:19.193 INFO:teuthology.orchestra.run.smithi096.stdout:(67/159): lua-5.4.4-4.el9.x86_64.rpm 593 kB/s | 188 kB 00:00 2024-06-02T23:44:19.198 INFO:teuthology.orchestra.run.smithi162.stdout:(150/159): librados2-19.0.0-2946.g3d89accf.el9. 6.3 MB/s | 3.4 MB 00:00 2024-06-02T23:44:19.235 INFO:teuthology.orchestra.run.smithi096.stdout:(68/159): postgresql-13.14-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-06-02T23:44:19.294 INFO:teuthology.orchestra.run.smithi096.stdout:(69/159): ceph-mgr-dashboard-19.0.0-2946.g3d89a 1.3 MB/s | 3.5 MB 00:02 2024-06-02T23:44:19.319 INFO:teuthology.orchestra.run.smithi096.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-06-02T23:44:19.353 INFO:teuthology.orchestra.run.smithi096.stdout:(71/159): postgresql-contrib-13.14-1.el9.x86_64 5.6 MB/s | 911 kB 00:00 2024-06-02T23:44:19.386 INFO:teuthology.orchestra.run.smithi096.stdout:(72/159): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-06-02T23:44:19.403 INFO:teuthology.orchestra.run.smithi096.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-06-02T23:44:19.437 INFO:teuthology.orchestra.run.smithi096.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-06-02T23:44:19.465 INFO:teuthology.orchestra.run.smithi162.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 155 kB/s | 41 kB 00:00 2024-06-02T23:44:19.529 INFO:teuthology.orchestra.run.smithi096.stdout:(75/159): python3-babel-2.9.1-2.el9.noarch.rpm 42 MB/s | 6.0 MB 00:00 2024-06-02T23:44:19.556 INFO:teuthology.orchestra.run.smithi096.stdout:(76/159): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-06-02T23:44:19.579 INFO:teuthology.orchestra.run.smithi096.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-06-02T23:44:19.596 INFO:teuthology.orchestra.run.smithi096.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-06-02T23:44:19.607 INFO:teuthology.orchestra.run.smithi162.stdout:(152/159): NetworkManager-1.47.91-1.el9.x86_64. 2.7 MB/s | 2.3 MB 00:00 2024-06-02T23:44:19.613 INFO:teuthology.orchestra.run.smithi096.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 571 kB/s | 19 kB 00:00 2024-06-02T23:44:19.639 INFO:teuthology.orchestra.run.smithi096.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-06-02T23:44:19.656 INFO:teuthology.orchestra.run.smithi096.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 830 kB/s | 35 kB 00:00 2024-06-02T23:44:19.749 INFO:teuthology.orchestra.run.smithi096.stdout:(82/159): postgresql-server-13.14-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-06-02T23:44:19.774 INFO:teuthology.orchestra.run.smithi096.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-06-02T23:44:19.798 INFO:teuthology.orchestra.run.smithi096.stdout:(84/159): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-06-02T23:44:19.823 INFO:teuthology.orchestra.run.smithi096.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-06-02T23:44:19.849 INFO:teuthology.orchestra.run.smithi096.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-06-02T23:44:19.874 INFO:teuthology.orchestra.run.smithi096.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-06-02T23:44:19.874 INFO:teuthology.orchestra.run.smithi162.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 138 kB/s | 37 kB 00:00 2024-06-02T23:44:19.899 INFO:teuthology.orchestra.run.smithi096.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-02T23:44:19.924 INFO:teuthology.orchestra.run.smithi096.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-06-02T23:44:19.991 INFO:teuthology.orchestra.run.smithi096.stdout:(90/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-06-02T23:44:20.017 INFO:teuthology.orchestra.run.smithi096.stdout:(91/159): python3-pytz-2021.1-5.el9.noarch.rpm 435 kB/s | 51 kB 00:00 2024-06-02T23:44:20.042 INFO:teuthology.orchestra.run.smithi096.stdout:(92/159): python3-requests-oauthlib-1.3.0-12.el 458 kB/s | 54 kB 00:00 2024-06-02T23:44:20.084 INFO:teuthology.orchestra.run.smithi096.stdout:(93/159): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-06-02T23:44:20.109 INFO:teuthology.orchestra.run.smithi096.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 663 kB/s | 44 kB 00:00 2024-06-02T23:44:20.132 INFO:teuthology.orchestra.run.smithi162.stdout:(154/159): NetworkManager-tui-1.47.91-1.el9.x86 372 kB/s | 248 kB 00:00 2024-06-02T23:44:20.151 INFO:teuthology.orchestra.run.smithi096.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 867 kB/s | 36 kB 00:00 2024-06-02T23:44:20.176 INFO:teuthology.orchestra.run.smithi096.stdout:(96/159): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-06-02T23:44:20.201 INFO:teuthology.orchestra.run.smithi096.stdout:(97/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-06-02T23:44:20.227 INFO:teuthology.orchestra.run.smithi096.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-06-02T23:44:20.252 INFO:teuthology.orchestra.run.smithi096.stdout:(99/159): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-06-02T23:44:20.277 INFO:teuthology.orchestra.run.smithi096.stdout:(100/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-06-02T23:44:20.303 INFO:teuthology.orchestra.run.smithi096.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-06-02T23:44:20.328 INFO:teuthology.orchestra.run.smithi096.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-06-02T23:44:20.353 INFO:teuthology.orchestra.run.smithi096.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-06-02T23:44:20.374 INFO:teuthology.orchestra.run.smithi162.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 413 kB/s | 207 kB 00:00 2024-06-02T23:44:20.387 INFO:teuthology.orchestra.run.smithi096.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 14 MB/s | 863 kB 00:00 2024-06-02T23:44:20.629 INFO:teuthology.orchestra.run.smithi096.stdout:(105/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-06-02T23:44:20.633 INFO:teuthology.orchestra.run.smithi162.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 519 kB/s | 260 kB 00:00 2024-06-02T23:44:20.738 INFO:teuthology.orchestra.run.smithi096.stdout:(106/159): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-06-02T23:44:20.763 INFO:teuthology.orchestra.run.smithi096.stdout:(107/159): grpc-data-1.46.7-10.el9.noarch.rpm 146 kB/s | 19 kB 00:00 2024-06-02T23:44:20.788 INFO:teuthology.orchestra.run.smithi096.stdout:(108/159): gperftools-libs-2.9.1-2.el9.x86_64.r 771 kB/s | 309 kB 00:00 2024-06-02T23:44:20.813 INFO:teuthology.orchestra.run.smithi096.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-06-02T23:44:20.838 INFO:teuthology.orchestra.run.smithi096.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2024-06-02T23:44:20.905 INFO:teuthology.orchestra.run.smithi096.stdout:(111/159): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-06-02T23:44:20.931 INFO:teuthology.orchestra.run.smithi096.stdout:(112/159): libunwind-1.6.2-1.el9.x86_64.rpm 574 kB/s | 67 kB 00:00 2024-06-02T23:44:20.998 INFO:teuthology.orchestra.run.smithi096.stdout:(113/159): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-06-02T23:44:21.056 INFO:teuthology.orchestra.run.smithi096.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 839 kB 00:00 2024-06-02T23:44:21.082 INFO:teuthology.orchestra.run.smithi096.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 521 kB/s | 43 kB 00:00 2024-06-02T23:44:21.115 INFO:teuthology.orchestra.run.smithi096.stdout:(116/159): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-06-02T23:44:21.141 INFO:teuthology.orchestra.run.smithi096.stdout:(117/159): python3-cachetools-4.2.4-1.el9.noarc 384 kB/s | 32 kB 00:00 2024-06-02T23:44:21.166 INFO:teuthology.orchestra.run.smithi096.stdout:(118/159): python3-certifi-2021.10.8-2.el9.noar 178 kB/s | 15 kB 00:00 2024-06-02T23:44:21.191 INFO:teuthology.orchestra.run.smithi096.stdout:(119/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-06-02T23:44:21.216 INFO:teuthology.orchestra.run.smithi096.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-06-02T23:44:21.250 INFO:teuthology.orchestra.run.smithi096.stdout:(121/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-06-02T23:44:21.275 INFO:teuthology.orchestra.run.smithi096.stdout:(122/159): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-06-02T23:44:21.326 INFO:teuthology.orchestra.run.smithi096.stdout:(123/159): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-06-02T23:44:21.350 INFO:teuthology.orchestra.run.smithi096.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-06-02T23:44:21.376 INFO:teuthology.orchestra.run.smithi096.stdout:(125/159): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-06-02T23:44:21.401 INFO:teuthology.orchestra.run.smithi096.stdout:(126/159): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-06-02T23:44:21.426 INFO:teuthology.orchestra.run.smithi096.stdout:(127/159): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-06-02T23:44:21.452 INFO:teuthology.orchestra.run.smithi096.stdout:(128/159): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-06-02T23:44:21.477 INFO:teuthology.orchestra.run.smithi096.stdout:(129/159): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2024-06-02T23:44:21.483 INFO:teuthology.orchestra.run.smithi162.stdout:(157/159): NetworkManager-libnm-1.47.91-1.el9.x 738 kB/s | 1.8 MB 00:02 2024-06-02T23:44:21.511 INFO:teuthology.orchestra.run.smithi096.stdout:(130/159): python3-logutils-0.3.5-21.el9.noarch 790 kB/s | 46 kB 00:00 2024-06-02T23:44:21.544 INFO:teuthology.orchestra.run.smithi096.stdout:(131/159): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-06-02T23:44:21.570 INFO:teuthology.orchestra.run.smithi096.stdout:(132/159): python3-more-itertools-8.12.0-2.el9. 853 kB/s | 79 kB 00:00 2024-06-02T23:44:21.595 INFO:teuthology.orchestra.run.smithi096.stdout:(133/159): python3-natsort-7.1.1-5.el9.noarch.r 687 kB/s | 58 kB 00:00 2024-06-02T23:44:21.620 INFO:teuthology.orchestra.run.smithi096.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-06-02T23:44:21.646 INFO:teuthology.orchestra.run.smithi096.stdout:(135/159): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-06-02T23:44:21.671 INFO:teuthology.orchestra.run.smithi096.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-06-02T23:44:21.696 INFO:teuthology.orchestra.run.smithi096.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-06-02T23:44:21.721 INFO:teuthology.orchestra.run.smithi096.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-06-02T23:44:21.747 INFO:teuthology.orchestra.run.smithi096.stdout:(139/159): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-06-02T23:44:21.772 INFO:teuthology.orchestra.run.smithi096.stdout:(140/159): python3-rsa-4.9-2.el9.noarch.rpm 784 kB/s | 59 kB 00:00 2024-06-02T23:44:21.797 INFO:teuthology.orchestra.run.smithi096.stdout:(141/159): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-06-02T23:44:21.822 INFO:teuthology.orchestra.run.smithi096.stdout:(142/159): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-06-02T23:44:21.848 INFO:teuthology.orchestra.run.smithi096.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-06-02T23:44:21.873 INFO:teuthology.orchestra.run.smithi096.stdout:(144/159): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-06-02T23:44:21.898 INFO:teuthology.orchestra.run.smithi096.stdout:(145/159): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-06-02T23:44:21.924 INFO:teuthology.orchestra.run.smithi096.stdout:(146/159): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-06-02T23:44:21.949 INFO:teuthology.orchestra.run.smithi096.stdout:(147/159): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-06-02T23:44:22.032 INFO:teuthology.orchestra.run.smithi096.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-06-02T23:44:22.199 INFO:teuthology.orchestra.run.smithi096.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 14 MB/s | 2.3 MB 00:00 2024-06-02T23:44:22.266 INFO:teuthology.orchestra.run.smithi096.stdout:(150/159): librbd1-19.0.0-2946.g3d89accf.el9.x8 9.9 MB/s | 3.1 MB 00:00 2024-06-02T23:44:22.308 INFO:teuthology.orchestra.run.smithi096.stdout:(151/159): NetworkManager-libnm-1.47.91-1.el9.x 17 MB/s | 1.8 MB 00:00 2024-06-02T23:44:22.333 INFO:teuthology.orchestra.run.smithi096.stdout:(152/159): NetworkManager-team-1.47.91-1.el9.x8 619 kB/s | 41 kB 00:00 2024-06-02T23:44:22.358 INFO:teuthology.orchestra.run.smithi162.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 697 kB/s | 1.3 MB 00:01 2024-06-02T23:44:22.367 INFO:teuthology.orchestra.run.smithi096.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 1.1 MB/s | 37 kB 00:00 2024-06-02T23:44:22.392 INFO:teuthology.orchestra.run.smithi096.stdout:(154/159): NetworkManager-tui-1.47.91-1.el9.x86 2.9 MB/s | 248 kB 00:00 2024-06-02T23:44:22.434 INFO:teuthology.orchestra.run.smithi096.stdout:(155/159): elfutils-libelf-0.191-4.el9.x86_64.r 3.0 MB/s | 207 kB 00:00 2024-06-02T23:44:22.459 INFO:teuthology.orchestra.run.smithi096.stdout:(156/159): elfutils-libs-0.191-4.el9.x86_64.rpm 3.8 MB/s | 260 kB 00:00 2024-06-02T23:44:22.535 INFO:teuthology.orchestra.run.smithi096.stdout:(157/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-06-02T23:44:22.702 INFO:teuthology.orchestra.run.smithi096.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 5.1 MB/s | 1.3 MB 00:00 2024-06-02T23:44:23.108 INFO:teuthology.orchestra.run.smithi162.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 990 kB/s | 2.4 MB 00:02 2024-06-02T23:44:23.112 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:44:23.112 INFO:teuthology.orchestra.run.smithi162.stdout:Total 14 MB/s | 225 MB 00:16 2024-06-02T23:44:23.327 INFO:teuthology.orchestra.run.smithi096.stdout:(159/159): librados2-19.0.0-2946.g3d89accf.el9. 2.4 MB/s | 3.4 MB 00:01 2024-06-02T23:44:23.329 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-06-02T23:44:23.330 INFO:teuthology.orchestra.run.smithi096.stdout:Total 17 MB/s | 225 MB 00:12 2024-06-02T23:44:24.337 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-06-02T23:44:24.494 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-06-02T23:44:24.494 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-06-02T23:44:24.558 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-06-02T23:44:24.716 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-06-02T23:44:24.716 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-06-02T23:44:26.628 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-06-02T23:44:26.629 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-06-02T23:44:26.856 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-06-02T23:44:26.857 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-06-02T23:44:33.018 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-06-02T23:44:33.129 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T23:44:33.158 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-06-02T23:44:33.167 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T23:44:33.225 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T23:44:33.248 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-02T23:44:33.261 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T23:44:33.287 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T23:44:33.302 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-02T23:44:33.335 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T23:44:33.360 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-02T23:44:33.397 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-02T23:44:33.423 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-02T23:44:33.468 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-02T23:44:33.667 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T23:44:33.789 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:44:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-02T23:44:33.899 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:44:33.909 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:44:33.931 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:44:34.007 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:44:34.020 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:44:34.035 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T23:44:34.050 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:44:34.081 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T23:44:34.151 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:44:34.180 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T23:44:34.222 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-02T23:44:34.274 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T23:44:34.334 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T23:44:34.361 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:44:34.428 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-02T23:44:34.449 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:44:34.479 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T23:44:34.486 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-02T23:44:34.513 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:44:34.550 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T23:44:34.572 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T23:44:34.598 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T23:44:34.617 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:44:34.640 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T23:44:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/170 2024-06-02T23:44:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T23:44:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-02T23:44:34.782 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T23:44:34.918 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T23:44:34.958 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T23:44:35.093 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-02T23:44:35.094 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T23:44:35.137 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T23:44:35.247 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:44:35.263 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T23:44:35.314 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:44:35.323 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-02T23:44:35.431 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:44:35.508 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:44:35.527 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:44:35.643 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T23:44:35.716 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-02T23:44:35.741 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T23:44:35.788 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-02T23:44:35.829 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-02T23:44:35.841 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-02T23:44:35.903 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-02T23:44:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-02T23:44:35.943 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-02T23:44:35.979 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-02T23:44:35.992 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/170 2024-06-02T23:44:36.031 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/170 2024-06-02T23:44:36.074 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-02T23:44:36.105 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/170 2024-06-02T23:44:36.224 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-02T23:44:36.234 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/170 2024-06-02T23:44:36.389 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-02T23:44:36.415 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-02T23:44:36.445 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-02T23:44:36.476 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-02T23:44:36.511 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-02T23:44:36.565 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-02T23:44:36.592 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-02T23:44:36.596 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-02T23:44:36.630 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-02T23:44:36.660 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-02T23:44:36.674 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-02T23:44:36.702 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-02T23:44:36.714 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-02T23:44:36.745 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-02T23:44:36.771 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-02T23:44:36.788 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-02T23:44:36.817 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-02T23:44:36.865 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-02T23:44:36.892 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-02T23:44:36.899 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 34/170 2024-06-02T23:44:36.943 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 35/170 2024-06-02T23:44:36.971 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 36/170 2024-06-02T23:44:37.032 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-02T23:44:37.041 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-02T23:44:37.086 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-02T23:44:37.087 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-02T23:44:37.160 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-02T23:44:37.302 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-02T23:44:37.355 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-02T23:44:37.615 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-02T23:44:37.707 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-02T23:44:37.743 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-02T23:44:37.791 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-02T23:44:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-02T23:44:37.867 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-02T23:44:37.873 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-02T23:44:37.908 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-02T23:44:37.958 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-02T23:44:37.996 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-02T23:44:38.025 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-02T23:44:38.070 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-02T23:44:38.082 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-02T23:44:38.119 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-02T23:44:38.120 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 47/170 2024-06-02T23:44:38.161 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-02T23:44:38.174 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-02T23:44:38.248 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T23:44:38.287 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T23:44:38.316 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-02T23:44:38.323 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T23:44:38.364 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-02T23:44:38.370 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T23:44:38.406 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T23:44:38.418 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-02T23:44:38.449 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T23:44:38.491 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T23:44:38.499 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/170 2024-06-02T23:44:38.531 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 53/170 2024-06-02T23:44:38.568 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 54/170 2024-06-02T23:44:38.616 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/170 2024-06-02T23:44:38.627 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T23:44:38.652 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/170 2024-06-02T23:44:38.787 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/170 2024-06-02T23:44:38.836 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T23:44:38.886 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T23:44:38.983 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T23:44:39.026 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T23:44:39.048 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/170 2024-06-02T23:44:39.067 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T23:44:39.100 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T23:44:39.124 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T23:44:39.193 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/170 2024-06-02T23:44:39.212 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T23:44:39.231 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/170 2024-06-02T23:44:39.272 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 61/170 2024-06-02T23:44:39.343 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T23:44:39.367 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/170 2024-06-02T23:44:39.373 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T23:44:39.401 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T23:44:39.406 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 63/170 2024-06-02T23:44:39.443 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T23:44:39.447 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/170 2024-06-02T23:44:39.479 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/170 2024-06-02T23:44:39.482 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T23:44:39.504 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/170 2024-06-02T23:44:39.514 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T23:44:39.545 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T23:44:39.578 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T23:44:39.591 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/170 2024-06-02T23:44:39.612 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T23:44:39.645 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T23:44:39.680 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T23:44:39.713 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/170 2024-06-02T23:44:39.745 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/170 2024-06-02T23:44:39.766 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T23:44:39.773 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/170 2024-06-02T23:44:39.807 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/170 2024-06-02T23:44:39.810 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T23:44:39.841 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T23:44:39.846 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/170 2024-06-02T23:44:39.878 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/170 2024-06-02T23:44:39.888 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T23:44:39.916 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/170 2024-06-02T23:44:39.950 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/170 2024-06-02T23:44:39.984 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/170 2024-06-02T23:44:39.987 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T23:44:40.025 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/170 2024-06-02T23:44:40.042 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T23:44:40.060 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/170 2024-06-02T23:44:40.146 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/170 2024-06-02T23:44:40.190 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/170 2024-06-02T23:44:40.230 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/170 2024-06-02T23:44:40.277 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/170 2024-06-02T23:44:40.374 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-packaging-20.9-5.el9.noarch 83/170 2024-06-02T23:44:40.422 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-02T23:44:40.764 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T23:44:40.806 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T23:44:40.840 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T23:44:40.939 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T23:44:40.995 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T23:44:41.040 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T23:44:41.127 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T23:44:41.135 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-02T23:44:41.168 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T23:44:41.195 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-02T23:44:41.228 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-02T23:44:41.326 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-02T23:44:41.345 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T23:44:41.376 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T23:44:41.379 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-02T23:44:41.428 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-02T23:44:41.455 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T23:44:41.508 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-02T23:44:41.556 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-02T23:44:41.734 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-02T23:44:41.787 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-02T23:44:41.880 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-02T23:44:42.107 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T23:44:42.216 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T23:44:42.526 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-02T23:44:42.651 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-02T23:44:43.498 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T23:44:43.563 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T23:44:43.582 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T23:44:43.607 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T23:44:43.904 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-02T23:44:43.918 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T23:44:43.962 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T23:44:43.991 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-02T23:44:44.035 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-02T23:44:44.068 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-02T23:44:44.070 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T23:44:44.100 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-02T23:44:44.137 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T23:44:44.386 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-02T23:44:44.465 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T23:44:44.555 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 103/170 2024-06-02T23:44:44.595 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 104/170 2024-06-02T23:44:44.610 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T23:44:44.631 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-02T23:44:44.640 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T23:44:44.711 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T23:44:44.733 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-02T23:44:45.100 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-02T23:44:45.134 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T23:44:45.205 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 107/170 2024-06-02T23:44:45.227 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 108/170 2024-06-02T23:44:47.032 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:44:47.063 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:44:47.465 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:44:47.507 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:44:47.610 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:44:47.642 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T23:44:47.732 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T23:44:47.733 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T23:44:47.733 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T23:44:47.733 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:44:47.768 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T23:44:48.057 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 109/170 2024-06-02T23:44:48.093 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T23:44:48.177 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 110/170 2024-06-02T23:44:48.177 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-02T23:44:48.177 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-02T23:44:48.178 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:44:48.212 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T23:44:59.608 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T23:44:59.608 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-06-02T23:44:59.608 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-06-02T23:44:59.608 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-06-02T23:44:59.608 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-06-02T23:44:59.608 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-06-02T23:44:59.608 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-06-02T23:44:59.609 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-06-02T23:44:59.609 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:44:59.647 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 111/170 2024-06-02T23:44:59.647 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /sys 2024-06-02T23:44:59.647 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /proc 2024-06-02T23:44:59.647 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /mnt 2024-06-02T23:44:59.647 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /var/tmp 2024-06-02T23:44:59.647 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /home 2024-06-02T23:44:59.647 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /root 2024-06-02T23:44:59.647 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /tmp 2024-06-02T23:44:59.648 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:44:59.782 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T23:44:59.799 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T23:44:59.799 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:44:59.799 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T23:44:59.800 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:44:59.824 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T23:44:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 112/170 2024-06-02T23:44:59.840 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:44:59.840 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-02T23:44:59.840 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:01.269 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T23:45:01.295 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T23:45:01.296 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:01.296 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T23:45:01.296 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:45:01.296 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:45:01.296 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:01.319 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T23:45:01.345 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 113/170 2024-06-02T23:45:01.345 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:01.345 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-02T23:45:01.345 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:45:01.345 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-02T23:45:01.345 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:01.528 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T23:45:01.551 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T23:45:01.551 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:01.551 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T23:45:01.551 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:45:01.551 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:45:01.552 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:01.570 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T23:45:01.593 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 114/170 2024-06-02T23:45:01.593 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:01.593 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-02T23:45:01.593 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:45:01.593 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-02T23:45:01.594 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:01.995 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T23:45:02.019 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T23:45:02.019 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:02.019 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T23:45:02.019 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:45:02.019 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:45:02.019 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:02.037 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T23:45:02.060 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 115/170 2024-06-02T23:45:02.060 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:02.060 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-02T23:45:02.060 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:45:02.060 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-02T23:45:02.060 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:02.125 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T23:45:02.167 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-02T23:45:02.173 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T23:45:02.224 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-02T23:45:02.230 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T23:45:02.280 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-02T23:45:02.413 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T23:45:02.462 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T23:45:02.464 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-02T23:45:02.521 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-02T23:45:02.541 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T23:45:02.599 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-02T23:45:02.670 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T23:45:02.712 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-02T23:45:02.800 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T23:45:02.851 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-02T23:45:02.854 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T23:45:02.887 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T23:45:02.896 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-02T23:45:02.914 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T23:45:02.927 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-02T23:45:02.955 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-02T23:45:03.300 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T23:45:03.321 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T23:45:03.361 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-02T23:45:03.393 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T23:45:03.420 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 127/170 2024-06-02T23:45:03.424 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-02T23:45:03.452 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 128/170 2024-06-02T23:45:03.453 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T23:45:03.506 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 129/170 2024-06-02T23:45:03.577 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T23:45:04.491 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T23:45:04.521 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T23:45:04.605 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 130/170 2024-06-02T23:45:04.645 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T23:45:05.490 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T23:45:05.513 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T23:45:05.607 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 131/170 2024-06-02T23:45:05.616 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T23:45:05.637 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T23:45:05.739 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 132/170 2024-06-02T23:45:05.778 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-02T23:45:05.809 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T23:45:05.832 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T23:45:05.833 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:05.833 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T23:45:05.833 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:45:05.833 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:45:05.833 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:05.890 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T23:45:05.899 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 133/170 2024-06-02T23:45:05.901 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T23:45:05.922 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T23:45:05.946 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 134/170 2024-06-02T23:45:05.946 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:05.946 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-02T23:45:05.946 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:45:05.946 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-02T23:45:05.947 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:05.990 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T23:45:05.999 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-02T23:45:06.001 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 135/170 2024-06-02T23:45:06.051 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-02T23:45:06.091 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 136/170 2024-06-02T23:45:06.158 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 137/170 2024-06-02T23:45:06.954 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T23:45:06.984 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T23:45:07.009 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T23:45:07.009 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:07.009 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T23:45:07.009 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:45:07.009 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:45:07.009 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:07.052 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T23:45:07.061 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-02T23:45:07.074 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T23:45:07.075 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:07.075 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T23:45:07.075 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:07.092 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T23:45:07.115 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 139/170 2024-06-02T23:45:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-02T23:45:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:45:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-02T23:45:07.115 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:07.119 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T23:45:07.142 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T23:45:07.142 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:07.142 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T23:45:07.142 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T23:45:07.142 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T23:45:07.142 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:07.172 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T23:45:07.195 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 140/170 2024-06-02T23:45:07.195 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:07.195 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-02T23:45:07.195 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:07.240 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T23:45:07.263 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 141/170 2024-06-02T23:45:07.263 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:07.263 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-02T23:45:07.263 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T23:45:07.263 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-02T23:45:07.263 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:07.453 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T23:45:07.476 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T23:45:07.476 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:07.476 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T23:45:07.476 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:45:07.477 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:45:07.477 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:07.565 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T23:45:07.588 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/170 2024-06-02T23:45:07.589 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-02T23:45:07.589 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-02T23:45:07.589 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:45:07.589 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-02T23:45:07.589 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:11.998 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-02T23:45:12.040 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-02T23:45:12.080 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-02T23:45:12.110 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 143/170 2024-06-02T23:45:12.112 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T23:45:12.140 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T23:45:12.152 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 144/170 2024-06-02T23:45:12.192 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 145/170 2024-06-02T23:45:12.225 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-02T23:45:12.252 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-02T23:45:12.327 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-02T23:45:12.378 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T23:45:12.419 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-02T23:45:12.436 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 148/170 2024-06-02T23:45:12.451 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T23:45:12.481 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T23:45:12.482 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-02T23:45:12.515 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 150/170 2024-06-02T23:45:12.518 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T23:45:12.555 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-02T23:45:12.585 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-02T23:45:12.631 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T23:45:13.135 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:45:13.175 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:45:13.195 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:45:13.265 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:45:13.304 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:45:13.324 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-02T23:45:14.042 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-02T23:45:14.123 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T23:45:14.154 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 155/170 2024-06-02T23:45:14.166 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T23:45:14.243 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-02T23:45:14.247 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T23:45:14.277 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T23:45:14.284 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-02T23:45:14.301 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T23:45:14.327 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T23:45:14.353 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T23:45:14.353 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T23:45:14.369 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-02T23:45:14.396 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-02T23:45:14.422 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T23:45:14.438 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T23:45:14.455 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-02T23:45:14.470 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T23:45:14.471 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T23:45:14.481 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-02T23:45:14.481 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T23:45:14.574 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T23:45:14.574 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-02T23:45:14.597 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T23:45:14.603 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:45:14.603 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:45:14.607 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-02T23:45:14.607 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T23:45:14.692 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-02T23:45:14.717 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-02T23:45:14.723 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:45:14.723 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:45:14.782 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:45:14.783 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T23:45:14.850 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T23:45:14.875 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T23:45:14.919 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-02T23:45:14.920 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T23:45:14.940 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T23:45:15.003 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-02T23:45:15.028 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-02T23:45:15.094 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T23:45:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T23:45:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-02T23:45:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-02T23:45:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-02T23:45:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-02T23:45:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-02T23:45:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-02T23:45:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-02T23:45:20.582 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-02T23:45:20.583 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-02T23:45:20.584 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T23:45:20.585 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T23:45:20.586 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T23:45:20.587 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T23:45:20.588 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T23:45:20.589 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T23:45:20.590 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T23:45:20.591 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T23:45:20.592 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T23:45:20.593 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T23:45:20.594 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T23:45:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T23:45:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T23:45:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T23:45:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T23:45:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T23:45:20.595 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T23:45:20.811 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/170 2024-06-02T23:45:20.812 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/170 2024-06-02T23:45:20.813 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/170 2024-06-02T23:45:20.814 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-02T23:45:20.815 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-02T23:45:20.816 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-02T23:45:20.817 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-02T23:45:20.818 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-02T23:45:20.819 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-02T23:45:20.820 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-02T23:45:20.821 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-02T23:45:20.822 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-02T23:45:20.823 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-02T23:45:20.824 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-02T23:45:23.311 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T23:45:23.311 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:23.311 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-06-02T23:45:23.311 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T23:45:23.311 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T23:45:23.311 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T23:45:23.312 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T23:45:23.312 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T23:45:23.312 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T23:45:23.312 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.313 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.314 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T23:45:23.315 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T23:45:23.316 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T23:45:23.317 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T23:45:23.318 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T23:45:23.319 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T23:45:23.320 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T23:45:23.321 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T23:45:23.322 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.324 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.324 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T23:45:23.324 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T23:45:23.324 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T23:45:23.324 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T23:45:23.324 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T23:45:23.324 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T23:45:23.324 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T23:45:23.324 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:23.324 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-06-02T23:45:23.639 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-02T23:45:23.639 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:23.639 INFO:teuthology.orchestra.run.smithi096.stdout:Upgraded: 2024-06-02T23:45:23.639 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-02T23:45:23.639 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-02T23:45:23.639 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-02T23:45:23.639 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: automake-1.16.2-8.el9.noarch 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: bison-3.7.4-5.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-02T23:45:23.640 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.641 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-02T23:45:23.642 INFO:teuthology.orchestra.run.smithi096.stdout: flex-2.6.4-9.el9.x86_64 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.643 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-02T23:45:23.644 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: lua-5.4.4-4.el9.x86_64 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-13.14-1.el9.x86_64 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-02T23:45:23.645 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-02T23:45:23.646 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-02T23:45:23.647 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-02T23:45:23.648 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply-3.11-14.el9.noarch 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.649 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-02T23:45:23.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: re2-1:20211101-3.el9.x86_64 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-02T23:45:23.651 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-02T23:45:23.652 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-02T23:45:23.652 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-02T23:45:23.652 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:23.652 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-06-02T23:45:23.738 DEBUG:teuthology.parallel:result is None 2024-06-02T23:45:24.076 DEBUG:teuthology.parallel:result is None 2024-06-02T23:45:24.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:45:24.297 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T23:45:24.320 INFO:teuthology.orchestra.run.smithi096.stdout:19.0.0-2946.g3d89accf.el9 2024-06-02T23:45:24.321 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-02T23:45:24.321 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-02T23:45:24.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-02T23:45:24.543 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T23:45:24.567 INFO:teuthology.orchestra.run.smithi162.stdout:19.0.0-2946.g3d89accf.el9 2024-06-02T23:45:24.567 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-02T23:45:24.567 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-02T23:45:24.569 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-02T23:45:24.569 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:24.569 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T23:45:24.598 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:24.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T23:45:24.637 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-02T23:45:24.638 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:24.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T23:45:24.664 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T23:45:24.730 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:24.730 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T23:45:24.756 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T23:45:24.822 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-02T23:45:24.822 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:24.822 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T23:45:24.847 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T23:45:24.911 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:24.911 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T23:45:24.936 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T23:45:25.002 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-02T23:45:25.002 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:25.002 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T23:45:25.026 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T23:45:25.091 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:25.091 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T23:45:25.116 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T23:45:25.180 INFO:teuthology.run_tasks:Running task ceph... 2024-06-02T23:45:25.257 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-06-02T23:45:25.257 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-06-02T23:45:25.259 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-06-02T23:45:25.284 INFO:tasks.ceph:Disabling ceph logrotate... 2024-06-02T23:45:25.284 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-02T23:45:25.324 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-06-02T23:45:25.349 INFO:tasks.ceph:Creating extra log directories... 2024-06-02T23:45:25.349 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-02T23:45:25.388 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-06-02T23:45:25.419 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-06-02T23:45:25.419 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-06-02T23:45:25.419 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-06-02T23:45:25.419 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:25.419 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-06-02T23:45:25.466 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-06-02T23:45:25.575 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-06-02T23:45:25.600 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:25.600 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-06-02T23:45:25.615 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-06-02T23:45:25.725 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-06-02T23:45:25.754 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-06-02T23:45:25.755 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-06-02T23:45:25.755 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/snap-schedule}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7738687', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'dfcc4b3c2c55532c4c04fa47551c9df1dffdf746'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2064, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'sleep_before_teardown': 0, 'subset': '125/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'dfcc4b3c2c55532c4c04fa47551c9df1dffdf746', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBzXAXExlllZL3QBDT76maUBNp4S7jutATjA5KmN29fUOgbheK0nomxD7cJzFc4eEuq87/Fj/M172HIolnO0DIs=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMlQu/lo+6PKYxYzJhi2ScDyh7eQSlyPzuAGrWnCHFvLaqV8yhWYPfJAGa48OpFZTS+GnF5kSGSXlmfpCeteCI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '861a8dcf7aa816a26e13f039336f7ed0a9aec0fa', 'timestamp': '2024-06-02_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-06-02T23:45:25.755 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-02T23:45:25.758 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-06-02T23:45:25.804 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-06-02T23:45:25.813 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-06-02T23:45:25.869 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:25.869 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T23:45:25.893 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T23:45:25.894 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2024-06-02T23:45:25.949 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T23:45:25.949 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:45:25.949 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-06-02T23:45:25.949 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:45:25.949 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:45:25.949 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-06-02 23:45:15.454169664 +0000 2024-06-02T23:45:25.950 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-06-02 23:43:06.766228087 +0000 2024-06-02T23:45:25.950 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-06-02 23:43:06.766228087 +0000 2024-06-02T23:45:25.950 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-06-02 23:43:06.766228087 +0000 2024-06-02T23:45:25.950 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T23:45:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-06-02T23:45:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-06-02T23:45:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000239388 s, 2.1 MB/s 2024-06-02T23:45:26.014 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T23:45:26.071 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2024-06-02T23:45:26.127 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T23:45:26.127 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:45:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 693 Links: 1 2024-06-02T23:45:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:45:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:45:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-06-02 23:45:15.455169642 +0000 2024-06-02T23:45:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-06-02 23:43:07.111220144 +0000 2024-06-02T23:45:26.127 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-06-02 23:43:07.111220144 +0000 2024-06-02T23:45:26.127 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-06-02 23:43:07.111220144 +0000 2024-06-02T23:45:26.127 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T23:45:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-06-02T23:45:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-06-02T23:45:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000183003 s, 2.8 MB/s 2024-06-02T23:45:26.191 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T23:45:26.247 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2024-06-02T23:45:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T23:45:26.302 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:45:26.302 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 710 Links: 1 2024-06-02T23:45:26.302 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:45:26.302 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:45:26.302 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-06-02 23:45:15.455169642 +0000 2024-06-02T23:45:26.302 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-06-02 23:43:07.444212478 +0000 2024-06-02T23:45:26.302 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-06-02 23:43:07.444212478 +0000 2024-06-02T23:45:26.303 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-06-02 23:43:07.444212478 +0000 2024-06-02T23:45:26.303 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T23:45:26.365 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-06-02T23:45:26.365 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-06-02T23:45:26.365 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000163488 s, 3.1 MB/s 2024-06-02T23:45:26.366 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T23:45:26.421 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2024-06-02T23:45:26.476 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T23:45:26.477 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:45:26.477 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 728 Links: 1 2024-06-02T23:45:26.477 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:45:26.477 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:45:26.477 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-06-02 23:45:15.456169619 +0000 2024-06-02T23:45:26.477 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-06-02 23:43:07.769204996 +0000 2024-06-02T23:45:26.477 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-06-02 23:43:07.769204996 +0000 2024-06-02T23:45:26.477 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-06-02 23:43:07.769204996 +0000 2024-06-02T23:45:26.477 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T23:45:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-06-02T23:45:26.539 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-06-02T23:45:26.540 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000168707 s, 3.0 MB/s 2024-06-02T23:45:26.541 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T23:45:26.597 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T23:45:26.597 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:26.597 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T23:45:26.614 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T23:45:26.614 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-06-02T23:45:26.670 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T23:45:26.670 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:45:26.670 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-06-02T23:45:26.670 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:45:26.671 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:45:26.671 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-06-02 23:45:15.287557313 +0000 2024-06-02T23:45:26.671 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-06-02 23:43:06.778371800 +0000 2024-06-02T23:45:26.671 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-06-02 23:43:06.778371800 +0000 2024-06-02T23:45:26.671 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-06-02 23:43:06.778371800 +0000 2024-06-02T23:45:26.671 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T23:45:26.735 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-06-02T23:45:26.736 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-06-02T23:45:26.736 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000258077 s, 2.0 MB/s 2024-06-02T23:45:26.737 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T23:45:26.796 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-06-02T23:45:26.852 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T23:45:26.852 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:45:26.852 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-06-02T23:45:26.852 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:45:26.852 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:45:26.852 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-06-02 23:45:15.287557313 +0000 2024-06-02T23:45:26.852 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-06-02 23:43:07.120364504 +0000 2024-06-02T23:45:26.852 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-06-02 23:43:07.120364504 +0000 2024-06-02T23:45:26.852 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-06-02 23:43:07.120364504 +0000 2024-06-02T23:45:26.853 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T23:45:26.916 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-06-02T23:45:26.916 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-06-02T23:45:26.916 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000185499 s, 2.8 MB/s 2024-06-02T23:45:26.917 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T23:45:26.974 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-06-02T23:45:27.031 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T23:45:27.031 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:45:27.031 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 708 Links: 1 2024-06-02T23:45:27.031 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:45:27.031 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:45:27.031 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-06-02 23:45:15.288557292 +0000 2024-06-02T23:45:27.031 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-06-02 23:43:07.457357315 +0000 2024-06-02T23:45:27.031 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-06-02 23:43:07.457357315 +0000 2024-06-02T23:45:27.031 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-06-02 23:43:07.457357315 +0000 2024-06-02T23:45:27.032 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T23:45:27.094 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-06-02T23:45:27.095 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-06-02T23:45:27.095 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000187556 s, 2.7 MB/s 2024-06-02T23:45:27.096 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T23:45:27.152 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-06-02T23:45:27.208 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T23:45:27.208 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T23:45:27.208 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 726 Links: 1 2024-06-02T23:45:27.208 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T23:45:27.208 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T23:45:27.208 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-06-02 23:45:15.288557292 +0000 2024-06-02T23:45:27.208 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-06-02 23:43:07.793350148 +0000 2024-06-02T23:45:27.208 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-06-02 23:43:07.793350148 +0000 2024-06-02T23:45:27.208 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-06-02 23:43:07.793350148 +0000 2024-06-02T23:45:27.209 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T23:45:27.271 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-06-02T23:45:27.271 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-06-02T23:45:27.271 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000229048 s, 2.2 MB/s 2024-06-02T23:45:27.272 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T23:45:27.329 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T23:45:27.329 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-02T23:45:27.329 INFO:tasks.ceph:Generating config... 2024-06-02T23:45:27.331 INFO:tasks.ceph:[client] client mount timeout = 600 2024-06-02T23:45:27.331 INFO:tasks.ceph:[client] debug client = 20 2024-06-02T23:45:27.331 INFO:tasks.ceph:[client] debug ms = 1 2024-06-02T23:45:27.331 INFO:tasks.ceph:[client] pid file = 2024-06-02T23:45:27.331 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-06-02T23:45:27.331 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-06-02T23:45:27.331 INFO:tasks.ceph:[mds] debug mds = 20 2024-06-02T23:45:27.331 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mds] debug ms = 1 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mds] mds debug frag = True 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mgr] debug client = 20 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mgr] debug ms = 1 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mon] debug mon = 20 2024-06-02T23:45:27.332 INFO:tasks.ceph:[mon] debug ms = 1 2024-06-02T23:45:27.333 INFO:tasks.ceph:[mon] debug paxos = 20 2024-06-02T23:45:27.333 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-06-02T23:45:27.333 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] debug ms = 1 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] debug osd = 20 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-06-02T23:45:27.333 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-06-02T23:45:27.334 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-06-02T23:45:27.334 INFO:tasks.ceph:Setting up mon.a... 2024-06-02T23:45:27.334 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-06-02T23:45:27.379 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.keyring 2024-06-02T23:45:27.382 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-06-02T23:45:27.425 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-02T23:45:27.489 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.96'), ('mon.b', '172.21.15.162'), ('mon.c', '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]')] 2024-06-02T23:45:27.490 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.96,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-06-02T23:45:27.491 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:27.491 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-06-02T23:45:27.545 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.96 --add b 172.21.15.162 --addv c '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:27.630 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:27.630 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: generated fsid 83723afd-2657-4b93-818a-1e4b19cab42f 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:setting min_mon_release = quincy 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 0 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:fsid 83723afd-2657-4b93-818a-1e4b19cab42f 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:last_changed 2024-06-02T23:45:27.631568+0000 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-06-02T23:45:27.631568+0000 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:min_mon_release 17 (quincy) 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:election_strategy: 1 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:0: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.a 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:2: [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] mon.c 2024-06-02T23:45:27.631 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-06-02T23:45:27.632 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-06-02T23:45:27.648 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 83723afd-2657-4b93-818a-1e4b19cab42f... 2024-06-02T23:45:27.650 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-02T23:45:27.691 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-06-02T23:45:27.731 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-06-02T23:45:27.731 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-06-02T23:45:27.731 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-02T23:45:27.731 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-06-02T23:45:27.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.731 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-06-02T23:45:27.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.731 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-06-02T23:45:27.731 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-06-02T23:45:27.732 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.733 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.96,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = 83723afd-2657-4b93-818a-1e4b19cab42f 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.734 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug trim objects = true 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-06-02T23:45:27.735 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-06-02T23:45:27.736 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 20 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 20 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 10 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.737 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: debug finisher = 20 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-06-02T23:45:27.738 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.739 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: mon down mkfs grace = 300 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: mon op complaint time = 120 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-06-02T23:45:27.740 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout: client mount timeout = 600 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = "" 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2024-06-02T23:45:27.741 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d] 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout:[mds] 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds = 20 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds balancer = 20 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug frag = True 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug scatterstat = True 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: mds op complaint time = 180 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: mds verify scatter = True 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2024-06-02T23:45:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2024-06-02T23:45:27.743 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-06-02T23:45:27.743 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-06-02T23:45:27.743 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-06-02T23:45:27.743 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-06-02T23:45:27.743 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.744 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-06-02T23:45:27.745 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.96,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 83723afd-2657-4b93-818a-1e4b19cab42f 2024-06-02T23:45:27.746 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-06-02T23:45:27.747 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug trim objects = true 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-06-02T23:45:27.748 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 20 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 20 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 10 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-06-02T23:45:27.749 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: debug finisher = 20 2024-06-02T23:45:27.750 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.751 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: mon down mkfs grace = 300 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2024-06-02T23:45:27.752 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-06-02T23:45:27.753 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2024-06-02T23:45:27.754 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2024-06-02T23:45:27.755 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-06-02T23:45:27.755 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-06-02T23:45:27.755 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-06-02T23:45:27.756 INFO:tasks.ceph:Creating admin key on mon.a... 2024-06-02T23:45:27.756 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-06-02T23:45:27.850 INFO:tasks.ceph:Copying monmap to all nodes... 2024-06-02T23:45:27.850 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:27.850 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-06-02T23:45:27.865 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:27.865 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-06-02T23:45:27.921 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:45:27.921 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:27.921 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-02T23:45:27.921 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-02T23:45:27.995 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:27.995 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:28.050 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T23:45:28.050 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:28.050 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-06-02T23:45:28.050 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-06-02T23:45:28.086 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:28.086 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:28.143 INFO:tasks.ceph:Setting up mon nodes... 2024-06-02T23:45:28.143 INFO:tasks.ceph:Setting up mgr nodes... 2024-06-02T23:45:28.143 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-06-02T23:45:28.193 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-06-02T23:45:28.196 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-06-02T23:45:28.256 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-06-02T23:45:28.258 INFO:tasks.ceph:Setting up mds nodes... 2024-06-02T23:45:28.259 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-06-02T23:45:28.309 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-06-02T23:45:28.312 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-06-02T23:45:28.336 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-06-02T23:45:28.427 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-06-02T23:45:28.430 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-06-02T23:45:28.454 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-06-02T23:45:28.506 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-06-02T23:45:28.510 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-06-02T23:45:28.535 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-06-02T23:45:28.625 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-06-02T23:45:28.628 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-06-02T23:45:28.652 INFO:tasks.ceph_client:Setting up client nodes... 2024-06-02T23:45:28.653 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-02T23:45:28.693 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-06-02T23:45:28.705 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-06-02T23:45:28.786 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-06-02T23:45:28.799 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-06-02T23:45:28.839 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-06-02T23:45:28.852 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-06-02T23:45:28.933 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-06-02T23:45:28.945 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-06-02T23:45:28.945 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-06-02T23:45:28.945 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-06-02T23:45:28.970 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T23:45:28.970 INFO:tasks.ceph:role: osd.0 2024-06-02T23:45:28.970 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:45:28.970 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-02T23:45:29.041 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T23:45:29.041 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T23:45:29.041 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T23:45:29.042 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T23:45:29.042 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T23:45:29.042 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-06-02T23:45:29.042 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T23:45:29.042 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T23:45:29.042 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T23:45:29.042 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T23:45:29.557 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-06-02T23:45:29.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-06-02T23:45:29.560 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-06-02T23:45:29.707 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-06-02T23:45:29.738 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-06-02T23:45:29.803 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T23:45:29.803 INFO:tasks.ceph:role: osd.1 2024-06-02T23:45:29.803 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:45:29.803 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-02T23:45:29.875 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T23:45:29.875 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T23:45:29.875 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T23:45:29.875 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T23:45:29.875 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T23:45:29.875 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-06-02T23:45:29.875 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T23:45:29.875 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T23:45:29.875 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T23:45:29.875 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T23:45:30.316 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-06-02T23:45:30.318 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-06-02T23:45:30.318 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-06-02T23:45:30.414 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-06-02T23:45:30.443 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-06-02T23:45:30.507 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T23:45:30.508 INFO:tasks.ceph:role: osd.2 2024-06-02T23:45:30.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:45:30.508 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-02T23:45:30.579 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T23:45:30.579 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T23:45:30.579 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T23:45:30.579 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T23:45:30.579 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T23:45:30.580 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-06-02T23:45:30.580 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T23:45:30.580 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T23:45:30.580 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T23:45:30.580 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T23:45:31.060 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-06-02T23:45:31.062 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-06-02T23:45:31.062 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-06-02T23:45:31.207 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-06-02T23:45:31.236 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-06-02T23:45:31.301 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-06-02T23:45:31.301 INFO:tasks.ceph:role: osd.3 2024-06-02T23:45:31.301 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:45:31.302 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-02T23:45:31.374 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T23:45:31.375 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T23:45:31.375 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T23:45:31.375 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T23:45:31.375 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T23:45:31.375 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2024-06-02T23:45:31.375 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T23:45:31.375 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T23:45:31.375 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T23:45:31.375 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T23:45:31.901 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2024-06-02T23:45:31.904 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2024-06-02T23:45:31.904 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-06-02T23:45:32.050 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-06-02T23:45:32.083 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:32.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:32.175+0000 7f7a62e0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-06-02T23:45:32.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:32.175+0000 7f7a62e0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-06-02T23:45:32.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:32.175+0000 7f7a62e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-02T23:45:32.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:32.175+0000 7f7a62e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-02T23:45:32.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:32.175+0000 7f7a62e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-06-02T23:45:32.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:32.176+0000 7f7a62e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-06-02T23:45:35.025 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-06-02T23:45:35.056 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:35.146+0000 7f1086011640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-06-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:35.147+0000 7f1086011640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-06-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:35.147+0000 7f1086011640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:35.147+0000 7f1086011640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:35.147+0000 7f1086011640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-06-02T23:45:35.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:35.147+0000 7f1086011640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-06-02T23:45:37.989 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-06-02T23:45:38.017 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:38.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:38.105+0000 7f23aec0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-06-02T23:45:38.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:38.105+0000 7f23aec0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-06-02T23:45:38.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:38.105+0000 7f23aec0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-02T23:45:38.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:38.105+0000 7f23aec0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-02T23:45:38.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:38.105+0000 7f23aec0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-06-02T23:45:38.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:38.105+0000 7f23aec0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-06-02T23:45:40.955 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-06-02T23:45:40.983 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:41.070+0000 7f270a243640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-06-02T23:45:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:41.070+0000 7f270a243640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-06-02T23:45:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:41.070+0000 7f270a243640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-02T23:45:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:41.070+0000 7f270a243640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-02T23:45:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:41.070+0000 7f270a243640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-06-02T23:45:41.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:45:41.071+0000 7f270a243640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-06-02T23:45:43.917 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-06-02T23:45:43.945 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-06-02T23:45:43.975 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T23:45:43.975 INFO:tasks.ceph:role: osd.4 2024-06-02T23:45:43.975 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T23:45:43.975 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-06-02T23:45:44.051 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T23:45:44.051 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T23:45:44.051 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T23:45:44.051 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T23:45:44.051 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T23:45:44.051 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-06-02T23:45:44.051 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T23:45:44.051 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T23:45:44.051 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T23:45:44.052 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T23:45:44.566 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-06-02T23:45:44.568 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-06-02T23:45:44.569 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-06-02T23:45:44.674 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-06-02T23:45:44.710 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-06-02T23:45:44.776 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T23:45:44.776 INFO:tasks.ceph:role: osd.5 2024-06-02T23:45:44.776 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T23:45:44.777 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-06-02T23:45:44.850 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T23:45:44.850 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T23:45:44.850 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T23:45:44.851 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T23:45:44.851 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T23:45:44.851 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-06-02T23:45:44.851 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T23:45:44.851 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T23:45:44.851 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T23:45:44.851 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T23:45:45.319 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-06-02T23:45:45.322 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-06-02T23:45:45.323 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-06-02T23:45:45.424 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-06-02T23:45:45.459 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-06-02T23:45:45.526 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T23:45:45.527 INFO:tasks.ceph:role: osd.6 2024-06-02T23:45:45.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T23:45:45.527 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-06-02T23:45:45.601 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T23:45:45.602 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T23:45:45.602 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T23:45:45.602 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T23:45:45.602 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T23:45:45.602 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-06-02T23:45:45.602 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T23:45:45.602 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T23:45:45.602 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T23:45:45.602 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T23:45:46.095 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-06-02T23:45:46.097 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-06-02T23:45:46.097 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-06-02T23:45:46.225 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-06-02T23:45:46.259 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-06-02T23:45:46.327 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-06-02T23:45:46.327 INFO:tasks.ceph:role: osd.7 2024-06-02T23:45:46.327 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T23:45:46.327 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-06-02T23:45:46.401 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-06-02T23:45:46.401 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-06-02T23:45:46.402 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-06-02T23:45:46.402 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-06-02T23:45:46.402 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-06-02T23:45:46.402 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-06-02T23:45:46.402 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-06-02T23:45:46.402 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-06-02T23:45:46.402 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-06-02T23:45:46.402 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-06-02T23:45:46.910 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-06-02T23:45:46.912 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-06-02T23:45:46.912 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-06-02T23:45:47.042 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-06-02T23:45:47.077 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:47.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:47.176+0000 7f74b8a14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-06-02T23:45:47.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:47.176+0000 7f74b8a14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-06-02T23:45:47.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:47.176+0000 7f74b8a14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-02T23:45:47.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:47.176+0000 7f74b8a14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-02T23:45:47.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:47.176+0000 7f74b8a14640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-06-02T23:45:47.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:47.177+0000 7f74b8a14640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-06-02T23:45:50.035 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-06-02T23:45:50.065 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:50.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:50.156+0000 7f087ab01640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-06-02T23:45:50.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:50.156+0000 7f087ab01640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-06-02T23:45:50.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:50.156+0000 7f087ab01640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-02T23:45:50.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:50.156+0000 7f087ab01640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-02T23:45:50.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:50.156+0000 7f087ab01640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-06-02T23:45:50.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:50.157+0000 7f087ab01640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-06-02T23:45:53.004 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-06-02T23:45:53.033 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:53.122+0000 7fd675210640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-06-02T23:45:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:53.122+0000 7fd675210640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-06-02T23:45:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:53.122+0000 7fd675210640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-02T23:45:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:53.122+0000 7fd675210640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-02T23:45:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:53.122+0000 7fd675210640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-06-02T23:45:53.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:53.123+0000 7fd675210640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-06-02T23:45:55.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:45:55.760 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:45:55.965 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-06-02T23:45:55.991 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:45:56.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:56.077+0000 7f067f5cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-06-02T23:45:56.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:56.077+0000 7f067f5cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-06-02T23:45:56.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:56.078+0000 7f067f5cb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-02T23:45:56.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:56.078+0000 7f067f5cb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-02T23:45:56.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:56.078+0000 7f067f5cb640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-06-02T23:45:56.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:45:56.078+0000 7f067f5cb640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-06-02T23:45:58.932 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-06-02T23:45:58.961 INFO:tasks.ceph:Reading keys from all nodes... 2024-06-02T23:45:58.961 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:58.961 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-06-02T23:45:58.991 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:58.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-06-02T23:45:59.059 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:59.059 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-06-02T23:45:59.127 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:59.127 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-06-02T23:45:59.194 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:59.194 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-06-02T23:45:59.260 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:59.260 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-06-02T23:45:59.327 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:59.327 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-06-02T23:45:59.392 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:59.393 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-06-02T23:45:59.423 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:59.423 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-06-02T23:45:59.492 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:59.492 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-06-02T23:45:59.560 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:59.560 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-06-02T23:45:59.629 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:59.629 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-06-02T23:45:59.696 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:59.696 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-06-02T23:45:59.763 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:59.763 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-06-02T23:45:59.830 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:59.830 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-06-02T23:45:59.847 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:45:59.847 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-06-02T23:45:59.904 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:59.905 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-06-02T23:45:59.921 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:45:59.921 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-06-02T23:45:59.978 INFO:tasks.ceph:Adding keys to all mons... 2024-06-02T23:45:59.978 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-02T23:45:59.981 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-06-02T23:46:00.022 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2024-06-02T23:46:00.022 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1mQ/aZCxAAV7Dado7gJa/pxz43da1eVw== 2024-06-02T23:46:00.022 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-06-02T23:46:00.022 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1mv+yHEhAA5drjcpFFkuZtP9jn4RNKJg== 2024-06-02T23:46:00.022 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2024-06-02T23:46:00.025 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1mVjKRGRAAC+vsd0hUCCQ/mOXFYGV5YA== 2024-06-02T23:46:00.025 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2024-06-02T23:46:00.025 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAcBF1mte+CChAAPDwA0vI0SJosZ3U0rWu1mA== 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAfBF1m7PXNCBAAp/N/6XnBcejiNP+Gf4riJQ== 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAiBF1mJNZTBhAAO96HFWEr7FRUBPsfMIAyvQ== 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAlBF1mE3dFBBAAHQ/axJajuNqTcSyq3iuhzg== 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1mWkxYDxAAOgAEKD5eR7iDnKFLhTRz6Q== 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1m7XM8HhAAKUlPE4OvGuBeKe6DGbkyHQ== 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d] 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1myBlaJRAAIjex3ET8YFlbLgoaY4JnKQ== 2024-06-02T23:46:00.026 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.4] 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQArBF1mGCqhChAA2rAbXRqzMPrK0+00D7j+WA== 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.5] 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAuBF1mj5VeCRAAwVs8J2MBZE6bXG4mW5g2Sg== 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.6] 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAxBF1mYqZaBxAAiDIOH5xXTjT4+vj/u3MvNw== 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.7] 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQA0BF1mpoCvBBAAJYKc3QKLtU3cT/zALs8RLg== 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1mSH5jKRAAiBQXUb900fop4NegNAGVlQ== 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout:[client.2] 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1mV+3yLhAAx/UoeSwIrsirjBB3auHGig== 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout:[client.1] 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1mBgQeMhAA/ozEWt5lxs+djJ0fv79MKQ== 2024-06-02T23:46:00.027 INFO:teuthology.orchestra.run.smithi096.stdout:[client.3] 2024-06-02T23:46:00.028 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1mGVOsNxAAmWB6RKMd/43AazTZCxqLYw== 2024-06-02T23:46:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-06-02T23:46:00.043 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAYBF1mQ/aZCxAAV7Dado7gJa/pxz43da1eVw== 2024-06-02T23:46:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-06-02T23:46:00.043 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAYBF1mv+yHEhAA5drjcpFFkuZtP9jn4RNKJg== 2024-06-02T23:46:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-06-02T23:46:00.043 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAYBF1mVjKRGRAAC+vsd0hUCCQ/mOXFYGV5YA== 2024-06-02T23:46:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAcBF1mte+CChAAPDwA0vI0SJosZ3U0rWu1mA== 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAfBF1m7PXNCBAAp/N/6XnBcejiNP+Gf4riJQ== 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAiBF1mJNZTBhAAO96HFWEr7FRUBPsfMIAyvQ== 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAlBF1mE3dFBBAAHQ/axJajuNqTcSyq3iuhzg== 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAYBF1mWkxYDxAAOgAEKD5eR7iDnKFLhTRz6Q== 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-06-02T23:46:00.044 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAYBF1m7XM8HhAAKUlPE4OvGuBeKe6DGbkyHQ== 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAYBF1myBlaJRAAIjex3ET8YFlbLgoaY4JnKQ== 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQArBF1mGCqhChAA2rAbXRqzMPrK0+00D7j+WA== 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAuBF1mj5VeCRAAwVs8J2MBZE6bXG4mW5g2Sg== 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAxBF1mYqZaBxAAiDIOH5xXTjT4+vj/u3MvNw== 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQA0BF1mpoCvBBAAJYKc3QKLtU3cT/zALs8RLg== 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAYBF1mSH5jKRAAiBQXUb900fop4NegNAGVlQ== 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:[client.2] 2024-06-02T23:46:00.045 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAYBF1mV+3yLhAAx/UoeSwIrsirjBB3auHGig== 2024-06-02T23:46:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-06-02T23:46:00.046 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAYBF1mBgQeMhAA/ozEWt5lxs+djJ0fv79MKQ== 2024-06-02T23:46:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:[client.3] 2024-06-02T23:46:00.046 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAYBF1mGVOsNxAAmWB6RKMd/43AazTZCxqLYw== 2024-06-02T23:46:00.047 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T23:46:00.071 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T23:46:00.138 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T23:46:00.140 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T23:46:00.194 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T23:46:00.196 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T23:46:00.250 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.252 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.304 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.306 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.357 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.360 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.411 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.413 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T23:46:00.466 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-06-02T23:46:00.516 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T23:46:00.519 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T23:46:00.573 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T23:46:00.575 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-06-02T23:46:00.628 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.630 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.681 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.683 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.733 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.735 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.786 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.788 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-06-02T23:46:00.840 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T23:46:00.842 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T23:46:00.896 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T23:46:00.898 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T23:46:00.953 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T23:46:00.955 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T23:46:01.009 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T23:46:01.011 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-06-02T23:46:01.065 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-06-02T23:46:01.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-06-02T23:46:01.089 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-02T23:46:01.184 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-06-02T23:46:01.208 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-06-02T23:46:01.233 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-02T23:46:01.330 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-06-02T23:46:01.354 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-06-02T23:46:01.419 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-06-02T23:46:01.514 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-06-02T23:46:01.538 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:46:01.541 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-06-02T23:46:01.594 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-06-02T23:46:01.594 INFO:tasks.ceph.mon.a:Restarting daemon 2024-06-02T23:46:01.594 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-06-02T23:46:01.597 INFO:tasks.ceph.mon.a:Started 2024-06-02T23:46:01.597 INFO:tasks.ceph.mon.b:Restarting daemon 2024-06-02T23:46:01.597 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-06-02T23:46:01.636 INFO:tasks.ceph.mon.b:Started 2024-06-02T23:46:01.636 INFO:tasks.ceph.mon.c:Restarting daemon 2024-06-02T23:46:01.636 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-06-02T23:46:01.638 INFO:tasks.ceph.mon.c:Started 2024-06-02T23:46:01.638 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-06-02T23:46:01.639 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-06-02T23:46:01.639 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-06-02T23:46:01.641 INFO:tasks.ceph.mgr.y:Started 2024-06-02T23:46:01.641 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-06-02T23:46:01.641 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-06-02T23:46:01.643 INFO:tasks.ceph.mgr.x:Started 2024-06-02T23:46:01.643 INFO:tasks.ceph:Setting crush tunables to default 2024-06-02T23:46:01.644 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd crush tunables default 2024-06-02T23:46:01.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.743+0000 7ff3f0629640 1 Processor -- start 2024-06-02T23:46:01.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.743+0000 7ff3f0629640 1 -- start start 2024-06-02T23:46:01.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3f0629640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff3e80b4640 0x7ff3e80b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:01.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3f0629640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff3e80b4b50 0x7ff3e80b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:01.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3f0629640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e80b73e0 con 0x7ff3e80d2630 2024-06-02T23:46:01.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3f0629640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e80d4ff0 con 0x7ff3e80b4640 2024-06-02T23:46:01.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3f0629640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e80cec60 con 0x7ff3e80b4b50 2024-06-02T23:46:01.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3ee3c5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff3e80b4640 0x7ff3e80b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3eebc6640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff3e80d2630 0x7ff3e80cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48632/0 (socket says 172.21.15.96:48632) 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3eebc6640 1 -- 172.21.15.96:0/2605525853 learned_addr learned my addr 172.21.15.96:0/2605525853 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3ee3c5640 1 -- 172.21.15.96:0/2605525853 >> v2:172.21.15.96:3300/0 conn(0x7ff3e80b4640 msgr2=0x7ff3e80b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3ee3c5640 1 -- 172.21.15.96:0/2605525853 >> v2:172.21.15.96:3300/0 conn(0x7ff3e80b4640 msgr2=0x7ff3e80b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3ee3c5640 1 --2- 172.21.15.96:0/2605525853 >> v2:172.21.15.96:3300/0 conn(0x7ff3e80b4640 0x7ff3e80b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3ee3c5640 1 --2- 172.21.15.96:0/2605525853 >> v2:172.21.15.96:3300/0 conn(0x7ff3e80b4640 0x7ff3e80b6ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3edbc4640 1 --2- 172.21.15.96:0/2605525853 >> v2:172.21.15.162:3300/0 conn(0x7ff3e80b4b50 0x7ff3e80b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3edbc4640 1 -- 172.21.15.96:0/2605525853 >> v2:172.21.15.162:3300/0 conn(0x7ff3e80b4b50 msgr2=0x7ff3e80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3edbc4640 1 -- 172.21.15.96:0/2605525853 >> v2:172.21.15.162:3300/0 conn(0x7ff3e80b4b50 msgr2=0x7ff3e80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3edbc4640 1 --2- 172.21.15.96:0/2605525853 >> v2:172.21.15.162:3300/0 conn(0x7ff3e80b4b50 0x7ff3e80b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T23:46:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.744+0000 7ff3edbc4640 1 --2- 172.21.15.96:0/2605525853 >> v2:172.21.15.162:3300/0 conn(0x7ff3e80b4b50 0x7ff3e80b5000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:46:01.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1406252969 0 0) 0x7ff3e80b73e0 con 0x7ff3e80d2630 2024-06-02T23:46:01.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3d4003520 con 0x7ff3e80d2630 2024-06-02T23:46:01.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 783053359 0 0) 0x7ff3d4003520 con 0x7ff3e80d2630 2024-06-02T23:46:01.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 >> v2:172.21.15.162:3300/0 conn(0x7ff3e80b4b50 msgr2=0x7ff3e80b5000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T23:46:01.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 --2- 172.21.15.96:0/2605525853 >> v2:172.21.15.162:3300/0 conn(0x7ff3e80b4b50 0x7ff3e80b5000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 >> v2:172.21.15.96:3300/0 conn(0x7ff3e80b4640 msgr2=0x7ff3e80b6ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 --2- 172.21.15.96:0/2605525853 >> v2:172.21.15.96:3300/0 conn(0x7ff3e80b4640 0x7ff3e80b6ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e80d1fd0 con 0x7ff3e80d2630 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7ff3e00019f0 con 0x7ff3e80d2630 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 >> v1:172.21.15.96:6789/0 conn(0x7ff3e80d2630 legacy=0x7ff3e80cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3d40039b0 0x7ff3d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d4004800 0x7ff3d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3d4005230 0x7ff3d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80cec60 con 0x7ff3d40039b0 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d400c190 con 0x7ff3d4004800 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d400c390 con 0x7ff3d4005230 2024-06-02T23:46:01.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.904+0000 7ff3ee3c5640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3d40039b0 0x7ff3d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.905+0000 7ff3eebc6640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3d4005230 0x7ff3d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.905+0000 7ff3edbc4640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d4004800 0x7ff3d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.905+0000 7ff3ee3c5640 1 -- 172.21.15.96:0/2605525853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3d4005230 msgr2=0x7ff3d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.905+0000 7ff3ee3c5640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3d4005230 0x7ff3d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.905+0000 7ff3ee3c5640 1 -- 172.21.15.96:0/2605525853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d4004800 msgr2=0x7ff3d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.905+0000 7ff3ee3c5640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d4004800 0x7ff3d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.905+0000 7ff3ee3c5640 1 -- 172.21.15.96:0/2605525853 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d4003520 con 0x7ff3d40039b0 2024-06-02T23:46:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.905+0000 7ff3eebc6640 1 -- 172.21.15.96:0/2605525853 reap_dead start 2024-06-02T23:46:01.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.905+0000 7ff3edbc4640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3d4004800 0x7ff3d4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:01.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.906+0000 7ff3ee3c5640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3d40039b0 0x7ff3d4003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400b9e0 tx=0x7ff3d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f6347f400ae229 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:01.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.906+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4030070 con 0x7ff3d40039b0 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.906+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e402ace0 con 0x7ff3d40039b0 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.906+0000 7ff3ed3c3640 1 -- 172.21.15.96:0/2605525853 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400b5e0 con 0x7ff3d40039b0 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.907+0000 7ff3f0629640 1 -- 172.21.15.96:0/2605525853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3d40039b0 msgr2=0x7ff3d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.907+0000 7ff3f0629640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3d40039b0 0x7ff3d4003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400b9e0 tx=0x7ff3d4005830 comp rx=0 tx=0).stop 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.907+0000 7ff3f0629640 1 -- 172.21.15.96:0/2605525853 shutdown_connections 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.907+0000 7ff3f0629640 1 --2- 172.21.15.96:0/2605525853 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3d40039b0 0x7ff3d4003dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.907+0000 7ff3f0629640 1 -- 172.21.15.96:0/2605525853 >> 172.21.15.96:0/2605525853 conn(0x7ff3e80d4050 msgr2=0x7ff3e80d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.907+0000 7ff3f0629640 1 -- 172.21.15.96:0/2605525853 shutdown_connections 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.907+0000 7ff3f0629640 1 -- 172.21.15.96:0/2605525853 wait complete. 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.908+0000 7ff3f0629640 1 Processor -- start 2024-06-02T23:46:01.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.908+0000 7ff3f0629640 1 -- start start 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3f0629640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3d40039b0 0x7ff3e80b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3f0629640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8157ed0 0x7ff3e8158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3f0629640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3e815a6b0 0x7ff3e815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3f0629640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80d13b0 con 0x7ff3e815a6b0 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3f0629640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80cef00 con 0x7ff3e8157ed0 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3f0629640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e80b6ea0 con 0x7ff3d40039b0 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3eebc6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3e815a6b0 0x7ff3e815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3ee3c5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3d40039b0 0x7ff3e80b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3eebc6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3e815a6b0 0x7ff3e815ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46380/0 (socket says 172.21.15.96:46380) 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3eebc6640 1 -- 172.21.15.96:0/2956521954 learned_addr learned my addr 172.21.15.96:0/2956521954 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:01.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3edbc4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8157ed0 0x7ff3e8158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3eebc6640 1 -- 172.21.15.96:0/2956521954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3d40039b0 msgr2=0x7ff3e80b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3eebc6640 1 --2- 172.21.15.96:0/2956521954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3d40039b0 0x7ff3e80b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3eebc6640 1 -- 172.21.15.96:0/2956521954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8157ed0 msgr2=0x7ff3e8158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3eebc6640 1 --2- 172.21.15.96:0/2956521954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8157ed0 0x7ff3e8158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.909+0000 7ff3eebc6640 1 -- 172.21.15.96:0/2956521954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e81575a0 con 0x7ff3e815a6b0 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.910+0000 7ff3eebc6640 1 --2- 172.21.15.96:0/2956521954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3e815a6b0 0x7ff3e815ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00013d0 tx=0x7ff3e0007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.910+0000 7ff3daffd640 1 -- 172.21.15.96:0/2956521954 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0019070 con 0x7ff3e815a6b0 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.910+0000 7ff3daffd640 1 -- 172.21.15.96:0/2956521954 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e000ab20 con 0x7ff3e815a6b0 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.910+0000 7ff3f0629640 1 -- 172.21.15.96:0/2956521954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e81f4100 con 0x7ff3e815a6b0 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.910+0000 7ff3daffd640 1 -- 172.21.15.96:0/2956521954 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00133f0 con 0x7ff3e815a6b0 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.910+0000 7ff3f0629640 1 -- 172.21.15.96:0/2956521954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e80b1f50 con 0x7ff3e815a6b0 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.910+0000 7ff3daffd640 1 -- 172.21.15.96:0/2956521954 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff3e001c070 con 0x7ff3e815a6b0 2024-06-02T23:46:01.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.910+0000 7ff3daffd640 1 -- 172.21.15.96:0/2956521954 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff3e001ea70 con 0x7ff3e815a6b0 2024-06-02T23:46:01.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.911+0000 7ff3f0629640 1 -- 172.21.15.96:0/2956521954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e80683e0 con 0x7ff3e815a6b0 2024-06-02T23:46:01.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.913+0000 7ff3daffd640 1 -- 172.21.15.96:0/2956521954 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff3e0023020 con 0x7ff3e815a6b0 2024-06-02T23:46:01.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.978+0000 7ff3f0629640 1 -- 172.21.15.96:0/2956521954 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff3e80d2410 con 0x7ff3e815a6b0 2024-06-02T23:46:01.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.980+0000 7ff3daffd640 1 -- 172.21.15.96:0/2956521954 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff3e81575a0 con 0x7ff3e815a6b0 2024-06-02T23:46:01.980 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2024-06-02T23:46:01.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.981+0000 7ff3f0629640 1 -- 172.21.15.96:0/2956521954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3e815a6b0 msgr2=0x7ff3e815ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:01.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.981+0000 7ff3f0629640 1 --2- 172.21.15.96:0/2956521954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3e815a6b0 0x7ff3e815ab30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00013d0 tx=0x7ff3e0007a90 comp rx=0 tx=0).stop 2024-06-02T23:46:01.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.981+0000 7ff3f0629640 1 -- 172.21.15.96:0/2956521954 shutdown_connections 2024-06-02T23:46:01.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.981+0000 7ff3f0629640 1 --2- 172.21.15.96:0/2956521954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3e815a6b0 0x7ff3e815ab30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:01.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.981+0000 7ff3f0629640 1 --2- 172.21.15.96:0/2956521954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3e8157ed0 0x7ff3e8158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:01.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.981+0000 7ff3f0629640 1 --2- 172.21.15.96:0/2956521954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3d40039b0 0x7ff3e80b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:01.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.981+0000 7ff3f0629640 1 -- 172.21.15.96:0/2956521954 >> 172.21.15.96:0/2956521954 conn(0x7ff3e80d4050 msgr2=0x7ff3e80b9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:01.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.981+0000 7ff3f0629640 1 -- 172.21.15.96:0/2956521954 shutdown_connections 2024-06-02T23:46:01.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:01.981+0000 7ff3f0629640 1 -- 172.21.15.96:0/2956521954 wait complete. 2024-06-02T23:46:01.992 INFO:tasks.ceph:check_enable_crimson: False 2024-06-02T23:46:01.992 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-06-02T23:46:01.992 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:46:01.992 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-06-02T23:46:02.012 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:02.012+0000 7f2d4f20f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:46:02.014 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:02.014+0000 7facb5b60040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:46:02.017 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:46:02.017 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-06-02T23:46:02.082 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:46:02.082 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-06-02T23:46:02.146 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:46:02.146 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-06-02T23:46:02.170 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:02.170+0000 7f2d4f20f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:46:02.176 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:02.176+0000 7facb5b60040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:46:02.195 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:46:02.195 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-06-02T23:46:02.220 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:46:02.220 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-06-02T23:46:02.226 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:02.226+0000 7f2d4f20f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:46:02.231 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:02.232+0000 7facb5b60040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:46:02.256 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:46:02.256 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-06-02T23:46:02.322 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:46:02.322 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-06-02T23:46:02.387 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 676c9ee9-2d5a-4ed5-a74d-4c174799d433 0 2024-06-02T23:46:02.466 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:02.466+0000 7f2d4f20f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:46:02.510 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:02.510+0000 7f2d4f20f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:46:02.515 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:02.515+0000 7facb5b60040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:46:02.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.527+0000 7fb4b0476640 1 Processor -- start 2024-06-02T23:46:02.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.527+0000 7fb4b0476640 1 -- start start 2024-06-02T23:46:02.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.528+0000 7fb4b0476640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb4a80727f0 0x7fb4a80b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.528+0000 7fb4b0476640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a80adda0 0x7fb4a80b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.528+0000 7fb4b0476640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a815c7e0 con 0x7fb4a815c010 2024-06-02T23:46:02.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.528+0000 7fb4b0476640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a815cac0 con 0x7fb4a80727f0 2024-06-02T23:46:02.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.528+0000 7fb4b0476640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a815cda0 con 0x7fb4a80adda0 2024-06-02T23:46:02.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.528+0000 7fb4aea13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a80adda0 0x7fb4a80b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.529+0000 7fb4aea13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a80adda0 0x7fb4a80b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53132/0 (socket says 172.21.15.162:53132) 2024-06-02T23:46:02.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.529+0000 7fb4aea13640 1 -- 172.21.15.162:0/319316970 learned_addr learned my addr 172.21.15.162:0/319316970 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:02.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.529+0000 7fb4ada11640 1 --2- 172.21.15.162:0/319316970 >> v2:172.21.15.96:3300/0 conn(0x7fb4a80727f0 0x7fb4a80b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.529+0000 7fb4aea13640 1 -- 172.21.15.162:0/319316970 >> v2:172.21.15.96:3300/0 conn(0x7fb4a80727f0 msgr2=0x7fb4a80b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:02.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.529+0000 7fb4aea13640 1 --2- 172.21.15.162:0/319316970 >> v2:172.21.15.96:3300/0 conn(0x7fb4a80727f0 0x7fb4a80b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.529+0000 7fb4aea13640 1 -- 172.21.15.162:0/319316970 >> v1:172.21.15.96:6789/0 conn(0x7fb4a815c010 legacy=0x7fb4a80720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.529+0000 7fb4aea13640 1 -- 172.21.15.162:0/319316970 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a815d080 con 0x7fb4a80adda0 2024-06-02T23:46:02.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.529+0000 7fb4ada11640 1 --2- 172.21.15.162:0/319316970 >> v2:172.21.15.96:3300/0 conn(0x7fb4a80727f0 0x7fb4a80b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:02.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.529+0000 7fb4aea13640 1 --2- 172.21.15.162:0/319316970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a80adda0 0x7fb4a80b3ec0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009e50 tx=0x7fb4a002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7312ce3ae2f98c56 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:02.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4ad210640 1 -- 172.21.15.162:0/319316970 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0036070 con 0x7fb4a80adda0 2024-06-02T23:46:02.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4ad210640 1 -- 172.21.15.162:0/319316970 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a0031600 con 0x7fb4a80adda0 2024-06-02T23:46:02.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4ad210640 1 -- 172.21.15.162:0/319316970 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a00319d0 con 0x7fb4a80adda0 2024-06-02T23:46:02.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4b0476640 1 -- 172.21.15.162:0/319316970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a80adda0 msgr2=0x7fb4a80b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4b0476640 1 --2- 172.21.15.162:0/319316970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a80adda0 0x7fb4a80b3ec0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009e50 tx=0x7fb4a002a710 comp rx=0 tx=0).stop 2024-06-02T23:46:02.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4b0476640 1 -- 172.21.15.162:0/319316970 shutdown_connections 2024-06-02T23:46:02.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4b0476640 1 --2- 172.21.15.162:0/319316970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a80adda0 0x7fb4a80b3ec0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4b0476640 1 --2- 172.21.15.162:0/319316970 >> v2:172.21.15.96:3300/0 conn(0x7fb4a80727f0 0x7fb4a80b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4b0476640 1 -- 172.21.15.162:0/319316970 >> 172.21.15.162:0/319316970 conn(0x7fb4a80b2ba0 msgr2=0x7fb4a80b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:02.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4b0476640 1 -- 172.21.15.162:0/319316970 shutdown_connections 2024-06-02T23:46:02.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.530+0000 7fb4b0476640 1 -- 172.21.15.162:0/319316970 wait complete. 2024-06-02T23:46:02.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.532+0000 7fb4b0476640 1 Processor -- start 2024-06-02T23:46:02.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.532+0000 7fb4b0476640 1 -- start start 2024-06-02T23:46:02.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.532+0000 7fb4b0476640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a80727f0 0x7fb4a8144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.532+0000 7fb4b0476640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a80adda0 0x7fb4a809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.532+0000 7fb4b0476640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a815c010 0x7fb4a815d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.532+0000 7fb4b0476640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a815c570 con 0x7fb4a80adda0 2024-06-02T23:46:02.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.532+0000 7fb4b0476640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a815c3f0 con 0x7fb4a80727f0 2024-06-02T23:46:02.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.532+0000 7fb4b0476640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a80b0310 con 0x7fb4a815c010 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.532+0000 7fb4aea13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a815c010 0x7fb4a815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.532+0000 7fb4ae212640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a80727f0 0x7fb4a8144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4aea13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a815c010 0x7fb4a815d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53138/0 (socket says 172.21.15.162:53138) 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4aea13640 1 -- 172.21.15.162:0/378649851 learned_addr learned my addr 172.21.15.162:0/378649851 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4ada11640 1 --2- 172.21.15.162:0/378649851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a80adda0 0x7fb4a809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4aea13640 1 -- 172.21.15.162:0/378649851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a80727f0 msgr2=0x7fb4a8144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4aea13640 1 --2- 172.21.15.162:0/378649851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a80727f0 0x7fb4a8144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4aea13640 1 -- 172.21.15.162:0/378649851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a80adda0 msgr2=0x7fb4a809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4aea13640 1 --2- 172.21.15.162:0/378649851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a80adda0 0x7fb4a809aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4aea13640 1 -- 172.21.15.162:0/378649851 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a809d5d0 con 0x7fb4a815c010 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4ae212640 1 --2- 172.21.15.162:0/378649851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a80727f0 0x7fb4a8144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4aea13640 1 --2- 172.21.15.162:0/378649851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a815c010 0x7fb4a815d720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009e50 tx=0x7fb4a0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb49effd640 1 -- 172.21.15.162:0/378649851 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0036050 con 0x7fb4a815c010 2024-06-02T23:46:02.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb49effd640 1 -- 172.21.15.162:0/378649851 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a0042070 con 0x7fb4a815c010 2024-06-02T23:46:02.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4b0476640 1 -- 172.21.15.162:0/378649851 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a809d8b0 con 0x7fb4a815c010 2024-06-02T23:46:02.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb49effd640 1 -- 172.21.15.162:0/378649851 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0009510 con 0x7fb4a815c010 2024-06-02T23:46:02.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb4b0476640 1 -- 172.21.15.162:0/378649851 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a809de70 con 0x7fb4a815c010 2024-06-02T23:46:02.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb49effd640 1 -- 172.21.15.162:0/378649851 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb4a0007bd0 con 0x7fb4a815c010 2024-06-02T23:46:02.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.533+0000 7fb49effd640 1 -- 172.21.15.162:0/378649851 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb4a0047b40 con 0x7fb4a815c010 2024-06-02T23:46:02.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.534+0000 7fb4b0476640 1 -- 172.21.15.162:0/378649851 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a8068af0 con 0x7fb4a815c010 2024-06-02T23:46:02.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.537+0000 7fb49effd640 1 -- 172.21.15.162:0/378649851 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb4a0047460 con 0x7fb4a815c010 2024-06-02T23:46:02.564 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:02.564+0000 7facb5b60040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:46:02.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.609+0000 7fb4b0476640 1 -- 172.21.15.162:0/378649851 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "676c9ee9-2d5a-4ed5-a74d-4c174799d433", "id": 0} v 0) -- 0x7fb4a80cfee0 con 0x7fb4a815c010 2024-06-02T23:46:02.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.614+0000 7fb49effd640 1 -- 172.21.15.162:0/378649851 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "676c9ee9-2d5a-4ed5-a74d-4c174799d433", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb4a0047640 con 0x7fb4a815c010 2024-06-02T23:46:02.614 INFO:teuthology.orchestra.run.smithi162.stdout:0 2024-06-02T23:46:02.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.615+0000 7fb4b0476640 1 -- 172.21.15.162:0/378649851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a815c010 msgr2=0x7fb4a815d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.615+0000 7fb4b0476640 1 --2- 172.21.15.162:0/378649851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a815c010 0x7fb4a815d720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009e50 tx=0x7fb4a0004a40 comp rx=0 tx=0).stop 2024-06-02T23:46:02.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.615+0000 7fb4b0476640 1 -- 172.21.15.162:0/378649851 shutdown_connections 2024-06-02T23:46:02.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.615+0000 7fb4b0476640 1 --2- 172.21.15.162:0/378649851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4a815c010 0x7fb4a815d720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.615+0000 7fb4b0476640 1 --2- 172.21.15.162:0/378649851 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4a80adda0 0x7fb4a809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.615+0000 7fb4b0476640 1 --2- 172.21.15.162:0/378649851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4a80727f0 0x7fb4a8144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.615+0000 7fb4b0476640 1 -- 172.21.15.162:0/378649851 >> 172.21.15.162:0/378649851 conn(0x7fb4a80b2ba0 msgr2=0x7fb4a80b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:02.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.615+0000 7fb4b0476640 1 -- 172.21.15.162:0/378649851 shutdown_connections 2024-06-02T23:46:02.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.615+0000 7fb4b0476640 1 -- 172.21.15.162:0/378649851 wait complete. 2024-06-02T23:46:02.626 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 33afefe9-4fbc-464c-882e-eb7678d89a1c 1 2024-06-02T23:46:02.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.726+0000 7f7e713ee640 1 Processor -- start 2024-06-02T23:46:02.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.726+0000 7f7e713ee640 1 -- start start 2024-06-02T23:46:02.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.727+0000 7f7e713ee640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7e6c0b4b50 0x7f7e6c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.727+0000 7f7e713ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.727+0000 7f7e713ee640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e6c0cec60 con 0x7f7e6c0b4640 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.727+0000 7f7e713ee640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7e6c0d4ff0 con 0x7f7e6c0b4b50 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.727+0000 7f7e713ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6c0d1fd0 con 0x7f7e6c0d2630 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.727+0000 7f7e6b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.727+0000 7f7e6b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0d2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53144/0 (socket says 172.21.15.162:53144) 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.727+0000 7f7e6b7fe640 1 -- 172.21.15.162:0/1621217807 learned_addr learned my addr 172.21.15.162:0/1621217807 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.727+0000 7f7e6a7fc640 1 --2- 172.21.15.162:0/1621217807 >> v2:172.21.15.96:3300/0 conn(0x7f7e6c0b4b50 0x7f7e6c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.728+0000 7f7e6b7fe640 1 -- 172.21.15.162:0/1621217807 >> v2:172.21.15.96:3300/0 conn(0x7f7e6c0b4b50 msgr2=0x7f7e6c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.728+0000 7f7e6b7fe640 1 --2- 172.21.15.162:0/1621217807 >> v2:172.21.15.96:3300/0 conn(0x7f7e6c0b4b50 0x7f7e6c0b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.728+0000 7f7e6b7fe640 1 -- 172.21.15.162:0/1621217807 >> v1:172.21.15.96:6789/0 conn(0x7f7e6c0b4640 legacy=0x7f7e6c0b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.728+0000 7f7e6b7fe640 1 -- 172.21.15.162:0/1621217807 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6c0d4d10 con 0x7f7e6c0d2630 2024-06-02T23:46:02.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.728+0000 7f7e6b7fe640 1 --2- 172.21.15.162:0/1621217807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0d2ac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009e50 tx=0x7f7e6402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b32d51cb7bf78c4e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:02.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e69ffb640 1 -- 172.21.15.162:0/1621217807 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64036070 con 0x7f7e6c0d2630 2024-06-02T23:46:02.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e69ffb640 1 -- 172.21.15.162:0/1621217807 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e64031600 con 0x7f7e6c0d2630 2024-06-02T23:46:02.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e69ffb640 1 -- 172.21.15.162:0/1621217807 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e640319d0 con 0x7f7e6c0d2630 2024-06-02T23:46:02.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e713ee640 1 -- 172.21.15.162:0/1621217807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 msgr2=0x7f7e6c0d2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e713ee640 1 --2- 172.21.15.162:0/1621217807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0d2ac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009e50 tx=0x7f7e6402a5f0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e713ee640 1 -- 172.21.15.162:0/1621217807 shutdown_connections 2024-06-02T23:46:02.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e713ee640 1 --2- 172.21.15.162:0/1621217807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0d2ac0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e713ee640 1 --2- 172.21.15.162:0/1621217807 >> v2:172.21.15.96:3300/0 conn(0x7f7e6c0b4b50 0x7f7e6c0b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e713ee640 1 -- 172.21.15.162:0/1621217807 >> 172.21.15.162:0/1621217807 conn(0x7f7e6c0d4050 msgr2=0x7f7e6c0d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:02.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e713ee640 1 -- 172.21.15.162:0/1621217807 shutdown_connections 2024-06-02T23:46:02.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.729+0000 7f7e713ee640 1 -- 172.21.15.162:0/1621217807 wait complete. 2024-06-02T23:46:02.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.731+0000 7f7e713ee640 1 Processor -- start 2024-06-02T23:46:02.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.731+0000 7f7e713ee640 1 -- start start 2024-06-02T23:46:02.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.731+0000 7f7e713ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6c0b4640 0x7f7e6c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.731+0000 7f7e713ee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0b4b50 0x7f7e6c14d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.731+0000 7f7e713ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.731+0000 7f7e713ee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c0cf420 con 0x7f7e6c0b4b50 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.731+0000 7f7e713ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6c0d13b0 con 0x7f7e6c0b4640 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.731+0000 7f7e713ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6c0cf5a0 con 0x7f7e6c0d2630 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.731+0000 7f7e6affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6c0b4640 0x7f7e6c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6c0b4640 0x7f7e6c0c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40102/0 (socket says 172.21.15.162:40102) 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53146/0 (socket says 172.21.15.162:53146) 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6affd640 1 -- 172.21.15.162:0/1826449818 learned_addr learned my addr 172.21.15.162:0/1826449818 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6a7fc640 1 --2- 172.21.15.162:0/1826449818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0b4b50 0x7f7e6c14d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6affd640 1 -- 172.21.15.162:0/1826449818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 msgr2=0x7f7e6c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6affd640 1 --2- 172.21.15.162:0/1826449818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6affd640 1 -- 172.21.15.162:0/1826449818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0b4b50 msgr2=0x7f7e6c14d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6affd640 1 --2- 172.21.15.162:0/1826449818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0b4b50 0x7f7e6c14d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6affd640 1 -- 172.21.15.162:0/1826449818 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6c0c8010 con 0x7f7e6c0b4640 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e6affd640 1 --2- 172.21.15.162:0/1826449818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6c0b4640 0x7f7e6c0c90b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00c400 tx=0x7f7e5c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e637fe640 1 -- 172.21.15.162:0/1826449818 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0052d0 con 0x7f7e6c0b4640 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e637fe640 1 -- 172.21.15.162:0/1826449818 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5c005490 con 0x7f7e6c0b4640 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e713ee640 1 -- 172.21.15.162:0/1826449818 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e6c0c82f0 con 0x7f7e6c0b4640 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e637fe640 1 -- 172.21.15.162:0/1826449818 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c007260 con 0x7f7e6c0b4640 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e713ee640 1 -- 172.21.15.162:0/1826449818 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e6c0c88b0 con 0x7f7e6c0b4640 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e637fe640 1 -- 172.21.15.162:0/1826449818 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7e5c007400 con 0x7f7e6c0b4640 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.732+0000 7f7e637fe640 1 -- 172.21.15.162:0/1826449818 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f7e5c003b20 con 0x7f7e6c0b4640 2024-06-02T23:46:02.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.733+0000 7f7e713ee640 1 -- 172.21.15.162:0/1826449818 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e6c0683e0 con 0x7f7e6c0b4640 2024-06-02T23:46:02.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.737+0000 7f7e637fe640 1 -- 172.21.15.162:0/1826449818 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7e5c0035f0 con 0x7f7e6c0b4640 2024-06-02T23:46:02.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.810+0000 7f7e713ee640 1 -- 172.21.15.162:0/1826449818 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "33afefe9-4fbc-464c-882e-eb7678d89a1c", "id": 1} v 0) -- 0x7f7e6c0d2410 con 0x7f7e6c0b4640 2024-06-02T23:46:02.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.816+0000 7f7e637fe640 1 -- 172.21.15.162:0/1826449818 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "33afefe9-4fbc-464c-882e-eb7678d89a1c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f7e5c003d70 con 0x7f7e6c0b4640 2024-06-02T23:46:02.816 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-06-02T23:46:02.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.816+0000 7f7e713ee640 1 -- 172.21.15.162:0/1826449818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6c0b4640 msgr2=0x7f7e6c0c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.816+0000 7f7e713ee640 1 --2- 172.21.15.162:0/1826449818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6c0b4640 0x7f7e6c0c90b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00c400 tx=0x7f7e5c00c8c0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.816+0000 7f7e713ee640 1 -- 172.21.15.162:0/1826449818 shutdown_connections 2024-06-02T23:46:02.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.816+0000 7f7e713ee640 1 --2- 172.21.15.162:0/1826449818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e6c0d2630 0x7f7e6c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.816+0000 7f7e713ee640 1 --2- 172.21.15.162:0/1826449818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e6c0b4b50 0x7f7e6c14d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.816+0000 7f7e713ee640 1 --2- 172.21.15.162:0/1826449818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e6c0b4640 0x7f7e6c0c90b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.816+0000 7f7e713ee640 1 -- 172.21.15.162:0/1826449818 >> 172.21.15.162:0/1826449818 conn(0x7f7e6c0d4050 msgr2=0x7f7e6c0cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:02.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.816+0000 7f7e713ee640 1 -- 172.21.15.162:0/1826449818 shutdown_connections 2024-06-02T23:46:02.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.817+0000 7f7e713ee640 1 -- 172.21.15.162:0/1826449818 wait complete. 2024-06-02T23:46:02.827 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new c0708c1a-bcbe-4e0b-86ac-582bd12b0999 2 2024-06-02T23:46:02.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.928+0000 7f1bb6b42640 1 Processor -- start 2024-06-02T23:46:02.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.929+0000 7f1bb6b42640 1 -- start start 2024-06-02T23:46:02.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.929+0000 7f1bb6b42640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1bb015e630 0x7f1bb00b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.929+0000 7f1bb6b42640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1bb00b10b0 0x7f1bb00ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.929+0000 7f1bb6b42640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb006c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.929+0000 7f1bb6b42640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb00d10a0 con 0x7f1bb00b10b0 2024-06-02T23:46:02.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.929+0000 7f1bb6b42640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb00d1380 con 0x7f1bb015e630 2024-06-02T23:46:02.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.929+0000 7f1bb6b42640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb00d1660 con 0x7f1bb00cec00 2024-06-02T23:46:02.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1bb50df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb006c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1bb48de640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1bb015e630 0x7f1bb00b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1bb50df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb006c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53154/0 (socket says 172.21.15.162:53154) 2024-06-02T23:46:02.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1bb50df640 1 -- 172.21.15.162:0/3775536092 learned_addr learned my addr 172.21.15.162:0/3775536092 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:02.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1baffff640 1 --2- 172.21.15.162:0/3775536092 >> v2:172.21.15.96:3300/0 conn(0x7f1bb00b10b0 0x7f1bb00ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1bb48de640 1 -- 172.21.15.162:0/3775536092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 msgr2=0x7f1bb006c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:02.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1bb48de640 1 --2- 172.21.15.162:0/3775536092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb006c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1bb48de640 1 -- 172.21.15.162:0/3775536092 >> v2:172.21.15.96:3300/0 conn(0x7f1bb00b10b0 msgr2=0x7f1bb00ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:02.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1bb48de640 1 --2- 172.21.15.162:0/3775536092 >> v2:172.21.15.96:3300/0 conn(0x7f1bb00b10b0 0x7f1bb00ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1bb48de640 1 -- 172.21.15.162:0/3775536092 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb00d1940 con 0x7f1bb015e630 2024-06-02T23:46:02.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.930+0000 7f1bb50df640 1 --2- 172.21.15.162:0/3775536092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb006c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:02.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1bb48de640 1 --2- 172.21.15.162:0/3775536092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bb015e630 0x7f1bb00b0b70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bb00727c0 tx=0x7f1ba402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b13d241b8534cfa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:02.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1baf7fe640 1 -- 172.21.15.162:0/3775536092 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4037070 con 0x7f1bb015e630 2024-06-02T23:46:02.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1baf7fe640 1 -- 172.21.15.162:0/3775536092 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba402add0 con 0x7f1bb015e630 2024-06-02T23:46:02.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1baf7fe640 1 -- 172.21.15.162:0/3775536092 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4032660 con 0x7f1bb015e630 2024-06-02T23:46:02.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1bb6b42640 1 -- 172.21.15.162:0/3775536092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bb015e630 msgr2=0x7f1bb00b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1bb6b42640 1 --2- 172.21.15.162:0/3775536092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bb015e630 0x7f1bb00b0b70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bb00727c0 tx=0x7f1ba402a080 comp rx=0 tx=0).stop 2024-06-02T23:46:02.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1bb6b42640 1 -- 172.21.15.162:0/3775536092 shutdown_connections 2024-06-02T23:46:02.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1bb6b42640 1 --2- 172.21.15.162:0/3775536092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb006c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1bb6b42640 1 --2- 172.21.15.162:0/3775536092 >> v2:172.21.15.96:3300/0 conn(0x7f1bb00b10b0 0x7f1bb00ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1bb6b42640 1 --2- 172.21.15.162:0/3775536092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bb015e630 0x7f1bb00b0b70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1bb6b42640 1 -- 172.21.15.162:0/3775536092 >> 172.21.15.162:0/3775536092 conn(0x7f1bb00d1e40 msgr2=0x7f1bb00d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:02.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.931+0000 7f1bb6b42640 1 -- 172.21.15.162:0/3775536092 shutdown_connections 2024-06-02T23:46:02.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.932+0000 7f1bb6b42640 1 -- 172.21.15.162:0/3775536092 wait complete. 2024-06-02T23:46:02.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.933+0000 7f1bb6b42640 1 Processor -- start 2024-06-02T23:46:02.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.933+0000 7f1bb6b42640 1 -- start start 2024-06-02T23:46:02.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1bb6b42640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00b10b0 0x7f1bb00705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1bb6b42640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb01f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1bb6b42640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bb015e630 0x7f1bb01f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:02.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1bb6b42640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb006cf30 con 0x7f1bb00b10b0 2024-06-02T23:46:02.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1bb6b42640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb006cdb0 con 0x7f1bb015e630 2024-06-02T23:46:02.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1bb6b42640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb006d0b0 con 0x7f1bb00cec00 2024-06-02T23:46:02.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1baffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb01f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1baffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb01f3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53160/0 (socket says 172.21.15.162:53160) 2024-06-02T23:46:02.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1bb50df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bb015e630 0x7f1bb01f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1baffff640 1 -- 172.21.15.162:0/1059287148 learned_addr learned my addr 172.21.15.162:0/1059287148 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:02.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1bb48de640 1 --2- 172.21.15.162:0/1059287148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00b10b0 0x7f1bb00705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:02.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1baffff640 1 -- 172.21.15.162:0/1059287148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bb015e630 msgr2=0x7f1bb01f3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1baffff640 1 --2- 172.21.15.162:0/1059287148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bb015e630 0x7f1bb01f3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1baffff640 1 -- 172.21.15.162:0/1059287148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00b10b0 msgr2=0x7f1bb00705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:02.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1baffff640 1 --2- 172.21.15.162:0/1059287148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00b10b0 0x7f1bb00705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:02.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1baffff640 1 -- 172.21.15.162:0/1059287148 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb00c9f60 con 0x7f1bb00cec00 2024-06-02T23:46:02.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1bb50df640 1 --2- 172.21.15.162:0/1059287148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bb015e630 0x7f1bb01f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:02.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1bb48de640 1 --2- 172.21.15.162:0/1059287148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00b10b0 0x7f1bb00705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:02.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.935+0000 7f1baffff640 1 --2- 172.21.15.162:0/1059287148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb01f3570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00d800 tx=0x7f1b9c00dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:02.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.936+0000 7f1bad7fa640 1 -- 172.21.15.162:0/1059287148 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c018020 con 0x7f1bb00cec00 2024-06-02T23:46:02.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.936+0000 7f1bad7fa640 1 -- 172.21.15.162:0/1059287148 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b9c0096a0 con 0x7f1bb00cec00 2024-06-02T23:46:02.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.936+0000 7f1bb6b42640 1 -- 172.21.15.162:0/1059287148 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb00c66a0 con 0x7f1bb00cec00 2024-06-02T23:46:02.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.936+0000 7f1bad7fa640 1 -- 172.21.15.162:0/1059287148 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c009a70 con 0x7f1bb00cec00 2024-06-02T23:46:02.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.936+0000 7f1bb6b42640 1 -- 172.21.15.162:0/1059287148 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb00c6c60 con 0x7f1bb00cec00 2024-06-02T23:46:02.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.936+0000 7f1bad7fa640 1 -- 172.21.15.162:0/1059287148 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b9c01b020 con 0x7f1bb00cec00 2024-06-02T23:46:02.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.936+0000 7f1bad7fa640 1 -- 172.21.15.162:0/1059287148 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f1b9c01d960 con 0x7f1bb00cec00 2024-06-02T23:46:02.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.937+0000 7f1bb6b42640 1 -- 172.21.15.162:0/1059287148 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb0068af0 con 0x7f1bb00cec00 2024-06-02T23:46:02.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:02.939+0000 7f1bad7fa640 1 -- 172.21.15.162:0/1059287148 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1b9c022020 con 0x7f1bb00cec00 2024-06-02T23:46:03.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.012+0000 7f1bb6b42640 1 -- 172.21.15.162:0/1059287148 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c0708c1a-bcbe-4e0b-86ac-582bd12b0999", "id": 2} v 0) -- 0x7f1bb00cd3d0 con 0x7f1bb00cec00 2024-06-02T23:46:03.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.017+0000 7f1bad7fa640 1 -- 172.21.15.162:0/1059287148 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0708c1a-bcbe-4e0b-86ac-582bd12b0999", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f1b9c01d610 con 0x7f1bb00cec00 2024-06-02T23:46:03.017 INFO:teuthology.orchestra.run.smithi162.stdout:2 2024-06-02T23:46:03.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.017+0000 7f1bb6b42640 1 -- 172.21.15.162:0/1059287148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 msgr2=0x7f1bb01f3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.017+0000 7f1bb6b42640 1 --2- 172.21.15.162:0/1059287148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb01f3570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00d800 tx=0x7f1b9c00dcc0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.018+0000 7f1bb6b42640 1 -- 172.21.15.162:0/1059287148 shutdown_connections 2024-06-02T23:46:03.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.018+0000 7f1bb6b42640 1 --2- 172.21.15.162:0/1059287148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bb015e630 0x7f1bb01f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.018+0000 7f1bb6b42640 1 --2- 172.21.15.162:0/1059287148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bb00cec00 0x7f1bb01f3570 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.018+0000 7f1bb6b42640 1 --2- 172.21.15.162:0/1059287148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bb00b10b0 0x7f1bb00705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.018+0000 7f1bb6b42640 1 -- 172.21.15.162:0/1059287148 >> 172.21.15.162:0/1059287148 conn(0x7f1bb00d1e40 msgr2=0x7f1bb00cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:03.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.018+0000 7f1bb6b42640 1 -- 172.21.15.162:0/1059287148 shutdown_connections 2024-06-02T23:46:03.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.018+0000 7f1bb6b42640 1 -- 172.21.15.162:0/1059287148 wait complete. 2024-06-02T23:46:03.028 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 3ccf5232-d50c-40f1-985c-cd5b36e1dffd 3 2024-06-02T23:46:03.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.130+0000 7f1eca6bd640 1 Processor -- start 2024-06-02T23:46:03.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.130+0000 7f1eca6bd640 1 -- start start 2024-06-02T23:46:03.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.130+0000 7f1eca6bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0430 0x7f1ec406f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.130+0000 7f1eca6bd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1ec4072b60 0x7f1ec406b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.130+0000 7f1eca6bd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec40ceff0 con 0x7f1ec40b0050 2024-06-02T23:46:03.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.130+0000 7f1eca6bd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f1ec40d0490 con 0x7f1ec4072b60 2024-06-02T23:46:03.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.130+0000 7f1eca6bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec406f960 con 0x7f1ec40b0430 2024-06-02T23:46:03.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.131+0000 7f1ec37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0430 0x7f1ec406f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.131+0000 7f1ec37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0430 0x7f1ec406f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53174/0 (socket says 172.21.15.162:53174) 2024-06-02T23:46:03.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.131+0000 7f1ec37fe640 1 -- 172.21.15.162:0/3453738603 learned_addr learned my addr 172.21.15.162:0/3453738603 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:03.132 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.131+0000 7f1ec8c5a640 1 --2- 172.21.15.162:0/3453738603 >> v2:172.21.15.96:3300/0 conn(0x7f1ec4072b60 0x7f1ec406b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.131+0000 7f1ec37fe640 1 -- 172.21.15.162:0/3453738603 >> v2:172.21.15.96:3300/0 conn(0x7f1ec4072b60 msgr2=0x7f1ec406b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:03.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.131+0000 7f1ec37fe640 1 --2- 172.21.15.162:0/3453738603 >> v2:172.21.15.96:3300/0 conn(0x7f1ec4072b60 0x7f1ec406b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.131+0000 7f1ec37fe640 1 -- 172.21.15.162:0/3453738603 >> v1:172.21.15.96:6789/0 conn(0x7f1ec40b0050 legacy=0x7f1ec40cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.131+0000 7f1ec37fe640 1 -- 172.21.15.162:0/3453738603 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec40d06f0 con 0x7f1ec40b0430 2024-06-02T23:46:03.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1ec37fe640 1 --2- 172.21.15.162:0/3453738603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0430 0x7f1ec406f420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009870 tx=0x7f1eb802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a78efad299b0f169 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:03.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1ec2ffd640 1 -- 172.21.15.162:0/3453738603 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8037070 con 0x7f1ec40b0430 2024-06-02T23:46:03.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1ec2ffd640 1 -- 172.21.15.162:0/3453738603 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb8032440 con 0x7f1ec40b0430 2024-06-02T23:46:03.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1ec2ffd640 1 -- 172.21.15.162:0/3453738603 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8032810 con 0x7f1ec40b0430 2024-06-02T23:46:03.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3453738603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0430 msgr2=0x7f1ec406f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1eca6bd640 1 --2- 172.21.15.162:0/3453738603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0430 0x7f1ec406f420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009870 tx=0x7f1eb802a1c0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3453738603 shutdown_connections 2024-06-02T23:46:03.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1eca6bd640 1 --2- 172.21.15.162:0/3453738603 >> v2:172.21.15.96:3300/0 conn(0x7f1ec4072b60 0x7f1ec406b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1eca6bd640 1 --2- 172.21.15.162:0/3453738603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0430 0x7f1ec406f420 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3453738603 >> 172.21.15.162:0/3453738603 conn(0x7f1ec40d0d60 msgr2=0x7f1ec40d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:03.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3453738603 shutdown_connections 2024-06-02T23:46:03.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.132+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3453738603 wait complete. 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.134+0000 7f1eca6bd640 1 Processor -- start 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.134+0000 7f1eca6bd640 1 -- start start 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.134+0000 7f1eca6bd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec4072b60 0x7f1ec415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1eca6bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0050 0x7f1ec40b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1eca6bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec40b4d60 0x7f1ec414e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1eca6bd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec40cec10 con 0x7f1ec4072b60 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1eca6bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec40ce930 con 0x7f1ec40b4d60 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1eca6bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec406b900 con 0x7f1ec40b0050 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0050 0x7f1ec40b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0050 0x7f1ec40b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53178/0 (socket says 172.21.15.162:53178) 2024-06-02T23:46:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec37fe640 1 -- 172.21.15.162:0/3405007999 learned_addr learned my addr 172.21.15.162:0/3405007999 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec8c5a640 1 --2- 172.21.15.162:0/3405007999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec40b4d60 0x7f1ec414e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec3fff640 1 --2- 172.21.15.162:0/3405007999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec4072b60 0x7f1ec415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec37fe640 1 -- 172.21.15.162:0/3405007999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec40b4d60 msgr2=0x7f1ec414e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec37fe640 1 --2- 172.21.15.162:0/3405007999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec40b4d60 0x7f1ec414e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec37fe640 1 -- 172.21.15.162:0/3405007999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec4072b60 msgr2=0x7f1ec415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec37fe640 1 --2- 172.21.15.162:0/3405007999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec4072b60 0x7f1ec415ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec37fe640 1 -- 172.21.15.162:0/3405007999 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec40b51f0 con 0x7f1ec40b0050 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec37fe640 1 --2- 172.21.15.162:0/3405007999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0050 0x7f1ec40b6290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1eb802a200 tx=0x7f1eb80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec0ff9640 1 -- 172.21.15.162:0/3405007999 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8041030 con 0x7f1ec40b0050 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec0ff9640 1 -- 172.21.15.162:0/3405007999 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb8030440 con 0x7f1ec40b0050 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3405007999 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec40b54d0 con 0x7f1ec40b0050 2024-06-02T23:46:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1ec0ff9640 1 -- 172.21.15.162:0/3405007999 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8037040 con 0x7f1ec40b0050 2024-06-02T23:46:03.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.135+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3405007999 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec40b5a90 con 0x7f1ec40b0050 2024-06-02T23:46:03.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.136+0000 7f1ec0ff9640 1 -- 172.21.15.162:0/3405007999 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1eb8044070 con 0x7f1ec40b0050 2024-06-02T23:46:03.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.136+0000 7f1ec0ff9640 1 -- 172.21.15.162:0/3405007999 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1eb803dae0 con 0x7f1ec40b0050 2024-06-02T23:46:03.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.136+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3405007999 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec4068af0 con 0x7f1ec40b0050 2024-06-02T23:46:03.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.138+0000 7f1ec0ff9640 1 -- 172.21.15.162:0/3405007999 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1eb803dd80 con 0x7f1ec40b0050 2024-06-02T23:46:03.255 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:03.256+0000 7f2d4f20f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:46:03.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.280+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3405007999 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3ccf5232-d50c-40f1-985c-cd5b36e1dffd", "id": 3} v 0) -- 0x7f1ec40c7440 con 0x7f1ec40b0050 2024-06-02T23:46:03.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.285+0000 7f1ec0ff9640 1 -- 172.21.15.162:0/3405007999 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ccf5232-d50c-40f1-985c-cd5b36e1dffd", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1eb803d650 con 0x7f1ec40b0050 2024-06-02T23:46:03.285 INFO:teuthology.orchestra.run.smithi162.stdout:3 2024-06-02T23:46:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.286+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3405007999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0050 msgr2=0x7f1ec40b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.286+0000 7f1eca6bd640 1 --2- 172.21.15.162:0/3405007999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0050 0x7f1ec40b6290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1eb802a200 tx=0x7f1eb80046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.286+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3405007999 shutdown_connections 2024-06-02T23:46:03.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.286+0000 7f1eca6bd640 1 --2- 172.21.15.162:0/3405007999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec40b4d60 0x7f1ec414e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.286+0000 7f1eca6bd640 1 --2- 172.21.15.162:0/3405007999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ec40b0050 0x7f1ec40b6290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.286+0000 7f1eca6bd640 1 --2- 172.21.15.162:0/3405007999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ec4072b60 0x7f1ec415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.286+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3405007999 >> 172.21.15.162:0/3405007999 conn(0x7f1ec40d0d60 msgr2=0x7f1ec40cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.286+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3405007999 shutdown_connections 2024-06-02T23:46:03.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.286+0000 7f1eca6bd640 1 -- 172.21.15.162:0/3405007999 wait complete. 2024-06-02T23:46:03.298 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 0e9f0793-389a-4bae-b84a-147786827665 4 2024-06-02T23:46:03.342 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:03.342+0000 7f2d4f20f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:46:03.384 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:03.384+0000 7f2d4f20f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:46:03.390 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:03.390+0000 7facb5b60040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:46:03.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.402+0000 7f0945a3f640 1 Processor -- start 2024-06-02T23:46:03.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.402+0000 7f0945a3f640 1 -- start start 2024-06-02T23:46:03.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f0945a3f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f094015e490 0x7f09400d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f0945a3f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f09400b21e0 0x7f09400d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f0945a3f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09400d1310 con 0x7f09400d4ba0 2024-06-02T23:46:03.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f0945a3f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f09400d10c0 con 0x7f09400b21e0 2024-06-02T23:46:03.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f0945a3f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f09400b0d40 con 0x7f094015e490 2024-06-02T23:46:03.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f093effd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f094015e490 0x7f09400d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f093effd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f094015e490 0x7f09400d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40128/0 (socket says 172.21.15.162:40128) 2024-06-02T23:46:03.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f093effd640 1 -- 172.21.15.162:0/1221007140 learned_addr learned my addr 172.21.15.162:0/1221007140 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:03.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f093f7fe640 1 --2- 172.21.15.162:0/1221007140 >> v2:172.21.15.96:3300/0 conn(0x7f09400b21e0 0x7f09400d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f093effd640 1 -- 172.21.15.162:0/1221007140 >> v2:172.21.15.96:3300/0 conn(0x7f09400b21e0 msgr2=0x7f09400d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:03.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f093effd640 1 --2- 172.21.15.162:0/1221007140 >> v2:172.21.15.96:3300/0 conn(0x7f09400b21e0 0x7f09400d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f093effd640 1 -- 172.21.15.162:0/1221007140 >> v1:172.21.15.96:6789/0 conn(0x7f09400d4ba0 legacy=0x7f09400ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.403+0000 7f093effd640 1 -- 172.21.15.162:0/1221007140 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09400d15f0 con 0x7f094015e490 2024-06-02T23:46:03.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.404+0000 7f093effd640 1 --2- 172.21.15.162:0/1221007140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f094015e490 0x7f09400d2660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0940067c00 tx=0x7f093002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=875a66e962cd9261 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:03.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.404+0000 7f093dffb640 1 -- 172.21.15.162:0/1221007140 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930037070 con 0x7f094015e490 2024-06-02T23:46:03.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.404+0000 7f093dffb640 1 -- 172.21.15.162:0/1221007140 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0930032440 con 0x7f094015e490 2024-06-02T23:46:03.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.404+0000 7f093dffb640 1 -- 172.21.15.162:0/1221007140 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930032810 con 0x7f094015e490 2024-06-02T23:46:03.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.405+0000 7f0945a3f640 1 -- 172.21.15.162:0/1221007140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f094015e490 msgr2=0x7f09400d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.405+0000 7f0945a3f640 1 --2- 172.21.15.162:0/1221007140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f094015e490 0x7f09400d2660 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0940067c00 tx=0x7f093002a1e0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.405+0000 7f0945a3f640 1 -- 172.21.15.162:0/1221007140 shutdown_connections 2024-06-02T23:46:03.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.405+0000 7f0945a3f640 1 --2- 172.21.15.162:0/1221007140 >> v2:172.21.15.96:3300/0 conn(0x7f09400b21e0 0x7f09400d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.405+0000 7f0945a3f640 1 --2- 172.21.15.162:0/1221007140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f094015e490 0x7f09400d2660 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.405+0000 7f0945a3f640 1 -- 172.21.15.162:0/1221007140 >> 172.21.15.162:0/1221007140 conn(0x7f09400d4080 msgr2=0x7f09400d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:03.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.405+0000 7f0945a3f640 1 -- 172.21.15.162:0/1221007140 shutdown_connections 2024-06-02T23:46:03.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.405+0000 7f0945a3f640 1 -- 172.21.15.162:0/1221007140 wait complete. 2024-06-02T23:46:03.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.406+0000 7f0945a3f640 1 Processor -- start 2024-06-02T23:46:03.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.406+0000 7f0945a3f640 1 -- start start 2024-06-02T23:46:03.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f0945a3f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09400b21e0 0x7f09401540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f0945a3f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09400d4ba0 0x7f09400c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f0945a3f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094015e490 0x7f09400c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f0945a3f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f09400d2020 con 0x7f094015e490 2024-06-02T23:46:03.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f0945a3f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f094015e870 con 0x7f09400b21e0 2024-06-02T23:46:03.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f0945a3f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f09400d21a0 con 0x7f09400d4ba0 2024-06-02T23:46:03.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f093e7fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09400d4ba0 0x7f09400c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f093effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09400b21e0 0x7f09401540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f093e7fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09400d4ba0 0x7f09400c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53184/0 (socket says 172.21.15.162:53184) 2024-06-02T23:46:03.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f093e7fc640 1 -- 172.21.15.162:0/1956197399 learned_addr learned my addr 172.21.15.162:0/1956197399 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f093f7fe640 1 --2- 172.21.15.162:0/1956197399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094015e490 0x7f09400c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f093e7fc640 1 -- 172.21.15.162:0/1956197399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09400b21e0 msgr2=0x7f09401540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f093e7fc640 1 --2- 172.21.15.162:0/1956197399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09400b21e0 0x7f09401540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f093e7fc640 1 -- 172.21.15.162:0/1956197399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094015e490 msgr2=0x7f09400c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f093e7fc640 1 --2- 172.21.15.162:0/1956197399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094015e490 0x7f09400c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.407+0000 7f093e7fc640 1 -- 172.21.15.162:0/1956197399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094015eb70 con 0x7f09400d4ba0 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.408+0000 7f093e7fc640 1 --2- 172.21.15.162:0/1956197399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09400d4ba0 0x7f09400c9940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f093400c400 tx=0x7f093400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.408+0000 7f0927fff640 1 -- 172.21.15.162:0/1956197399 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09340052d0 con 0x7f09400d4ba0 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.408+0000 7f0927fff640 1 -- 172.21.15.162:0/1956197399 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0934005490 con 0x7f09400d4ba0 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.408+0000 7f0927fff640 1 -- 172.21.15.162:0/1956197399 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934007260 con 0x7f09400d4ba0 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.408+0000 7f0945a3f640 1 -- 172.21.15.162:0/1956197399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094015ee30 con 0x7f09400d4ba0 2024-06-02T23:46:03.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.408+0000 7f0945a3f640 1 -- 172.21.15.162:0/1956197399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09401549a0 con 0x7f09400d4ba0 2024-06-02T23:46:03.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.408+0000 7f0927fff640 1 -- 172.21.15.162:0/1956197399 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0934007400 con 0x7f09400d4ba0 2024-06-02T23:46:03.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.408+0000 7f0927fff640 1 -- 172.21.15.162:0/1956197399 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f0934011590 con 0x7f09400d4ba0 2024-06-02T23:46:03.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.409+0000 7f0945a3f640 1 -- 172.21.15.162:0/1956197399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09400ce4b0 con 0x7f09400d4ba0 2024-06-02T23:46:03.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.411+0000 7f0927fff640 1 -- 172.21.15.162:0/1956197399 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f09400ce4b0 con 0x7f09400d4ba0 2024-06-02T23:46:03.482 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:03.482+0000 7facb5b60040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:46:03.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.483+0000 7f0945a3f640 1 -- 172.21.15.162:0/1956197399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0e9f0793-389a-4bae-b84a-147786827665", "id": 4} v 0) -- 0x7f09400683e0 con 0x7f09400d4ba0 2024-06-02T23:46:03.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.489+0000 7f0927fff640 1 -- 172.21.15.162:0/1956197399 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e9f0793-389a-4bae-b84a-147786827665", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f0934003a50 con 0x7f09400d4ba0 2024-06-02T23:46:03.489 INFO:teuthology.orchestra.run.smithi162.stdout:4 2024-06-02T23:46:03.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.490+0000 7f0945a3f640 1 -- 172.21.15.162:0/1956197399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09400d4ba0 msgr2=0x7f09400c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.490+0000 7f0945a3f640 1 --2- 172.21.15.162:0/1956197399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09400d4ba0 0x7f09400c9940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f093400c400 tx=0x7f093400c8c0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.490+0000 7f0945a3f640 1 -- 172.21.15.162:0/1956197399 shutdown_connections 2024-06-02T23:46:03.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.490+0000 7f0945a3f640 1 --2- 172.21.15.162:0/1956197399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f094015e490 0x7f09400c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.490+0000 7f0945a3f640 1 --2- 172.21.15.162:0/1956197399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09400d4ba0 0x7f09400c9940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.490+0000 7f0945a3f640 1 --2- 172.21.15.162:0/1956197399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09400b21e0 0x7f09401540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.490+0000 7f0945a3f640 1 -- 172.21.15.162:0/1956197399 >> 172.21.15.162:0/1956197399 conn(0x7f09400d4080 msgr2=0x7f09400cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:03.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.490+0000 7f0945a3f640 1 -- 172.21.15.162:0/1956197399 shutdown_connections 2024-06-02T23:46:03.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.490+0000 7f0945a3f640 1 -- 172.21.15.162:0/1956197399 wait complete. 2024-06-02T23:46:03.501 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new f0c4a207-fec0-4a99-b751-4d5dcb3fddd9 5 2024-06-02T23:46:03.529 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:03.530+0000 7facb5b60040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:46:03.548 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:03.549+0000 7f2d4f20f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:46:03.594 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:03.595+0000 7f2d4f20f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:46:03.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.600+0000 7fa916309640 1 Processor -- start 2024-06-02T23:46:03.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.600+0000 7fa916309640 1 -- start start 2024-06-02T23:46:03.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa916309640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa916309640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa9100b4b50 0x7fa9100b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa916309640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9100b73e0 con 0x7fa9100d2630 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa916309640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa9100d4ff0 con 0x7fa9100b4b50 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa916309640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9100cec60 con 0x7fa9100b4640 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa90ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa90ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53198/0 (socket says 172.21.15.162:53198) 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa90f7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa9100b4b50 0x7fa9100b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa90ffff640 1 -- 172.21.15.162:0/2488709701 learned_addr learned my addr 172.21.15.162:0/2488709701 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa90ffff640 1 -- 172.21.15.162:0/2488709701 >> v2:172.21.15.162:3300/0 conn(0x7fa9100b4b50 msgr2=0x7fa9100b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa90ffff640 1 --2- 172.21.15.162:0/2488709701 >> v2:172.21.15.162:3300/0 conn(0x7fa9100b4b50 0x7fa9100b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa90ffff640 1 -- 172.21.15.162:0/2488709701 >> v1:172.21.15.96:6789/0 conn(0x7fa9100d2630 legacy=0x7fa9100cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.601+0000 7fa90ffff640 1 -- 172.21.15.162:0/2488709701 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9100d1fd0 con 0x7fa9100b4640 2024-06-02T23:46:03.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.602+0000 7fa90ffff640 1 --2- 172.21.15.162:0/2488709701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b6ea0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa900009870 tx=0x7fa90002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e5935702c4d58f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:03.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.602+0000 7fa90effd640 1 -- 172.21.15.162:0/2488709701 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900037070 con 0x7fa9100b4640 2024-06-02T23:46:03.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.602+0000 7fa90effd640 1 -- 172.21.15.162:0/2488709701 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa900032440 con 0x7fa9100b4640 2024-06-02T23:46:03.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.602+0000 7fa90effd640 1 -- 172.21.15.162:0/2488709701 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900032810 con 0x7fa9100b4640 2024-06-02T23:46:03.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.603+0000 7fa916309640 1 -- 172.21.15.162:0/2488709701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 msgr2=0x7fa9100b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.603+0000 7fa916309640 1 --2- 172.21.15.162:0/2488709701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b6ea0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa900009870 tx=0x7fa90002a1c0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.604 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.603+0000 7fa916309640 1 -- 172.21.15.162:0/2488709701 shutdown_connections 2024-06-02T23:46:03.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.603+0000 7fa916309640 1 --2- 172.21.15.162:0/2488709701 >> v2:172.21.15.162:3300/0 conn(0x7fa9100b4b50 0x7fa9100b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.603+0000 7fa916309640 1 --2- 172.21.15.162:0/2488709701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b6ea0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.603+0000 7fa916309640 1 -- 172.21.15.162:0/2488709701 >> 172.21.15.162:0/2488709701 conn(0x7fa9100d4050 msgr2=0x7fa9100d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:03.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.603+0000 7fa916309640 1 -- 172.21.15.162:0/2488709701 shutdown_connections 2024-06-02T23:46:03.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.603+0000 7fa916309640 1 -- 172.21.15.162:0/2488709701 wait complete. 2024-06-02T23:46:03.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.604+0000 7fa916309640 1 Processor -- start 2024-06-02T23:46:03.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.604+0000 7fa916309640 1 -- start start 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa916309640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa916309640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9100b4b50 0x7fa91015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa916309640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9100d2630 0x7fa9101f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa916309640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa9100d13b0 con 0x7fa9100d2630 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa916309640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9100cef00 con 0x7fa9100b4b50 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa916309640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9100d2ac0 con 0x7fa9100b4640 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9100b4b50 0x7fa91015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9100b4b50 0x7fa91015b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40156/0 (socket says 172.21.15.162:40156) 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90f7fe640 1 -- 172.21.15.162:0/396796034 learned_addr learned my addr 172.21.15.162:0/396796034 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:03.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53206/0 (socket says 172.21.15.162:53206) 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa9148a6640 1 --2- 172.21.15.162:0/396796034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9100d2630 0x7fa9101f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90ffff640 1 -- 172.21.15.162:0/396796034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9100b4b50 msgr2=0x7fa91015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90ffff640 1 --2- 172.21.15.162:0/396796034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9100b4b50 0x7fa91015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90ffff640 1 -- 172.21.15.162:0/396796034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9100d2630 msgr2=0x7fa9101f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90ffff640 1 --2- 172.21.15.162:0/396796034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9100d2630 0x7fa9101f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90ffff640 1 -- 172.21.15.162:0/396796034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9101f5460 con 0x7fa9100b4640 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.605+0000 7fa90f7fe640 1 --2- 172.21.15.162:0/396796034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9100b4b50 0x7fa91015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.606+0000 7fa90ffff640 1 --2- 172.21.15.162:0/396796034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b1d40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa900031000 tx=0x7fa9000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.606+0000 7fa90cff9640 1 -- 172.21.15.162:0/396796034 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900041070 con 0x7fa9100b4640 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.606+0000 7fa90cff9640 1 -- 172.21.15.162:0/396796034 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90003c870 con 0x7fa9100b4640 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.606+0000 7fa916309640 1 -- 172.21.15.162:0/396796034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9101f4b30 con 0x7fa9100b4640 2024-06-02T23:46:03.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.606+0000 7fa90cff9640 1 -- 172.21.15.162:0/396796034 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900037040 con 0x7fa9100b4640 2024-06-02T23:46:03.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.606+0000 7fa916309640 1 -- 172.21.15.162:0/396796034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9101f50f0 con 0x7fa9100b4640 2024-06-02T23:46:03.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.606+0000 7fa90cff9640 1 -- 172.21.15.162:0/396796034 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa900044070 con 0x7fa9100b4640 2024-06-02T23:46:03.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.606+0000 7fa90cff9640 1 -- 172.21.15.162:0/396796034 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa900046450 con 0x7fa9100b4640 2024-06-02T23:46:03.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.607+0000 7fa916309640 1 -- 172.21.15.162:0/396796034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9100683e0 con 0x7fa9100b4640 2024-06-02T23:46:03.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.609+0000 7fa90cff9640 1 -- 172.21.15.162:0/396796034 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa90003cc40 con 0x7fa9100b4640 2024-06-02T23:46:03.647 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:03.647+0000 7f2d4f20f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:46:03.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.681+0000 7fa916309640 1 -- 172.21.15.162:0/396796034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f0c4a207-fec0-4a99-b751-4d5dcb3fddd9", "id": 5} v 0) -- 0x7fa9100ce150 con 0x7fa9100b4640 2024-06-02T23:46:03.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.686+0000 7fa90cff9640 1 -- 172.21.15.162:0/396796034 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0c4a207-fec0-4a99-b751-4d5dcb3fddd9", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa90003ce20 con 0x7fa9100b4640 2024-06-02T23:46:03.686 INFO:teuthology.orchestra.run.smithi162.stdout:5 2024-06-02T23:46:03.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.687+0000 7fa916309640 1 -- 172.21.15.162:0/396796034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 msgr2=0x7fa9100b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.687+0000 7fa916309640 1 --2- 172.21.15.162:0/396796034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b1d40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa900031000 tx=0x7fa9000046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.687+0000 7fa916309640 1 -- 172.21.15.162:0/396796034 shutdown_connections 2024-06-02T23:46:03.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.687+0000 7fa916309640 1 --2- 172.21.15.162:0/396796034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9100d2630 0x7fa9101f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.687+0000 7fa916309640 1 --2- 172.21.15.162:0/396796034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9100b4b50 0x7fa91015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.687+0000 7fa916309640 1 --2- 172.21.15.162:0/396796034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9100b4640 0x7fa9100b1d40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.687+0000 7fa916309640 1 -- 172.21.15.162:0/396796034 >> 172.21.15.162:0/396796034 conn(0x7fa9100d4050 msgr2=0x7fa91006cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:03.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.688+0000 7fa916309640 1 -- 172.21.15.162:0/396796034 shutdown_connections 2024-06-02T23:46:03.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.688+0000 7fa916309640 1 -- 172.21.15.162:0/396796034 wait complete. 2024-06-02T23:46:03.698 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 6c2b64d7-c956-43cf-8723-92ae977adffc 6 2024-06-02T23:46:03.706 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:03.706+0000 7facb5b60040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:46:03.757 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:03.757+0000 7facb5b60040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:46:03.758 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:03.758+0000 7f2d4f20f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:46:03.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.805+0000 7fcef4534640 1 Processor -- start 2024-06-02T23:46:03.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.805+0000 7fcef4534640 1 -- start start 2024-06-02T23:46:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.806+0000 7fcef4534640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fceec15e130 0x7fceec06d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.806+0000 7fcef4534640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.806+0000 7fcef4534640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fceec06f4a0 0x7fceec06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.806+0000 7fcef4534640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fceec06dec0 con 0x7fceec15e130 2024-06-02T23:46:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.806+0000 7fcef4534640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fceec06e1a0 con 0x7fceec06f4a0 2024-06-02T23:46:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.806+0000 7fcef4534640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fceec06e480 con 0x7fceec0ae0c0 2024-06-02T23:46:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef1acf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef2ad1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fceec06f4a0 0x7fceec06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef1acf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec06ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53220/0 (socket says 172.21.15.162:53220) 2024-06-02T23:46:03.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef1acf640 1 -- 172.21.15.162:0/2644962733 learned_addr learned my addr 172.21.15.162:0/2644962733 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef22d0640 1 --2- 172.21.15.162:0/2644962733 >> v2:172.21.15.96:3300/0 conn(0x7fceec15e130 0x7fceec06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef1acf640 1 -- 172.21.15.162:0/2644962733 >> v2:172.21.15.162:3300/0 conn(0x7fceec06f4a0 msgr2=0x7fceec06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef1acf640 1 --2- 172.21.15.162:0/2644962733 >> v2:172.21.15.162:3300/0 conn(0x7fceec06f4a0 0x7fceec06c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef1acf640 1 -- 172.21.15.162:0/2644962733 >> v2:172.21.15.96:3300/0 conn(0x7fceec15e130 msgr2=0x7fceec06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef1acf640 1 --2- 172.21.15.162:0/2644962733 >> v2:172.21.15.96:3300/0 conn(0x7fceec15e130 0x7fceec06d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef1acf640 1 -- 172.21.15.162:0/2644962733 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec06e760 con 0x7fceec0ae0c0 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.807+0000 7fcef2ad1640 1 --2- 172.21.15.162:0/2644962733 >> v2:172.21.15.162:3300/0 conn(0x7fceec06f4a0 0x7fceec06c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.808+0000 7fcef1acf640 1 --2- 172.21.15.162:0/2644962733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec06ef60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fceec0d0050 tx=0x7fcee802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aeca228ff628a2e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.808+0000 7fcef12ce640 1 -- 172.21.15.162:0/2644962733 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8037070 con 0x7fceec0ae0c0 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.808+0000 7fcef12ce640 1 -- 172.21.15.162:0/2644962733 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee8032440 con 0x7fceec0ae0c0 2024-06-02T23:46:03.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.808+0000 7fcef12ce640 1 -- 172.21.15.162:0/2644962733 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8032810 con 0x7fceec0ae0c0 2024-06-02T23:46:03.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.808+0000 7fcef4534640 1 -- 172.21.15.162:0/2644962733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 msgr2=0x7fceec06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.808+0000 7fcef4534640 1 --2- 172.21.15.162:0/2644962733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec06ef60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fceec0d0050 tx=0x7fcee802a1e0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.809+0000 7fcef4534640 1 -- 172.21.15.162:0/2644962733 shutdown_connections 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.809+0000 7fcef4534640 1 --2- 172.21.15.162:0/2644962733 >> v2:172.21.15.162:3300/0 conn(0x7fceec06f4a0 0x7fceec06c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.809+0000 7fcef4534640 1 --2- 172.21.15.162:0/2644962733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec06ef60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.809+0000 7fcef4534640 1 --2- 172.21.15.162:0/2644962733 >> v2:172.21.15.96:3300/0 conn(0x7fceec15e130 0x7fceec06d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.809+0000 7fcef4534640 1 -- 172.21.15.162:0/2644962733 >> 172.21.15.162:0/2644962733 conn(0x7fceec0717b0 msgr2=0x7fceec071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.809+0000 7fcef4534640 1 -- 172.21.15.162:0/2644962733 shutdown_connections 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.809+0000 7fcef4534640 1 -- 172.21.15.162:0/2644962733 wait complete. 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.810+0000 7fcef4534640 1 Processor -- start 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.810+0000 7fcef4534640 1 -- start start 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.810+0000 7fcef4534640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.810+0000 7fcef4534640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceec15e130 0x7fceec161120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.810+0000 7fcef4534640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceec151040 0x7fceec1f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:03.813 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.810+0000 7fcef4534640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fceec15e510 con 0x7fceec15e130 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.810+0000 7fcef4534640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fceec06dbb0 con 0x7fceec151040 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.810+0000 7fcef4534640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fceec15e690 con 0x7fceec0ae0c0 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef22d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef2ad1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceec151040 0x7fceec1f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef22d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec14ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53230/0 (socket says 172.21.15.162:53230) 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef22d0640 1 -- 172.21.15.162:0/1135350363 learned_addr learned my addr 172.21.15.162:0/1135350363 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef1acf640 1 --2- 172.21.15.162:0/1135350363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceec15e130 0x7fceec161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef2ad1640 1 -- 172.21.15.162:0/1135350363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 msgr2=0x7fceec14ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef2ad1640 1 --2- 172.21.15.162:0/1135350363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec14ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef2ad1640 1 -- 172.21.15.162:0/1135350363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceec15e130 msgr2=0x7fceec161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef2ad1640 1 --2- 172.21.15.162:0/1135350363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceec15e130 0x7fceec161120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef2ad1640 1 -- 172.21.15.162:0/1135350363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec0b3ce0 con 0x7fceec151040 2024-06-02T23:46:03.814 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef2ad1640 1 --2- 172.21.15.162:0/1135350363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceec151040 0x7fceec1f7c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcee400eea0 tx=0x7fcee400ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:03.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcee2ffd640 1 -- 172.21.15.162:0/1135350363 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4018030 con 0x7fceec151040 2024-06-02T23:46:03.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcee2ffd640 1 -- 172.21.15.162:0/1135350363 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee400bcb0 con 0x7fceec151040 2024-06-02T23:46:03.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef4534640 1 -- 172.21.15.162:0/1135350363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceec161660 con 0x7fceec151040 2024-06-02T23:46:03.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcee2ffd640 1 -- 172.21.15.162:0/1135350363 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee400be60 con 0x7fceec151040 2024-06-02T23:46:03.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcef4534640 1 -- 172.21.15.162:0/1135350363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceec151b80 con 0x7fceec151040 2024-06-02T23:46:03.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcee2ffd640 1 -- 172.21.15.162:0/1135350363 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcee4005d10 con 0x7fceec151040 2024-06-02T23:46:03.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.811+0000 7fcee2ffd640 1 -- 172.21.15.162:0/1135350363 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fcee40149f0 con 0x7fceec151040 2024-06-02T23:46:03.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.812+0000 7fcef4534640 1 -- 172.21.15.162:0/1135350363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceec068af0 con 0x7fceec151040 2024-06-02T23:46:03.815 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:03.813+0000 7facb5b60040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:46:03.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.814+0000 7fcee2ffd640 1 -- 172.21.15.162:0/1135350363 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcee4022070 con 0x7fceec151040 2024-06-02T23:46:03.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.886+0000 7fcef4534640 1 -- 172.21.15.162:0/1135350363 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6c2b64d7-c956-43cf-8723-92ae977adffc", "id": 6} v 0) -- 0x7fceec0adc90 con 0x7fceec151040 2024-06-02T23:46:03.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.891+0000 7fcee2ffd640 1 -- 172.21.15.162:0/1135350363 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6c2b64d7-c956-43cf-8723-92ae977adffc", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fcee4014e00 con 0x7fceec151040 2024-06-02T23:46:03.891 INFO:teuthology.orchestra.run.smithi162.stdout:6 2024-06-02T23:46:03.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.892+0000 7fcef4534640 1 -- 172.21.15.162:0/1135350363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceec151040 msgr2=0x7fceec1f7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:03.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.892+0000 7fcef4534640 1 --2- 172.21.15.162:0/1135350363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceec151040 0x7fceec1f7c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcee400eea0 tx=0x7fcee400ef90 comp rx=0 tx=0).stop 2024-06-02T23:46:03.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.892+0000 7fcef4534640 1 -- 172.21.15.162:0/1135350363 shutdown_connections 2024-06-02T23:46:03.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.892+0000 7fcef4534640 1 --2- 172.21.15.162:0/1135350363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fceec151040 0x7fceec1f7c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.892+0000 7fcef4534640 1 --2- 172.21.15.162:0/1135350363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fceec15e130 0x7fceec161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.892+0000 7fcef4534640 1 --2- 172.21.15.162:0/1135350363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fceec0ae0c0 0x7fceec14ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:03.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.892+0000 7fcef4534640 1 -- 172.21.15.162:0/1135350363 >> 172.21.15.162:0/1135350363 conn(0x7fceec0717b0 msgr2=0x7fceec0b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:03.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.892+0000 7fcef4534640 1 -- 172.21.15.162:0/1135350363 shutdown_connections 2024-06-02T23:46:03.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:03.892+0000 7fcef4534640 1 -- 172.21.15.162:0/1135350363 wait complete. 2024-06-02T23:46:03.902 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 4b4aae57-776c-4afa-a0f8-04e41a4fabb8 7 2024-06-02T23:46:03.934 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:03.934+0000 7facb5b60040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:46:04.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.003+0000 7f84f9ff4640 1 Processor -- start 2024-06-02T23:46:04.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.003+0000 7f84f9ff4640 1 -- start start 2024-06-02T23:46:04.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.004+0000 7f84f9ff4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f84f40afef0 0x7f84f40ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:04.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.004+0000 7f84f9ff4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f40d2a00 con 0x7f84f40b0ec0 2024-06-02T23:46:04.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.004+0000 7f84f9ff4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f40d2ce0 con 0x7f84f40ce890 2024-06-02T23:46:04.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.004+0000 7f84f9ff4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f84f40aea50 con 0x7f84f40afef0 2024-06-02T23:46:04.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.004+0000 7f84f2ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f84f40afef0 0x7f84f40ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:04.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.004+0000 7f84f2ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f84f40afef0 0x7f84f40ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40180/0 (socket says 172.21.15.162:40180) 2024-06-02T23:46:04.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.004+0000 7f84f2ffd640 1 -- 172.21.15.162:0/3461513451 learned_addr learned my addr 172.21.15.162:0/3461513451 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:04.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.004+0000 7f84f2ffd640 1 -- 172.21.15.162:0/3461513451 >> v1:172.21.15.162:6789/0 conn(0x7f84f40ce890 legacy=0x7f84f415bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.004+0000 7f84f2ffd640 1 -- 172.21.15.162:0/3461513451 >> v1:172.21.15.96:6789/0 conn(0x7f84f40b0ec0 legacy=0x7f84f40cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.004+0000 7f84f2ffd640 1 -- 172.21.15.162:0/3461513451 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f40cfcc0 con 0x7f84f40afef0 2024-06-02T23:46:04.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.005+0000 7f84f2ffd640 1 --2- 172.21.15.162:0/3461513451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40afef0 0x7f84f40ccb00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009870 tx=0x7f84e802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=437f26451357aac7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:04.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.005+0000 7f84f27fc640 1 -- 172.21.15.162:0/3461513451 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8037070 con 0x7f84f40afef0 2024-06-02T23:46:04.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.005+0000 7f84f27fc640 1 -- 172.21.15.162:0/3461513451 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e8032440 con 0x7f84f40afef0 2024-06-02T23:46:04.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.005+0000 7f84f27fc640 1 -- 172.21.15.162:0/3461513451 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8032810 con 0x7f84f40afef0 2024-06-02T23:46:04.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.006+0000 7f84f9ff4640 1 -- 172.21.15.162:0/3461513451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40afef0 msgr2=0x7f84f40ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.006+0000 7f84f9ff4640 1 --2- 172.21.15.162:0/3461513451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40afef0 0x7f84f40ccb00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009870 tx=0x7f84e802a1e0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.006+0000 7f84f9ff4640 1 -- 172.21.15.162:0/3461513451 shutdown_connections 2024-06-02T23:46:04.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.006+0000 7f84f9ff4640 1 --2- 172.21.15.162:0/3461513451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40afef0 0x7f84f40ccb00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.006+0000 7f84f9ff4640 1 -- 172.21.15.162:0/3461513451 >> 172.21.15.162:0/3461513451 conn(0x7f84f40d1e40 msgr2=0x7f84f40d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:04.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.006+0000 7f84f9ff4640 1 -- 172.21.15.162:0/3461513451 shutdown_connections 2024-06-02T23:46:04.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.006+0000 7f84f9ff4640 1 -- 172.21.15.162:0/3461513451 wait complete. 2024-06-02T23:46:04.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.007+0000 7f84f9ff4640 1 Processor -- start 2024-06-02T23:46:04.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.007+0000 7f84f9ff4640 1 -- start start 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f9ff4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f40afef0 0x7f84f415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f9ff4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40b0ec0 0x7f84f414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f9ff4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84f40ce890 0x7f84f414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f9ff4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f84f40d0fd0 con 0x7f84f40ce890 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f9ff4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f84f40d0e50 con 0x7f84f40b0ec0 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f9ff4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f84f40cec70 con 0x7f84f40afef0 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f40afef0 0x7f84f415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40b0ec0 0x7f84f414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40b0ec0 0x7f84f414e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40182/0 (socket says 172.21.15.162:40182) 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f40afef0 0x7f84f415e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:53240/0 (socket says 172.21.15.162:53240) 2024-06-02T23:46:04.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f2ffd640 1 -- 172.21.15.162:0/2774970402 learned_addr learned my addr 172.21.15.162:0/2774970402 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.008+0000 7f84f3fff640 1 --2- 172.21.15.162:0/2774970402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84f40ce890 0x7f84f414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84f2ffd640 1 -- 172.21.15.162:0/2774970402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f40afef0 msgr2=0x7f84f415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84f2ffd640 1 --2- 172.21.15.162:0/2774970402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f40afef0 0x7f84f415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84f2ffd640 1 -- 172.21.15.162:0/2774970402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84f40ce890 msgr2=0x7f84f414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84f2ffd640 1 --2- 172.21.15.162:0/2774970402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84f40ce890 0x7f84f414eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84f2ffd640 1 -- 172.21.15.162:0/2774970402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f415c530 con 0x7f84f40b0ec0 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84f3fff640 1 --2- 172.21.15.162:0/2774970402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84f40ce890 0x7f84f414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84f37fe640 1 --2- 172.21.15.162:0/2774970402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f40afef0 0x7f84f415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84f2ffd640 1 --2- 172.21.15.162:0/2774970402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40b0ec0 0x7f84f414e5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f84e802a220 tx=0x7f84e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84dbfff640 1 -- 172.21.15.162:0/2774970402 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8037040 con 0x7f84f40b0ec0 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84dbfff640 1 -- 172.21.15.162:0/2774970402 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e8042070 con 0x7f84f40b0ec0 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84f9ff4640 1 -- 172.21.15.162:0/2774970402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f415cd10 con 0x7f84f40b0ec0 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84dbfff640 1 -- 172.21.15.162:0/2774970402 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8030bd0 con 0x7f84f40b0ec0 2024-06-02T23:46:04.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84f9ff4640 1 -- 172.21.15.162:0/2774970402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f415b860 con 0x7f84f40b0ec0 2024-06-02T23:46:04.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84dbfff640 1 -- 172.21.15.162:0/2774970402 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f84e8047460 con 0x7f84f40b0ec0 2024-06-02T23:46:04.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.009+0000 7f84dbfff640 1 -- 172.21.15.162:0/2774970402 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f84e803daa0 con 0x7f84f40b0ec0 2024-06-02T23:46:04.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.010+0000 7f84f9ff4640 1 -- 172.21.15.162:0/2774970402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f4068af0 con 0x7f84f40b0ec0 2024-06-02T23:46:04.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.012+0000 7f84dbfff640 1 -- 172.21.15.162:0/2774970402 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f84e803dd40 con 0x7f84f40b0ec0 2024-06-02T23:46:04.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.085+0000 7f84f9ff4640 1 -- 172.21.15.162:0/2774970402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4b4aae57-776c-4afa-a0f8-04e41a4fabb8", "id": 7} v 0) -- 0x7f84f40cc420 con 0x7f84f40b0ec0 2024-06-02T23:46:04.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.089+0000 7f84dbfff640 1 -- 172.21.15.162:0/2774970402 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b4aae57-776c-4afa-a0f8-04e41a4fabb8", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f84e803d440 con 0x7f84f40b0ec0 2024-06-02T23:46:04.089 INFO:teuthology.orchestra.run.smithi162.stdout:7 2024-06-02T23:46:04.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.090+0000 7f84f9ff4640 1 -- 172.21.15.162:0/2774970402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40b0ec0 msgr2=0x7f84f414e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.090+0000 7f84f9ff4640 1 --2- 172.21.15.162:0/2774970402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40b0ec0 0x7f84f414e5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f84e802a220 tx=0x7f84e80046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.090+0000 7f84f9ff4640 1 -- 172.21.15.162:0/2774970402 shutdown_connections 2024-06-02T23:46:04.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.090+0000 7f84f9ff4640 1 --2- 172.21.15.162:0/2774970402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84f40ce890 0x7f84f414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.090+0000 7f84f9ff4640 1 --2- 172.21.15.162:0/2774970402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40b0ec0 0x7f84f414e5b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.090+0000 7f84f9ff4640 1 --2- 172.21.15.162:0/2774970402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f40afef0 0x7f84f415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.090+0000 7f84f9ff4640 1 -- 172.21.15.162:0/2774970402 >> 172.21.15.162:0/2774970402 conn(0x7f84f40d1e40 msgr2=0x7f84f406de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:04.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.090+0000 7f84f9ff4640 1 -- 172.21.15.162:0/2774970402 shutdown_connections 2024-06-02T23:46:04.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:04.090+0000 7f84f9ff4640 1 -- 172.21.15.162:0/2774970402 wait complete. 2024-06-02T23:46:04.100 INFO:tasks.ceph.osd.0:Restarting daemon 2024-06-02T23:46:04.100 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-06-02T23:46:04.102 INFO:tasks.ceph.osd.0:Started 2024-06-02T23:46:04.102 INFO:tasks.ceph.osd.1:Restarting daemon 2024-06-02T23:46:04.103 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-06-02T23:46:04.105 INFO:tasks.ceph.osd.1:Started 2024-06-02T23:46:04.105 INFO:tasks.ceph.osd.2:Restarting daemon 2024-06-02T23:46:04.105 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-06-02T23:46:04.107 INFO:tasks.ceph.osd.2:Started 2024-06-02T23:46:04.107 INFO:tasks.ceph.osd.3:Restarting daemon 2024-06-02T23:46:04.107 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-06-02T23:46:04.109 INFO:tasks.ceph.osd.3:Started 2024-06-02T23:46:04.109 INFO:tasks.ceph.osd.4:Restarting daemon 2024-06-02T23:46:04.109 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-06-02T23:46:04.141 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:04.141+0000 7f2d4f20f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:46:04.142 INFO:tasks.ceph.osd.4:Started 2024-06-02T23:46:04.142 INFO:tasks.ceph.osd.5:Restarting daemon 2024-06-02T23:46:04.142 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-06-02T23:46:04.145 INFO:tasks.ceph.osd.5:Started 2024-06-02T23:46:04.145 INFO:tasks.ceph.osd.6:Restarting daemon 2024-06-02T23:46:04.145 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-06-02T23:46:04.148 INFO:tasks.ceph.osd.6:Started 2024-06-02T23:46:04.148 INFO:tasks.ceph.osd.7:Restarting daemon 2024-06-02T23:46:04.148 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-06-02T23:46:04.150 INFO:tasks.ceph.osd.7:Started 2024-06-02T23:46:04.150 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:04.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.272+0000 7fe658389640 1 Processor -- start 2024-06-02T23:46:04.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.272+0000 7fe658389640 1 -- start start 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe658389640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe650159b90 0x7fe6501604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe658389640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe65015c4d0 0x7fe6500ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe658389640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6500b6600 con 0x7fe6500cd160 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe658389640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe650073220 con 0x7fe65015c4d0 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe658389640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe65015ca90 con 0x7fe650159b90 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe656926640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe6500cd160 0x7fe65006b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51456/0 (socket says 172.21.15.96:51456) 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe656926640 1 -- 172.21.15.96:0/3137741846 learned_addr learned my addr 172.21.15.96:0/3137741846 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe656125640 1 --2- 172.21.15.96:0/3137741846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe650159b90 0x7fe6501604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe655924640 1 --2- 172.21.15.96:0/3137741846 >> v2:172.21.15.162:3300/0 conn(0x7fe65015c4d0 0x7fe6500ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe655123640 1 -- 172.21.15.96:0/3137741846 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4079726473 0 0) 0x7fe6500b6600 con 0x7fe6500cd160 2024-06-02T23:46:04.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe655123640 1 -- 172.21.15.96:0/3137741846 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe63c003520 con 0x7fe6500cd160 2024-06-02T23:46:04.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe655924640 1 -- 172.21.15.96:0/3137741846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe650159b90 msgr2=0x7fe6501604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:04.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe655924640 1 --2- 172.21.15.96:0/3137741846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe650159b90 0x7fe6501604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.273+0000 7fe655924640 1 -- 172.21.15.96:0/3137741846 >> v1:172.21.15.96:6789/0 conn(0x7fe6500cd160 legacy=0x7fe65006b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.274+0000 7fe655924640 1 -- 172.21.15.96:0/3137741846 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6500ce950 con 0x7fe65015c4d0 2024-06-02T23:46:04.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.274+0000 7fe655924640 1 --2- 172.21.15.96:0/3137741846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe65015c4d0 0x7fe6500ccc20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6400097a0 tx=0x7fe64002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7bc2335a26a3d64 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:04.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.274+0000 7fe655123640 1 -- 172.21.15.96:0/3137741846 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe640037070 con 0x7fe65015c4d0 2024-06-02T23:46:04.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.274+0000 7fe655123640 1 -- 172.21.15.96:0/3137741846 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe640032440 con 0x7fe65015c4d0 2024-06-02T23:46:04.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.274+0000 7fe655123640 1 -- 172.21.15.96:0/3137741846 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe640032810 con 0x7fe65015c4d0 2024-06-02T23:46:04.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.275+0000 7fe658389640 1 -- 172.21.15.96:0/3137741846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe65015c4d0 msgr2=0x7fe6500ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.275+0000 7fe658389640 1 --2- 172.21.15.96:0/3137741846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe65015c4d0 0x7fe6500ccc20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6400097a0 tx=0x7fe64002a180 comp rx=0 tx=0).stop 2024-06-02T23:46:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.275+0000 7fe658389640 1 -- 172.21.15.96:0/3137741846 shutdown_connections 2024-06-02T23:46:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.275+0000 7fe658389640 1 --2- 172.21.15.96:0/3137741846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe65015c4d0 0x7fe6500ccc20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.275+0000 7fe658389640 1 --2- 172.21.15.96:0/3137741846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe650159b90 0x7fe6501604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.275+0000 7fe658389640 1 -- 172.21.15.96:0/3137741846 >> 172.21.15.96:0/3137741846 conn(0x7fe6500b28b0 msgr2=0x7fe6500b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.275+0000 7fe658389640 1 -- 172.21.15.96:0/3137741846 shutdown_connections 2024-06-02T23:46:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.275+0000 7fe658389640 1 -- 172.21.15.96:0/3137741846 wait complete. 2024-06-02T23:46:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.276+0000 7fe658389640 1 Processor -- start 2024-06-02T23:46:04.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.276+0000 7fe658389640 1 -- start start 2024-06-02T23:46:04.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe658389640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500cd160 0x7fe6500aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:04.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe658389640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe650159b90 0x7fe6500b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:04.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe658389640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe65015c4d0 0x7fe65015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:04.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe658389640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe65015d330 con 0x7fe6500cd160 2024-06-02T23:46:04.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe658389640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe65015d050 con 0x7fe65015c4d0 2024-06-02T23:46:04.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe658389640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe65006bad0 con 0x7fe650159b90 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe656125640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500cd160 0x7fe6500aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe656125640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500cd160 0x7fe6500aec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44368/0 (socket says 172.21.15.96:44368) 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe656125640 1 -- 172.21.15.96:0/2148466526 learned_addr learned my addr 172.21.15.96:0/2148466526 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe655924640 1 --2- 172.21.15.96:0/2148466526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe650159b90 0x7fe6500b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe656926640 1 --2- 172.21.15.96:0/2148466526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe65015c4d0 0x7fe65015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe656125640 1 -- 172.21.15.96:0/2148466526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe650159b90 msgr2=0x7fe6500b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe656125640 1 --2- 172.21.15.96:0/2148466526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe650159b90 0x7fe6500b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe656125640 1 -- 172.21.15.96:0/2148466526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe65015c4d0 msgr2=0x7fe65015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe656125640 1 --2- 172.21.15.96:0/2148466526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe65015c4d0 0x7fe65015e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.277+0000 7fe656125640 1 -- 172.21.15.96:0/2148466526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6500b5560 con 0x7fe6500cd160 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.278+0000 7fe656125640 1 --2- 172.21.15.96:0/2148466526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500cd160 0x7fe6500aec00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe64800e9b0 tx=0x7fe64800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.278+0000 7fe646ffd640 1 -- 172.21.15.96:0/2148466526 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648017070 con 0x7fe6500cd160 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.278+0000 7fe658389640 1 -- 172.21.15.96:0/2148466526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6500b5840 con 0x7fe6500cd160 2024-06-02T23:46:04.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.278+0000 7fe646ffd640 1 -- 172.21.15.96:0/2148466526 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe64800c9a0 con 0x7fe6500cd160 2024-06-02T23:46:04.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.278+0000 7fe646ffd640 1 -- 172.21.15.96:0/2148466526 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64800cd90 con 0x7fe6500cd160 2024-06-02T23:46:04.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.278+0000 7fe658389640 1 -- 172.21.15.96:0/2148466526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65006e150 con 0x7fe6500cd160 2024-06-02T23:46:04.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.278+0000 7fe646ffd640 1 -- 172.21.15.96:0/2148466526 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe64801a070 con 0x7fe6500cd160 2024-06-02T23:46:04.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.278+0000 7fe646ffd640 1 -- 172.21.15.96:0/2148466526 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe64801cc60 con 0x7fe6500cd160 2024-06-02T23:46:04.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.279+0000 7fe658389640 1 -- 172.21.15.96:0/2148466526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe650068af0 con 0x7fe6500cd160 2024-06-02T23:46:04.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.281+0000 7fe646ffd640 1 -- 172.21.15.96:0/2148466526 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe64801c590 con 0x7fe6500cd160 2024-06-02T23:46:04.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.340+0000 7fe658389640 1 -- 172.21.15.96:0/2148466526 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6500727f0 con 0x7fe6500cd160 2024-06-02T23:46:04.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.341+0000 7fe646ffd640 1 -- 172.21.15.96:0/2148466526 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe64801c770 con 0x7fe6500cd160 2024-06-02T23:46:04.341 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:04.341 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:04.087153+0000","last_up_change":"0.000000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:04.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.342+0000 7fe658389640 1 -- 172.21.15.96:0/2148466526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500cd160 msgr2=0x7fe6500aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:04.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.342+0000 7fe658389640 1 --2- 172.21.15.96:0/2148466526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500cd160 0x7fe6500aec00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe64800e9b0 tx=0x7fe64800ee70 comp rx=0 tx=0).stop 2024-06-02T23:46:04.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.342+0000 7fe658389640 1 -- 172.21.15.96:0/2148466526 shutdown_connections 2024-06-02T23:46:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.342+0000 7fe658389640 1 --2- 172.21.15.96:0/2148466526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe65015c4d0 0x7fe65015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.342+0000 7fe658389640 1 --2- 172.21.15.96:0/2148466526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe650159b90 0x7fe6500b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.342+0000 7fe658389640 1 --2- 172.21.15.96:0/2148466526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe6500cd160 0x7fe6500aec00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.342+0000 7fe658389640 1 -- 172.21.15.96:0/2148466526 >> 172.21.15.96:0/2148466526 conn(0x7fe6500b28b0 msgr2=0x7fe650158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.342+0000 7fe658389640 1 -- 172.21.15.96:0/2148466526 shutdown_connections 2024-06-02T23:46:04.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:04.342+0000 7fe658389640 1 -- 172.21.15.96:0/2148466526 wait complete. 2024-06-02T23:46:04.350 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:04.350+0000 7facb5b60040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:46:04.352 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-06-02T23:46:04.353 INFO:tasks.ceph:Waiting for OSDs to come up 2024-06-02T23:46:04.428 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:04.428+0000 7f2d4f20f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:46:04.482 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:04.482+0000 7f2d4f20f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:46:04.596 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:04.596+0000 7f2d4f20f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:46:04.610 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:04.610+0000 7facb5b60040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:46:04.662 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:04.662+0000 7facb5b60040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:46:04.718 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-06-02T23:46:04.718+0000 7f7bf7c14640 -1 Falling back to public interface 2024-06-02T23:46:04.720 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-06-02T23:46:04.720+0000 7f088b219640 -1 Falling back to public interface 2024-06-02T23:46:04.722 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-06-02T23:46:04.722+0000 7f4ad4a14640 -1 Falling back to public interface 2024-06-02T23:46:04.726 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-06-02T23:46:04.726+0000 7ff92cf18640 -1 Falling back to public interface 2024-06-02T23:46:04.750 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-06-02T23:46:04.751+0000 7f7edf0fd640 -1 Falling back to public interface 2024-06-02T23:46:04.751 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-06-02T23:46:04.751+0000 7f359a2dd640 -1 Falling back to public interface 2024-06-02T23:46:04.759 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-06-02T23:46:04.759+0000 7fbb15f53640 -1 Falling back to public interface 2024-06-02T23:46:04.761 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-06-02T23:46:04.761+0000 7f530849d640 -1 Falling back to public interface 2024-06-02T23:46:04.784 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:04.784+0000 7facb5b60040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:46:04.890 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:04.890+0000 7f2d4f20f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:46:04.937 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:04.937+0000 7f2d4f20f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:46:05.080 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:05.080+0000 7facb5b60040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:46:05.092 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:05.092+0000 7f2d4f20f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:46:05.128 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:05.128+0000 7facb5b60040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:46:05.157 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:05.231 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:05.231+0000 7f2d4f20f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:46:05.249 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.249+0000 7fcbf7c5d640 1 Processor -- start 2024-06-02T23:46:05.249 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.249+0000 7fcbf7c5d640 1 -- start start 2024-06-02T23:46:05.250 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.250+0000 7fcbf7c5d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 0x7fcbf00cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:05.250 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.250+0000 7fcbf7c5d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcbf015f250 0x7fcbf00d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:05.251 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.250+0000 7fcbf7c5d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf00d1350 con 0x7fcbf0161d90 2024-06-02T23:46:05.251 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.250+0000 7fcbf7c5d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf00cf310 con 0x7fcbf015f250 2024-06-02T23:46:05.251 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.250+0000 7fcbf7c5d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf00cf5f0 con 0x7fcbf00d0a30 2024-06-02T23:46:05.251 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.250+0000 7fcbf51f8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcbf015f250 0x7fcbf00d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:05.251 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.250+0000 7fcbf51f8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcbf015f250 0x7fcbf00d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:37488/0 (socket says 172.21.15.96:37488) 2024-06-02T23:46:05.251 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.250+0000 7fcbf59f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 0x7fcbf00cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:05.251 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.250+0000 7fcbf51f8640 1 -- 172.21.15.96:0/2022450768 learned_addr learned my addr 172.21.15.96:0/2022450768 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:05.251 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.250+0000 7fcbf61fa640 1 --1- 172.21.15.96:0/2022450768 >> v1:172.21.15.162:6789/0 conn(0x7fcbf0161d90 0x7fcbf0162220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:38204/0 (socket says 172.21.15.96:38204) 2024-06-02T23:46:05.251 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.251+0000 7fcbf59f9640 1 -- 172.21.15.96:0/2022450768 >> v2:172.21.15.162:3300/0 conn(0x7fcbf015f250 msgr2=0x7fcbf00d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:05.251 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.251+0000 7fcbf59f9640 1 --2- 172.21.15.96:0/2022450768 >> v2:172.21.15.162:3300/0 conn(0x7fcbf015f250 0x7fcbf00d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:05.252 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.251+0000 7fcbf59f9640 1 -- 172.21.15.96:0/2022450768 >> v1:172.21.15.162:6789/0 conn(0x7fcbf0161d90 legacy=0x7fcbf0162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:05.252 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.251+0000 7fcbf59f9640 1 -- 172.21.15.96:0/2022450768 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf00cf8d0 con 0x7fcbf00d0a30 2024-06-02T23:46:05.252 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.251+0000 7fcbf51f8640 1 --2- 172.21.15.96:0/2022450768 >> v2:172.21.15.162:3300/0 conn(0x7fcbf015f250 0x7fcbf00d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:05.253 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.251+0000 7fcbf59f9640 1 --2- 172.21.15.96:0/2022450768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 0x7fcbf00cec30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00097a0 tx=0x7fcbe002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90777b36e69bf4d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:05.253 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf49f7640 1 -- 172.21.15.96:0/2022450768 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0037070 con 0x7fcbf00d0a30 2024-06-02T23:46:05.253 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf49f7640 1 -- 172.21.15.96:0/2022450768 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe0032440 con 0x7fcbf00d0a30 2024-06-02T23:46:05.253 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf49f7640 1 -- 172.21.15.96:0/2022450768 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0032810 con 0x7fcbf00d0a30 2024-06-02T23:46:05.253 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/2022450768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 msgr2=0x7fcbf00cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:05.253 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf7c5d640 1 --2- 172.21.15.96:0/2022450768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 0x7fcbf00cec30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00097a0 tx=0x7fcbe002a180 comp rx=0 tx=0).stop 2024-06-02T23:46:05.253 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/2022450768 shutdown_connections 2024-06-02T23:46:05.253 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf7c5d640 1 --2- 172.21.15.96:0/2022450768 >> v2:172.21.15.162:3300/0 conn(0x7fcbf015f250 0x7fcbf00d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:05.253 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf7c5d640 1 --2- 172.21.15.96:0/2022450768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 0x7fcbf00cec30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:05.254 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/2022450768 >> 172.21.15.96:0/2022450768 conn(0x7fcbf009d360 msgr2=0x7fcbf00d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:05.254 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/2022450768 shutdown_connections 2024-06-02T23:46:05.254 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.252+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/2022450768 wait complete. 2024-06-02T23:46:05.256 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.253+0000 7fcbf7c5d640 1 Processor -- start 2024-06-02T23:46:05.256 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.253+0000 7fcbf7c5d640 1 -- start start 2024-06-02T23:46:05.256 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf7c5d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 0x7fcbf014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:05.256 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf7c5d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf015f250 0x7fcbf00cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf7c5d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf0161d90 0x7fcbf00cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf7c5d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf015f6b0 con 0x7fcbf015f250 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf7c5d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf00cfe90 con 0x7fcbf0161d90 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf7c5d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf015e560 con 0x7fcbf00d0a30 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf51f8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf015f250 0x7fcbf00cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf51f8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf015f250 0x7fcbf00cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44384/0 (socket says 172.21.15.96:44384) 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf51f8640 1 -- 172.21.15.96:0/3960287484 learned_addr learned my addr 172.21.15.96:0/3960287484 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf61fa640 1 --2- 172.21.15.96:0/3960287484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf0161d90 0x7fcbf00cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.254+0000 7fcbf59f9640 1 --2- 172.21.15.96:0/3960287484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 0x7fcbf014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbf61fa640 1 -- 172.21.15.96:0/3960287484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 msgr2=0x7fcbf014d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbf61fa640 1 --2- 172.21.15.96:0/3960287484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 0x7fcbf014d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbf61fa640 1 -- 172.21.15.96:0/3960287484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf015f250 msgr2=0x7fcbf00cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:05.257 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbf61fa640 1 --2- 172.21.15.96:0/3960287484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf015f250 0x7fcbf00cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:05.258 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbf61fa640 1 -- 172.21.15.96:0/3960287484 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf00c9900 con 0x7fcbf0161d90 2024-06-02T23:46:05.258 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbf51f8640 1 --2- 172.21.15.96:0/3960287484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf015f250 0x7fcbf00cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:05.258 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbf61fa640 1 --2- 172.21.15.96:0/3960287484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf0161d90 0x7fcbf00cb630 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800c6c0 tx=0x7fcbe800cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:05.258 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbe67fc640 1 -- 172.21.15.96:0/3960287484 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8018070 con 0x7fcbf0161d90 2024-06-02T23:46:05.258 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbe67fc640 1 -- 172.21.15.96:0/3960287484 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe8004d60 con 0x7fcbf0161d90 2024-06-02T23:46:05.258 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/3960287484 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf00c9be0 con 0x7fcbf0161d90 2024-06-02T23:46:05.258 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbe67fc640 1 -- 172.21.15.96:0/3960287484 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800a840 con 0x7fcbf0161d90 2024-06-02T23:46:05.258 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/3960287484 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf00ca1a0 con 0x7fcbf0161d90 2024-06-02T23:46:05.258 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbe67fc640 1 -- 172.21.15.96:0/3960287484 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcbe800a9e0 con 0x7fcbf0161d90 2024-06-02T23:46:05.258 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.255+0000 7fcbe67fc640 1 -- 172.21.15.96:0/3960287484 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fcbe800acd0 con 0x7fcbf0161d90 2024-06-02T23:46:05.259 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.256+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/3960287484 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf004f7d0 con 0x7fcbf0161d90 2024-06-02T23:46:05.259 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.258+0000 7fcbe67fc640 1 -- 172.21.15.96:0/3960287484 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcbe8007070 con 0x7fcbf0161d90 2024-06-02T23:46:05.283 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:05.283+0000 7f2d4f20f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:46:05.284 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:05.284+0000 7facb5b60040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:46:05.318 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.318+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/3960287484 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbf00d16a0 con 0x7fcbf0161d90 2024-06-02T23:46:05.319 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.319+0000 7fcbe67fc640 1 -- 172.21.15.96:0/3960287484 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fcbe8007250 con 0x7fcbf0161d90 2024-06-02T23:46:05.319 INFO:teuthology.misc.health.smithi096.stdout: 2024-06-02T23:46:05.319 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":10,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:04.087153+0000","last_up_change":"0.000000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:05.320 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.320+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/3960287484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf0161d90 msgr2=0x7fcbf00cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:05.320 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.320+0000 7fcbf7c5d640 1 --2- 172.21.15.96:0/3960287484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf0161d90 0x7fcbf00cb630 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800c6c0 tx=0x7fcbe800cb80 comp rx=0 tx=0).stop 2024-06-02T23:46:05.321 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.320+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/3960287484 shutdown_connections 2024-06-02T23:46:05.321 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.320+0000 7fcbf7c5d640 1 --2- 172.21.15.96:0/3960287484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf0161d90 0x7fcbf00cb630 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:05.321 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.320+0000 7fcbf7c5d640 1 --2- 172.21.15.96:0/3960287484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbf015f250 0x7fcbf00cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:05.321 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.320+0000 7fcbf7c5d640 1 --2- 172.21.15.96:0/3960287484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbf00d0a30 0x7fcbf014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:05.321 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.320+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/3960287484 >> 172.21.15.96:0/3960287484 conn(0x7fcbf009d360 msgr2=0x7fcbf015f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:05.321 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.320+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/3960287484 shutdown_connections 2024-06-02T23:46:05.321 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:05.320+0000 7fcbf7c5d640 1 -- 172.21.15.96:0/3960287484 wait complete. 2024-06-02T23:46:05.329 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-06-02T23:46:05.356 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:05.356+0000 7f2d4f20f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:46:05.400 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:05.400+0000 7f2d4f20f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:46:05.421 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:05.421+0000 7facb5b60040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:46:05.470 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:05.471+0000 7facb5b60040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:46:05.541 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:05.541+0000 7facb5b60040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:46:05.588 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:05.588+0000 7facb5b60040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:46:05.871 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:05.871+0000 7f2d4f20f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:46:05.985 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:05.985+0000 7f2d4f20f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:46:06.068 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:06.068+0000 7facb5b60040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:46:06.186 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:46:06.186+0000 7facb5b60040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:46:06.998 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:06.998+0000 7f2cef896640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-02T23:46:07.000 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:46:07.001+0000 7f2cef896640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-02T23:46:08.185 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-06-02T23:46:08.184+0000 7f088b219640 -1 osd.1 0 log_to_monitors true 2024-06-02T23:46:08.243 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-06-02T23:46:08.243+0000 7f7edf0fd640 -1 osd.6 0 log_to_monitors true 2024-06-02T23:46:08.247 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-06-02T23:46:08.246+0000 7ff92cf18640 -1 osd.2 0 log_to_monitors true 2024-06-02T23:46:08.252 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-06-02T23:46:08.251+0000 7f4ad4a14640 -1 osd.0 0 log_to_monitors true 2024-06-02T23:46:08.254 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-06-02T23:46:08.254+0000 7f7bf7c14640 -1 osd.3 0 log_to_monitors true 2024-06-02T23:46:08.293 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-06-02T23:46:08.293+0000 7f530849d640 -1 osd.7 0 log_to_monitors true 2024-06-02T23:46:08.309 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-06-02T23:46:08.309+0000 7fbb15f53640 -1 osd.4 0 log_to_monitors true 2024-06-02T23:46:08.311 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-06-02T23:46:08.312+0000 7f359a2dd640 -1 osd.5 0 log_to_monitors true 2024-06-02T23:46:12.041 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-06-02T23:46:12.040+0000 7f0886b0c640 -1 osd.1 0 waiting for initial osdmap 2024-06-02T23:46:12.055 INFO:tasks.ceph.osd.1.smithi096.stderr:2024-06-02T23:46:12.055+0000 7f087e92c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:46:12.088 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-06-02T23:46:12.088+0000 7ff928eae640 -1 osd.2 0 waiting for initial osdmap 2024-06-02T23:46:12.097 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-06-02T23:46:12.098+0000 7f7bf3580640 -1 osd.3 0 waiting for initial osdmap 2024-06-02T23:46:12.101 INFO:tasks.ceph.osd.2.smithi096.stderr:2024-06-02T23:46:12.101+0000 7ff920cce640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:46:12.108 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-06-02T23:46:12.109+0000 7f4ad02a5640 -1 osd.0 0 waiting for initial osdmap 2024-06-02T23:46:12.109 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-06-02T23:46:12.108+0000 7f7edb8a7640 -1 osd.6 0 waiting for initial osdmap 2024-06-02T23:46:12.113 INFO:tasks.ceph.osd.3.smithi096.stderr:2024-06-02T23:46:12.114+0000 7f7beb3a0640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:46:12.121 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-06-02T23:46:12.121+0000 7f7ed2eb3640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:46:12.125 INFO:tasks.ceph.osd.0.smithi096.stderr:2024-06-02T23:46:12.126+0000 7f4ac80c5640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:46:12.137 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:12.144 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-06-02T23:46:12.144+0000 7fbb126fd640 -1 osd.4 0 waiting for initial osdmap 2024-06-02T23:46:12.150 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-06-02T23:46:12.151+0000 7f3596a87640 -1 osd.5 0 waiting for initial osdmap 2024-06-02T23:46:12.152 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-06-02T23:46:12.153+0000 7f5304433640 -1 osd.7 0 waiting for initial osdmap 2024-06-02T23:46:12.154 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-06-02T23:46:12.155+0000 7fbb09d09640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:46:12.163 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-06-02T23:46:12.163+0000 7f358e093640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:46:12.166 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-06-02T23:46:12.167+0000 7f52fc253640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T23:46:12.228 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.228+0000 7fc7f747b640 1 Processor -- start 2024-06-02T23:46:12.229 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.229+0000 7fc7f747b640 1 -- start start 2024-06-02T23:46:12.230 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.229+0000 7fc7f747b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc7f0161910 0x7fc7f00d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.229+0000 7fc7f747b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc7f00b5630 0x7fc7f00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.229+0000 7fc7f747b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f00d02c0 con 0x7fc7f00b2e30 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.229+0000 7fc7f747b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f00d2770 con 0x7fc7f0161910 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.229+0000 7fc7f747b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f00d2a10 con 0x7fc7f00b5630 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.229+0000 7fc7f5217640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc7f0161910 0x7fc7f00d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.229+0000 7fc7f5a18640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc7f00b2e30 0x7fc7f0162090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:51458/0 (socket says 172.21.15.96:51458) 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.229+0000 7fc7f5a18640 1 -- 172.21.15.96:0/3155616367 learned_addr learned my addr 172.21.15.96:0/3155616367 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.229+0000 7fc7f5217640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc7f0161910 0x7fc7f00d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44484/0 (socket says 172.21.15.96:44484) 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.230+0000 7fc7f4a16640 1 --2- 172.21.15.96:0/3155616367 >> v2:172.21.15.162:3300/0 conn(0x7fc7f00b5630 0x7fc7f00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.230+0000 7fc7f5217640 1 -- 172.21.15.96:0/3155616367 >> v2:172.21.15.162:3300/0 conn(0x7fc7f00b5630 msgr2=0x7fc7f00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:12.231 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.230+0000 7fc7f5217640 1 --2- 172.21.15.96:0/3155616367 >> v2:172.21.15.162:3300/0 conn(0x7fc7f00b5630 0x7fc7f00d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:12.232 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.230+0000 7fc7f5217640 1 -- 172.21.15.96:0/3155616367 >> v1:172.21.15.96:6789/0 conn(0x7fc7f00b2e30 legacy=0x7fc7f0162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:12.232 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.230+0000 7fc7e3fff640 1 -- 172.21.15.96:0/3155616367 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212534550 0 0) 0x7fc7f00d02c0 con 0x7fc7f00b2e30 2024-06-02T23:46:12.232 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.230+0000 7fc7f5217640 1 -- 172.21.15.96:0/3155616367 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f00d2cd0 con 0x7fc7f0161910 2024-06-02T23:46:12.232 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.230+0000 7fc7f4a16640 1 --2- 172.21.15.96:0/3155616367 >> v2:172.21.15.162:3300/0 conn(0x7fc7f00b5630 0x7fc7f00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:12.232 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.230+0000 7fc7f5217640 1 --2- 172.21.15.96:0/3155616367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f0161910 0x7fc7f00d0a50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80097a0 tx=0x7fc7e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6f52c65b8a401e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:12.232 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7e3fff640 1 -- 172.21.15.96:0/3155616367 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8037070 con 0x7fc7f0161910 2024-06-02T23:46:12.232 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7e3fff640 1 -- 172.21.15.96:0/3155616367 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e8032440 con 0x7fc7f0161910 2024-06-02T23:46:12.232 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7e3fff640 1 -- 172.21.15.96:0/3155616367 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8032810 con 0x7fc7f0161910 2024-06-02T23:46:12.235 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7f747b640 1 -- 172.21.15.96:0/3155616367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f0161910 msgr2=0x7fc7f00d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:12.235 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7f747b640 1 --2- 172.21.15.96:0/3155616367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f0161910 0x7fc7f00d0a50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80097a0 tx=0x7fc7e802a1e0 comp rx=0 tx=0).stop 2024-06-02T23:46:12.235 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7f747b640 1 -- 172.21.15.96:0/3155616367 shutdown_connections 2024-06-02T23:46:12.235 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7f747b640 1 --2- 172.21.15.96:0/3155616367 >> v2:172.21.15.162:3300/0 conn(0x7fc7f00b5630 0x7fc7f00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:12.235 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7f747b640 1 --2- 172.21.15.96:0/3155616367 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f0161910 0x7fc7f00d0a50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:12.235 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7f747b640 1 -- 172.21.15.96:0/3155616367 >> 172.21.15.96:0/3155616367 conn(0x7fc7f009d3b0 msgr2=0x7fc7f00d4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:12.236 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7f747b640 1 -- 172.21.15.96:0/3155616367 shutdown_connections 2024-06-02T23:46:12.236 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.231+0000 7fc7f747b640 1 -- 172.21.15.96:0/3155616367 wait complete. 2024-06-02T23:46:12.236 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.232+0000 7fc7f747b640 1 Processor -- start 2024-06-02T23:46:12.236 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.232+0000 7fc7f747b640 1 -- start start 2024-06-02T23:46:12.236 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f747b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f00b2e30 0x7fc7f015b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:12.236 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f747b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f00b5630 0x7fc7f015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:12.236 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f747b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f0161910 0x7fc7f00cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:12.236 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f747b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00d23b0 con 0x7fc7f00b5630 2024-06-02T23:46:12.236 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f747b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00b3960 con 0x7fc7f00b2e30 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f747b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f00d2530 con 0x7fc7f0161910 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f4a16640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f00b5630 0x7fc7f015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f4a16640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f00b5630 0x7fc7f015fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44494/0 (socket says 172.21.15.96:44494) 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f4a16640 1 -- 172.21.15.96:0/284500158 learned_addr learned my addr 172.21.15.96:0/284500158 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f5217640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f00b2e30 0x7fc7f015b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f5a18640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f0161910 0x7fc7f00cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f4a16640 1 -- 172.21.15.96:0/284500158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f0161910 msgr2=0x7fc7f00cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f4a16640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f0161910 0x7fc7f00cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f4a16640 1 -- 172.21.15.96:0/284500158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f00b2e30 msgr2=0x7fc7f015b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f4a16640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f00b2e30 0x7fc7f015b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.233+0000 7fc7f4a16640 1 -- 172.21.15.96:0/284500158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f015bab0 con 0x7fc7f00b5630 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.234+0000 7fc7f5217640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f00b2e30 0x7fc7f015b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.234+0000 7fc7f5a18640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f0161910 0x7fc7f00cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:12.237 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.234+0000 7fc7f4a16640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f00b5630 0x7fc7f015fad0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009fc0 tx=0x7fc7e400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:12.238 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.234+0000 7fc7e1ffb640 1 -- 172.21.15.96:0/284500158 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e401a070 con 0x7fc7f00b5630 2024-06-02T23:46:12.238 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.234+0000 7fc7e1ffb640 1 -- 172.21.15.96:0/284500158 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e4003bb0 con 0x7fc7f00b5630 2024-06-02T23:46:12.238 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.234+0000 7fc7e1ffb640 1 -- 172.21.15.96:0/284500158 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4004030 con 0x7fc7f00b5630 2024-06-02T23:46:12.238 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.234+0000 7fc7f747b640 1 -- 172.21.15.96:0/284500158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f00c7f20 con 0x7fc7f00b5630 2024-06-02T23:46:12.238 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.234+0000 7fc7f747b640 1 -- 172.21.15.96:0/284500158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f00c84e0 con 0x7fc7f00b5630 2024-06-02T23:46:12.238 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.235+0000 7fc7f747b640 1 -- 172.21.15.96:0/284500158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f004f800 con 0x7fc7f00b5630 2024-06-02T23:46:12.238 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.235+0000 7fc7e1ffb640 1 -- 172.21.15.96:0/284500158 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7fc7e401d070 con 0x7fc7f00b5630 2024-06-02T23:46:12.239 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.235+0000 7fc7e1ffb640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc7d406bda0 0x7fc7d406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:12.239 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.236+0000 7fc7e1ffb640 1 -- 172.21.15.96:0/284500158 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fc7e408a200 con 0x7fc7f00b5630 2024-06-02T23:46:12.239 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.236+0000 7fc7f5217640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc7d406bda0 0x7fc7d406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:12.239 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.236+0000 7fc7f5217640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc7d406bda0 0x7fc7d406e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8034000 tx=0x7fc7e802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:12.240 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.240+0000 7fc7e1ffb640 1 -- 172.21.15.96:0/284500158 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc7e4010070 con 0x7fc7f00b5630 2024-06-02T23:46:12.422 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.422+0000 7fc7f747b640 1 -- 172.21.15.96:0/284500158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7f009d850 con 0x7fc7f00b5630 2024-06-02T23:46:12.423 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.423+0000 7fc7e1ffb640 1 -- 172.21.15.96:0/284500158 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fc7e40593d0 con 0x7fc7f00b5630 2024-06-02T23:46:12.423 INFO:teuthology.misc.health.smithi096.stdout: 2024-06-02T23:46:12.423 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":12,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:10.002550+0000","last_up_change":"0.000000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:12.425 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 -- 172.21.15.96:0/284500158 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc7d406bda0 msgr2=0x7fc7d406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc7d406bda0 0x7fc7d406e260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8034000 tx=0x7fc7e802e000 comp rx=0 tx=0).stop 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 -- 172.21.15.96:0/284500158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f00b5630 msgr2=0x7fc7f015fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f00b5630 0x7fc7f015fad0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009fc0 tx=0x7fc7e400d560 comp rx=0 tx=0).stop 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 -- 172.21.15.96:0/284500158 shutdown_connections 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7f0161910 0x7fc7f00cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc7d406bda0 0x7fc7d406e260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc7f00b5630 0x7fc7f015fad0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 --2- 172.21.15.96:0/284500158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7f00b2e30 0x7fc7f015b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 -- 172.21.15.96:0/284500158 >> 172.21.15.96:0/284500158 conn(0x7fc7f009d3b0 msgr2=0x7fc7f00b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 -- 172.21.15.96:0/284500158 shutdown_connections 2024-06-02T23:46:12.426 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:12.425+0000 7fc7f747b640 1 -- 172.21.15.96:0/284500158 wait complete. 2024-06-02T23:46:12.434 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-06-02T23:46:19.241 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:19.344 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.343+0000 7f313a89e640 1 Processor -- start 2024-06-02T23:46:19.344 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.344+0000 7f313a89e640 1 -- start start 2024-06-02T23:46:19.345 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.344+0000 7f313a89e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f313406df80 0x7f3134168f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.345 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.344+0000 7f313a89e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313406ccb0 con 0x7f31340af370 2024-06-02T23:46:19.345 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.344+0000 7f313a89e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313406b4e0 con 0x7f3134067450 2024-06-02T23:46:19.345 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.344+0000 7f313a89e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f31340b0130 con 0x7f313406df80 2024-06-02T23:46:19.345 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.345+0000 7f3133fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f31340af370 0x7f3134162790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37716/0 (socket says 172.21.15.96:37716) 2024-06-02T23:46:19.345 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.345+0000 7f3133fff640 1 -- 172.21.15.96:0/2132315864 learned_addr learned my addr 172.21.15.96:0/2132315864 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:19.345 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.345+0000 7f3138e3b640 1 --2- 172.21.15.96:0/2132315864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f313406df80 0x7f3134168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.346 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.345+0000 7f31337fe640 1 -- 172.21.15.96:0/2132315864 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2765976250 0 0) 0x7f313406ccb0 con 0x7f31340af370 2024-06-02T23:46:19.346 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.345+0000 7f31337fe640 1 -- 172.21.15.96:0/2132315864 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3120003520 con 0x7f31340af370 2024-06-02T23:46:19.346 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.345+0000 7f31337fe640 1 -- 172.21.15.96:0/2132315864 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3173976134 0 0) 0x7f313406b4e0 con 0x7f3134067450 2024-06-02T23:46:19.346 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.345+0000 7f31337fe640 1 -- 172.21.15.96:0/2132315864 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f313406ccb0 con 0x7f3134067450 2024-06-02T23:46:19.346 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.345+0000 7f3138e3b640 1 -- 172.21.15.96:0/2132315864 >> v1:172.21.15.162:6789/0 conn(0x7f3134067450 legacy=0x7f313406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.346 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.345+0000 7f3138e3b640 1 -- 172.21.15.96:0/2132315864 >> v1:172.21.15.96:6789/0 conn(0x7f31340af370 legacy=0x7f3134162790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.346 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.345+0000 7f3138e3b640 1 -- 172.21.15.96:0/2132315864 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31340afb70 con 0x7f313406df80 2024-06-02T23:46:19.347 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.346+0000 7f3138e3b640 1 --2- 172.21.15.96:0/2132315864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f313406df80 0x7f3134168f00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f312c009dc0 tx=0x7f312c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=659d50a05fbcdeb9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:19.347 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.346+0000 7f31337fe640 1 -- 172.21.15.96:0/2132315864 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c007740 con 0x7f313406df80 2024-06-02T23:46:19.347 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.346+0000 7f31337fe640 1 -- 172.21.15.96:0/2132315864 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f312c0078e0 con 0x7f313406df80 2024-06-02T23:46:19.347 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.346+0000 7f31337fe640 1 -- 172.21.15.96:0/2132315864 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c007c90 con 0x7f313406df80 2024-06-02T23:46:19.347 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.347+0000 7f313a89e640 1 -- 172.21.15.96:0/2132315864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f313406df80 msgr2=0x7f3134168f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.348 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.347+0000 7f313a89e640 1 --2- 172.21.15.96:0/2132315864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f313406df80 0x7f3134168f00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f312c009dc0 tx=0x7f312c02a6d0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.348 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.347+0000 7f313a89e640 1 -- 172.21.15.96:0/2132315864 shutdown_connections 2024-06-02T23:46:19.348 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.347+0000 7f313a89e640 1 --2- 172.21.15.96:0/2132315864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f313406df80 0x7f3134168f00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.348 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.347+0000 7f313a89e640 1 -- 172.21.15.96:0/2132315864 >> 172.21.15.96:0/2132315864 conn(0x7f31340cd090 msgr2=0x7f31340cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:19.348 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.347+0000 7f313a89e640 1 -- 172.21.15.96:0/2132315864 shutdown_connections 2024-06-02T23:46:19.348 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.347+0000 7f313a89e640 1 -- 172.21.15.96:0/2132315864 wait complete. 2024-06-02T23:46:19.350 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.348+0000 7f313a89e640 1 Processor -- start 2024-06-02T23:46:19.350 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.348+0000 7f313a89e640 1 -- start start 2024-06-02T23:46:19.350 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f313a89e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3134067450 0x7f313413aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.350 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f313a89e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313406df80 0x7f31341e7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f313a89e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31340af370 0x7f31340cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f313a89e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f313406b780 con 0x7f313406df80 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f313a89e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3134141750 con 0x7f3134067450 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f313a89e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f31340ad8a0 con 0x7f31340af370 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f312bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313406df80 0x7f31341e7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f312bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313406df80 0x7f31341e7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40218/0 (socket says 172.21.15.96:40218) 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f312bfff640 1 -- 172.21.15.96:0/322258706 learned_addr learned my addr 172.21.15.96:0/322258706 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f3133fff640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3134067450 0x7f313413aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f3138e3b640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31340af370 0x7f31340cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f312bfff640 1 -- 172.21.15.96:0/322258706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31340af370 msgr2=0x7f31340cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f312bfff640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31340af370 0x7f31340cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f312bfff640 1 -- 172.21.15.96:0/322258706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3134067450 msgr2=0x7f313413aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f312bfff640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3134067450 0x7f313413aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.351 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f312bfff640 1 -- 172.21.15.96:0/322258706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313415c970 con 0x7f313406df80 2024-06-02T23:46:19.352 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f312bfff640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313406df80 0x7f31341e7df0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f311c00c530 tx=0x7f311c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:19.352 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f31317fa640 1 -- 172.21.15.96:0/322258706 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c0052d0 con 0x7f313406df80 2024-06-02T23:46:19.352 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f31317fa640 1 -- 172.21.15.96:0/322258706 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f311c005490 con 0x7f313406df80 2024-06-02T23:46:19.352 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f313a89e640 1 -- 172.21.15.96:0/322258706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313415cc50 con 0x7f313406df80 2024-06-02T23:46:19.352 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f31317fa640 1 -- 172.21.15.96:0/322258706 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c012870 con 0x7f313406df80 2024-06-02T23:46:19.352 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.349+0000 7f313a89e640 1 -- 172.21.15.96:0/322258706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313415d210 con 0x7f313406df80 2024-06-02T23:46:19.352 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.350+0000 7f313a89e640 1 -- 172.21.15.96:0/322258706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f313404f800 con 0x7f313406df80 2024-06-02T23:46:19.353 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.351+0000 7f31317fa640 1 -- 172.21.15.96:0/322258706 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f311c012a10 con 0x7f313406df80 2024-06-02T23:46:19.353 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.351+0000 7f31317fa640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f311406be30 0x7f311406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.353 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.352+0000 7f3133fff640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f311406be30 0x7f311406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.353 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.352+0000 7f31317fa640 1 -- 172.21.15.96:0/322258706 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f311c08a5f0 con 0x7f313406df80 2024-06-02T23:46:19.353 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.352+0000 7f3133fff640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f311406be30 0x7f311406e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f31240011e0 tx=0x7f3124007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:19.356 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.356+0000 7f31317fa640 1 -- 172.21.15.96:0/322258706 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f311c058cb0 con 0x7f313406df80 2024-06-02T23:46:19.529 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.529+0000 7f313a89e640 1 -- 172.21.15.96:0/322258706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3134067c40 con 0x7f313406df80 2024-06-02T23:46:19.530 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.530+0000 7f31317fa640 1 -- 172.21.15.96:0/322258706 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7f311c05cfb0 con 0x7f313406df80 2024-06-02T23:46:19.530 INFO:teuthology.misc.health.smithi096.stdout: 2024-06-02T23:46:19.530 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":16,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:16.306391+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:19.532 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 -- 172.21.15.96:0/322258706 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f311406be30 msgr2=0x7f311406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.532 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f311406be30 0x7f311406e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f31240011e0 tx=0x7f3124007d30 comp rx=0 tx=0).stop 2024-06-02T23:46:19.532 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 -- 172.21.15.96:0/322258706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313406df80 msgr2=0x7f31341e7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.533 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313406df80 0x7f31341e7df0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f311c00c530 tx=0x7f311c00c9f0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.533 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 -- 172.21.15.96:0/322258706 shutdown_connections 2024-06-02T23:46:19.533 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31340af370 0x7f31340cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.533 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f311406be30 0x7f311406e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.533 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f313406df80 0x7f31341e7df0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.533 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 --2- 172.21.15.96:0/322258706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3134067450 0x7f313413aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.533 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 -- 172.21.15.96:0/322258706 >> 172.21.15.96:0/322258706 conn(0x7f31340cd090 msgr2=0x7f31340ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:19.533 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 -- 172.21.15.96:0/322258706 shutdown_connections 2024-06-02T23:46:19.533 INFO:teuthology.misc.health.smithi096.stderr:2024-06-02T23:46:19.532+0000 7f313a89e640 1 -- 172.21.15.96:0/322258706 wait complete. 2024-06-02T23:46:19.542 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-06-02T23:46:19.542 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-06-02T23:46:19.542 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-02T23:46:19.543 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-02T23:46:19.545 INFO:tasks.ceph.mds.a:Started 2024-06-02T23:46:19.545 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-02T23:46:19.545 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-02T23:46:19.547 INFO:tasks.ceph.mds.c:Started 2024-06-02T23:46:19.547 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-02T23:46:19.547 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-02T23:46:19.550 INFO:tasks.ceph.mds.b:Started 2024-06-02T23:46:19.550 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-02T23:46:19.551 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-02T23:46:19.553 INFO:tasks.ceph.mds.d:Started 2024-06-02T23:46:19.553 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-06-02T23:46:19.553 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:46:19.619 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2024-06-02T23:46:19.619 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-06-02T23:46:19.635 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-06-02T23:46:19.636 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-06-02T23:46:19.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.656+0000 7f53f7de7640 1 Processor -- start 2024-06-02T23:46:19.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.657+0000 7f53f7de7640 1 -- start start 2024-06-02T23:46:19.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.657+0000 7f53f7de7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f53f0161900 0x7f53f00d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.657+0000 7f53f7de7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f53f00b4fa0 0x7f53f00d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.657+0000 7f53f7de7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f00d4a90 con 0x7f53f00b5510 2024-06-02T23:46:19.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.657+0000 7f53f7de7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f53f00cf5c0 con 0x7f53f0161900 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.657+0000 7f53f7de7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f53f00caf70 con 0x7f53f00b4fa0 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.657+0000 7f53f5b83640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f53f0161900 0x7f53f00d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.657+0000 7f53f5b83640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f53f0161900 0x7f53f00d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40260/0 (socket says 172.21.15.96:40260) 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.658+0000 7f53f5b83640 1 -- 172.21.15.96:0/3293490996 learned_addr learned my addr 172.21.15.96:0/3293490996 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.658+0000 7f53f6384640 1 --2- 172.21.15.96:0/3293490996 >> v2:172.21.15.162:3300/0 conn(0x7f53f00b4fa0 0x7f53f00d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.658+0000 7f53f5b83640 1 -- 172.21.15.96:0/3293490996 >> v2:172.21.15.162:3300/0 conn(0x7f53f00b4fa0 msgr2=0x7f53f00d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.658+0000 7f53f5b83640 1 --2- 172.21.15.96:0/3293490996 >> v2:172.21.15.162:3300/0 conn(0x7f53f00b4fa0 0x7f53f00d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.658+0000 7f53f5b83640 1 -- 172.21.15.96:0/3293490996 >> v1:172.21.15.162:6789/0 conn(0x7f53f00b5510 legacy=0x7f53f00d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.658+0000 7f53f5b83640 1 -- 172.21.15.96:0/3293490996 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f00d4d70 con 0x7f53f0161900 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.658+0000 7f53f5b83640 1 --2- 172.21.15.96:0/3293490996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f0161900 0x7f53f00d0a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f53f00d39c0 tx=0x7f53ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0830c70b56bc96 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f4b81640 1 -- 172.21.15.96:0/3293490996 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec037070 con 0x7f53f0161900 2024-06-02T23:46:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f4b81640 1 -- 172.21.15.96:0/3293490996 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec032440 con 0x7f53f0161900 2024-06-02T23:46:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f4b81640 1 -- 172.21.15.96:0/3293490996 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec032810 con 0x7f53f0161900 2024-06-02T23:46:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f7de7640 1 -- 172.21.15.96:0/3293490996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f0161900 msgr2=0x7f53f00d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f7de7640 1 --2- 172.21.15.96:0/3293490996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f0161900 0x7f53f00d0a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f53f00d39c0 tx=0x7f53ec02a1a0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f7de7640 1 -- 172.21.15.96:0/3293490996 shutdown_connections 2024-06-02T23:46:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f7de7640 1 --2- 172.21.15.96:0/3293490996 >> v2:172.21.15.162:3300/0 conn(0x7f53f00b4fa0 0x7f53f00d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f7de7640 1 --2- 172.21.15.96:0/3293490996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f0161900 0x7f53f00d0a10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f7de7640 1 -- 172.21.15.96:0/3293490996 >> 172.21.15.96:0/3293490996 conn(0x7f53f009d3b0 msgr2=0x7f53f00d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f7de7640 1 -- 172.21.15.96:0/3293490996 shutdown_connections 2024-06-02T23:46:19.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.659+0000 7f53f7de7640 1 -- 172.21.15.96:0/3293490996 wait complete. 2024-06-02T23:46:19.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.660+0000 7f53f7de7640 1 Processor -- start 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.660+0000 7f53f7de7640 1 -- start start 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f7de7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f00b4fa0 0x7f53f0158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f7de7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53f00b5510 0x7f53f0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f7de7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53f0161900 0x7f53f015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f7de7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f53f00d4780 con 0x7f53f00b4fa0 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f7de7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53f00cfae0 con 0x7f53f00b5510 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f7de7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f53f0161ce0 con 0x7f53f0161900 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f5b83640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f00b4fa0 0x7f53f0158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f5b83640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f00b4fa0 0x7f53f0158630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40276/0 (socket says 172.21.15.96:40276) 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f5b83640 1 -- 172.21.15.96:0/2683720450 learned_addr learned my addr 172.21.15.96:0/2683720450 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f6384640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53f0161900 0x7f53f015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f5382640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53f00b5510 0x7f53f0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f5b83640 1 -- 172.21.15.96:0/2683720450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53f0161900 msgr2=0x7f53f015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f5b83640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53f0161900 0x7f53f015cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f5b83640 1 -- 172.21.15.96:0/2683720450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53f00b5510 msgr2=0x7f53f0159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f5b83640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53f00b5510 0x7f53f0159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.661+0000 7f53f5b83640 1 -- 172.21.15.96:0/2683720450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f015a500 con 0x7f53f00b4fa0 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.662+0000 7f53f5b83640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f00b4fa0 0x7f53f0158630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f53ec000c00 tx=0x7f53ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.662+0000 7f53e67fc640 1 -- 172.21.15.96:0/2683720450 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec041020 con 0x7f53f00b4fa0 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.662+0000 7f53e67fc640 1 -- 172.21.15.96:0/2683720450 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec0306c0 con 0x7f53f00b4fa0 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.662+0000 7f53f7de7640 1 -- 172.21.15.96:0/2683720450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f015a7e0 con 0x7f53f00b4fa0 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.662+0000 7f53e67fc640 1 -- 172.21.15.96:0/2683720450 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec037040 con 0x7f53f00b4fa0 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.662+0000 7f53f7de7640 1 -- 172.21.15.96:0/2683720450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f015ada0 con 0x7f53f00b4fa0 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.663+0000 7f53f7de7640 1 -- 172.21.15.96:0/2683720450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f01f3dd0 con 0x7f53f00b4fa0 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.663+0000 7f53e67fc640 1 -- 172.21.15.96:0/2683720450 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53ec044020 con 0x7f53f00b4fa0 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.664+0000 7f53e67fc640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f53d406be30 0x7f53d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.664+0000 7f53e67fc640 1 -- 172.21.15.96:0/2683720450 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f53ec0ab4f0 con 0x7f53f00b4fa0 2024-06-02T23:46:19.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.664+0000 7f53f5382640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f53d406be30 0x7f53d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:19.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.664+0000 7f53f5382640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f53d406be30 0x7f53d406e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53f00cdae0 tx=0x7f53e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:19.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.668+0000 7f53e67fc640 1 -- 172.21.15.96:0/2683720450 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f53ec04b030 con 0x7f53f00b4fa0 2024-06-02T23:46:19.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.880+0000 7f53f7de7640 1 -- 172.21.15.96:0/2683720450 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53f00683e0 con 0x7f53f00b4fa0 2024-06-02T23:46:19.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.881+0000 7f53e67fc640 1 -- 172.21.15.96:0/2683720450 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f53ec07a0c0 con 0x7f53f00b4fa0 2024-06-02T23:46:19.881 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:19.881 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-02T23:46:19.881 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 2 2024-06-02T23:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 -- 172.21.15.96:0/2683720450 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f53d406be30 msgr2=0x7f53d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f53d406be30 0x7f53d406e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f53f00cdae0 tx=0x7f53e0009040 comp rx=0 tx=0).stop 2024-06-02T23:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 -- 172.21.15.96:0/2683720450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f00b4fa0 msgr2=0x7f53f0158630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f00b4fa0 0x7f53f0158630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f53ec000c00 tx=0x7f53ec0046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 -- 172.21.15.96:0/2683720450 shutdown_connections 2024-06-02T23:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53f0161900 0x7f53f015cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53f00b5510 0x7f53f0159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f53d406be30 0x7f53d406e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 --2- 172.21.15.96:0/2683720450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f00b4fa0 0x7f53f0158630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 -- 172.21.15.96:0/2683720450 >> 172.21.15.96:0/2683720450 conn(0x7f53f009d3b0 msgr2=0x7f53f006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 -- 172.21.15.96:0/2683720450 shutdown_connections 2024-06-02T23:46:19.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:19.883+0000 7f53f7de7640 1 -- 172.21.15.96:0/2683720450 wait complete. 2024-06-02T23:46:21.895 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:46:22.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.006+0000 7f02c29dc640 1 Processor -- start 2024-06-02T23:46:22.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.006+0000 7f02c29dc640 1 -- start start 2024-06-02T23:46:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c29dc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02bc15f5e0 0x7f02bc071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c29dc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02bc0cae00 0x7f02bc0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c29dc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02bc06f210 con 0x7f02bc06ea70 2024-06-02T23:46:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c29dc640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f02bc06ef30 con 0x7f02bc0cae00 2024-06-02T23:46:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c29dc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f02bc0ca320 con 0x7f02bc15f5e0 2024-06-02T23:46:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c0f79640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02bc0cae00 0x7f02bc0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c0f79640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f02bc0cae00 0x7f02bc0cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40286/0 (socket says 172.21.15.96:40286) 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c0f79640 1 -- 172.21.15.96:0/2443899624 learned_addr learned my addr 172.21.15.96:0/2443899624 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02bbfff640 1 --2- 172.21.15.96:0/2443899624 >> v2:172.21.15.162:3300/0 conn(0x7f02bc15f5e0 0x7f02bc071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c0f79640 1 -- 172.21.15.96:0/2443899624 >> v2:172.21.15.162:3300/0 conn(0x7f02bc15f5e0 msgr2=0x7f02bc071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c0f79640 1 --2- 172.21.15.96:0/2443899624 >> v2:172.21.15.162:3300/0 conn(0x7f02bc15f5e0 0x7f02bc071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c0f79640 1 -- 172.21.15.96:0/2443899624 >> v1:172.21.15.162:6789/0 conn(0x7f02bc06ea70 legacy=0x7f02bc071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02c0f79640 1 -- 172.21.15.96:0/2443899624 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02bc0ca600 con 0x7f02bc0cae00 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.007+0000 7f02bbfff640 1 --2- 172.21.15.96:0/2443899624 >> v2:172.21.15.162:3300/0 conn(0x7f02bc15f5e0 0x7f02bc071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.008+0000 7f02c0f79640 1 --2- 172.21.15.96:0/2443899624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc0cae00 0x7f02bc0cb210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02bc070ba0 tx=0x7f02b402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a175118b958a69 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.008+0000 7f02baffd640 1 -- 172.21.15.96:0/2443899624 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4036070 con 0x7f02bc0cae00 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.008+0000 7f02baffd640 1 -- 172.21.15.96:0/2443899624 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b4031600 con 0x7f02bc0cae00 2024-06-02T23:46:22.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.008+0000 7f02baffd640 1 -- 172.21.15.96:0/2443899624 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b40319d0 con 0x7f02bc0cae00 2024-06-02T23:46:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.009+0000 7f02c29dc640 1 -- 172.21.15.96:0/2443899624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc0cae00 msgr2=0x7f02bc0cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.009+0000 7f02c29dc640 1 --2- 172.21.15.96:0/2443899624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc0cae00 0x7f02bc0cb210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02bc070ba0 tx=0x7f02b402a6f0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.009+0000 7f02c29dc640 1 -- 172.21.15.96:0/2443899624 shutdown_connections 2024-06-02T23:46:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.009+0000 7f02c29dc640 1 --2- 172.21.15.96:0/2443899624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc0cae00 0x7f02bc0cb210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.009+0000 7f02c29dc640 1 --2- 172.21.15.96:0/2443899624 >> v2:172.21.15.162:3300/0 conn(0x7f02bc15f5e0 0x7f02bc071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.009+0000 7f02c29dc640 1 -- 172.21.15.96:0/2443899624 >> 172.21.15.96:0/2443899624 conn(0x7f02bc0cfc30 msgr2=0x7f02bc0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:22.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.009+0000 7f02c29dc640 1 -- 172.21.15.96:0/2443899624 shutdown_connections 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.009+0000 7f02c29dc640 1 -- 172.21.15.96:0/2443899624 wait complete. 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.010+0000 7f02c29dc640 1 Processor -- start 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.010+0000 7f02c29dc640 1 -- start start 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02c29dc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc06ea70 0x7f02bc0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02c29dc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02bc0cae00 0x7f02bc157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02c29dc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02bc15f5e0 0x7f02bc0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02c29dc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc0731b0 con 0x7f02bc06ea70 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02c29dc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc073030 con 0x7f02bc0cae00 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02c29dc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f02bc0b2ac0 con 0x7f02bc15f5e0 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc06ea70 0x7f02bc0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc06ea70 0x7f02bc0c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40302/0 (socket says 172.21.15.96:40302) 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bbfff640 1 -- 172.21.15.96:0/534266750 learned_addr learned my addr 172.21.15.96:0/534266750 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:22.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02c0f79640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02bc15f5e0 0x7f02bc0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bb7fe640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02bc0cae00 0x7f02bc157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bbfff640 1 -- 172.21.15.96:0/534266750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02bc15f5e0 msgr2=0x7f02bc0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bbfff640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02bc15f5e0 0x7f02bc0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bbfff640 1 -- 172.21.15.96:0/534266750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02bc0cae00 msgr2=0x7f02bc157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bbfff640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02bc0cae00 0x7f02bc157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bbfff640 1 -- 172.21.15.96:0/534266750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02bc1f5650 con 0x7f02bc06ea70 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bb7fe640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02bc0cae00 0x7f02bc157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02bbfff640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc06ea70 0x7f02bc0c6100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00c820 tx=0x7f02ac00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02b8ff9640 1 -- 172.21.15.96:0/534266750 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac015070 con 0x7f02bc06ea70 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02b8ff9640 1 -- 172.21.15.96:0/534266750 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ac007a30 con 0x7f02bc06ea70 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02b8ff9640 1 -- 172.21.15.96:0/534266750 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac007de0 con 0x7f02bc06ea70 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.011+0000 7f02c29dc640 1 -- 172.21.15.96:0/534266750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02bc0c6640 con 0x7f02bc06ea70 2024-06-02T23:46:22.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.012+0000 7f02c29dc640 1 -- 172.21.15.96:0/534266750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02bc1f5bd0 con 0x7f02bc06ea70 2024-06-02T23:46:22.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.013+0000 7f02c29dc640 1 -- 172.21.15.96:0/534266750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02bc0683e0 con 0x7f02bc06ea70 2024-06-02T23:46:22.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.013+0000 7f02b8ff9640 1 -- 172.21.15.96:0/534266750 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f02ac018070 con 0x7f02bc06ea70 2024-06-02T23:46:22.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.014+0000 7f02b8ff9640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f02a806be30 0x7f02a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.014+0000 7f02bb7fe640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f02a806be30 0x7f02a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.014+0000 7f02b8ff9640 1 -- 172.21.15.96:0/534266750 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f02ac08a9e0 con 0x7f02bc06ea70 2024-06-02T23:46:22.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.014+0000 7f02bb7fe640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f02a806be30 0x7f02a806e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f02bc14ce60 tx=0x7f02b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:22.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.018+0000 7f02b8ff9640 1 -- 172.21.15.96:0/534266750 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f02ac0596e0 con 0x7f02bc06ea70 2024-06-02T23:46:22.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.228+0000 7f02c29dc640 1 -- 172.21.15.96:0/534266750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02bc0cc920 con 0x7f02bc06ea70 2024-06-02T23:46:22.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.229+0000 7f02b8ff9640 1 -- 172.21.15.96:0/534266750 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f02ac058fe0 con 0x7f02bc06ea70 2024-06-02T23:46:22.229 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:22.229 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-06-02T23:46:22.230 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 3 2024-06-02T23:46:22.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 -- 172.21.15.96:0/534266750 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f02a806be30 msgr2=0x7f02a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f02a806be30 0x7f02a806e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f02bc14ce60 tx=0x7f02b0009040 comp rx=0 tx=0).stop 2024-06-02T23:46:22.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 -- 172.21.15.96:0/534266750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc06ea70 msgr2=0x7f02bc0c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc06ea70 0x7f02bc0c6100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00c820 tx=0x7f02ac00cce0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 -- 172.21.15.96:0/534266750 shutdown_connections 2024-06-02T23:46:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02bc15f5e0 0x7f02bc0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02bc0cae00 0x7f02bc157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f02a806be30 0x7f02a806e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 --2- 172.21.15.96:0/534266750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02bc06ea70 0x7f02bc0c6100 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 -- 172.21.15.96:0/534266750 >> 172.21.15.96:0/534266750 conn(0x7f02bc0cfc30 msgr2=0x7f02bc0b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 -- 172.21.15.96:0/534266750 shutdown_connections 2024-06-02T23:46:22.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.231+0000 7f02c29dc640 1 -- 172.21.15.96:0/534266750 wait complete. 2024-06-02T23:46:22.242 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T23:46:22.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.341+0000 7fb78bc15640 1 Processor -- start 2024-06-02T23:46:22.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.342+0000 7fb78bc15640 1 -- start start 2024-06-02T23:46:22.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.342+0000 7fb78bc15640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78415c360 0x7fb7840ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.342+0000 7fb78bc15640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7840d07f0 con 0x7fb7840cdbb0 2024-06-02T23:46:22.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.342+0000 7fb78bc15640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7840d0ad0 con 0x7fb7840cec20 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.342+0000 7fb78bc15640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb7840cf080 con 0x7fb78415c360 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb78a1b2640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb7840cdbb0 0x7fb7840c6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37726/0 (socket says 172.21.15.96:37726) 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb78a1b2640 1 -- 172.21.15.96:0/2165529064 learned_addr learned my addr 172.21.15.96:0/2165529064 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7899b1640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78415c360 0x7fb7840ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3204328080 0 0) 0x7fb7840d07f0 con 0x7fb7840cdbb0 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb76c003520 con 0x7fb7840cdbb0 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2024638455 0 0) 0x7fb76c003520 con 0x7fb7840cdbb0 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78415c360 msgr2=0x7fb7840ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78415c360 0x7fb7840ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 >> v1:172.21.15.162:6789/0 conn(0x7fb7840cec20 legacy=0x7fb7840c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7840d0db0 con 0x7fb7840cdbb0 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fb77c001670 con 0x7fb7840cdbb0 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 >> v1:172.21.15.96:6789/0 conn(0x7fb7840cdbb0 legacy=0x7fb7840c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78415c360 0x7fb76c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb76c003f60 0x7fb76c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c004d40 0x7fb76c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c00bb50 con 0x7fb76c004d40 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c00bcd0 con 0x7fb76c003f60 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb76c00bed0 con 0x7fb78415c360 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb78a1b2640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c004d40 0x7fb76c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7899b1640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78415c360 0x7fb76c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb7891b0640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb76c003f60 0x7fb76c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb78a1b2640 1 -- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78415c360 msgr2=0x7fb76c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb78a1b2640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78415c360 0x7fb76c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb78a1b2640 1 -- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb76c003f60 msgr2=0x7fb76c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.343+0000 7fb78a1b2640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb76c003f60 0x7fb76c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.344+0000 7fb78a1b2640 1 -- 172.21.15.96:0/2165529064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c003520 con 0x7fb76c004d40 2024-06-02T23:46:22.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.344+0000 7fb78a1b2640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c004d40 0x7fb76c0051c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00c210 tx=0x7fb76c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709bf3125a78769a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:22.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.344+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c007d30 con 0x7fb76c004d40 2024-06-02T23:46:22.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.344+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77c005af0 con 0x7fb76c004d40 2024-06-02T23:46:22.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.344+0000 7fb7889af640 1 -- 172.21.15.96:0/2165529064 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c007070 con 0x7fb76c004d40 2024-06-02T23:46:22.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.345+0000 7fb78bc15640 1 -- 172.21.15.96:0/2165529064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c004d40 msgr2=0x7fb76c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.345+0000 7fb78bc15640 1 --2- 172.21.15.96:0/2165529064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb76c004d40 0x7fb76c0051c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00c210 tx=0x7fb76c005830 comp rx=0 tx=0).stop 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.345+0000 7fb78a1b2640 1 -- 172.21.15.96:0/2165529064 reap_dead start 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.345+0000 7fb78bc15640 1 -- 172.21.15.96:0/2165529064 shutdown_connections 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.345+0000 7fb78bc15640 1 -- 172.21.15.96:0/2165529064 >> 172.21.15.96:0/2165529064 conn(0x7fb7840d1db0 msgr2=0x7fb7840d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.345+0000 7fb78bc15640 1 -- 172.21.15.96:0/2165529064 shutdown_connections 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.345+0000 7fb78bc15640 1 -- 172.21.15.96:0/2165529064 wait complete. 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.346+0000 7fb78bc15640 1 Processor -- start 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.346+0000 7fb78bc15640 1 -- start start 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78bc15640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb76c004d40 0x7fb7840cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78bc15640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7840b2ff0 0x7fb784156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78bc15640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb784154170 0x7fb784150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78bc15640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb7840d05a0 con 0x7fb784154170 2024-06-02T23:46:22.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78bc15640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb78415c740 con 0x7fb7840b2ff0 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78bc15640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb7840ce040 con 0x7fb76c004d40 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78a1b2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb784154170 0x7fb784150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78a1b2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb784154170 0x7fb784150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40320/0 (socket says 172.21.15.96:40320) 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78a1b2640 1 -- 172.21.15.96:0/1927379717 learned_addr learned my addr 172.21.15.96:0/1927379717 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb7899b1640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb76c004d40 0x7fb7840cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb7891b0640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7840b2ff0 0x7fb784156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78a1b2640 1 -- 172.21.15.96:0/1927379717 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb76c004d40 msgr2=0x7fb7840cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78a1b2640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb76c004d40 0x7fb7840cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78a1b2640 1 -- 172.21.15.96:0/1927379717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7840b2ff0 msgr2=0x7fb784156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78a1b2640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7840b2ff0 0x7fb784156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78a1b2640 1 -- 172.21.15.96:0/1927379717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb784151b10 con 0x7fb784154170 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb7891b0640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7840b2ff0 0x7fb784156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78a1b2640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb784154170 0x7fb784150c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00c330 tx=0x7fb77c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:22.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb7827fc640 1 -- 172.21.15.96:0/1927379717 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c000ed0 con 0x7fb784154170 2024-06-02T23:46:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb7827fc640 1 -- 172.21.15.96:0/1927379717 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77c007d10 con 0x7fb784154170 2024-06-02T23:46:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb78bc15640 1 -- 172.21.15.96:0/1927379717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7840b3590 con 0x7fb784154170 2024-06-02T23:46:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.347+0000 7fb7827fc640 1 -- 172.21.15.96:0/1927379717 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c007070 con 0x7fb784154170 2024-06-02T23:46:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.348+0000 7fb78bc15640 1 -- 172.21.15.96:0/1927379717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb784152100 con 0x7fb784154170 2024-06-02T23:46:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.348+0000 7fb78bc15640 1 -- 172.21.15.96:0/1927379717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb784067c30 con 0x7fb784154170 2024-06-02T23:46:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.349+0000 7fb7827fc640 1 -- 172.21.15.96:0/1927379717 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb77c046020 con 0x7fb784154170 2024-06-02T23:46:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.349+0000 7fb7827fc640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb77006bfd0 0x7fb77006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.349+0000 7fb7827fc640 1 -- 172.21.15.96:0/1927379717 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb77c0aa920 con 0x7fb784154170 2024-06-02T23:46:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.349+0000 7fb7899b1640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb77006bfd0 0x7fb77006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.350+0000 7fb7899b1640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb77006bfd0 0x7fb77006e490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb774014510 tx=0x7fb77400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:22.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.354+0000 7fb7827fc640 1 -- 172.21.15.96:0/1927379717 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb784067c30 con 0x7fb784154170 2024-06-02T23:46:22.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.527+0000 7fb78bc15640 1 -- 172.21.15.96:0/1927379717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb784073410 con 0x7fb784154170 2024-06-02T23:46:22.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.528+0000 7fb7827fc640 1 -- 172.21.15.96:0/1927379717 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fb77c079820 con 0x7fb784154170 2024-06-02T23:46:22.530 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:22.530 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-06-02T23:46:22.530 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:46:22.530 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2024-06-02T23:46:22.530 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2024-06-02T23:46:22.530 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:46:22.530 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-06-02T23:46:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 -- 172.21.15.96:0/1927379717 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb77006bfd0 msgr2=0x7fb77006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb77006bfd0 0x7fb77006e490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb774014510 tx=0x7fb77400b040 comp rx=0 tx=0).stop 2024-06-02T23:46:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 -- 172.21.15.96:0/1927379717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb784154170 msgr2=0x7fb784150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb784154170 0x7fb784150c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00c330 tx=0x7fb77c001a40 comp rx=0 tx=0).stop 2024-06-02T23:46:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 -- 172.21.15.96:0/1927379717 shutdown_connections 2024-06-02T23:46:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb77006bfd0 0x7fb77006e490 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb784154170 0x7fb784150c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7840b2ff0 0x7fb784156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 --2- 172.21.15.96:0/1927379717 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb76c004d40 0x7fb7840cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 -- 172.21.15.96:0/1927379717 >> 172.21.15.96:0/1927379717 conn(0x7fb7840d1db0 msgr2=0x7fb7840d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:22.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 -- 172.21.15.96:0/1927379717 shutdown_connections 2024-06-02T23:46:22.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.530+0000 7fb78bc15640 1 -- 172.21.15.96:0/1927379717 wait complete. 2024-06-02T23:46:22.541 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T23:46:22.541 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T23:46:22.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.643+0000 7f01a2e9a640 1 Processor -- start 2024-06-02T23:46:22.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.644+0000 7f01a2e9a640 1 -- start start 2024-06-02T23:46:22.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.644+0000 7f01a2e9a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f019c15c130 0x7f019c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.644+0000 7f01a2e9a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 0x7f019c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.644+0000 7f01a2e9a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f019c0cdbb0 con 0x7f019c0cd440 2024-06-02T23:46:22.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.644+0000 7f01a2e9a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f019c0b1a60 con 0x7f019c15c130 2024-06-02T23:46:22.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.644+0000 7f01a2e9a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f019c0b1410 con 0x7f019c0d0730 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.644+0000 7f01a0c36640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f019c15c130 0x7f019c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.645+0000 7f01a0c36640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f019c15c130 0x7f019c0cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40324/0 (socket says 172.21.15.96:40324) 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.645+0000 7f01a0c36640 1 -- 172.21.15.96:0/2084747364 learned_addr learned my addr 172.21.15.96:0/2084747364 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.645+0000 7f01a1437640 1 --2- 172.21.15.96:0/2084747364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 0x7f019c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.645+0000 7f01a0c36640 1 -- 172.21.15.96:0/2084747364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 msgr2=0x7f019c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.645+0000 7f01a0c36640 1 --2- 172.21.15.96:0/2084747364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 0x7f019c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.645+0000 7f01a0c36640 1 -- 172.21.15.96:0/2084747364 >> v1:172.21.15.162:6789/0 conn(0x7f019c0cd440 legacy=0x7f019c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.645+0000 7f01a0c36640 1 -- 172.21.15.96:0/2084747364 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c0b16f0 con 0x7f019c15c130 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.645+0000 7f01a1437640 1 --2- 172.21.15.96:0/2084747364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 0x7f019c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.645+0000 7f01a0c36640 1 --2- 172.21.15.96:0/2084747364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c15c130 0x7f019c0cf9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f018c009870 tx=0x7f018c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcdf300a0e545b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.645+0000 7f019b7fe640 1 -- 172.21.15.96:0/2084747364 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c037070 con 0x7f019c15c130 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.646+0000 7f019b7fe640 1 -- 172.21.15.96:0/2084747364 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018c032440 con 0x7f019c15c130 2024-06-02T23:46:22.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.646+0000 7f019b7fe640 1 -- 172.21.15.96:0/2084747364 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c032810 con 0x7f019c15c130 2024-06-02T23:46:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.646+0000 7f01a2e9a640 1 -- 172.21.15.96:0/2084747364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c15c130 msgr2=0x7f019c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.646+0000 7f01a2e9a640 1 --2- 172.21.15.96:0/2084747364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c15c130 0x7f019c0cf9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f018c009870 tx=0x7f018c02a210 comp rx=0 tx=0).stop 2024-06-02T23:46:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.646+0000 7f01a2e9a640 1 -- 172.21.15.96:0/2084747364 shutdown_connections 2024-06-02T23:46:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.646+0000 7f01a2e9a640 1 --2- 172.21.15.96:0/2084747364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 0x7f019c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.646+0000 7f01a2e9a640 1 --2- 172.21.15.96:0/2084747364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c15c130 0x7f019c0cf9f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.646+0000 7f01a2e9a640 1 -- 172.21.15.96:0/2084747364 >> 172.21.15.96:0/2084747364 conn(0x7f019c0d1e20 msgr2=0x7f019c0d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.646+0000 7f01a2e9a640 1 -- 172.21.15.96:0/2084747364 shutdown_connections 2024-06-02T23:46:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.646+0000 7f01a2e9a640 1 -- 172.21.15.96:0/2084747364 wait complete. 2024-06-02T23:46:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.647+0000 7f01a2e9a640 1 Processor -- start 2024-06-02T23:46:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.647+0000 7f01a2e9a640 1 -- start start 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a2e9a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c0cd440 0x7f019c0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a2e9a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 0x7f019c0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a2e9a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c15c130 0x7f019c0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a2e9a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f019c15c690 con 0x7f019c0cd440 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a2e9a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f019c15c510 con 0x7f019c15c130 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a2e9a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f019c0b2430 con 0x7f019c0d0730 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a0c36640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c0cd440 0x7f019c0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a0c36640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c0cd440 0x7f019c0b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40340/0 (socket says 172.21.15.96:40340) 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a0c36640 1 -- 172.21.15.96:0/336609007 learned_addr learned my addr 172.21.15.96:0/336609007 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a1437640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c15c130 0x7f019c0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f019bfff640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 0x7f019c0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a0c36640 1 -- 172.21.15.96:0/336609007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 msgr2=0x7f019c0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a0c36640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 0x7f019c0cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a0c36640 1 -- 172.21.15.96:0/336609007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c15c130 msgr2=0x7f019c0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a0c36640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c15c130 0x7f019c0cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a0c36640 1 -- 172.21.15.96:0/336609007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c09cb50 con 0x7f019c0cd440 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.648+0000 7f01a1437640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c15c130 0x7f019c0cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.649+0000 7f01a0c36640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c0cd440 0x7f019c0b2da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f018c000c00 tx=0x7f018c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.649+0000 7f01997fa640 1 -- 172.21.15.96:0/336609007 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c037040 con 0x7f019c0cd440 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.649+0000 7f01997fa640 1 -- 172.21.15.96:0/336609007 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018c042070 con 0x7f019c0cd440 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.649+0000 7f01a2e9a640 1 -- 172.21.15.96:0/336609007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019c14af60 con 0x7f019c0cd440 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.649+0000 7f01997fa640 1 -- 172.21.15.96:0/336609007 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c030bb0 con 0x7f019c0cd440 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.649+0000 7f01a2e9a640 1 -- 172.21.15.96:0/336609007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019c14b520 con 0x7f019c0cd440 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.650+0000 7f01a2e9a640 1 -- 172.21.15.96:0/336609007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f019c068af0 con 0x7f019c0cd440 2024-06-02T23:46:22.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.650+0000 7f01997fa640 1 -- 172.21.15.96:0/336609007 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f018c047460 con 0x7f019c0cd440 2024-06-02T23:46:22.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.651+0000 7f01997fa640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f017c06be60 0x7f017c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:22.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.651+0000 7f01997fa640 1 -- 172.21.15.96:0/336609007 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f018c0ab790 con 0x7f019c0cd440 2024-06-02T23:46:22.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.651+0000 7f019bfff640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f017c06be60 0x7f017c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:22.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.651+0000 7f019bfff640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f017c06be60 0x7f017c06e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0184007fd0 tx=0x7f0184009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:22.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.655+0000 7f01997fa640 1 -- 172.21.15.96:0/336609007 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f018c045360 con 0x7f019c0cd440 2024-06-02T23:46:22.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:22.832+0000 7f01a2e9a640 1 -- 172.21.15.96:0/336609007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f019c070d40 con 0x7f019c0cd440 2024-06-02T23:46:23.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.697+0000 7f01997fa640 1 -- 172.21.15.96:0/336609007 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f018c07a490 con 0x7f019c0cd440 2024-06-02T23:46:23.697 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2024-06-02T23:46:23.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.700+0000 7f01a2e9a640 1 -- 172.21.15.96:0/336609007 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f017c06be60 msgr2=0x7f017c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:23.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.700+0000 7f01a2e9a640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f017c06be60 0x7f017c06e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0184007fd0 tx=0x7f0184009040 comp rx=0 tx=0).stop 2024-06-02T23:46:23.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.700+0000 7f01a2e9a640 1 -- 172.21.15.96:0/336609007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c0cd440 msgr2=0x7f019c0b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:23.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.700+0000 7f01a2e9a640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c0cd440 0x7f019c0b2da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f018c000c00 tx=0x7f018c0046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.701+0000 7f01a2e9a640 1 -- 172.21.15.96:0/336609007 shutdown_connections 2024-06-02T23:46:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.701+0000 7f01a2e9a640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c15c130 0x7f019c0cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.701+0000 7f01a2e9a640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c0d0730 0x7f019c0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.701+0000 7f01a2e9a640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f017c06be60 0x7f017c06e320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.701+0000 7f01a2e9a640 1 --2- 172.21.15.96:0/336609007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c0cd440 0x7f019c0b2da0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.701+0000 7f01a2e9a640 1 -- 172.21.15.96:0/336609007 >> 172.21.15.96:0/336609007 conn(0x7f019c0d1e20 msgr2=0x7f019c0b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.701+0000 7f01a2e9a640 1 -- 172.21.15.96:0/336609007 shutdown_connections 2024-06-02T23:46:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.701+0000 7f01a2e9a640 1 -- 172.21.15.96:0/336609007 wait complete. 2024-06-02T23:46:23.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-06-02T23:46:23.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.825+0000 7f2c55cbd640 1 Processor -- start 2024-06-02T23:46:23.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.826+0000 7f2c55cbd640 1 -- start start 2024-06-02T23:46:23.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.826+0000 7f2c55cbd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c500b4640 0x7f2c500b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:23.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.826+0000 7f2c55cbd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2c500b4b50 0x7f2c500b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:23.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.826+0000 7f2c55cbd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c500d2630 0x7f2c500d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:23.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.826+0000 7f2c55cbd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2c500d4ff0 con 0x7f2c500d2630 2024-06-02T23:46:23.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.826+0000 7f2c55cbd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2c500b73e0 con 0x7f2c500b4b50 2024-06-02T23:46:23.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.826+0000 7f2c55cbd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c500cec60 con 0x7f2c500b4640 2024-06-02T23:46:23.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.827+0000 7f2c4ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c500d2630 0x7f2c500d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:23.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.827+0000 7f2c4ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c500d2630 0x7f2c500d2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53916/0 (socket says 172.21.15.96:53916) 2024-06-02T23:46:23.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.827+0000 7f2c4ffff640 1 -- 172.21.15.96:0/3182427399 learned_addr learned my addr 172.21.15.96:0/3182427399 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.827+0000 7f2c4f7fe640 1 --2- 172.21.15.96:0/3182427399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c500b4640 0x7f2c500b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.827+0000 7f2c4ffff640 1 -- 172.21.15.96:0/3182427399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c500b4640 msgr2=0x7f2c500b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.827+0000 7f2c4ffff640 1 --2- 172.21.15.96:0/3182427399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c500b4640 0x7f2c500b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.827+0000 7f2c4ffff640 1 -- 172.21.15.96:0/3182427399 >> v2:172.21.15.162:3300/0 conn(0x7f2c500b4b50 msgr2=0x7f2c500b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.827+0000 7f2c4ffff640 1 --2- 172.21.15.96:0/3182427399 >> v2:172.21.15.162:3300/0 conn(0x7f2c500b4b50 0x7f2c500b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.827+0000 7f2c4ffff640 1 -- 172.21.15.96:0/3182427399 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c500d1fd0 con 0x7f2c500d2630 2024-06-02T23:46:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c4ffff640 1 --2- 172.21.15.96:0/3182427399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 0x7f2c500d2ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2c5008da30 tx=0x7f2c4802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f595d6e2aa49d31 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c4e7fc640 1 -- 172.21.15.96:0/3182427399 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48036070 con 0x7f2c500d2630 2024-06-02T23:46:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c4e7fc640 1 -- 172.21.15.96:0/3182427399 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c48031600 con 0x7f2c500d2630 2024-06-02T23:46:23.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c4e7fc640 1 -- 172.21.15.96:0/3182427399 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480319d0 con 0x7f2c500d2630 2024-06-02T23:46:23.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3182427399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 msgr2=0x7f2c500d2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:23.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c55cbd640 1 --2- 172.21.15.96:0/3182427399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 0x7f2c500d2ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2c5008da30 tx=0x7f2c4802a610 comp rx=0 tx=0).stop 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3182427399 shutdown_connections 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c55cbd640 1 --2- 172.21.15.96:0/3182427399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 0x7f2c500d2ac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c55cbd640 1 --2- 172.21.15.96:0/3182427399 >> v2:172.21.15.162:3300/0 conn(0x7f2c500b4b50 0x7f2c500b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c55cbd640 1 --2- 172.21.15.96:0/3182427399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c500b4640 0x7f2c500b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3182427399 >> 172.21.15.96:0/3182427399 conn(0x7f2c500d4050 msgr2=0x7f2c500d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3182427399 shutdown_connections 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.828+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3182427399 wait complete. 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.829+0000 7f2c55cbd640 1 Processor -- start 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.830+0000 7f2c55cbd640 1 -- start start 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.830+0000 7f2c55cbd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c500b4640 0x7f2c500b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:23.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.830+0000 7f2c55cbd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c500b4b50 0x7f2c500cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.830+0000 7f2c55cbd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 0x7f2c5015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.830+0000 7f2c55cbd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2c500d13b0 con 0x7f2c500d2630 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.830+0000 7f2c55cbd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c500cef00 con 0x7f2c500b4b50 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.830+0000 7f2c55cbd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c500cf420 con 0x7f2c500b4640 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.830+0000 7f2c4ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 0x7f2c5015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.830+0000 7f2c4ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 0x7f2c5015b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53918/0 (socket says 172.21.15.96:53918) 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.830+0000 7f2c4ffff640 1 -- 172.21.15.96:0/3495337464 learned_addr learned my addr 172.21.15.96:0/3495337464 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c4f7fe640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c500b4640 0x7f2c500b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c4ffff640 1 -- 172.21.15.96:0/3495337464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c500b4640 msgr2=0x7f2c500b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c4ffff640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c500b4640 0x7f2c500b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c4effd640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c500b4b50 0x7f2c500cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:23.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c4ffff640 1 -- 172.21.15.96:0/3495337464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c500b4b50 msgr2=0x7f2c500cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c4ffff640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c500b4b50 0x7f2c500cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c4ffff640 1 -- 172.21.15.96:0/3495337464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c500cba90 con 0x7f2c500d2630 2024-06-02T23:46:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c4ffff640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 0x7f2c5015b380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c4802ac00 tx=0x7f2c48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c47fff640 1 -- 172.21.15.96:0/3495337464 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48036050 con 0x7f2c500d2630 2024-06-02T23:46:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c47fff640 1 -- 172.21.15.96:0/3495337464 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c48042070 con 0x7f2c500d2630 2024-06-02T23:46:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3495337464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c500cbd70 con 0x7f2c500d2630 2024-06-02T23:46:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c47fff640 1 -- 172.21.15.96:0/3495337464 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48009510 con 0x7f2c500d2630 2024-06-02T23:46:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.831+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3495337464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c500cc710 con 0x7f2c500d2630 2024-06-02T23:46:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.832+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3495337464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c500cbf40 con 0x7f2c500d2630 2024-06-02T23:46:23.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.833+0000 7f2c47fff640 1 -- 172.21.15.96:0/3495337464 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c48007c50 con 0x7f2c500d2630 2024-06-02T23:46:23.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.833+0000 7f2c47fff640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c3006be30 0x7f2c3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:23.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.833+0000 7f2c47fff640 1 -- 172.21.15.96:0/3495337464 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f2c480abd00 con 0x7f2c500d2630 2024-06-02T23:46:23.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.833+0000 7f2c4f7fe640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c3006be30 0x7f2c3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:23.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.834+0000 7f2c4f7fe640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c3006be30 0x7f2c3006e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2c40006fd0 tx=0x7f2c40008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:23.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:23.838+0000 7f2c47fff640 1 -- 172.21.15.96:0/3495337464 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2c4803a360 con 0x7f2c500d2630 2024-06-02T23:46:24.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.012+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3495337464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f2c500683e0 con 0x7f2c500d2630 2024-06-02T23:46:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.702+0000 7f2c47fff640 1 -- 172.21.15.96:0/3495337464 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f2c4807a8a0 con 0x7f2c500d2630 2024-06-02T23:46:24.702 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2024-06-02T23:46:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.704+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3495337464 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c3006be30 msgr2=0x7f2c3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.704+0000 7f2c55cbd640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c3006be30 0x7f2c3006e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2c40006fd0 tx=0x7f2c40008040 comp rx=0 tx=0).stop 2024-06-02T23:46:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.704+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3495337464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 msgr2=0x7f2c5015b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.704+0000 7f2c55cbd640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 0x7f2c5015b380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c4802ac00 tx=0x7f2c48004a40 comp rx=0 tx=0).stop 2024-06-02T23:46:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.705+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3495337464 shutdown_connections 2024-06-02T23:46:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.705+0000 7f2c55cbd640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c3006be30 0x7f2c3006e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.705+0000 7f2c55cbd640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c500d2630 0x7f2c5015b380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.705+0000 7f2c55cbd640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c500b4b50 0x7f2c500cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:24.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.705+0000 7f2c55cbd640 1 --2- 172.21.15.96:0/3495337464 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c500b4640 0x7f2c500b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.705+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3495337464 >> 172.21.15.96:0/3495337464 conn(0x7f2c500d4050 msgr2=0x7f2c500d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.705+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3495337464 shutdown_connections 2024-06-02T23:46:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.705+0000 7f2c55cbd640 1 -- 172.21.15.96:0/3495337464 wait complete. 2024-06-02T23:46:24.731 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T23:46:24.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.837+0000 7fd66a69e640 1 Processor -- start 2024-06-02T23:46:24.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.837+0000 7fd66a69e640 1 -- start start 2024-06-02T23:46:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.838+0000 7fd66a69e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6640ce9b0 0x7fd6640ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.838+0000 7fd66a69e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd6640cdbe0 0x7fd6640d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.838+0000 7fd66a69e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66415e770 con 0x7fd6640cf2d0 2024-06-02T23:46:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.838+0000 7fd66a69e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd6640d1210 con 0x7fd6640ce9b0 2024-06-02T23:46:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.838+0000 7fd66a69e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd6640d14f0 con 0x7fd6640cdbe0 2024-06-02T23:46:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.838+0000 7fd663fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6640ce9b0 0x7fd6640ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:24.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.838+0000 7fd663fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd6640ce9b0 0x7fd6640ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53922/0 (socket says 172.21.15.96:53922) 2024-06-02T23:46:24.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.838+0000 7fd663fff640 1 -- 172.21.15.96:0/2099099084 learned_addr learned my addr 172.21.15.96:0/2099099084 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:24.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.839+0000 7fd663fff640 1 -- 172.21.15.96:0/2099099084 >> v2:172.21.15.162:3300/0 conn(0x7fd6640cdbe0 msgr2=0x7fd6640d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:24.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.839+0000 7fd663fff640 1 --2- 172.21.15.96:0/2099099084 >> v2:172.21.15.162:3300/0 conn(0x7fd6640cdbe0 0x7fd6640d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:24.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.839+0000 7fd663fff640 1 -- 172.21.15.96:0/2099099084 >> v1:172.21.15.162:6789/0 conn(0x7fd6640cf2d0 legacy=0x7fd6640d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:24.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.839+0000 7fd663fff640 1 -- 172.21.15.96:0/2099099084 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6640d17d0 con 0x7fd6640ce9b0 2024-06-02T23:46:24.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.839+0000 7fd663fff640 1 --2- 172.21.15.96:0/2099099084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 0x7fd6640ced90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd664072cc0 tx=0x7fd65402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d9c1941f040c37 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:24.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.839+0000 7fd662ffd640 1 -- 172.21.15.96:0/2099099084 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654037070 con 0x7fd6640ce9b0 2024-06-02T23:46:24.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.839+0000 7fd662ffd640 1 -- 172.21.15.96:0/2099099084 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd654032440 con 0x7fd6640ce9b0 2024-06-02T23:46:24.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.839+0000 7fd662ffd640 1 -- 172.21.15.96:0/2099099084 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654032810 con 0x7fd6640ce9b0 2024-06-02T23:46:24.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.840+0000 7fd66a69e640 1 -- 172.21.15.96:0/2099099084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 msgr2=0x7fd6640ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:24.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.840+0000 7fd66a69e640 1 --2- 172.21.15.96:0/2099099084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 0x7fd6640ced90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd664072cc0 tx=0x7fd65402a230 comp rx=0 tx=0).stop 2024-06-02T23:46:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.840+0000 7fd66a69e640 1 -- 172.21.15.96:0/2099099084 shutdown_connections 2024-06-02T23:46:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.840+0000 7fd66a69e640 1 --2- 172.21.15.96:0/2099099084 >> v2:172.21.15.162:3300/0 conn(0x7fd6640cdbe0 0x7fd6640d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.840+0000 7fd66a69e640 1 --2- 172.21.15.96:0/2099099084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 0x7fd6640ced90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.840+0000 7fd66a69e640 1 -- 172.21.15.96:0/2099099084 >> 172.21.15.96:0/2099099084 conn(0x7fd6640d1ec0 msgr2=0x7fd6640d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.840+0000 7fd66a69e640 1 -- 172.21.15.96:0/2099099084 shutdown_connections 2024-06-02T23:46:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.840+0000 7fd66a69e640 1 -- 172.21.15.96:0/2099099084 wait complete. 2024-06-02T23:46:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.841+0000 7fd66a69e640 1 Processor -- start 2024-06-02T23:46:24.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.841+0000 7fd66a69e640 1 -- start start 2024-06-02T23:46:24.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd66a69e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6640cdbe0 0x7fd6641532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:24.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd66a69e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 0x7fd6640c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:24.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd66a69e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6640cf2d0 0x7fd664157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:24.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd66a69e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd664168090 con 0x7fd6640ce9b0 2024-06-02T23:46:24.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd66a69e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd664167f10 con 0x7fd6640cf2d0 2024-06-02T23:46:24.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd66a69e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd664168210 con 0x7fd6640cdbe0 2024-06-02T23:46:24.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd6637fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 0x7fd6640c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:24.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd6637fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 0x7fd6640c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53924/0 (socket says 172.21.15.96:53924) 2024-06-02T23:46:24.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd6637fe640 1 -- 172.21.15.96:0/2424650548 learned_addr learned my addr 172.21.15.96:0/2424650548 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd663fff640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6640cdbe0 0x7fd6641532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd668c3b640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6640cf2d0 0x7fd664157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd6637fe640 1 -- 172.21.15.96:0/2424650548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6640cdbe0 msgr2=0x7fd6641532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd6637fe640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6640cdbe0 0x7fd6641532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd6637fe640 1 -- 172.21.15.96:0/2424650548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6640cf2d0 msgr2=0x7fd664157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd6637fe640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6640cf2d0 0x7fd664157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.842+0000 7fd6637fe640 1 -- 172.21.15.96:0/2424650548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6640cba70 con 0x7fd6640ce9b0 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.843+0000 7fd6637fe640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 0x7fd6640c94b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd65800b3c0 tx=0x7fd65800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.843+0000 7fd660ff9640 1 -- 172.21.15.96:0/2424650548 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658011830 con 0x7fd6640ce9b0 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.843+0000 7fd660ff9640 1 -- 172.21.15.96:0/2424650548 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd658016070 con 0x7fd6640ce9b0 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.843+0000 7fd66a69e640 1 -- 172.21.15.96:0/2424650548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6640cbd50 con 0x7fd6640ce9b0 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.843+0000 7fd660ff9640 1 -- 172.21.15.96:0/2424650548 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658011bf0 con 0x7fd6640ce9b0 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.843+0000 7fd66a69e640 1 -- 172.21.15.96:0/2424650548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6640c99f0 con 0x7fd6640ce9b0 2024-06-02T23:46:24.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.844+0000 7fd66a69e640 1 -- 172.21.15.96:0/2424650548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6640683e0 con 0x7fd6640ce9b0 2024-06-02T23:46:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.844+0000 7fd660ff9640 1 -- 172.21.15.96:0/2424650548 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd65801b460 con 0x7fd6640ce9b0 2024-06-02T23:46:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.845+0000 7fd660ff9640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd65006be30 0x7fd65006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.845+0000 7fd660ff9640 1 -- 172.21.15.96:0/2424650548 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fd65808aad0 con 0x7fd6640ce9b0 2024-06-02T23:46:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.845+0000 7fd663fff640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd65006be30 0x7fd65006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.845+0000 7fd663fff640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd65006be30 0x7fd65006e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd654034000 tx=0x7fd65402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:24.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:24.849+0000 7fd660ff9640 1 -- 172.21.15.96:0/2424650548 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd6580594f0 con 0x7fd6640ce9b0 2024-06-02T23:46:25.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.058+0000 7fd66a69e640 1 -- 172.21.15.96:0/2424650548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd6640c89e0 con 0x7fd6640ce9b0 2024-06-02T23:46:25.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.703+0000 7fd660ff9640 1 -- 172.21.15.96:0/2424650548 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd658058df0 con 0x7fd6640ce9b0 2024-06-02T23:46:25.704 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 2 and data pool 3 2024-06-02T23:46:25.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 -- 172.21.15.96:0/2424650548 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd65006be30 msgr2=0x7fd65006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd65006be30 0x7fd65006e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd654034000 tx=0x7fd65402e000 comp rx=0 tx=0).stop 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 -- 172.21.15.96:0/2424650548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 msgr2=0x7fd6640c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 0x7fd6640c94b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd65800b3c0 tx=0x7fd65800b880 comp rx=0 tx=0).stop 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 -- 172.21.15.96:0/2424650548 shutdown_connections 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6640cf2d0 0x7fd664157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd65006be30 0x7fd65006e2f0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd654034000 tx=0x7fd65402e000 comp rx=0 tx=0).stop 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6640ce9b0 0x7fd6640c94b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 --2- 172.21.15.96:0/2424650548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6640cdbe0 0x7fd6641532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 -- 172.21.15.96:0/2424650548 >> 172.21.15.96:0/2424650548 conn(0x7fd6640d1ec0 msgr2=0x7fd6640af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.709+0000 7fd66a69e640 1 -- 172.21.15.96:0/2424650548 shutdown_connections 2024-06-02T23:46:25.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.710+0000 7fd66a69e640 1 -- 172.21.15.96:0/2424650548 wait complete. 2024-06-02T23:46:25.743 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-06-02T23:46:25.743 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-06-02T23:46:25.844 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:46:25.846 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:46:25.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.851+0000 7ff79f309640 1 Processor -- start 2024-06-02T23:46:25.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.851+0000 7ff79f309640 1 -- start start 2024-06-02T23:46:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.852+0000 7ff79f309640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79806b3c0 0x7ff79815d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.852+0000 7ff79f309640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff79806b7a0 0x7ff798071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.852+0000 7ff79f309640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff79815d770 con 0x7ff7980724e0 2024-06-02T23:46:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.852+0000 7ff79f309640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff79813f800 con 0x7ff79806b7a0 2024-06-02T23:46:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.852+0000 7ff79f309640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff798160cc0 con 0x7ff79806b3c0 2024-06-02T23:46:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.852+0000 7ff79c8a4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff79806b7a0 0x7ff798071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.852+0000 7ff79c8a4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff79806b7a0 0x7ff798071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53940/0 (socket says 172.21.15.96:53940) 2024-06-02T23:46:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.852+0000 7ff79c8a4640 1 -- 172.21.15.96:0/178242572 learned_addr learned my addr 172.21.15.96:0/178242572 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:25.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.853+0000 7ff79d0a5640 1 --2- 172.21.15.96:0/178242572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79806b3c0 0x7ff79815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.853+0000 7ff79c8a4640 1 -- 172.21.15.96:0/178242572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79806b3c0 msgr2=0x7ff79815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.853+0000 7ff79c8a4640 1 --2- 172.21.15.96:0/178242572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79806b3c0 0x7ff79815d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.853+0000 7ff79c8a4640 1 -- 172.21.15.96:0/178242572 >> v1:172.21.15.162:6789/0 conn(0x7ff7980724e0 legacy=0x7ff7980cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:25.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.853+0000 7ff79c8a4640 1 -- 172.21.15.96:0/178242572 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff798160140 con 0x7ff79806b7a0 2024-06-02T23:46:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.853+0000 7ff79c8a4640 1 --2- 172.21.15.96:0/178242572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b7a0 0x7ff798071fa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff788009870 tx=0x7ff78802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbcfcc779fefc86 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff78ffff640 1 -- 172.21.15.96:0/178242572 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788037070 con 0x7ff79806b7a0 2024-06-02T23:46:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff78ffff640 1 -- 172.21.15.96:0/178242572 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff788032440 con 0x7ff79806b7a0 2024-06-02T23:46:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff78ffff640 1 -- 172.21.15.96:0/178242572 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788032810 con 0x7ff79806b7a0 2024-06-02T23:46:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff79f309640 1 -- 172.21.15.96:0/178242572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b7a0 msgr2=0x7ff798071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff79f309640 1 --2- 172.21.15.96:0/178242572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b7a0 0x7ff798071fa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff788009870 tx=0x7ff78802a270 comp rx=0 tx=0).stop 2024-06-02T23:46:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff79f309640 1 -- 172.21.15.96:0/178242572 shutdown_connections 2024-06-02T23:46:25.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff79f309640 1 --2- 172.21.15.96:0/178242572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b7a0 0x7ff798071fa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:25.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff79f309640 1 --2- 172.21.15.96:0/178242572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79806b3c0 0x7ff79815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:25.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff79f309640 1 -- 172.21.15.96:0/178242572 >> 172.21.15.96:0/178242572 conn(0x7ff7980b28b0 msgr2=0x7ff7980b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:25.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff79f309640 1 -- 172.21.15.96:0/178242572 shutdown_connections 2024-06-02T23:46:25.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.854+0000 7ff79f309640 1 -- 172.21.15.96:0/178242572 wait complete. 2024-06-02T23:46:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79f309640 1 Processor -- start 2024-06-02T23:46:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79f309640 1 -- start start 2024-06-02T23:46:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79f309640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b3c0 0x7ff79815f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79f309640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79806b7a0 0x7ff798156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79f309640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7980724e0 0x7ff7980cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79f309640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff7981609e0 con 0x7ff79806b3c0 2024-06-02T23:46:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79f309640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff798160700 con 0x7ff7980724e0 2024-06-02T23:46:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79f309640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff798141b20 con 0x7ff79806b7a0 2024-06-02T23:46:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79d0a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b3c0 0x7ff79815f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:25.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79d0a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b3c0 0x7ff79815f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53942/0 (socket says 172.21.15.96:53942) 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.856+0000 7ff79d0a5640 1 -- 172.21.15.96:0/1146156622 learned_addr learned my addr 172.21.15.96:0/1146156622 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff79c8a4640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79806b7a0 0x7ff798156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff79d8a6640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7980724e0 0x7ff7980cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff79d0a5640 1 -- 172.21.15.96:0/1146156622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79806b7a0 msgr2=0x7ff798156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff79d0a5640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79806b7a0 0x7ff798156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff79d0a5640 1 -- 172.21.15.96:0/1146156622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7980724e0 msgr2=0x7ff7980cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff79d0a5640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7980724e0 0x7ff7980cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff79d0a5640 1 -- 172.21.15.96:0/1146156622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff798158360 con 0x7ff79806b3c0 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff79d0a5640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b3c0 0x7ff79815f660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff79400e9b0 tx=0x7ff79400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff78dffb640 1 -- 172.21.15.96:0/1146156622 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff794017070 con 0x7ff79806b3c0 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff78dffb640 1 -- 172.21.15.96:0/1146156622 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79400c9a0 con 0x7ff79806b3c0 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff78dffb640 1 -- 172.21.15.96:0/1146156622 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79400cd90 con 0x7ff79806b3c0 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff79f309640 1 -- 172.21.15.96:0/1146156622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7981577e0 con 0x7ff79806b3c0 2024-06-02T23:46:25.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.857+0000 7ff79f309640 1 -- 172.21.15.96:0/1146156622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff798158080 con 0x7ff79806b3c0 2024-06-02T23:46:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.858+0000 7ff79f309640 1 -- 172.21.15.96:0/1146156622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff798068af0 con 0x7ff79806b3c0 2024-06-02T23:46:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.859+0000 7ff78dffb640 1 -- 172.21.15.96:0/1146156622 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff79401a070 con 0x7ff79806b3c0 2024-06-02T23:46:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.859+0000 7ff78dffb640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff77c06be30 0x7ff77c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:25.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.859+0000 7ff78dffb640 1 -- 172.21.15.96:0/1146156622 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7ff79408ade0 con 0x7ff79806b3c0 2024-06-02T23:46:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.859+0000 7ff79c8a4640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff77c06be30 0x7ff77c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:25.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.860+0000 7ff79c8a4640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff77c06be30 0x7ff77c06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff788034000 tx=0x7ff78802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:25.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:25.864+0000 7ff78dffb640 1 -- 172.21.15.96:0/1146156622 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff794059140 con 0x7ff79806b3c0 2024-06-02T23:46:26.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.047+0000 7ff79f309640 1 -- 172.21.15.96:0/1146156622 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7ff79806e170 con 0x7ff79806b3c0 2024-06-02T23:46:26.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.721+0000 7ff78dffb640 1 -- 172.21.15.96:0/1146156622 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7ff79405d440 con 0x7ff79806b3c0 2024-06-02T23:46:26.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 -- 172.21.15.96:0/1146156622 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff77c06be30 msgr2=0x7ff77c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff77c06be30 0x7ff77c06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff788034000 tx=0x7ff78802e000 comp rx=0 tx=0).stop 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 -- 172.21.15.96:0/1146156622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b3c0 msgr2=0x7ff79815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b3c0 0x7ff79815f660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff79400e9b0 tx=0x7ff79400ee70 comp rx=0 tx=0).stop 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 -- 172.21.15.96:0/1146156622 shutdown_connections 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7980724e0 0x7ff7980cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff79806b7a0 0x7ff798156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff77c06be30 0x7ff77c06e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 --2- 172.21.15.96:0/1146156622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff79806b3c0 0x7ff79815f660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 -- 172.21.15.96:0/1146156622 >> 172.21.15.96:0/1146156622 conn(0x7ff7980b28b0 msgr2=0x7ff79806fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 -- 172.21.15.96:0/1146156622 shutdown_connections 2024-06-02T23:46:26.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.724+0000 7ff79f309640 1 -- 172.21.15.96:0/1146156622 wait complete. 2024-06-02T23:46:26.735 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T23:46:26.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.845+0000 7f5008f5a640 1 Processor -- start 2024-06-02T23:46:26.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.845+0000 7f5008f5a640 1 -- start start 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5008f5a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f500406eaa0 0x7f50040cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5008f5a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50040723e0 con 0x7f500415e530 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5008f5a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50040cb7b0 con 0x7f500406e610 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5008f5a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5004072680 con 0x7f500406eaa0 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f500259c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f500415e530 0x7f50040cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48134/0 (socket says 172.21.15.96:48134) 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f500259c640 1 -- 172.21.15.96:0/41540210 learned_addr learned my addr 172.21.15.96:0/41540210 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5002d9d640 1 --2- 172.21.15.96:0/41540210 >> v2:172.21.15.162:3300/0 conn(0x7f500406eaa0 0x7f50040cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544101815 0 0) 0x7f50040723e0 con 0x7f500415e530 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff0003520 con 0x7f500415e530 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3976676815 0 0) 0x7f4ff0003520 con 0x7f500415e530 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 >> v2:172.21.15.162:3300/0 conn(0x7f500406eaa0 msgr2=0x7f50040cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:26.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 --2- 172.21.15.96:0/41540210 >> v2:172.21.15.162:3300/0 conn(0x7f500406eaa0 0x7f50040cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 >> v1:172.21.15.162:6789/0 conn(0x7f500406e610 legacy=0x7f50040cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5004072960 con 0x7f500415e530 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f4ff4001670 con 0x7f500415e530 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 >> v1:172.21.15.96:6789/0 conn(0x7f500415e530 legacy=0x7f50040cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff00039b0 0x7f4ff0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.846+0000 7f5001d9b640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ff0004800 0x7f4ff0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f5001d9b640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff00051c0 0x7f4ff000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5004072680 con 0x7f4ff00039b0 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff000c110 con 0x7f4ff0004800 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff000c310 con 0x7f4ff00051c0 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f500259c640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff00039b0 0x7f4ff0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f4ff9d9b640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ff0004800 0x7f4ff0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:26.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f5002d9d640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff00051c0 0x7f4ff000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:26.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f500259c640 1 -- 172.21.15.96:0/41540210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff00051c0 msgr2=0x7f4ff000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:26.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f500259c640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff00051c0 0x7f4ff000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:26.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f500259c640 1 -- 172.21.15.96:0/41540210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ff0004800 msgr2=0x7f4ff0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:26.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f500259c640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ff0004800 0x7f4ff0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:26.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f500259c640 1 -- 172.21.15.96:0/41540210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff0003520 con 0x7f4ff00039b0 2024-06-02T23:46:26.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f5002d9d640 1 -- 172.21.15.96:0/41540210 reap_dead start 2024-06-02T23:46:26.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f4ff9d9b640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ff0004800 0x7f4ff0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:26.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.847+0000 7f500259c640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff00039b0 0x7f4ff0003d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c290 tx=0x7f4ff0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d868f80dc54a4c85 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:26.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.848+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4007d50 con 0x7f4ff00039b0 2024-06-02T23:46:26.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.848+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff4005af0 con 0x7f4ff00039b0 2024-06-02T23:46:26.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.848+0000 7f5001d9b640 1 -- 172.21.15.96:0/41540210 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4007070 con 0x7f4ff00039b0 2024-06-02T23:46:26.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.848+0000 7f5008f5a640 1 -- 172.21.15.96:0/41540210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff00039b0 msgr2=0x7f4ff0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:26.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.848+0000 7f5008f5a640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff00039b0 0x7f4ff0003d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c290 tx=0x7f4ff0005830 comp rx=0 tx=0).stop 2024-06-02T23:46:26.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.848+0000 7f5008f5a640 1 -- 172.21.15.96:0/41540210 shutdown_connections 2024-06-02T23:46:26.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.848+0000 7f5008f5a640 1 --2- 172.21.15.96:0/41540210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ff00039b0 0x7f4ff0003d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:26.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.848+0000 7f5008f5a640 1 -- 172.21.15.96:0/41540210 >> 172.21.15.96:0/41540210 conn(0x7f50040cfcb0 msgr2=0x7f50040d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:26.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.848+0000 7f5008f5a640 1 -- 172.21.15.96:0/41540210 shutdown_connections 2024-06-02T23:46:26.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.848+0000 7f5008f5a640 1 -- 172.21.15.96:0/41540210 wait complete. 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.850+0000 7f5008f5a640 1 Processor -- start 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.850+0000 7f5008f5a640 1 -- start start 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.850+0000 7f5008f5a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff00039b0 0x7f5004159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.850+0000 7f5008f5a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040b4a60 0x7f50040c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.850+0000 7f5008f5a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50040b4ee0 0x7f50040c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.850+0000 7f5008f5a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5004073160 con 0x7f50040b4a60 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.850+0000 7f5008f5a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f500415e910 con 0x7f50040b4ee0 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.850+0000 7f5008f5a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f500406eeb0 con 0x7f4ff00039b0 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.850+0000 7f4ff9d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040b4a60 0x7f50040c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ff9d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040b4a60 0x7f50040c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53948/0 (socket says 172.21.15.96:53948) 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ff9d9b640 1 -- 172.21.15.96:0/1278931723 learned_addr learned my addr 172.21.15.96:0/1278931723 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f500259c640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff00039b0 0x7f5004159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:26.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f5002d9d640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50040b4ee0 0x7f50040c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ff9d9b640 1 -- 172.21.15.96:0/1278931723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff00039b0 msgr2=0x7f5004159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ff9d9b640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff00039b0 0x7f5004159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ff9d9b640 1 -- 172.21.15.96:0/1278931723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50040b4ee0 msgr2=0x7f50040c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ff9d9b640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50040b4ee0 0x7f50040c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ff9d9b640 1 -- 172.21.15.96:0/1278931723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50040b2970 con 0x7f50040b4a60 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f500259c640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff00039b0 0x7f5004159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f5002d9d640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50040b4ee0 0x7f50040c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ff9d9b640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040b4a60 0x7f50040c5d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00e5b0 tx=0x7f4fec00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ffb7fe640 1 -- 172.21.15.96:0/1278931723 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0052e0 con 0x7f50040b4a60 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ffb7fe640 1 -- 172.21.15.96:0/1278931723 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec018070 con 0x7f50040b4a60 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f5008f5a640 1 -- 172.21.15.96:0/1278931723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50040b2c50 con 0x7f50040b4a60 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f4ffb7fe640 1 -- 172.21.15.96:0/1278931723 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec003830 con 0x7f50040b4a60 2024-06-02T23:46:26.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.851+0000 7f5008f5a640 1 -- 172.21.15.96:0/1278931723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50040b3210 con 0x7f50040b4a60 2024-06-02T23:46:26.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.852+0000 7f5008f5a640 1 -- 172.21.15.96:0/1278931723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50040683e0 con 0x7f50040b4a60 2024-06-02T23:46:26.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.852+0000 7f4ffb7fe640 1 -- 172.21.15.96:0/1278931723 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fec0039d0 con 0x7f50040b4a60 2024-06-02T23:46:26.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.853+0000 7f4ffb7fe640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4fe406be30 0x7f4fe406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:26.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.853+0000 7f4ffb7fe640 1 -- 172.21.15.96:0/1278931723 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f4fec08abf0 con 0x7f50040b4a60 2024-06-02T23:46:26.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.853+0000 7f500259c640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4fe406be30 0x7f4fe406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:26.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.853+0000 7f500259c640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4fe406be30 0x7f4fe406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4032000 tx=0x7f4ff402d000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:26.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:26.857+0000 7f4ffb7fe640 1 -- 172.21.15.96:0/1278931723 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4fec059530 con 0x7f50040b4a60 2024-06-02T23:46:27.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:27.054+0000 7f5008f5a640 1 -- 172.21.15.96:0/1278931723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f500415b1c0 con 0x7f50040b4a60 2024-06-02T23:46:28.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.726+0000 7f4ffb7fe640 1 -- 172.21.15.96:0/1278931723 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f4fec058e30 con 0x7f50040b4a60 2024-06-02T23:46:28.726 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data_ec' created 2024-06-02T23:46:28.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.729+0000 7f5008f5a640 1 -- 172.21.15.96:0/1278931723 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4fe406be30 msgr2=0x7f4fe406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:28.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.729+0000 7f5008f5a640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4fe406be30 0x7f4fe406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4032000 tx=0x7f4ff402d000 comp rx=0 tx=0).stop 2024-06-02T23:46:28.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.729+0000 7f5008f5a640 1 -- 172.21.15.96:0/1278931723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040b4a60 msgr2=0x7f50040c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:28.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.729+0000 7f5008f5a640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040b4a60 0x7f50040c5d40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00e5b0 tx=0x7f4fec00ea70 comp rx=0 tx=0).stop 2024-06-02T23:46:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.729+0000 7f5008f5a640 1 -- 172.21.15.96:0/1278931723 shutdown_connections 2024-06-02T23:46:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.729+0000 7f5008f5a640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50040b4ee0 0x7f50040c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.729+0000 7f5008f5a640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4fe406be30 0x7f4fe406e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.729+0000 7f5008f5a640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50040b4a60 0x7f50040c5d40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.729+0000 7f5008f5a640 1 --2- 172.21.15.96:0/1278931723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ff00039b0 0x7f5004159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:28.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.729+0000 7f5008f5a640 1 -- 172.21.15.96:0/1278931723 >> 172.21.15.96:0/1278931723 conn(0x7f50040cfcb0 msgr2=0x7f50040cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:28.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.730+0000 7f5008f5a640 1 -- 172.21.15.96:0/1278931723 shutdown_connections 2024-06-02T23:46:28.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.731+0000 7f5008f5a640 1 -- 172.21.15.96:0/1278931723 wait complete. 2024-06-02T23:46:28.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-06-02T23:46:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.860+0000 7f38248a5640 1 Processor -- start 2024-06-02T23:46:28.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.860+0000 7f38248a5640 1 -- start start 2024-06-02T23:46:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.861+0000 7f38248a5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f382015e1d0 0x7f382015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.861+0000 7f38248a5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38200cfa70 con 0x7f38200d09d0 2024-06-02T23:46:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.861+0000 7f38248a5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38200cfd50 con 0x7f38200d1570 2024-06-02T23:46:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.861+0000 7f38248a5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f38200d0030 con 0x7f382015e1d0 2024-06-02T23:46:28.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381dd9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f38200d09d0 0x7f38200d0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48150/0 (socket says 172.21.15.96:48150) 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381dd9b640 1 -- 172.21.15.96:0/1818381586 learned_addr learned my addr 172.21.15.96:0/1818381586 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536109188 0 0) 0x7f38200cfa70 con 0x7f38200d09d0 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381e59c640 1 --2- 172.21.15.96:0/1818381586 >> v2:172.21.15.162:3300/0 conn(0x7f382015e1d0 0x7f382015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3808003520 con 0x7f38200d09d0 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1811167470 0 0) 0x7f3808003520 con 0x7f38200d09d0 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 >> v2:172.21.15.162:3300/0 conn(0x7f382015e1d0 msgr2=0x7f382015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 --2- 172.21.15.96:0/1818381586 >> v2:172.21.15.162:3300/0 conn(0x7f382015e1d0 0x7f382015e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 >> v1:172.21.15.162:6789/0 conn(0x7f38200d1570 legacy=0x7f38200d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38200c7c40 con 0x7f38200d09d0 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f3814001670 con 0x7f38200d09d0 2024-06-02T23:46:28.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 >> v1:172.21.15.96:6789/0 conn(0x7f38200d09d0 legacy=0x7f38200d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080039b0 0x7f3808003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f3808004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38080051c0 0x7f380800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f38200d0030 con 0x7f3808004800 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f380800c160 con 0x7f38080039b0 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f380800c360 con 0x7f38080051c0 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381dd9b640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f3808004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381e59c640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080039b0 0x7f3808003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381ed9d640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38080051c0 0x7f380800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.862+0000 7f381dd9b640 1 -- 172.21.15.96:0/1818381586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38080051c0 msgr2=0x7f380800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381dd9b640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38080051c0 0x7f380800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:28.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381dd9b640 1 -- 172.21.15.96:0/1818381586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080039b0 msgr2=0x7f3808003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381dd9b640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080039b0 0x7f3808003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381dd9b640 1 -- 172.21.15.96:0/1818381586 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3808003520 con 0x7f3808004800 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381e59c640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080039b0 0x7f3808003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381ed9d640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38080051c0 0x7f380800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381ed9d640 1 -- 172.21.15.96:0/1818381586 reap_dead start 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381dd9b640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f3808004c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f381400c240 tx=0x7f3808005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdad16fb66cf2d8b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814007d10 con 0x7f3808004800 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3814005ad0 con 0x7f3808004800 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.863+0000 7f381d59a640 1 -- 172.21.15.96:0/1818381586 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814007070 con 0x7f3808004800 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.864+0000 7f38248a5640 1 -- 172.21.15.96:0/1818381586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 msgr2=0x7f3808004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.864+0000 7f38248a5640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f3808004c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f381400c240 tx=0x7f3808005830 comp rx=0 tx=0).stop 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.864+0000 7f38248a5640 1 -- 172.21.15.96:0/1818381586 shutdown_connections 2024-06-02T23:46:28.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.864+0000 7f38248a5640 1 --2- 172.21.15.96:0/1818381586 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f3808004c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:28.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.864+0000 7f38248a5640 1 -- 172.21.15.96:0/1818381586 >> 172.21.15.96:0/1818381586 conn(0x7f38200d3fc0 msgr2=0x7f38200d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:28.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.864+0000 7f38248a5640 1 -- 172.21.15.96:0/1818381586 shutdown_connections 2024-06-02T23:46:28.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.864+0000 7f38248a5640 1 -- 172.21.15.96:0/1818381586 wait complete. 2024-06-02T23:46:28.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.865+0000 7f38248a5640 1 Processor -- start 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.865+0000 7f38248a5640 1 -- start start 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f38248a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f38201f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f38248a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38200cd0a0 0x7f38200cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f38248a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38200b36a0 0x7f38200b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f38248a5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f382015e730 con 0x7f3808004800 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f38248a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f382015e5b0 con 0x7f38200cd0a0 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f38248a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f382015e8b0 con 0x7f38200b36a0 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f381e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f38201f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f381e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f38201f2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53972/0 (socket says 172.21.15.96:53972) 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f381e59c640 1 -- 172.21.15.96:0/826821815 learned_addr learned my addr 172.21.15.96:0/826821815 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:28.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f381ed9d640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38200b36a0 0x7f38200b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f381e59c640 1 -- 172.21.15.96:0/826821815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38200b36a0 msgr2=0x7f38200b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f381e59c640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38200b36a0 0x7f38200b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f381e59c640 1 -- 172.21.15.96:0/826821815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38200cd0a0 msgr2=0x7f38200cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f381e59c640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38200cd0a0 0x7f38200cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.866+0000 7f381e59c640 1 -- 172.21.15.96:0/826821815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38200b43b0 con 0x7f3808004800 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.867+0000 7f381e59c640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f38201f2ea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3810011ca0 tx=0x7f381000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.867+0000 7f380effd640 1 -- 172.21.15.96:0/826821815 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381000fd20 con 0x7f3808004800 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.867+0000 7f380effd640 1 -- 172.21.15.96:0/826821815 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3810014440 con 0x7f3808004800 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.867+0000 7f38248a5640 1 -- 172.21.15.96:0/826821815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38200b0cc0 con 0x7f3808004800 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.867+0000 7f380effd640 1 -- 172.21.15.96:0/826821815 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3810014830 con 0x7f3808004800 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.867+0000 7f38248a5640 1 -- 172.21.15.96:0/826821815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38200b1280 con 0x7f3808004800 2024-06-02T23:46:28.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.868+0000 7f38248a5640 1 -- 172.21.15.96:0/826821815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38200683e0 con 0x7f3808004800 2024-06-02T23:46:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.868+0000 7f380effd640 1 -- 172.21.15.96:0/826821815 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3810012040 con 0x7f3808004800 2024-06-02T23:46:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.869+0000 7f380effd640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f380006be60 0x7f380006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.869+0000 7f381dd9b640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f380006be60 0x7f380006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.869+0000 7f380effd640 1 -- 172.21.15.96:0/826821815 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f381008bab0 con 0x7f3808004800 2024-06-02T23:46:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.869+0000 7f381dd9b640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f380006be60 0x7f380006e320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3814033000 tx=0x7f3814009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:28.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:28.873+0000 7f380effd640 1 -- 172.21.15.96:0/826821815 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3810019030 con 0x7f3808004800 2024-06-02T23:46:29.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.048+0000 7f38248a5640 1 -- 172.21.15.96:0/826821815 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f38200751e0 con 0x7f3808004800 2024-06-02T23:46:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.727+0000 7f380effd640 1 -- 172.21.15.96:0/826821815 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f3810059b80 con 0x7f3808004800 2024-06-02T23:46:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:set pool 4 allow_ec_overwrites to true 2024-06-02T23:46:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.732+0000 7f38248a5640 1 -- 172.21.15.96:0/826821815 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f380006be60 msgr2=0x7f380006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:29.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.732+0000 7f38248a5640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f380006be60 0x7f380006e320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3814033000 tx=0x7f3814009030 comp rx=0 tx=0).stop 2024-06-02T23:46:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.732+0000 7f38248a5640 1 -- 172.21.15.96:0/826821815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 msgr2=0x7f38201f2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.732+0000 7f38248a5640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f38201f2ea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3810011ca0 tx=0x7f381000f610 comp rx=0 tx=0).stop 2024-06-02T23:46:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.732+0000 7f38248a5640 1 -- 172.21.15.96:0/826821815 shutdown_connections 2024-06-02T23:46:29.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.732+0000 7f38248a5640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38200b36a0 0x7f38200b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.732+0000 7f38248a5640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38200cd0a0 0x7f38200cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.732+0000 7f38248a5640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f380006be60 0x7f380006e320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.732+0000 7f38248a5640 1 --2- 172.21.15.96:0/826821815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3808004800 0x7f38201f2ea0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:29.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.732+0000 7f38248a5640 1 -- 172.21.15.96:0/826821815 >> 172.21.15.96:0/826821815 conn(0x7f38200d3fc0 msgr2=0x7f38200c9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:29.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.737+0000 7f38248a5640 1 -- 172.21.15.96:0/826821815 shutdown_connections 2024-06-02T23:46:29.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.737+0000 7f38248a5640 1 -- 172.21.15.96:0/826821815 wait complete. 2024-06-02T23:46:29.762 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-06-02T23:46:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.865+0000 7ffbbd4b3640 1 Processor -- start 2024-06-02T23:46:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.865+0000 7ffbbd4b3640 1 -- start start 2024-06-02T23:46:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbbd4b3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ffbb80729e0 0x7ffbb8071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbbd4b3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb8072fa0 con 0x7ffbb806ec50 2024-06-02T23:46:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbbd4b3640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb80712a0 con 0x7ffbb815fc40 2024-06-02T23:46:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbbd4b3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ffbb80718f0 con 0x7ffbb80729e0 2024-06-02T23:46:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbb67fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ffbb80729e0 0x7ffbb8071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbb67fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ffbb80729e0 0x7ffbb8071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53976/0 (socket says 172.21.15.96:53976) 2024-06-02T23:46:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbb67fc640 1 -- 172.21.15.96:0/274597907 learned_addr learned my addr 172.21.15.96:0/274597907 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbb67fc640 1 -- 172.21.15.96:0/274597907 >> v1:172.21.15.162:6789/0 conn(0x7ffbb815fc40 legacy=0x7ffbb8160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbb67fc640 1 -- 172.21.15.96:0/274597907 >> v1:172.21.15.96:6789/0 conn(0x7ffbb806ec50 legacy=0x7ffbb80ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbb67fc640 1 -- 172.21.15.96:0/274597907 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb8071580 con 0x7ffbb80729e0 2024-06-02T23:46:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.866+0000 7ffbb5ffb640 1 -- 172.21.15.96:0/274597907 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 249874762 0 0) 0x7ffbb8072fa0 con 0x7ffbb806ec50 2024-06-02T23:46:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.867+0000 7ffbb67fc640 1 --2- 172.21.15.96:0/274597907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb80729e0 0x7ffbb8071d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8071a70 tx=0x7ffbac02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ca0fd0be82f8f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.867+0000 7ffbb5ffb640 1 -- 172.21.15.96:0/274597907 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac037070 con 0x7ffbb80729e0 2024-06-02T23:46:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.867+0000 7ffbb5ffb640 1 -- 172.21.15.96:0/274597907 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbac032440 con 0x7ffbb80729e0 2024-06-02T23:46:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.867+0000 7ffbb5ffb640 1 -- 172.21.15.96:0/274597907 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac032810 con 0x7ffbb80729e0 2024-06-02T23:46:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.868+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/274597907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb80729e0 msgr2=0x7ffbb8071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.868+0000 7ffbbd4b3640 1 --2- 172.21.15.96:0/274597907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb80729e0 0x7ffbb8071d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8071a70 tx=0x7ffbac02a210 comp rx=0 tx=0).stop 2024-06-02T23:46:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.868+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/274597907 shutdown_connections 2024-06-02T23:46:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.868+0000 7ffbbd4b3640 1 --2- 172.21.15.96:0/274597907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb80729e0 0x7ffbb8071d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.868+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/274597907 >> 172.21.15.96:0/274597907 conn(0x7ffbb80cfcb0 msgr2=0x7ffbb80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.868+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/274597907 shutdown_connections 2024-06-02T23:46:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.868+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/274597907 wait complete. 2024-06-02T23:46:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.869+0000 7ffbbd4b3640 1 Processor -- start 2024-06-02T23:46:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.869+0000 7ffbbd4b3640 1 -- start start 2024-06-02T23:46:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbbd4b3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbb806ec50 0x7ffbb80c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbbd4b3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb80729e0 0x7ffbb8153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbbd4b3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb815fc40 0x7ffbb8154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbbd4b3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb80cab90 con 0x7ffbb815fc40 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbbd4b3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb80caa10 con 0x7ffbb80729e0 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbbd4b3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffbb80b4d50 con 0x7ffbb806ec50 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbb77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb815fc40 0x7ffbb8154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbb77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb815fc40 0x7ffbb8154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53986/0 (socket says 172.21.15.96:53986) 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbb77fe640 1 -- 172.21.15.96:0/461258356 learned_addr learned my addr 172.21.15.96:0/461258356 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbb6ffd640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbb806ec50 0x7ffbb80c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbb77fe640 1 -- 172.21.15.96:0/461258356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbb806ec50 msgr2=0x7ffbb80c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:29.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbb77fe640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbb806ec50 0x7ffbb80c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbb77fe640 1 -- 172.21.15.96:0/461258356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb80729e0 msgr2=0x7ffbb8153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbb77fe640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb80729e0 0x7ffbb8153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbb77fe640 1 -- 172.21.15.96:0/461258356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb81e6740 con 0x7ffbb815fc40 2024-06-02T23:46:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbb77fe640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb815fc40 0x7ffbb8154110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c3e0 tx=0x7ffbb000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffb9f7fe640 1 -- 172.21.15.96:0/461258356 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0017070 con 0x7ffbb815fc40 2024-06-02T23:46:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffb9f7fe640 1 -- 172.21.15.96:0/461258356 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb00035f0 con 0x7ffbb815fc40 2024-06-02T23:46:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/461258356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb81e6a20 con 0x7ffbb815fc40 2024-06-02T23:46:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.870+0000 7ffb9f7fe640 1 -- 172.21.15.96:0/461258356 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00039e0 con 0x7ffbb815fc40 2024-06-02T23:46:29.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.871+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/461258356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb81e6fe0 con 0x7ffbb815fc40 2024-06-02T23:46:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.871+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/461258356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb80683e0 con 0x7ffbb815fc40 2024-06-02T23:46:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.872+0000 7ffb9f7fe640 1 -- 172.21.15.96:0/461258356 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffbb001a070 con 0x7ffbb815fc40 2024-06-02T23:46:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.872+0000 7ffb9f7fe640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ffba406be30 0x7ffba406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.873+0000 7ffbb6ffd640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ffba406be30 0x7ffba406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.873+0000 7ffb9f7fe640 1 -- 172.21.15.96:0/461258356 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7ffbb008a320 con 0x7ffbb815fc40 2024-06-02T23:46:29.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.873+0000 7ffbb6ffd640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ffba406be30 0x7ffba406e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffba8007fd0 tx=0x7ffba8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:29.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:29.877+0000 7ffb9f7fe640 1 -- 172.21.15.96:0/461258356 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ffbb0058a40 con 0x7ffbb815fc40 2024-06-02T23:46:30.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.095+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/461258356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ffbb80cbff0 con 0x7ffbb815fc40 2024-06-02T23:46:30.632 INFO:tasks.ceph.mds.c.smithi096.stderr:2024-06-02T23:46:30.632+0000 7ff0b6f66640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T23:46:30.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.761+0000 7ffb9f7fe640 1 -- 172.21.15.96:0/461258356 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7ffbb0058340 con 0x7ffbb815fc40 2024-06-02T23:46:30.761 INFO:teuthology.orchestra.run.smithi096.stderr:added data pool 4 to fsmap 2024-06-02T23:46:30.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/461258356 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ffba406be30 msgr2=0x7ffba406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ffba406be30 0x7ffba406e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ffba8007fd0 tx=0x7ffba8009040 comp rx=0 tx=0).stop 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/461258356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb815fc40 msgr2=0x7ffbb8154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb815fc40 0x7ffbb8154110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c3e0 tx=0x7ffbb000c8a0 comp rx=0 tx=0).stop 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/461258356 shutdown_connections 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ffba406be30 0x7ffba406e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffbb815fc40 0x7ffbb8154110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb80729e0 0x7ffbb8153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 --2- 172.21.15.96:0/461258356 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbb806ec50 0x7ffbb80c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/461258356 >> 172.21.15.96:0/461258356 conn(0x7ffbb80cfcb0 msgr2=0x7ffbb8160020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/461258356 shutdown_connections 2024-06-02T23:46:30.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.764+0000 7ffbbd4b3640 1 -- 172.21.15.96:0/461258356 wait complete. 2024-06-02T23:46:30.776 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:46:30.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.876+0000 7f9d6b8f5640 1 Processor -- start 2024-06-02T23:46:30.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.876+0000 7f9d6b8f5640 1 -- start start 2024-06-02T23:46:30.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.877+0000 7f9d6b8f5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9d640d2d10 0x7f9d640b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:30.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.877+0000 7f9d6b8f5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d4b40 0x7f9d640b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:30.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.877+0000 7f9d6b8f5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6415e810 con 0x7f9d6415e430 2024-06-02T23:46:30.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.877+0000 7f9d6b8f5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9d640b6e70 con 0x7f9d640d2d10 2024-06-02T23:46:30.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.877+0000 7f9d6b8f5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d640b70c0 con 0x7f9d640d4b40 2024-06-02T23:46:30.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d68e90640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9d640d2d10 0x7f9d640b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:30.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d69e92640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d4b40 0x7f9d640b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:30.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d68e90640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9d640d2d10 0x7f9d640b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:42500/0 (socket says 172.21.15.96:42500) 2024-06-02T23:46:30.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d69691640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9d6415e430 0x7f9d640d2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:37718/0 (socket says 172.21.15.96:37718) 2024-06-02T23:46:30.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d69e92640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d4b40 0x7f9d640b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:48438/0 (socket says 172.21.15.96:48438) 2024-06-02T23:46:30.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d68e90640 1 -- 172.21.15.96:0/1378647552 learned_addr learned my addr 172.21.15.96:0/1378647552 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:30.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d68e90640 1 -- 172.21.15.96:0/1378647552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d4b40 msgr2=0x7f9d640b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d68e90640 1 --2- 172.21.15.96:0/1378647552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d4b40 0x7f9d640b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d68e90640 1 -- 172.21.15.96:0/1378647552 >> v1:172.21.15.162:6789/0 conn(0x7f9d6415e430 legacy=0x7f9d640d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d68e90640 1 -- 172.21.15.96:0/1378647552 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d640b73a0 con 0x7f9d640d2d10 2024-06-02T23:46:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.878+0000 7f9d69e92640 1 --2- 172.21.15.96:0/1378647552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d4b40 0x7f9d640b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d68e90640 1 --2- 172.21.15.96:0/1378647552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d640d2d10 0x7f9d640b4bd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009870 tx=0x7f9d5402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beae1db5378b47bf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d5bfff640 1 -- 172.21.15.96:0/1378647552 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54037070 con 0x7f9d640d2d10 2024-06-02T23:46:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d5bfff640 1 -- 172.21.15.96:0/1378647552 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d54032440 con 0x7f9d640d2d10 2024-06-02T23:46:30.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d5bfff640 1 -- 172.21.15.96:0/1378647552 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54032810 con 0x7f9d640d2d10 2024-06-02T23:46:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/1378647552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d640d2d10 msgr2=0x7f9d640b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d6b8f5640 1 --2- 172.21.15.96:0/1378647552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d640d2d10 0x7f9d640b4bd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009870 tx=0x7f9d5402a270 comp rx=0 tx=0).stop 2024-06-02T23:46:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/1378647552 shutdown_connections 2024-06-02T23:46:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d6b8f5640 1 --2- 172.21.15.96:0/1378647552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d4b40 0x7f9d640b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:30.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d6b8f5640 1 --2- 172.21.15.96:0/1378647552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d640d2d10 0x7f9d640b4bd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/1378647552 >> 172.21.15.96:0/1378647552 conn(0x7f9d640d4020 msgr2=0x7f9d640d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/1378647552 shutdown_connections 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.879+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/1378647552 wait complete. 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d6b8f5640 1 Processor -- start 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d6b8f5640 1 -- start start 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d6b8f5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d2d10 0x7f9d6415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d6b8f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d640d4b40 0x7f9d641f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d6b8f5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d6415e430 0x7f9d641f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d6b8f5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9d640d1260 con 0x7f9d6415e430 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d6b8f5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d640b7960 con 0x7f9d640d4b40 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d6b8f5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d640d13e0 con 0x7f9d640d2d10 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d69e92640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d6415e430 0x7f9d641f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:30.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d69e92640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d6415e430 0x7f9d641f8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54002/0 (socket says 172.21.15.96:54002) 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.881+0000 7f9d69e92640 1 -- 172.21.15.96:0/2076076616 learned_addr learned my addr 172.21.15.96:0/2076076616 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d69691640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d2d10 0x7f9d6415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d68e90640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d640d4b40 0x7f9d641f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d69e92640 1 -- 172.21.15.96:0/2076076616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d2d10 msgr2=0x7f9d6415ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d69e92640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d2d10 0x7f9d6415ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d69e92640 1 -- 172.21.15.96:0/2076076616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d640d4b40 msgr2=0x7f9d641f7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d69e92640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d640d4b40 0x7f9d641f7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d69e92640 1 -- 172.21.15.96:0/2076076616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d641606e0 con 0x7f9d6415e430 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d69e92640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d6415e430 0x7f9d641f8300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00efc0 tx=0x7f9d5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d59ffb640 1 -- 172.21.15.96:0/2076076616 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c018030 con 0x7f9d6415e430 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d59ffb640 1 -- 172.21.15.96:0/2076076616 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5c00cdf0 con 0x7f9d6415e430 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/2076076616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6415efb0 con 0x7f9d6415e430 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d59ffb640 1 -- 172.21.15.96:0/2076076616 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c003bb0 con 0x7f9d6415e430 2024-06-02T23:46:30.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.882+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/2076076616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d64160c40 con 0x7f9d6415e430 2024-06-02T23:46:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.883+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/2076076616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d640683e0 con 0x7f9d6415e430 2024-06-02T23:46:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.883+0000 7f9d59ffb640 1 -- 172.21.15.96:0/2076076616 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d5c005d10 con 0x7f9d6415e430 2024-06-02T23:46:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.884+0000 7f9d59ffb640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9d4806be30 0x7f9d4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.884+0000 7f9d69691640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9d4806be30 0x7f9d4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.884+0000 7f9d59ffb640 1 -- 172.21.15.96:0/2076076616 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9d5c08b9e0 con 0x7f9d6415e430 2024-06-02T23:46:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.884+0000 7f9d69691640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9d4806be30 0x7f9d4806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9d60007fd0 tx=0x7f9d60007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:30.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:30.888+0000 7f9d59ffb640 1 -- 172.21.15.96:0/2076076616 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9d5c022070 con 0x7f9d6415e430 2024-06-02T23:46:31.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.096+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/2076076616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d6415dbc0 con 0x7f9d6415e430 2024-06-02T23:46:31.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.097+0000 7f9d59ffb640 1 -- 172.21.15.96:0/2076076616 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5183 (secure 0 0 0) 0x7f9d641606e0 con 0x7f9d6415e430 2024-06-02T23:46:31.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:31.097 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:46:25.060503+0000","modified":"2024-06-02T23:46:30.096471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-02T23:46:31.097 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 6 2024-06-02T23:46:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.098+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/2076076616 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9d4806be30 msgr2=0x7f9d4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.098+0000 7f9d6b8f5640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9d4806be30 0x7f9d4806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9d60007fd0 tx=0x7f9d60007e80 comp rx=0 tx=0).stop 2024-06-02T23:46:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.099+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/2076076616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d6415e430 msgr2=0x7f9d641f8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.099+0000 7f9d6b8f5640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d6415e430 0x7f9d641f8300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00efc0 tx=0x7f9d5c00c490 comp rx=0 tx=0).stop 2024-06-02T23:46:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.099+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/2076076616 shutdown_connections 2024-06-02T23:46:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.099+0000 7f9d6b8f5640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9d4806be30 0x7f9d4806e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.099+0000 7f9d6b8f5640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d6415e430 0x7f9d641f8300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.099+0000 7f9d6b8f5640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d640d4b40 0x7f9d641f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.099+0000 7f9d6b8f5640 1 --2- 172.21.15.96:0/2076076616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d640d2d10 0x7f9d6415ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.099+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/2076076616 >> 172.21.15.96:0/2076076616 conn(0x7f9d640d4020 msgr2=0x7f9d6406c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.099+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/2076076616 shutdown_connections 2024-06-02T23:46:31.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.099+0000 7f9d6b8f5640 1 -- 172.21.15.96:0/2076076616 wait complete. 2024-06-02T23:46:31.110 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:31.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.209+0000 7f4e17ee7640 1 Processor -- start 2024-06-02T23:46:31.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.209+0000 7f4e17ee7640 1 -- start start 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.210+0000 7f4e17ee7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 0x7f4e10071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.210+0000 7f4e17ee7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4e100cae00 0x7f4e100cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.210+0000 7f4e17ee7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e1006f210 con 0x7f4e1006ea70 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.210+0000 7f4e17ee7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4e1006ef30 con 0x7f4e100cae00 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.210+0000 7f4e17ee7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4e100ca320 con 0x7f4e1015f5e0 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.210+0000 7f4e16484640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4e100cae00 0x7f4e100cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.210+0000 7f4e16484640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4e100cae00 0x7f4e100cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54008/0 (socket says 172.21.15.96:54008) 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.210+0000 7f4e16484640 1 -- 172.21.15.96:0/4034885828 learned_addr learned my addr 172.21.15.96:0/4034885828 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.210+0000 7f4e15c83640 1 --2- 172.21.15.96:0/4034885828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 0x7f4e10071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.211+0000 7f4e16484640 1 -- 172.21.15.96:0/4034885828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 msgr2=0x7f4e10071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.211+0000 7f4e16484640 1 --2- 172.21.15.96:0/4034885828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 0x7f4e10071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.211+0000 7f4e16484640 1 -- 172.21.15.96:0/4034885828 >> v1:172.21.15.162:6789/0 conn(0x7f4e1006ea70 legacy=0x7f4e10071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.211+0000 7f4e16484640 1 -- 172.21.15.96:0/4034885828 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e100ca600 con 0x7f4e100cae00 2024-06-02T23:46:31.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.211+0000 7f4e16484640 1 --2- 172.21.15.96:0/4034885828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e100cae00 0x7f4e100cb270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009e50 tx=0x7f4e0802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e6eb3c1d21b940 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.211+0000 7f4e14c81640 1 -- 172.21.15.96:0/4034885828 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08036070 con 0x7f4e100cae00 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.211+0000 7f4e14c81640 1 -- 172.21.15.96:0/4034885828 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e08031600 con 0x7f4e100cae00 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.211+0000 7f4e14c81640 1 -- 172.21.15.96:0/4034885828 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e080319d0 con 0x7f4e100cae00 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.212+0000 7f4e17ee7640 1 -- 172.21.15.96:0/4034885828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e100cae00 msgr2=0x7f4e100cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.212+0000 7f4e17ee7640 1 --2- 172.21.15.96:0/4034885828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e100cae00 0x7f4e100cb270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009e50 tx=0x7f4e0802a710 comp rx=0 tx=0).stop 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.212+0000 7f4e17ee7640 1 -- 172.21.15.96:0/4034885828 shutdown_connections 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.212+0000 7f4e17ee7640 1 --2- 172.21.15.96:0/4034885828 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e100cae00 0x7f4e100cb270 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.212+0000 7f4e17ee7640 1 --2- 172.21.15.96:0/4034885828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 0x7f4e10071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.212+0000 7f4e17ee7640 1 -- 172.21.15.96:0/4034885828 >> 172.21.15.96:0/4034885828 conn(0x7f4e100cfc30 msgr2=0x7f4e100d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.212+0000 7f4e17ee7640 1 -- 172.21.15.96:0/4034885828 shutdown_connections 2024-06-02T23:46:31.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.212+0000 7f4e17ee7640 1 -- 172.21.15.96:0/4034885828 wait complete. 2024-06-02T23:46:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.213+0000 7f4e17ee7640 1 Processor -- start 2024-06-02T23:46:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.213+0000 7f4e17ee7640 1 -- start start 2024-06-02T23:46:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e17ee7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e1006ea70 0x7f4e100c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e17ee7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100cae00 0x7f4e101540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e17ee7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 0x7f4e101545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e17ee7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4e100731b0 con 0x7f4e1006ea70 2024-06-02T23:46:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e17ee7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e10073030 con 0x7f4e100cae00 2024-06-02T23:46:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e17ee7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4e100b2ac0 con 0x7f4e1015f5e0 2024-06-02T23:46:31.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e15c83640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e1006ea70 0x7f4e100c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e15c83640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e1006ea70 0x7f4e100c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54016/0 (socket says 172.21.15.96:54016) 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e15c83640 1 -- 172.21.15.96:0/3906911546 learned_addr learned my addr 172.21.15.96:0/3906911546 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e16484640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 0x7f4e101545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e15c83640 1 -- 172.21.15.96:0/3906911546 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 msgr2=0x7f4e101545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e15c83640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 0x7f4e101545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e15c83640 1 -- 172.21.15.96:0/3906911546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100cae00 msgr2=0x7f4e101540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e15c83640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100cae00 0x7f4e101540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e15c83640 1 -- 172.21.15.96:0/3906911546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e100c9fc0 con 0x7f4e1006ea70 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.214+0000 7f4e16484640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 0x7f4e101545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.215+0000 7f4e15c83640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e1006ea70 0x7f4e100c6f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00d620 tx=0x7f4e0c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.215+0000 7f4e067fc640 1 -- 172.21.15.96:0/3906911546 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00b620 con 0x7f4e1006ea70 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.215+0000 7f4e067fc640 1 -- 172.21.15.96:0/3906911546 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0c019070 con 0x7f4e1006ea70 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.215+0000 7f4e17ee7640 1 -- 172.21.15.96:0/3906911546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e100c9ce0 con 0x7f4e1006ea70 2024-06-02T23:46:31.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.215+0000 7f4e067fc640 1 -- 172.21.15.96:0/3906911546 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00ba00 con 0x7f4e1006ea70 2024-06-02T23:46:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.215+0000 7f4e17ee7640 1 -- 172.21.15.96:0/3906911546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e100cdb80 con 0x7f4e1006ea70 2024-06-02T23:46:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.216+0000 7f4e17ee7640 1 -- 172.21.15.96:0/3906911546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e100683e0 con 0x7f4e1006ea70 2024-06-02T23:46:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.216+0000 7f4e067fc640 1 -- 172.21.15.96:0/3906911546 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e0c00bba0 con 0x7f4e1006ea70 2024-06-02T23:46:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.217+0000 7f4e067fc640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4df406be30 0x7f4df406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.217+0000 7f4e067fc640 1 -- 172.21.15.96:0/3906911546 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4e0c08b520 con 0x7f4e1006ea70 2024-06-02T23:46:31.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.217+0000 7f4e15482640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4df406be30 0x7f4df406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.217+0000 7f4e15482640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4df406be30 0x7f4df406e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e00000f60 tx=0x7f4e000079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:31.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.221+0000 7f4e067fc640 1 -- 172.21.15.96:0/3906911546 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4e0c059c20 con 0x7f4e1006ea70 2024-06-02T23:46:31.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.399+0000 7f4e17ee7640 1 -- 172.21.15.96:0/3906911546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e1006e300 con 0x7f4e1006ea70 2024-06-02T23:46:31.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.400+0000 7f4e067fc640 1 -- 172.21.15.96:0/3906911546 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f4e0c059520 con 0x7f4e1006ea70 2024-06-02T23:46:31.401 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:31.401 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":24,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:30.096314+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 -- 172.21.15.96:0/3906911546 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4df406be30 msgr2=0x7f4df406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4df406be30 0x7f4df406e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e00000f60 tx=0x7f4e000079d0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 -- 172.21.15.96:0/3906911546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e1006ea70 msgr2=0x7f4e100c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e1006ea70 0x7f4e100c6f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00d620 tx=0x7f4e0c00dae0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 -- 172.21.15.96:0/3906911546 shutdown_connections 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e1015f5e0 0x7f4e101545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100cae00 0x7f4e101540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4df406be30 0x7f4df406e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 --2- 172.21.15.96:0/3906911546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e1006ea70 0x7f4e100c6f70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 -- 172.21.15.96:0/3906911546 >> 172.21.15.96:0/3906911546 conn(0x7f4e100cfc30 msgr2=0x7f4e100cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 -- 172.21.15.96:0/3906911546 shutdown_connections 2024-06-02T23:46:31.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.402+0000 7f4e17ee7640 1 -- 172.21.15.96:0/3906911546 wait complete. 2024-06-02T23:46:31.414 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:31.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.512+0000 7efd5be8c640 1 Processor -- start 2024-06-02T23:46:31.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.512+0000 7efd5be8c640 1 -- start start 2024-06-02T23:46:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd5be8c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efd5415a850 0x7efd540ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd5be8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd5406e820 0x7efd54071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd5be8c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5406ee70 con 0x7efd540ca9d0 2024-06-02T23:46:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd5be8c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efd540711b0 con 0x7efd5415a850 2024-06-02T23:46:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd5be8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efd54071490 con 0x7efd5406e820 2024-06-02T23:46:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd59427640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7efd540ca9d0 0x7efd5406e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48174/0 (socket says 172.21.15.96:48174) 2024-06-02T23:46:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd59427640 1 -- 172.21.15.96:0/2094719580 learned_addr learned my addr 172.21.15.96:0/2094719580 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 84766407 0 0) 0x7efd5406ee70 con 0x7efd540ca9d0 2024-06-02T23:46:31.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd5a429640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd5406e820 0x7efd54071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd40004630 con 0x7efd540ca9d0 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd59c28640 1 --2- 172.21.15.96:0/2094719580 >> v2:172.21.15.162:3300/0 conn(0x7efd5415a850 0x7efd540ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 486801716 0 0) 0x7efd40004630 con 0x7efd540ca9d0 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd5406e820 msgr2=0x7efd54071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd5406e820 0x7efd54071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 >> v2:172.21.15.162:3300/0 conn(0x7efd5415a850 msgr2=0x7efd540ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 --2- 172.21.15.96:0/2094719580 >> v2:172.21.15.162:3300/0 conn(0x7efd5415a850 0x7efd540ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd54071770 con 0x7efd540ca9d0 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7efd44001670 con 0x7efd540ca9d0 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 >> v1:172.21.15.96:6789/0 conn(0x7efd540ca9d0 legacy=0x7efd5406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd5406e820 0x7efd40004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 0x7efd40005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd40005e50 0x7efd400062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7efd540711b0 con 0x7efd40005040 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd54071490 con 0x7efd40005e50 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.513+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efd4000cbb0 con 0x7efd5406e820 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd59c28640 1 --2- 172.21.15.96:0/2094719580 >> v2:172.21.15.162:3300/0 conn(0x7efd5415a850 0x7efd540ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd59427640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 0x7efd40005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd5a429640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd40005e50 0x7efd400062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd59c28640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd5406e820 0x7efd40004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd59427640 1 -- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd5406e820 msgr2=0x7efd40004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd59427640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd5406e820 0x7efd40004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd59427640 1 -- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd40005e50 msgr2=0x7efd400062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd59427640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd40005e50 0x7efd400062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd59427640 1 -- 172.21.15.96:0/2094719580 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd40004630 con 0x7efd40005040 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd59c28640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd5406e820 0x7efd40004ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.514+0000 7efd59427640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 0x7efd40005910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd4400c210 tx=0x7efd40006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8ae78bc8a6f6d2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.515+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44007d30 con 0x7efd40005040 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.515+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd44005ad0 con 0x7efd40005040 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.515+0000 7efd58c26640 1 -- 172.21.15.96:0/2094719580 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44007070 con 0x7efd40005040 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.515+0000 7efd5be8c640 1 -- 172.21.15.96:0/2094719580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 msgr2=0x7efd40005910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.515+0000 7efd5be8c640 1 --2- 172.21.15.96:0/2094719580 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 0x7efd40005910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd4400c210 tx=0x7efd40006940 comp rx=0 tx=0).stop 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.515+0000 7efd5a429640 1 -- 172.21.15.96:0/2094719580 reap_dead start 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.515+0000 7efd5be8c640 1 -- 172.21.15.96:0/2094719580 shutdown_connections 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.515+0000 7efd5be8c640 1 -- 172.21.15.96:0/2094719580 >> 172.21.15.96:0/2094719580 conn(0x7efd540cfc30 msgr2=0x7efd540d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.515+0000 7efd5be8c640 1 -- 172.21.15.96:0/2094719580 shutdown_connections 2024-06-02T23:46:31.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.515+0000 7efd5be8c640 1 -- 172.21.15.96:0/2094719580 wait complete. 2024-06-02T23:46:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.516+0000 7efd5be8c640 1 Processor -- start 2024-06-02T23:46:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.516+0000 7efd5be8c640 1 -- start start 2024-06-02T23:46:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd5be8c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 0x7efd54155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd5be8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd541f17a0 0x7efd54156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd5be8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd541f1c20 0x7efd54157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd5be8c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7efd5406cdf0 con 0x7efd40005040 2024-06-02T23:46:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd5be8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efd5406cc70 con 0x7efd541f17a0 2024-06-02T23:46:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd5be8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efd5406cf70 con 0x7efd541f1c20 2024-06-02T23:46:31.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd59c28640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 0x7efd54155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd59c28640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 0x7efd54155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54036/0 (socket says 172.21.15.96:54036) 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd59c28640 1 -- 172.21.15.96:0/3383725932 learned_addr learned my addr 172.21.15.96:0/3383725932 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd59c28640 1 -- 172.21.15.96:0/3383725932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd541f1c20 msgr2=0x7efd54157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd59c28640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd541f1c20 0x7efd54157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd59c28640 1 -- 172.21.15.96:0/3383725932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd541f17a0 msgr2=0x7efd54156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd59c28640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd541f17a0 0x7efd54156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.517+0000 7efd59c28640 1 -- 172.21.15.96:0/3383725932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd54155660 con 0x7efd40005040 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.518+0000 7efd59c28640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 0x7efd54155120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd50010810 tx=0x7efd50010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.518+0000 7efd4a7fc640 1 -- 172.21.15.96:0/3383725932 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5001a070 con 0x7efd40005040 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.518+0000 7efd4a7fc640 1 -- 172.21.15.96:0/3383725932 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5000c930 con 0x7efd40005040 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.518+0000 7efd5be8c640 1 -- 172.21.15.96:0/3383725932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd540c7d50 con 0x7efd40005040 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.518+0000 7efd4a7fc640 1 -- 172.21.15.96:0/3383725932 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5000f040 con 0x7efd40005040 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.518+0000 7efd5be8c640 1 -- 172.21.15.96:0/3383725932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd540c8310 con 0x7efd40005040 2024-06-02T23:46:31.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.519+0000 7efd5be8c640 1 -- 172.21.15.96:0/3383725932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd540683e0 con 0x7efd40005040 2024-06-02T23:46:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.519+0000 7efd4a7fc640 1 -- 172.21.15.96:0/3383725932 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd5000cd00 con 0x7efd40005040 2024-06-02T23:46:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.520+0000 7efd4a7fc640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7efd3806be60 0x7efd3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.520+0000 7efd4a7fc640 1 -- 172.21.15.96:0/3383725932 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efd5008b7b0 con 0x7efd40005040 2024-06-02T23:46:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.520+0000 7efd59427640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7efd3806be60 0x7efd3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.520+0000 7efd59427640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7efd3806be60 0x7efd3806e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd44033000 tx=0x7efd44009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:31.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.524+0000 7efd4a7fc640 1 -- 172.21.15.96:0/3383725932 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efd50059e20 con 0x7efd40005040 2024-06-02T23:46:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.700+0000 7efd5be8c640 1 -- 172.21.15.96:0/3383725932 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd540cb870 con 0x7efd40005040 2024-06-02T23:46:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.701+0000 7efd4a7fc640 1 -- 172.21.15.96:0/3383725932 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7efd50059720 con 0x7efd40005040 2024-06-02T23:46:31.701 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:31.702 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":24,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:30.096314+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 -- 172.21.15.96:0/3383725932 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7efd3806be60 msgr2=0x7efd3806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7efd3806be60 0x7efd3806e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd44033000 tx=0x7efd44009030 comp rx=0 tx=0).stop 2024-06-02T23:46:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 -- 172.21.15.96:0/3383725932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 msgr2=0x7efd54155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 0x7efd54155120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd50010810 tx=0x7efd50010cd0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 -- 172.21.15.96:0/3383725932 shutdown_connections 2024-06-02T23:46:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efd541f1c20 0x7efd54157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efd541f17a0 0x7efd54156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7efd3806be60 0x7efd3806e320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 --2- 172.21.15.96:0/3383725932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40005040 0x7efd54155120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 -- 172.21.15.96:0/3383725932 >> 172.21.15.96:0/3383725932 conn(0x7efd540cfc30 msgr2=0x7efd541560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 -- 172.21.15.96:0/3383725932 shutdown_connections 2024-06-02T23:46:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.703+0000 7efd5be8c640 1 -- 172.21.15.96:0/3383725932 wait complete. 2024-06-02T23:46:31.730 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:46:31.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.829+0000 7fd3566d2640 1 Processor -- start 2024-06-02T23:46:31.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.829+0000 7fd3566d2640 1 -- start start 2024-06-02T23:46:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.829+0000 7fd3566d2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd35006b3c0 0x7fd35006b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.829+0000 7fd3566d2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd35006bce0 con 0x7fd350067100 2024-06-02T23:46:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.829+0000 7fd3566d2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3501627e0 con 0x7fd35015f290 2024-06-02T23:46:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.829+0000 7fd3566d2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd35015ee00 con 0x7fd35006b3c0 2024-06-02T23:46:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.830+0000 7fd34f7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd350067100 0x7fd350161f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48176/0 (socket says 172.21.15.96:48176) 2024-06-02T23:46:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.830+0000 7fd34f7fe640 1 -- 172.21.15.96:0/1600808229 learned_addr learned my addr 172.21.15.96:0/1600808229 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.830+0000 7fd34ffff640 1 --2- 172.21.15.96:0/1600808229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd35006b3c0 0x7fd35006b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.830+0000 7fd34effd640 1 -- 172.21.15.96:0/1600808229 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881981714 0 0) 0x7fd35006bce0 con 0x7fd350067100 2024-06-02T23:46:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.830+0000 7fd34effd640 1 -- 172.21.15.96:0/1600808229 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd338003520 con 0x7fd350067100 2024-06-02T23:46:31.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.830+0000 7fd34effd640 1 -- 172.21.15.96:0/1600808229 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3833761821 0 0) 0x7fd3501627e0 con 0x7fd35015f290 2024-06-02T23:46:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.830+0000 7fd34effd640 1 -- 172.21.15.96:0/1600808229 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd35006bce0 con 0x7fd35015f290 2024-06-02T23:46:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.830+0000 7fd34ffff640 1 -- 172.21.15.96:0/1600808229 >> v1:172.21.15.162:6789/0 conn(0x7fd35015f290 legacy=0x7fd3500b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.830+0000 7fd34ffff640 1 -- 172.21.15.96:0/1600808229 >> v1:172.21.15.96:6789/0 conn(0x7fd350067100 legacy=0x7fd350161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.830+0000 7fd34ffff640 1 -- 172.21.15.96:0/1600808229 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd350162ac0 con 0x7fd35006b3c0 2024-06-02T23:46:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.831+0000 7fd34ffff640 1 --2- 172.21.15.96:0/1600808229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd35006b3c0 0x7fd35006b7a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd3400097d0 tx=0x7fd34002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44ea0987ae8bba7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.831+0000 7fd34effd640 1 -- 172.21.15.96:0/1600808229 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340037070 con 0x7fd35006b3c0 2024-06-02T23:46:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.831+0000 7fd34effd640 1 -- 172.21.15.96:0/1600808229 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd340032440 con 0x7fd35006b3c0 2024-06-02T23:46:31.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.831+0000 7fd34effd640 1 -- 172.21.15.96:0/1600808229 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3400327f0 con 0x7fd35006b3c0 2024-06-02T23:46:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.831+0000 7fd3566d2640 1 -- 172.21.15.96:0/1600808229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd35006b3c0 msgr2=0x7fd35006b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.831+0000 7fd3566d2640 1 --2- 172.21.15.96:0/1600808229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd35006b3c0 0x7fd35006b7a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd3400097d0 tx=0x7fd34002a210 comp rx=0 tx=0).stop 2024-06-02T23:46:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.831+0000 7fd3566d2640 1 -- 172.21.15.96:0/1600808229 shutdown_connections 2024-06-02T23:46:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.831+0000 7fd3566d2640 1 --2- 172.21.15.96:0/1600808229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd35006b3c0 0x7fd35006b7a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.832+0000 7fd3566d2640 1 -- 172.21.15.96:0/1600808229 >> 172.21.15.96:0/1600808229 conn(0x7fd3500b1f80 msgr2=0x7fd3500b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.832+0000 7fd3566d2640 1 -- 172.21.15.96:0/1600808229 shutdown_connections 2024-06-02T23:46:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.832+0000 7fd3566d2640 1 -- 172.21.15.96:0/1600808229 wait complete. 2024-06-02T23:46:31.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.833+0000 7fd3566d2640 1 Processor -- start 2024-06-02T23:46:31.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.833+0000 7fd3566d2640 1 -- start start 2024-06-02T23:46:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd3566d2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd350067100 0x7fd35015c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd3566d2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd35006b3c0 0x7fd3500cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd3566d2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd35015f290 0x7fd3500cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd3566d2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd3500afe90 con 0x7fd35006b3c0 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd3566d2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd35015ea50 con 0x7fd35015f290 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd3566d2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd35015f720 con 0x7fd350067100 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd35006b3c0 0x7fd3500cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd35006b3c0 0x7fd3500cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54042/0 (socket says 172.21.15.96:54042) 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34f7fe640 1 -- 172.21.15.96:0/2961787043 learned_addr learned my addr 172.21.15.96:0/2961787043 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34ffff640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd350067100 0x7fd35015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd354c6f640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd35015f290 0x7fd3500cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34f7fe640 1 -- 172.21.15.96:0/2961787043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd350067100 msgr2=0x7fd35015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34f7fe640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd350067100 0x7fd35015c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34f7fe640 1 -- 172.21.15.96:0/2961787043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd35015f290 msgr2=0x7fd3500cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34f7fe640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd35015f290 0x7fd3500cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:31.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34f7fe640 1 -- 172.21.15.96:0/2961787043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3500c4e60 con 0x7fd35006b3c0 2024-06-02T23:46:31.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34f7fe640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd35006b3c0 0x7fd3500cf100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd34400c500 tx=0x7fd34400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:31.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34cff9640 1 -- 172.21.15.96:0/2961787043 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd344017070 con 0x7fd35006b3c0 2024-06-02T23:46:31.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34cff9640 1 -- 172.21.15.96:0/2961787043 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd344005ce0 con 0x7fd35006b3c0 2024-06-02T23:46:31.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd34cff9640 1 -- 172.21.15.96:0/2961787043 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3440072f0 con 0x7fd35006b3c0 2024-06-02T23:46:31.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.834+0000 7fd3566d2640 1 -- 172.21.15.96:0/2961787043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3500c5140 con 0x7fd35006b3c0 2024-06-02T23:46:31.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.835+0000 7fd3566d2640 1 -- 172.21.15.96:0/2961787043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3500c5700 con 0x7fd35006b3c0 2024-06-02T23:46:31.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.836+0000 7fd3566d2640 1 -- 172.21.15.96:0/2961787043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3500683e0 con 0x7fd35006b3c0 2024-06-02T23:46:31.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.836+0000 7fd34cff9640 1 -- 172.21.15.96:0/2961787043 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd34401a070 con 0x7fd35006b3c0 2024-06-02T23:46:31.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.836+0000 7fd34cff9640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd33c06be30 0x7fd33c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:31.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.836+0000 7fd34cff9640 1 -- 172.21.15.96:0/2961787043 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd34408a440 con 0x7fd35006b3c0 2024-06-02T23:46:31.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.836+0000 7fd34ffff640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd33c06be30 0x7fd33c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:31.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.837+0000 7fd34ffff640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd33c06be30 0x7fd33c06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd340034000 tx=0x7fd34002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:31.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:31.841+0000 7fd34cff9640 1 -- 172.21.15.96:0/2961787043 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd3440584f0 con 0x7fd35006b3c0 2024-06-02T23:46:32.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.052+0000 7fd3566d2640 1 -- 172.21.15.96:0/2961787043 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3500b2cc0 con 0x7fd35006b3c0 2024-06-02T23:46:32.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.053+0000 7fd34cff9640 1 -- 172.21.15.96:0/2961787043 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5183 (secure 0 0 0) 0x7fd34405c7f0 con 0x7fd35006b3c0 2024-06-02T23:46:32.053 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:32.053 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:46:25.060503+0000","modified":"2024-06-02T23:46:30.096471+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-02T23:46:32.053 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 6 2024-06-02T23:46:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 -- 172.21.15.96:0/2961787043 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd33c06be30 msgr2=0x7fd33c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd33c06be30 0x7fd33c06e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd340034000 tx=0x7fd34002e000 comp rx=0 tx=0).stop 2024-06-02T23:46:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 -- 172.21.15.96:0/2961787043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd35006b3c0 msgr2=0x7fd3500cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd35006b3c0 0x7fd3500cf100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd34400c500 tx=0x7fd34400c9c0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 -- 172.21.15.96:0/2961787043 shutdown_connections 2024-06-02T23:46:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd35015f290 0x7fd3500cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd33c06be30 0x7fd33c06e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd35006b3c0 0x7fd3500cf100 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 --2- 172.21.15.96:0/2961787043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd350067100 0x7fd35015c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 -- 172.21.15.96:0/2961787043 >> 172.21.15.96:0/2961787043 conn(0x7fd3500b1f80 msgr2=0x7fd35015ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 -- 172.21.15.96:0/2961787043 shutdown_connections 2024-06-02T23:46:32.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.055+0000 7fd3566d2640 1 -- 172.21.15.96:0/2961787043 wait complete. 2024-06-02T23:46:32.066 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:32.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.164+0000 7fd08d41c640 1 Processor -- start 2024-06-02T23:46:32.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.165+0000 7fd08d41c640 1 -- start start 2024-06-02T23:46:32.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.165+0000 7fd08d41c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd08815a850 0x7fd0880ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.165+0000 7fd08d41c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd08806ee70 con 0x7fd08806e820 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.165+0000 7fd08d41c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0880711b0 con 0x7fd0880ca9d0 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.165+0000 7fd08d41c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd088071490 con 0x7fd08815a850 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.165+0000 7fd086ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd08815a850 0x7fd0880ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.166+0000 7fd0877fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd08806e820 0x7fd088071f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48192/0 (socket says 172.21.15.96:48192) 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.166+0000 7fd0877fe640 1 -- 172.21.15.96:0/2599709679 learned_addr learned my addr 172.21.15.96:0/2599709679 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.166+0000 7fd086ffd640 1 -- 172.21.15.96:0/2599709679 >> v1:172.21.15.162:6789/0 conn(0x7fd0880ca9d0 legacy=0x7fd08806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.166+0000 7fd086ffd640 1 -- 172.21.15.96:0/2599709679 >> v1:172.21.15.96:6789/0 conn(0x7fd08806e820 legacy=0x7fd088071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.166+0000 7fd086ffd640 1 -- 172.21.15.96:0/2599709679 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd088071770 con 0x7fd08815a850 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.166+0000 7fd0867fc640 1 -- 172.21.15.96:0/2599709679 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79827895 0 0) 0x7fd08806ee70 con 0x7fd08806e820 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.166+0000 7fd086ffd640 1 --2- 172.21.15.96:0/2599709679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08815a850 0x7fd0880ca490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd07800a970 tx=0x7fd07802b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f379857a907210ca server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.167+0000 7fd0867fc640 1 -- 172.21.15.96:0/2599709679 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07800b040 con 0x7fd08815a850 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.167+0000 7fd0867fc640 1 -- 172.21.15.96:0/2599709679 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd078030710 con 0x7fd08815a850 2024-06-02T23:46:32.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.167+0000 7fd0867fc640 1 -- 172.21.15.96:0/2599709679 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078030ae0 con 0x7fd08815a850 2024-06-02T23:46:32.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.167+0000 7fd08d41c640 1 -- 172.21.15.96:0/2599709679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08815a850 msgr2=0x7fd0880ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.167+0000 7fd08d41c640 1 --2- 172.21.15.96:0/2599709679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08815a850 0x7fd0880ca490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd07800a970 tx=0x7fd07802b650 comp rx=0 tx=0).stop 2024-06-02T23:46:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.167+0000 7fd08d41c640 1 -- 172.21.15.96:0/2599709679 shutdown_connections 2024-06-02T23:46:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.167+0000 7fd08d41c640 1 --2- 172.21.15.96:0/2599709679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08815a850 0x7fd0880ca490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.167+0000 7fd08d41c640 1 -- 172.21.15.96:0/2599709679 >> 172.21.15.96:0/2599709679 conn(0x7fd0880cfc30 msgr2=0x7fd0880d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.167+0000 7fd08d41c640 1 -- 172.21.15.96:0/2599709679 shutdown_connections 2024-06-02T23:46:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.167+0000 7fd08d41c640 1 -- 172.21.15.96:0/2599709679 wait complete. 2024-06-02T23:46:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.168+0000 7fd08d41c640 1 Processor -- start 2024-06-02T23:46:32.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.169+0000 7fd08d41c640 1 -- start start 2024-06-02T23:46:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.169+0000 7fd08d41c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08806e820 0x7fd088152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.169+0000 7fd08d41c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0880ca9d0 0x7fd08815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.169+0000 7fd08d41c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd08815a850 0x7fd08815d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.169+0000 7fd08d41c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd08806cdf0 con 0x7fd08806e820 2024-06-02T23:46:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.169+0000 7fd08d41c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd08806cc70 con 0x7fd08815a850 2024-06-02T23:46:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.169+0000 7fd08d41c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd08806cf70 con 0x7fd0880ca9d0 2024-06-02T23:46:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.169+0000 7fd086ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08806e820 0x7fd088152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.169+0000 7fd086ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08806e820 0x7fd088152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54060/0 (socket says 172.21.15.96:54060) 2024-06-02T23:46:32.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.169+0000 7fd086ffd640 1 -- 172.21.15.96:0/746305201 learned_addr learned my addr 172.21.15.96:0/746305201 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd086ffd640 1 -- 172.21.15.96:0/746305201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0880ca9d0 msgr2=0x7fd08815cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd086ffd640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0880ca9d0 0x7fd08815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd086ffd640 1 -- 172.21.15.96:0/746305201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd08815a850 msgr2=0x7fd08815d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd086ffd640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd08815a850 0x7fd08815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd086ffd640 1 -- 172.21.15.96:0/746305201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0881527c0 con 0x7fd08806e820 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd086ffd640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08806e820 0x7fd088152280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd07802bc40 tx=0x7fd0780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd07ffff640 1 -- 172.21.15.96:0/746305201 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07803f070 con 0x7fd08806e820 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd07ffff640 1 -- 172.21.15.96:0/746305201 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd078033d50 con 0x7fd08806e820 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd07ffff640 1 -- 172.21.15.96:0/746305201 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078004230 con 0x7fd08806e820 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd08d41c640 1 -- 172.21.15.96:0/746305201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08815d9f0 con 0x7fd08806e820 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.170+0000 7fd08d41c640 1 -- 172.21.15.96:0/746305201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08815af10 con 0x7fd08806e820 2024-06-02T23:46:32.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.171+0000 7fd08d41c640 1 -- 172.21.15.96:0/746305201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd08815b620 con 0x7fd08806e820 2024-06-02T23:46:32.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.171+0000 7fd07ffff640 1 -- 172.21.15.96:0/746305201 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd078042070 con 0x7fd08806e820 2024-06-02T23:46:32.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.172+0000 7fd07ffff640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd06806be30 0x7fd06806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.172+0000 7fd07ffff640 1 -- 172.21.15.96:0/746305201 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd0780abbf0 con 0x7fd08806e820 2024-06-02T23:46:32.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.172+0000 7fd07e7fc640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd06806be30 0x7fd06806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.172+0000 7fd07e7fc640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd06806be30 0x7fd06806e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd0880b0bc0 tx=0x7fd070007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:32.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.176+0000 7fd07ffff640 1 -- 172.21.15.96:0/746305201 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd0881527c0 con 0x7fd08806e820 2024-06-02T23:46:32.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.350+0000 7fd08d41c640 1 -- 172.21.15.96:0/746305201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0880ca7b0 con 0x7fd08806e820 2024-06-02T23:46:32.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.352+0000 7fd07ffff640 1 -- 172.21.15.96:0/746305201 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fd07807a260 con 0x7fd08806e820 2024-06-02T23:46:32.352 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:32.352 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":24,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:30.096314+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:32.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 -- 172.21.15.96:0/746305201 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd06806be30 msgr2=0x7fd06806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd06806be30 0x7fd06806e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd0880b0bc0 tx=0x7fd070007990 comp rx=0 tx=0).stop 2024-06-02T23:46:32.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 -- 172.21.15.96:0/746305201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08806e820 msgr2=0x7fd088152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08806e820 0x7fd088152280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd07802bc40 tx=0x7fd0780046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 -- 172.21.15.96:0/746305201 shutdown_connections 2024-06-02T23:46:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd08815a850 0x7fd08815d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0880ca9d0 0x7fd08815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd06806be30 0x7fd06806e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 --2- 172.21.15.96:0/746305201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd08806e820 0x7fd088152280 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 -- 172.21.15.96:0/746305201 >> 172.21.15.96:0/746305201 conn(0x7fd0880cfc30 msgr2=0x7fd0880cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 -- 172.21.15.96:0/746305201 shutdown_connections 2024-06-02T23:46:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.354+0000 7fd08d41c640 1 -- 172.21.15.96:0/746305201 wait complete. 2024-06-02T23:46:32.767 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T23:46:25.060503+0000', 'modified': '2024-06-02T23:46:30.096471+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.96:6837/1720821828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6835', 'nonce': 1720821828}, {'type': 'v1', 'addr': '172.21.15.96:6837', 'nonce': 1720821828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-06-02T23:46:32.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T23:46:32.768 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-06-02T23:46:32.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.869+0000 7fe0a3909640 1 Processor -- start 2024-06-02T23:46:32.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.870+0000 7fe0a3909640 1 -- start start 2024-06-02T23:46:32.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.870+0000 7fe0a3909640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c0b4be0 0x7fe09c0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.870+0000 7fe0a3909640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe09c0b3640 con 0x7fe09c0ce610 2024-06-02T23:46:32.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.870+0000 7fe0a3909640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe09c0cc580 con 0x7fe09c0d1200 2024-06-02T23:46:32.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.870+0000 7fe0a3909640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c161c60 con 0x7fe09c0b4be0 2024-06-02T23:46:32.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a16a5640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe09c0ce610 0x7fe09c0ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48204/0 (socket says 172.21.15.96:48204) 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a16a5640 1 -- 172.21.15.96:0/2260451199 learned_addr learned my addr 172.21.15.96:0/2260451199 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503450357 0 0) 0x7fe09c0b3640 con 0x7fe09c0ce610 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c0b4be0 0x7fe09c0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe084003520 con 0x7fe09c0ce610 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3890658157 0 0) 0x7fe084003520 con 0x7fe09c0ce610 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c0b4be0 msgr2=0x7fe09c0d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c0b4be0 0x7fe09c0d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 >> v1:172.21.15.162:6789/0 conn(0x7fe09c0d1200 legacy=0x7fe09c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c0cc860 con 0x7fe09c0ce610 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fe08c0019f0 con 0x7fe09c0ce610 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 >> v1:172.21.15.96:6789/0 conn(0x7fe09c0ce610 legacy=0x7fe09c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c0b4be0 0x7fe0840039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe084003f60 0x7fe084004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe084004d40 0x7fe0840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c161c60 con 0x7fe084004d40 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe08400baa0 con 0x7fe084003f60 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe08400bca0 con 0x7fe09c0b4be0 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe084004d40 0x7fe0840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c0b4be0 0x7fe0840039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe084003f60 0x7fe084004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c0b4be0 msgr2=0x7fe0840039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c0b4be0 0x7fe0840039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe084003f60 msgr2=0x7fe084004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe084003f60 0x7fe084004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.871+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/2260451199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe084003520 con 0x7fe084004d40 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.872+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe084004d40 0x7fe0840051c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe094001750 tx=0x7fe084005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99338f89ab5d8495 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.872+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094001370 con 0x7fe084004d40 2024-06-02T23:46:32.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.872+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0940052d0 con 0x7fe084004d40 2024-06-02T23:46:32.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.872+0000 7fe09bfff640 1 -- 172.21.15.96:0/2260451199 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09402abe0 con 0x7fe084004d40 2024-06-02T23:46:32.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.873+0000 7fe0a3909640 1 -- 172.21.15.96:0/2260451199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe084004d40 msgr2=0x7fe0840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.873+0000 7fe0a3909640 1 --2- 172.21.15.96:0/2260451199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe084004d40 0x7fe0840051c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe094001750 tx=0x7fe084005830 comp rx=0 tx=0).stop 2024-06-02T23:46:32.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.873+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/2260451199 reap_dead start 2024-06-02T23:46:32.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.873+0000 7fe0a3909640 1 -- 172.21.15.96:0/2260451199 shutdown_connections 2024-06-02T23:46:32.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.873+0000 7fe0a3909640 1 -- 172.21.15.96:0/2260451199 >> 172.21.15.96:0/2260451199 conn(0x7fe09c0d1d90 msgr2=0x7fe09c0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:32.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.873+0000 7fe0a3909640 1 -- 172.21.15.96:0/2260451199 shutdown_connections 2024-06-02T23:46:32.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.873+0000 7fe0a3909640 1 -- 172.21.15.96:0/2260451199 wait complete. 2024-06-02T23:46:32.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.874+0000 7fe0a3909640 1 Processor -- start 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.874+0000 7fe0a3909640 1 -- start start 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a3909640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe084004d40 0x7fe09c14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a3909640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c06c4d0 0x7fe09c06c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a3909640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe09c15c880 0x7fe09c15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a3909640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c0cce20 con 0x7fe09c15c880 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a3909640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c0d16b0 con 0x7fe084004d40 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a3909640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c0d0cc0 con 0x7fe09c06c4d0 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a1ea6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe09c15c880 0x7fe09c15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a1ea6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe09c15c880 0x7fe09c15cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54072/0 (socket says 172.21.15.96:54072) 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/509612725 learned_addr learned my addr 172.21.15.96:0/509612725 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe084004d40 0x7fe09c14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c06c4d0 0x7fe09c06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/509612725 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c06c4d0 msgr2=0x7fe09c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c06c4d0 0x7fe09c06c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/509612725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe084004d40 msgr2=0x7fe09c14b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe084004d40 0x7fe09c14b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/509612725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c14b700 con 0x7fe09c15c880 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c06c4d0 0x7fe09c06c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe09c15c880 0x7fe09c15cd00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe09402a590 tx=0x7fe094001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe099ffb640 1 -- 172.21.15.96:0/509612725 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094037040 con 0x7fe09c15c880 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe099ffb640 1 -- 172.21.15.96:0/509612725 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe094040070 con 0x7fe09c15c880 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe099ffb640 1 -- 172.21.15.96:0/509612725 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094001370 con 0x7fe09c15c880 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.875+0000 7fe0a3909640 1 -- 172.21.15.96:0/509612725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09c15d670 con 0x7fe09c15c880 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.876+0000 7fe0a3909640 1 -- 172.21.15.96:0/509612725 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09c15dc30 con 0x7fe09c15c880 2024-06-02T23:46:32.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.877+0000 7fe099ffb640 1 -- 172.21.15.96:0/509612725 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0940052d0 con 0x7fe09c15c880 2024-06-02T23:46:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.878+0000 7fe099ffb640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe08806be60 0x7fe08806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.878+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe08806be60 0x7fe08806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.878+0000 7fe099ffb640 1 -- 172.21.15.96:0/509612725 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe0940aaa30 con 0x7fe09c15c880 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.878+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe08806be60 0x7fe08806e320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0013d0 tx=0x7fe08c006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.879+0000 7fe0a6615740 1 Processor -- start 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.879+0000 7fe0a6615740 1 -- start start 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.879+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa2d00 0x5645d4aa5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.879+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4aa5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.879+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4a75960 0x5645d4a79170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.879+0000 7fe0a6615740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x5645d49de740 con 0x5645d4aa2d00 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.879+0000 7fe0a6615740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5645d497ca80 con 0x5645d4a75960 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.879+0000 7fe0a6615740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5645d49da700 con 0x5645d4aa30e0 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a16a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa2d00 0x5645d4aa5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a16a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa2d00 0x5645d4aa5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54084/0 (socket says 172.21.15.96:54084) 2024-06-02T23:46:32.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a16a5640 1 -- 172.21.15.96:0/1754975279 learned_addr learned my addr 172.21.15.96:0/1754975279 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/1754975279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4aa5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/1754975279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4a75960 0x5645d4a79170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a16a5640 1 -- 172.21.15.96:0/1754975279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 msgr2=0x5645d4aa5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/1754975279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4aa5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a16a5640 1 -- 172.21.15.96:0/1754975279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4a75960 msgr2=0x5645d4a79170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/1754975279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4a75960 0x5645d4a79170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a16a5640 1 -- 172.21.15.96:0/1754975279 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645d49a7fb0 con 0x5645d4aa2d00 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/1754975279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa2d00 0x5645d4aa5510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe08c015600 tx=0x7fe08c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12da430ca3671c1a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe082ffd640 1 -- 172.21.15.96:0/1754975279 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c019070 con 0x5645d4aa2d00 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe082ffd640 1 -- 172.21.15.96:0/1754975279 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe08c026070 con 0x5645d4aa2d00 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.880+0000 7fe082ffd640 1 -- 172.21.15.96:0/1754975279 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c021610 con 0x5645d4aa2d00 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 -- 172.21.15.96:0/1754975279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa2d00 msgr2=0x5645d4aa5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 --2- 172.21.15.96:0/1754975279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa2d00 0x5645d4aa5510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe08c015600 tx=0x7fe08c015000 comp rx=0 tx=0).stop 2024-06-02T23:46:32.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 -- 172.21.15.96:0/1754975279 shutdown_connections 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 --2- 172.21.15.96:0/1754975279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4a75960 0x5645d4a79170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 --2- 172.21.15.96:0/1754975279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4aa5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 --2- 172.21.15.96:0/1754975279 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa2d00 0x5645d4aa5510 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 -- 172.21.15.96:0/1754975279 >> 172.21.15.96:0/1754975279 conn(0x5645d4a77bd0 msgr2=0x5645d4ac0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 -- 172.21.15.96:0/1754975279 shutdown_connections 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 -- 172.21.15.96:0/1754975279 wait complete. 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 -- start start 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.881+0000 7fe0a6615740 1 Processor -- start 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.882+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4aa2d00 0x5645d4a98890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.882+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4aa63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.882+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a99bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.882+0000 7fe0a6615740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x5645d4a7ad80 con 0x5645d4ad3cc0 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.882+0000 7fe0a6615740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5645d4967c30 con 0x5645d4aa2d00 2024-06-02T23:46:32.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.882+0000 7fe0a6615740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5645d4a7b060 con 0x5645d4aa30e0 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.882+0000 7fe0a6615740 10 client.0 _ll_register_callbacks cb 0x5645d49997f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.882+0000 7fe0a1ea6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a99bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.882+0000 7fe0a1ea6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a99bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54100/0 (socket says 172.21.15.96:54100) 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.882+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/3863395023 learned_addr learned my addr 172.21.15.96:0/3863395023 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4aa2d00 0x5645d4a98890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4aa63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/3863395023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 msgr2=0x5645d4aa63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4aa63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/3863395023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4aa2d00 msgr2=0x5645d4a98890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4aa2d00 0x5645d4a98890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/3863395023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645d46f22d0 con 0x5645d4ad3cc0 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4aa63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a99bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0940a8af0 tx=0x7fe09402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a650ae905ca8dd69 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:32.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe077fff640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe077fff640 1 -- 172.21.15.96:0/3863395023 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094079da0 con 0x5645d4ad3cc0 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a6615740 1 -- 172.21.15.96:0/3863395023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe08c026070 con 0x5645d4ad3cc0 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe077fff640 1 -- 172.21.15.96:0/3863395023 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe094077cc0 con 0x5645d4ad3cc0 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe077fff640 1 -- 172.21.15.96:0/3863395023 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fe09407cc20 con 0x5645d4ad3cc0 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a6615740 10 client.4407 fetch_fsmap learned FSMap version 6 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a6615740 1 -- 172.21.15.96:0/3863395023 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5645d47bc6b0 con 0x5645d4ad3cc0 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe077fff640 1 -- 172.21.15.96:0/3863395023 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe08c026070 con 0x5645d4ad3cc0 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe077fff640 1 -- 172.21.15.96:0/3863395023 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7fe09403a070 con 0x5645d4ad3cc0 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a6615740 10 client.4407 fetch_fsmap finished waiting for FSMap version 6 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a6615740 10 client.4407 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a6615740 20 client.4407 populate_metadata read hostname 'smithi096' 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a6615740 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x5645d4aa8850 0x5645d4aa8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a6615740 4 client.4407 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T23:46:32.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a6615740 1 -- 172.21.15.96:0/3863395023 --> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645d49ebe70 con 0x5645d4aa8850 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.883+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x5645d4aa8850 0x5645d4aa8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.884+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x5645d4aa8850 0x5645d4aa8c30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c9951cc792f12aa server_cookie=2cdd37f0ab92ee56 in_seq=0 out_seq=0 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.884+0000 7fe077fff640 10 client.4407 ms_handle_connect on v2:172.21.15.96:6835/1720821828 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.884+0000 7fe077fff640 1 -- 172.21.15.96:0/3863395023 <== mds.0 v2:172.21.15.96:6835/1720821828 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5645d49ebe70 con 0x5645d4aa8850 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.884+0000 7fe077fff640 10 client.4407 handle_command_reply: tid=0 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.884+0000 7fe0a6615740 1 client.4407 shutdown 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.884+0000 7fe0a6615740 1 -- 172.21.15.96:0/3863395023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 msgr2=0x5645d4a99bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.884+0000 7fe0a6615740 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a99bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0940a8af0 tx=0x7fe09402be30 comp rx=0 tx=0).stop 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.885+0000 7fe0a6615740 1 -- 172.21.15.96:0/3863395023 shutdown_connections 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.885+0000 7fe0a6615740 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x5645d4aa8850 0x5645d4aa8c30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.885+0000 7fe0a6615740 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a99bd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.885+0000 7fe0a6615740 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4aa63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.885+0000 7fe077fff640 0 client.4407 ms_handle_reset on v2:172.21.15.96:6835/1720821828 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.885+0000 7fe0a6615740 1 --2- 172.21.15.96:0/3863395023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4aa2d00 0x5645d4a98890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.885+0000 7fe0a6615740 1 -- 172.21.15.96:0/3863395023 >> 172.21.15.96:0/3863395023 conn(0x5645d4a75960 msgr2=0x5645d4aa1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:32.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.885+0000 7fe0a6615740 1 -- 172.21.15.96:0/3863395023 shutdown_connections 2024-06-02T23:46:32.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.885+0000 7fe0a6615740 1 -- 172.21.15.96:0/3863395023 wait complete. 2024-06-02T23:46:32.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.885+0000 7fe0a6615740 20 client.4407 trim_cache size 0 max 16384 2024-06-02T23:46:32.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.903+0000 7fe0a6615740 1 Processor -- start 2024-06-02T23:46:32.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.904+0000 7fe0a6615740 1 -- start start 2024-06-02T23:46:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.904+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa2d00 0x5645d4aa8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.904+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa30e0 0x5645d4ae5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.904+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4ad3cc0 0x5645d4ae5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.904+0000 7fe0a6615740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c201470 con 0x5645d4aa30e0 2024-06-02T23:46:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.904+0000 7fe0a6615740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c2007d0 con 0x5645d4ad3cc0 2024-06-02T23:46:32.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.904+0000 7fe0a6615740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c200e20 con 0x5645d4aa2d00 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.904+0000 7fe0a0ea4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa30e0 0x5645d4ae5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.904+0000 7fe0a0ea4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa30e0 0x5645d4ae5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54104/0 (socket says 172.21.15.96:54104) 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.904+0000 7fe0a0ea4640 1 -- 172.21.15.96:0/1785343933 learned_addr learned my addr 172.21.15.96:0/1785343933 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa2d00 0x5645d4aa8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4ad3cc0 0x5645d4ae5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a0ea4640 1 -- 172.21.15.96:0/1785343933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa2d00 msgr2=0x5645d4aa8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa2d00 0x5645d4aa8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a0ea4640 1 -- 172.21.15.96:0/1785343933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4ad3cc0 msgr2=0x5645d4ae5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4ad3cc0 0x5645d4ae5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a0ea4640 1 -- 172.21.15.96:0/1785343933 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645d4ac05b0 con 0x5645d4aa30e0 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa2d00 0x5645d4aa8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4ad3cc0 0x5645d4ae5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa30e0 0x5645d4ae5150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe090009d10 tx=0x7fe090009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5ea11c9dccdba0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:32.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0827fc640 1 -- 172.21.15.96:0/1785343933 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090004240 con 0x5645d4aa30e0 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0827fc640 1 -- 172.21.15.96:0/1785343933 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0900043e0 con 0x5645d4aa30e0 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0827fc640 1 -- 172.21.15.96:0/1785343933 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090003810 con 0x5645d4aa30e0 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a6615740 1 -- 172.21.15.96:0/1785343933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa30e0 msgr2=0x5645d4ae5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a6615740 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa30e0 0x5645d4ae5150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe090009d10 tx=0x7fe090009190 comp rx=0 tx=0).stop 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a6615740 1 -- 172.21.15.96:0/1785343933 shutdown_connections 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a6615740 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4ad3cc0 0x5645d4ae5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a6615740 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4aa30e0 0x5645d4ae5150 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a6615740 1 --2- 172.21.15.96:0/1785343933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa2d00 0x5645d4aa8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a6615740 1 -- 172.21.15.96:0/1785343933 >> 172.21.15.96:0/1785343933 conn(0x5645d4a75960 msgr2=0x5645d4a71090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a6615740 1 -- 172.21.15.96:0/1785343933 shutdown_connections 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.905+0000 7fe0a6615740 1 -- 172.21.15.96:0/1785343933 wait complete. 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.906+0000 7fe0a6615740 1 -- start start 2024-06-02T23:46:32.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.906+0000 7fe0a6615740 1 Processor -- start 2024-06-02T23:46:32.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4aa2d00 0x5645d4b3eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4a76500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a6615740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a97360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a6615740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x5645d4a99140 con 0x5645d4ad3cc0 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a6615740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5645d4a7ad80 con 0x5645d4aa2d00 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a6615740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5645d4ad4140 con 0x5645d4aa30e0 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a6615740 10 client.0 _ll_register_callbacks cb 0x7fe0940781d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a1ea6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a97360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a1ea6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a97360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54116/0 (socket says 172.21.15.96:54116) 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/2506885652 learned_addr learned my addr 172.21.15.96:0/2506885652 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a0ea4640 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4a76500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4aa2d00 0x5645d4b3eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/2506885652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 msgr2=0x5645d4a76500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4a76500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/2506885652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4aa2d00 msgr2=0x5645d4b3eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:32.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4aa2d00 0x5645d4b3eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a1ea6640 1 -- 172.21.15.96:0/2506885652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645d4abc910 con 0x5645d4ad3cc0 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe0a1ea6640 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a97360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe094078800 tx=0x7fe0940a8a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c2b1df214eeb98 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.907+0000 7fe077fff640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe077fff640 1 -- 172.21.15.96:0/2506885652 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094081530 con 0x5645d4ad3cc0 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe077fff640 1 -- 172.21.15.96:0/2506885652 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe094077ed0 con 0x5645d4ad3cc0 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a6615740 1 -- 172.21.15.96:0/2506885652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0900043e0 con 0x5645d4ad3cc0 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe077fff640 1 -- 172.21.15.96:0/2506885652 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fe09409e050 con 0x5645d4ad3cc0 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a6615740 10 client.4413 fetch_fsmap learned FSMap version 6 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a6615740 1 -- 172.21.15.96:0/2506885652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5645d4b43940 con 0x5645d4ad3cc0 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe077fff640 1 -- 172.21.15.96:0/2506885652 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0900043e0 con 0x5645d4ad3cc0 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe077fff640 1 -- 172.21.15.96:0/2506885652 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7fe0940a1020 con 0x5645d4ad3cc0 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a6615740 10 client.4413 fetch_fsmap finished waiting for FSMap version 6 2024-06-02T23:46:32.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a6615740 10 client.4413 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a6615740 20 client.4413 populate_metadata read hostname 'smithi096' 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a6615740 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x5645d4a978a0 0x5645d4ac4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a6615740 4 client.4413 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a6615740 1 -- 172.21.15.96:0/2506885652 --> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] -- command(tid 0: {"prefix": "status"}) -- 0x5645d49e61c0 con 0x5645d4a978a0 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x5645d4a978a0 0x5645d4ac4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe077fff640 10 client.4413 ms_handle_connect on v2:172.21.15.96:6835/1720821828 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe0a16a5640 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x5645d4a978a0 0x5645d4ac4500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=119465c484f94bfc server_cookie=5e747dd9ea145680 in_seq=0 out_seq=0 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe077fff640 1 -- 172.21.15.96:0/2506885652 <== mds.0 v2:172.21.15.96:6835/1720821828 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5645d49e61c0 con 0x5645d4a978a0 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.908+0000 7fe077fff640 10 client.4413 handle_command_reply: tid=0 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 client.4413 shutdown 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 -- 172.21.15.96:0/2506885652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 msgr2=0x5645d4a97360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a97360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe094078800 tx=0x7fe0940a8a50 comp rx=0 tx=0).stop 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 -- 172.21.15.96:0/2506885652 shutdown_connections 2024-06-02T23:46:32.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x5645d4a978a0 0x5645d4ac4500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5645d4ad3cc0 0x5645d4a97360 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5645d4aa30e0 0x5645d4a76500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe077fff640 0 client.4413 ms_handle_reset on v2:172.21.15.96:6835/1720821828 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 --2- 172.21.15.96:0/2506885652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645d4aa2d00 0x5645d4b3eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 -- 172.21.15.96:0/2506885652 >> 172.21.15.96:0/2506885652 conn(0x5645d4a75960 msgr2=0x5645d4aa6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 -- 172.21.15.96:0/2506885652 shutdown_connections 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 1 -- 172.21.15.96:0/2506885652 wait complete. 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a6615740 20 client.4413 trim_cache size 0 max 16384 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "83723afd-2657-4b93-818a-1e4b19cab42f", 2024-06-02T23:46:32.915 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2024-06-02T23:46:32.916 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4287, 2024-06-02T23:46:32.916 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-06-02T23:46:32.916 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-06-02T23:46:32.916 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-06-02T23:46:32.916 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 7.2045669620000004, 2024-06-02T23:46:32.916 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 6, 2024-06-02T23:46:32.916 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 24, 2024-06-02T23:46:32.916 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 24, 2024-06-02T23:46:32.916 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 13.288417916 2024-06-02T23:46:32.916 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:46:32.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a3909640 1 -- 172.21.15.96:0/509612725 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe08806be60 msgr2=0x7fe08806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a3909640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe08806be60 0x7fe08806e320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0013d0 tx=0x7fe08c006040 comp rx=0 tx=0).stop 2024-06-02T23:46:32.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a3909640 1 -- 172.21.15.96:0/509612725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe09c15c880 msgr2=0x7fe09c15cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:32.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a3909640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe09c15c880 0x7fe09c15cd00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe09402a590 tx=0x7fe094001120 comp rx=0 tx=0).stop 2024-06-02T23:46:32.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a3909640 1 -- 172.21.15.96:0/509612725 shutdown_connections 2024-06-02T23:46:32.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a3909640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe08806be60 0x7fe08806e320 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a3909640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe09c15c880 0x7fe09c15cd00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a3909640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe09c06c4d0 0x7fe09c06c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a3909640 1 --2- 172.21.15.96:0/509612725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe084004d40 0x7fe09c14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:32.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.909+0000 7fe0a3909640 1 -- 172.21.15.96:0/509612725 >> 172.21.15.96:0/509612725 conn(0x7fe09c0d1d90 msgr2=0x7fe09c06fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:32.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.910+0000 7fe0a3909640 1 -- 172.21.15.96:0/509612725 shutdown_connections 2024-06-02T23:46:32.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:32.910+0000 7fe0a3909640 1 -- 172.21.15.96:0/509612725 wait complete. 2024-06-02T23:46:32.920 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T23:46:32.920 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-02T23:46:32.921 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T23:46:33.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.019+0000 7f598e3a5640 1 Processor -- start 2024-06-02T23:46:33.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.019+0000 7f598e3a5640 1 -- start start 2024-06-02T23:46:33.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f598e3a5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f59880cad30 0x7f5988165e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f598e3a5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5988155950 con 0x7f598806ed20 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f598e3a5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59880cb2e0 con 0x7f5988155570 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f598e3a5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f59880cb5c0 con 0x7f59880cad30 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f59877fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f598806ed20 0x7f59880ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46648/0 (socket says 172.21.15.96:46648) 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f59877fe640 1 -- 172.21.15.96:0/2444427611 learned_addr learned my addr 172.21.15.96:0/2444427611 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f598c942640 1 --2- 172.21.15.96:0/2444427611 >> v2:172.21.15.162:3300/0 conn(0x7f59880cad30 0x7f5988165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f5986ffd640 1 -- 172.21.15.96:0/2444427611 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647428154 0 0) 0x7f5988155950 con 0x7f598806ed20 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f5986ffd640 1 -- 172.21.15.96:0/2444427611 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5970003520 con 0x7f598806ed20 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f598c942640 1 -- 172.21.15.96:0/2444427611 >> v1:172.21.15.162:6789/0 conn(0x7f5988155570 legacy=0x7f598806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f5986ffd640 1 -- 172.21.15.96:0/2444427611 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3692052597 0 0) 0x7f5970003520 con 0x7f598806ed20 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.020+0000 7f598c942640 1 -- 172.21.15.96:0/2444427611 >> v1:172.21.15.96:6789/0 conn(0x7f598806ed20 legacy=0x7f59880ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:33.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.021+0000 7f598c942640 1 -- 172.21.15.96:0/2444427611 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59880cb8a0 con 0x7f59880cad30 2024-06-02T23:46:33.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.021+0000 7f598c942640 1 --2- 172.21.15.96:0/2444427611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59880cad30 0x7f5988165e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5980009d90 tx=0x7f598002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db5552140fad6740 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:33.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.021+0000 7f5986ffd640 1 -- 172.21.15.96:0/2444427611 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c001670 con 0x7f59880cad30 2024-06-02T23:46:33.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.021+0000 7f5986ffd640 1 -- 172.21.15.96:0/2444427611 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5980007540 con 0x7f59880cad30 2024-06-02T23:46:33.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.022+0000 7f5986ffd640 1 -- 172.21.15.96:0/2444427611 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980007910 con 0x7f59880cad30 2024-06-02T23:46:33.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.022+0000 7f598e3a5640 1 -- 172.21.15.96:0/2444427611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59880cad30 msgr2=0x7f5988165e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:33.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.022+0000 7f598e3a5640 1 --2- 172.21.15.96:0/2444427611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59880cad30 0x7f5988165e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5980009d90 tx=0x7f598002a680 comp rx=0 tx=0).stop 2024-06-02T23:46:33.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.022+0000 7f598e3a5640 1 -- 172.21.15.96:0/2444427611 shutdown_connections 2024-06-02T23:46:33.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.022+0000 7f598e3a5640 1 --2- 172.21.15.96:0/2444427611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59880cad30 0x7f5988165e40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:33.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.022+0000 7f598e3a5640 1 -- 172.21.15.96:0/2444427611 >> 172.21.15.96:0/2444427611 conn(0x7f59880cfc30 msgr2=0x7f59880d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:33.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.022+0000 7f598e3a5640 1 -- 172.21.15.96:0/2444427611 shutdown_connections 2024-06-02T23:46:33.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.022+0000 7f598e3a5640 1 -- 172.21.15.96:0/2444427611 wait complete. 2024-06-02T23:46:33.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.023+0000 7f598e3a5640 1 Processor -- start 2024-06-02T23:46:33.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.023+0000 7f598e3a5640 1 -- start start 2024-06-02T23:46:33.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f598e3a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f598806ed20 0x7f59880b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:33.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f598e3a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880cad30 0x7f59880c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:33.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f598e3a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5988155570 0x7f5988151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:33.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f598e3a5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5988073030 con 0x7f59880cad30 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f598e3a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59880717d0 con 0x7f598806ed20 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f598e3a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f59880731b0 con 0x7f5988155570 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f59877fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880cad30 0x7f59880c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f59877fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880cad30 0x7f59880c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54494/0 (socket says 172.21.15.96:54494) 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f59877fe640 1 -- 172.21.15.96:0/650372072 learned_addr learned my addr 172.21.15.96:0/650372072 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f59877fe640 1 -- 172.21.15.96:0/650372072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5988155570 msgr2=0x7f5988151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f59877fe640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5988155570 0x7f5988151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f59877fe640 1 -- 172.21.15.96:0/650372072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f598806ed20 msgr2=0x7f59880b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f59877fe640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f598806ed20 0x7f59880b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f59877fe640 1 -- 172.21.15.96:0/650372072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59880c6690 con 0x7f59880cad30 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.024+0000 7f59877fe640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880cad30 0x7f59880c58d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f597c00c780 tx=0x7f597c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.025+0000 7f5984ff9640 1 -- 172.21.15.96:0/650372072 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c017070 con 0x7f59880cad30 2024-06-02T23:46:33.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.025+0000 7f5984ff9640 1 -- 172.21.15.96:0/650372072 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597c005ad0 con 0x7f59880cad30 2024-06-02T23:46:33.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.025+0000 7f598e3a5640 1 -- 172.21.15.96:0/650372072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59880c5e10 con 0x7f59880cad30 2024-06-02T23:46:33.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.025+0000 7f5984ff9640 1 -- 172.21.15.96:0/650372072 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c007070 con 0x7f59880cad30 2024-06-02T23:46:33.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.025+0000 7f598e3a5640 1 -- 172.21.15.96:0/650372072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59880c63b0 con 0x7f59880cad30 2024-06-02T23:46:33.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.026+0000 7f598e3a5640 1 -- 172.21.15.96:0/650372072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59880683e0 con 0x7f59880cad30 2024-06-02T23:46:33.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.026+0000 7f5984ff9640 1 -- 172.21.15.96:0/650372072 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f597c01a070 con 0x7f59880cad30 2024-06-02T23:46:33.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.027+0000 7f5984ff9640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f597406be60 0x7f597406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:33.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.027+0000 7f5984ff9640 1 -- 172.21.15.96:0/650372072 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f597c08a700 con 0x7f59880cad30 2024-06-02T23:46:33.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.027+0000 7f5987fff640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f597406be60 0x7f597406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:33.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.027+0000 7f5987fff640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f597406be60 0x7f597406e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5978000f60 tx=0x7f59780079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:33.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.031+0000 7f5984ff9640 1 -- 172.21.15.96:0/650372072 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f59880c6690 con 0x7f59880cad30 2024-06-02T23:46:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.241+0000 7f598e3a5640 1 -- 172.21.15.96:0/650372072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f598806cc90 con 0x7f59880cad30 2024-06-02T23:46:33.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.241+0000 7f5984ff9640 1 -- 172.21.15.96:0/650372072 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f597c058d80 con 0x7f59880cad30 2024-06-02T23:46:33.241 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T23:46:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 -- 172.21.15.96:0/650372072 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f597406be60 msgr2=0x7f597406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f597406be60 0x7f597406e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5978000f60 tx=0x7f59780079b0 comp rx=0 tx=0).stop 2024-06-02T23:46:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 -- 172.21.15.96:0/650372072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880cad30 msgr2=0x7f59880c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880cad30 0x7f59880c58d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f597c00c780 tx=0x7f597c00cc40 comp rx=0 tx=0).stop 2024-06-02T23:46:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 -- 172.21.15.96:0/650372072 shutdown_connections 2024-06-02T23:46:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5988155570 0x7f5988151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f597406be60 0x7f597406e320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:33.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59880cad30 0x7f59880c58d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 --2- 172.21.15.96:0/650372072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f598806ed20 0x7f59880b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 -- 172.21.15.96:0/650372072 >> 172.21.15.96:0/650372072 conn(0x7f59880cfc30 msgr2=0x7f5988152b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 -- 172.21.15.96:0/650372072 shutdown_connections 2024-06-02T23:46:33.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33.243+0000 7f598e3a5640 1 -- 172.21.15.96:0/650372072 wait complete. 2024-06-02T23:46:33.254 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-02T23:46:33.254 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T23:46:33.254 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-06-02T23:46:33.254 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-06-02T23:46:33.254 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-02T23:46:33.254 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-02T23:46:33.254 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T23:46:33.254 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T23:46:33.254 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-06-02T23:46:33.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:33.254 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-06-02T23:46:33.269 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:46:33.270 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:46:33.270 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:46:33.270 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:33.270 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-06-02T23:46:33.270 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:33.270 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:33.270 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:33.270 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-06-02T23:46:33.270 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:33.271 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:33.271 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-06-02T23:46:33.271 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:33.271 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:33.271 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T23:46:33.271 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:33.271 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T23:46:33.271 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42767sec preferred_lft 42767sec 2024-06-02T23:46:33.271 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-06-02T23:46:33.271 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:33.272 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T23:46:33.272 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:33.272 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:33.272 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2024-06-02T23:46:33.272 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2024-06-02T23:46:33.272 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2024-06-02T23:46:33.272 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T23:46:33.272 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:33.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:33.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:33.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:33.477 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T23:46:33.503 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-06-02T23:46:33.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:33.504 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-06-02T23:46:33.574 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-06-02T23:46:33.574 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T23:46:33.574 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T23:46:33.575 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T23:46:33.575 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T23:46:33.575 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:33.575 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:33.575 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T23:46:33.575 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T23:46:33.575 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T23:46:33.575 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:33.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:33.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:33.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:33.877 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-06-02T23:46:33.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:33.893 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2024-06-02T23:46:33.947 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:33.947 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:33.947 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T23:46:33.947 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-06-02T23:46:33.947 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:34.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:34.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:34.064 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-06-02T23:46:34.065 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:34.065 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:34.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-06-02T23:46:34.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T23:46:34.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-06-02T23:46:34.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-06-02T23:46:34.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-06-02T23:46:34.065 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:34.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:34.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:34.193 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:34.193 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:34.193 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2024-06-02T23:46:34.193 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T23:46:34.193 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:34.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:34.270 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-06-02T23:46:34.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:46:34.270 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-06-02T23:46:34.285 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-06-02T23:46:34.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:46:34.285 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-06-02T23:46:34.335 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-06-02T23:46:34.400 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:46:34.457 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-06-02T23:46:34.457 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-06-02T23:46:34.457 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-06-02T23:46:34.457 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-06-02T23:46:34.457 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-06-02T23:46:34.457 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-06-02T23:46:34.458 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:46:34.459 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:46:34.459 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:46:34.459 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:46:34.459 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-06-02T23:46:34.459 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-06-02T23:46:34.459 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T23:46:34.459 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T23:46:34.459 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T23:46:34.459 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T23:46:34.459 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-06-02T23:46:34.460 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T23:46:34.460 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T23:46:34.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:34.460 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-06-02T23:46:34.513 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T23:46:34.513 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-06-02T23:46:34.555 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-06-02T23:46:34.579 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:46:34.635 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-06-02T23:46:34.635 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-06-02T23:46:34.635 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-06-02T23:46:34.635 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-06-02T23:46:34.635 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-06-02T23:46:34.636 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T23:46:34.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:34.638 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-06-02T23:46:34.644 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:2024-06-02T23:46:34.644+0000 7f3a5c338480 -1 init, newargv = 0x55eba5a6ee90 newargc=15 2024-06-02T23:46:34.644 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:ceph-fuse[45129]: starting ceph client 2024-06-02T23:46:34.650 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:ceph-fuse[45129]: starting fuse 2024-06-02T23:46:34.660 INFO:teuthology.orchestra.run.smithi096.stdout:40 2024-06-02T23:46:34.660 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T23:46:34.660 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2024-06-02T23:46:34.660 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> import re 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> import os 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2024-06-02T23:46:34.661 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> return f 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T23:46:34.662 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:34.663 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.admin")) 2024-06-02T23:46:34.663 DEBUG:teuthology.orchestra.run.smithi096:> ' 2024-06-02T23:46:34.779 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.admin.45129.asok 2024-06-02T23:46:34.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:34.790 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.45129.asok 2024-06-02T23:46:34.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:34.790 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.45129.asok status 2024-06-02T23:46:34.923 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "admin", 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "45129", 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2024-06-02T23:46:34.924 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4428, 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4428 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 563959627 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-06-02T23:46:34.925 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 563959627 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4428 192.168.0.1:0/563959627", 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.1:0/563959627", 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 6, 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 24, 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2024-06-02T23:46:34.926 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:46:34.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:34.932 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2024-06-02T23:46:34.932 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-06-02T23:46:34.948 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2024-06-02T23:46:34.948 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-06-02T23:46:34.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:34.948 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-06-02T23:46:35.013 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-06-02T23:46:35.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-02T23:46:35.133 INFO:teuthology.orchestra.run.smithi096.stdout:# file: . 2024-06-02T23:46:35.133 INFO:teuthology.orchestra.run.smithi096.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-06-02T23:46:35.133 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:35.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:35.137 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:46:35.137 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:46:35.154 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:46:35.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.294+0000 7fa74aad4640 1 Processor -- start 2024-06-02T23:46:35.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.294+0000 7fa74aad4640 1 -- start start 2024-06-02T23:46:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.295+0000 7fa74aad4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa744161900 0x7fa7440d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.295+0000 7fa74aad4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7440d2a60 con 0x7fa7440b5510 2024-06-02T23:46:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.295+0000 7fa74aad4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7440d4a90 con 0x7fa7440b4fa0 2024-06-02T23:46:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.295+0000 7fa74aad4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa7440cf5c0 con 0x7fa744161900 2024-06-02T23:46:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.295+0000 7fa743fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa7440b5510 0x7fa7440d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46654/0 (socket says 172.21.15.96:46654) 2024-06-02T23:46:35.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.295+0000 7fa743fff640 1 -- 172.21.15.96:0/4031415616 learned_addr learned my addr 172.21.15.96:0/4031415616 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa748870640 1 --2- 172.21.15.96:0/4031415616 >> v2:172.21.15.162:3300/0 conn(0x7fa744161900 0x7fa7440d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578281200 0 0) 0x7fa7440d2a60 con 0x7fa7440b5510 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa72c003520 con 0x7fa7440b5510 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3777063442 0 0) 0x7fa72c003520 con 0x7fa7440b5510 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 >> v2:172.21.15.162:3300/0 conn(0x7fa744161900 msgr2=0x7fa7440d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 --2- 172.21.15.96:0/4031415616 >> v2:172.21.15.162:3300/0 conn(0x7fa744161900 0x7fa7440d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 >> v1:172.21.15.162:6789/0 conn(0x7fa7440b4fa0 legacy=0x7fa7440d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7440d4d70 con 0x7fa7440b5510 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fa7380019f0 con 0x7fa7440b5510 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 >> v1:172.21.15.96:6789/0 conn(0x7fa7440b5510 legacy=0x7fa7440d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa72c0039b0 0x7fa72c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa72c004800 0x7fa72c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa72c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa7440cf5c0 con 0x7fa72c0051c0 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c00c160 con 0x7fa72c0039b0 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa72c00c360 con 0x7fa72c004800 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa749071640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa72c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa748870640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa72c0039b0 0x7fa72c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa743fff640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa72c004800 0x7fa72c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa749071640 1 -- 172.21.15.96:0/4031415616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa72c004800 msgr2=0x7fa72c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa749071640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa72c004800 0x7fa72c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa749071640 1 -- 172.21.15.96:0/4031415616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa72c0039b0 msgr2=0x7fa72c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:35.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa749071640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa72c0039b0 0x7fa72c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa749071640 1 -- 172.21.15.96:0/4031415616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c003520 con 0x7fa72c0051c0 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.296+0000 7fa743fff640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa72c004800 0x7fa72c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.297+0000 7fa749071640 1 -- 172.21.15.96:0/4031415616 reap_dead start 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.297+0000 7fa749071640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa72c00b9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa73c001750 tx=0x7fa72c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473b982d161a53ac server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.297+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c001370 con 0x7fa72c0051c0 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.297+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73c005310 con 0x7fa72c0051c0 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.297+0000 7fa7437fe640 1 -- 172.21.15.96:0/4031415616 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c02abe0 con 0x7fa72c0051c0 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.298+0000 7fa74aad4640 1 -- 172.21.15.96:0/4031415616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 msgr2=0x7fa72c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.298+0000 7fa74aad4640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa72c00b9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa73c001750 tx=0x7fa72c005830 comp rx=0 tx=0).stop 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.298+0000 7fa74aad4640 1 -- 172.21.15.96:0/4031415616 shutdown_connections 2024-06-02T23:46:35.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.298+0000 7fa74aad4640 1 --2- 172.21.15.96:0/4031415616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa72c00b9c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.298+0000 7fa74aad4640 1 -- 172.21.15.96:0/4031415616 >> 172.21.15.96:0/4031415616 conn(0x7fa74409d3b0 msgr2=0x7fa7440d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:35.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.298+0000 7fa74aad4640 1 -- 172.21.15.96:0/4031415616 shutdown_connections 2024-06-02T23:46:35.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.298+0000 7fa74aad4640 1 -- 172.21.15.96:0/4031415616 wait complete. 2024-06-02T23:46:35.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.299+0000 7fa74aad4640 1 Processor -- start 2024-06-02T23:46:35.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.299+0000 7fa74aad4640 1 -- start start 2024-06-02T23:46:35.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa74aad4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa7441f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa74aad4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7440cc190 0x7fa74415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa74aad4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa74415b2c0 0x7fa74415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa74aad4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa7440cfae0 con 0x7fa72c0051c0 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa74aad4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa7440caf70 con 0x7fa74415b2c0 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa74aad4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa7440d4780 con 0x7fa7440cc190 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa748870640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa7441f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa748870640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa7441f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54508/0 (socket says 172.21.15.96:54508) 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa748870640 1 -- 172.21.15.96:0/349937591 learned_addr learned my addr 172.21.15.96:0/349937591 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa743fff640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7440cc190 0x7fa74415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa748870640 1 -- 172.21.15.96:0/349937591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7440cc190 msgr2=0x7fa74415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa748870640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7440cc190 0x7fa74415ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa748870640 1 -- 172.21.15.96:0/349937591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa74415b2c0 msgr2=0x7fa74415cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa748870640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa74415b2c0 0x7fa74415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa748870640 1 -- 172.21.15.96:0/349937591 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7441f4d80 con 0x7fa72c0051c0 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa748870640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa7441f4840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7340118e0 tx=0x7fa734011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.300+0000 7fa7417fa640 1 -- 172.21.15.96:0/349937591 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73400faf0 con 0x7fa72c0051c0 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.301+0000 7fa7417fa640 1 -- 172.21.15.96:0/349937591 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73400fc90 con 0x7fa72c0051c0 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.301+0000 7fa74aad4640 1 -- 172.21.15.96:0/349937591 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7440cc730 con 0x7fa72c0051c0 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.301+0000 7fa7417fa640 1 -- 172.21.15.96:0/349937591 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa734014440 con 0x7fa72c0051c0 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.301+0000 7fa74aad4640 1 -- 172.21.15.96:0/349937591 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7440cccf0 con 0x7fa72c0051c0 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.301+0000 7fa74aad4640 1 -- 172.21.15.96:0/349937591 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7440683e0 con 0x7fa72c0051c0 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.302+0000 7fa7417fa640 1 -- 172.21.15.96:0/349937591 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa734012040 con 0x7fa72c0051c0 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.302+0000 7fa7417fa640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa73006be30 0x7fa73006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.302+0000 7fa7417fa640 1 -- 172.21.15.96:0/349937591 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa73408b8b0 con 0x7fa72c0051c0 2024-06-02T23:46:35.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.302+0000 7fa743fff640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa73006be30 0x7fa73006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.303+0000 7fa743fff640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa73006be30 0x7fa73006e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa738002230 tx=0x7fa7380014d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:35.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.307+0000 7fa7417fa640 1 -- 172.21.15.96:0/349937591 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa7441f4d80 con 0x7fa72c0051c0 2024-06-02T23:46:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.492+0000 7fa74aad4640 1 -- 172.21.15.96:0/349937591 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa7440d05e0 con 0x7fa72c0051c0 2024-06-02T23:46:35.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.492+0000 7fa7417fa640 1 -- 172.21.15.96:0/349937591 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fa734019030 con 0x7fa72c0051c0 2024-06-02T23:46:35.493 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-02T23:46:35.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 -- 172.21.15.96:0/349937591 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa73006be30 msgr2=0x7fa73006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa73006be30 0x7fa73006e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa738002230 tx=0x7fa7380014d0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 -- 172.21.15.96:0/349937591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 msgr2=0x7fa7441f4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa7441f4840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7340118e0 tx=0x7fa734011da0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 -- 172.21.15.96:0/349937591 shutdown_connections 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa74415b2c0 0x7fa74415cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7440cc190 0x7fa74415ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa73006be30 0x7fa73006e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 --2- 172.21.15.96:0/349937591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa72c0051c0 0x7fa7441f4840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 -- 172.21.15.96:0/349937591 >> 172.21.15.96:0/349937591 conn(0x7fa74409d3b0 msgr2=0x7fa74406d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 -- 172.21.15.96:0/349937591 shutdown_connections 2024-06-02T23:46:35.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.494+0000 7fa74aad4640 1 -- 172.21.15.96:0/349937591 wait complete. 2024-06-02T23:46:35.505 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:46:35.505 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:46:35.522 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:46:35.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.662+0000 7fe4f8029640 1 Processor -- start 2024-06-02T23:46:35.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.662+0000 7fe4f8029640 1 -- start start 2024-06-02T23:46:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.663+0000 7fe4f8029640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe4f006ed20 0x7fe4f00ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.663+0000 7fe4f8029640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f0155950 con 0x7fe4f00cab60 2024-06-02T23:46:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.663+0000 7fe4f8029640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f00cb2e0 con 0x7fe4f0155570 2024-06-02T23:46:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.663+0000 7fe4f8029640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f00cb5c0 con 0x7fe4f006ed20 2024-06-02T23:46:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.663+0000 7fe4f65c6640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe4f00cab60 0x7fe4f0072020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46660/0 (socket says 172.21.15.96:46660) 2024-06-02T23:46:35.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.663+0000 7fe4f65c6640 1 -- 172.21.15.96:0/3777129548 learned_addr learned my addr 172.21.15.96:0/3777129548 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:35.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.663+0000 7fe4f55c4640 1 --2- 172.21.15.96:0/3777129548 >> v2:172.21.15.162:3300/0 conn(0x7fe4f006ed20 0x7fe4f00ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.663+0000 7fe4f4dc3640 1 -- 172.21.15.96:0/3777129548 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443905332 0 0) 0x7fe4f0155950 con 0x7fe4f00cab60 2024-06-02T23:46:35.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.663+0000 7fe4f4dc3640 1 -- 172.21.15.96:0/3777129548 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4dc003520 con 0x7fe4f00cab60 2024-06-02T23:46:35.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.664+0000 7fe4f55c4640 1 -- 172.21.15.96:0/3777129548 >> v1:172.21.15.162:6789/0 conn(0x7fe4f0155570 legacy=0x7fe4f006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.664+0000 7fe4f55c4640 1 -- 172.21.15.96:0/3777129548 >> v1:172.21.15.96:6789/0 conn(0x7fe4f00cab60 legacy=0x7fe4f0072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.664+0000 7fe4f4dc3640 1 -- 172.21.15.96:0/3777129548 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2828632398 0 0) 0x7fe4dc003520 con 0x7fe4f00cab60 2024-06-02T23:46:35.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.664+0000 7fe4f55c4640 1 -- 172.21.15.96:0/3777129548 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f00cb8a0 con 0x7fe4f006ed20 2024-06-02T23:46:35.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.664+0000 7fe4f55c4640 1 --2- 172.21.15.96:0/3777129548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4f006ed20 0x7fe4f00ca620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00097a0 tx=0x7fe4e002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f42968af448dddd1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:35.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.665+0000 7fe4f4dc3640 1 -- 172.21.15.96:0/3777129548 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0037070 con 0x7fe4f006ed20 2024-06-02T23:46:35.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.665+0000 7fe4f4dc3640 1 -- 172.21.15.96:0/3777129548 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e002ac50 con 0x7fe4f006ed20 2024-06-02T23:46:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.665+0000 7fe4f4dc3640 1 -- 172.21.15.96:0/3777129548 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80019f0 con 0x7fe4f006ed20 2024-06-02T23:46:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.665+0000 7fe4f8029640 1 -- 172.21.15.96:0/3777129548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4f006ed20 msgr2=0x7fe4f00ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.665+0000 7fe4f8029640 1 --2- 172.21.15.96:0/3777129548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4f006ed20 0x7fe4f00ca620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00097a0 tx=0x7fe4e002a1c0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.665+0000 7fe4f8029640 1 -- 172.21.15.96:0/3777129548 shutdown_connections 2024-06-02T23:46:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.665+0000 7fe4f8029640 1 --2- 172.21.15.96:0/3777129548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4f006ed20 0x7fe4f00ca620 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.665+0000 7fe4f8029640 1 -- 172.21.15.96:0/3777129548 >> 172.21.15.96:0/3777129548 conn(0x7fe4f00cfc30 msgr2=0x7fe4f00d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.665+0000 7fe4f8029640 1 -- 172.21.15.96:0/3777129548 shutdown_connections 2024-06-02T23:46:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.665+0000 7fe4f8029640 1 -- 172.21.15.96:0/3777129548 wait complete. 2024-06-02T23:46:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.666+0000 7fe4f8029640 1 Processor -- start 2024-06-02T23:46:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.666+0000 7fe4f8029640 1 -- start start 2024-06-02T23:46:35.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f8029640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4f006ed20 0x7fe4f00c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f8029640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4f00cab60 0x7fe4f00b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f8029640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0155570 0x7fe4f00c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f8029640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f00caf70 con 0x7fe4f0155570 2024-06-02T23:46:35.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f8029640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f00717d0 con 0x7fe4f00cab60 2024-06-02T23:46:35.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f8029640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f0072730 con 0x7fe4f006ed20 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f65c6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0155570 0x7fe4f00c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f65c6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0155570 0x7fe4f00c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54514/0 (socket says 172.21.15.96:54514) 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f65c6640 1 -- 172.21.15.96:0/1765455444 learned_addr learned my addr 172.21.15.96:0/1765455444 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f55c4640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4f00cab60 0x7fe4f00b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f5dc5640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4f006ed20 0x7fe4f00c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f65c6640 1 -- 172.21.15.96:0/1765455444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4f006ed20 msgr2=0x7fe4f00c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f65c6640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4f006ed20 0x7fe4f00c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f65c6640 1 -- 172.21.15.96:0/1765455444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4f00cab60 msgr2=0x7fe4f00b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f65c6640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4f00cab60 0x7fe4f00b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f65c6640 1 -- 172.21.15.96:0/1765455444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f00c42d0 con 0x7fe4f0155570 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f5dc5640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4f006ed20 0x7fe4f00c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.667+0000 7fe4f55c4640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4f00cab60 0x7fe4f00b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.668+0000 7fe4f65c6640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0155570 0x7fe4f00c8d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800cc30 tx=0x7fe4e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.668+0000 7fe4e67fc640 1 -- 172.21.15.96:0/1765455444 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8017070 con 0x7fe4f0155570 2024-06-02T23:46:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.668+0000 7fe4e67fc640 1 -- 172.21.15.96:0/1765455444 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e800ce40 con 0x7fe4f0155570 2024-06-02T23:46:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.668+0000 7fe4f8029640 1 -- 172.21.15.96:0/1765455444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f00c36c0 con 0x7fe4f0155570 2024-06-02T23:46:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.668+0000 7fe4e67fc640 1 -- 172.21.15.96:0/1765455444 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8012640 con 0x7fe4f0155570 2024-06-02T23:46:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.668+0000 7fe4f8029640 1 -- 172.21.15.96:0/1765455444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f00c3f60 con 0x7fe4f0155570 2024-06-02T23:46:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.669+0000 7fe4f8029640 1 -- 172.21.15.96:0/1765455444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f00c3ab0 con 0x7fe4f0155570 2024-06-02T23:46:35.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.669+0000 7fe4e67fc640 1 -- 172.21.15.96:0/1765455444 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4e801a070 con 0x7fe4f0155570 2024-06-02T23:46:35.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.670+0000 7fe4e67fc640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe4d406be30 0x7fe4d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:35.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.670+0000 7fe4e67fc640 1 -- 172.21.15.96:0/1765455444 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe4e808b190 con 0x7fe4f0155570 2024-06-02T23:46:35.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.670+0000 7fe4f5dc5640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe4d406be30 0x7fe4d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:35.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.670+0000 7fe4f5dc5640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe4d406be30 0x7fe4d406e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec000f60 tx=0x7fe4ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:35.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.674+0000 7fe4e67fc640 1 -- 172.21.15.96:0/1765455444 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe4e8059770 con 0x7fe4f0155570 2024-06-02T23:46:35.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.861+0000 7fe4f8029640 1 -- 172.21.15.96:0/1765455444 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe4f00683e0 con 0x7fe4f0155570 2024-06-02T23:46:35.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.862+0000 7fe4e67fc640 1 -- 172.21.15.96:0/1765455444 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fe4e8059070 con 0x7fe4f0155570 2024-06-02T23:46:35.862 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-02T23:46:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 -- 172.21.15.96:0/1765455444 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe4d406be30 msgr2=0x7fe4d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe4d406be30 0x7fe4d406e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec000f60 tx=0x7fe4ec009040 comp rx=0 tx=0).stop 2024-06-02T23:46:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 -- 172.21.15.96:0/1765455444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0155570 msgr2=0x7fe4f00c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0155570 0x7fe4f00c8d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800cc30 tx=0x7fe4e800a430 comp rx=0 tx=0).stop 2024-06-02T23:46:35.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 -- 172.21.15.96:0/1765455444 shutdown_connections 2024-06-02T23:46:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe4d406be30 0x7fe4d406e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0155570 0x7fe4f00c8d10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4f00cab60 0x7fe4f00b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 --2- 172.21.15.96:0/1765455444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4f006ed20 0x7fe4f00c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 -- 172.21.15.96:0/1765455444 >> 172.21.15.96:0/1765455444 conn(0x7fe4f00cfc30 msgr2=0x7fe4f00b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 -- 172.21.15.96:0/1765455444 shutdown_connections 2024-06-02T23:46:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:35.864+0000 7fe4f8029640 1 -- 172.21.15.96:0/1765455444 wait complete. 2024-06-02T23:46:35.875 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2024-06-02T23:46:35.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:35.875 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-06-02T23:46:35.898 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:ceph-fuse[45129]: fuse finished with error 0 and tester_r 0 2024-06-02T23:46:35.900 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:46:42.001 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:46:42.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:42.001 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-06-02T23:46:42.037 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:42.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.187+0000 7f4836af7640 1 Processor -- start 2024-06-02T23:46:42.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.187+0000 7f4836af7640 1 -- start start 2024-06-02T23:46:42.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.187+0000 7f4836af7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f483015f5e0 0x7f4830071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.187+0000 7f4836af7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f48300cae00 0x7f48300cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.187+0000 7f4836af7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f483006f210 con 0x7f483006ea70 2024-06-02T23:46:42.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.187+0000 7f4836af7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f483006ef30 con 0x7f48300cae00 2024-06-02T23:46:42.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.187+0000 7f4836af7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48300ca320 con 0x7f483015f5e0 2024-06-02T23:46:42.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482ffff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f483006ea70 0x7f4830071640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46672/0 (socket says 172.21.15.96:46672) 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482ffff640 1 -- 172.21.15.96:0/1225371289 learned_addr learned my addr 172.21.15.96:0/1225371289 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f4834893640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f483015f5e0 0x7f4830071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f4835094640 1 --2- 172.21.15.96:0/1225371289 >> v2:172.21.15.162:3300/0 conn(0x7f48300cae00 0x7f48300cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128688873 0 0) 0x7f483006f210 con 0x7f483006ea70 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4818003520 con 0x7f483006ea70 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 199498774 0 0) 0x7f4818003520 con 0x7f483006ea70 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f483015f5e0 msgr2=0x7f4830071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f483015f5e0 0x7f4830071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 >> v2:172.21.15.162:3300/0 conn(0x7f48300cae00 msgr2=0x7f48300cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 --2- 172.21.15.96:0/1225371289 >> v2:172.21.15.162:3300/0 conn(0x7f48300cae00 0x7f48300cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48300ca600 con 0x7f483006ea70 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f4824001670 con 0x7f483006ea70 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 >> v1:172.21.15.96:6789/0 conn(0x7f483006ea70 legacy=0x7f4830071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48180039b0 0x7f4818003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 0x7f4818004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f483015f5e0 0x7f48180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f483006ef30 con 0x7f4818004800 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48300ca320 con 0x7f48180039b0 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f481800b9c0 con 0x7f483015f5e0 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f482ffff640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 0x7f4818004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.188+0000 7f4834893640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48180039b0 0x7f4818003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.189+0000 7f4835094640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f483015f5e0 0x7f48180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.189+0000 7f482ffff640 1 -- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f483015f5e0 msgr2=0x7f48180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.189+0000 7f482ffff640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f483015f5e0 0x7f48180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.189+0000 7f482ffff640 1 -- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48180039b0 msgr2=0x7f4818003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.189+0000 7f482ffff640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48180039b0 0x7f4818003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.189+0000 7f482ffff640 1 -- 172.21.15.96:0/1225371289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4818003520 con 0x7f4818004800 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.189+0000 7f482ffff640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 0x7f4818004c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4824007fd0 tx=0x7f4818005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a121afaed0a5c669 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.190+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4824007d50 con 0x7f4818004800 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.190+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4824005ad0 con 0x7f4818004800 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.190+0000 7f482f7fe640 1 -- 172.21.15.96:0/1225371289 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4824007070 con 0x7f4818004800 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.190+0000 7f4836af7640 1 -- 172.21.15.96:0/1225371289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 msgr2=0x7f4818004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.190+0000 7f4836af7640 1 --2- 172.21.15.96:0/1225371289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 0x7f4818004c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4824007fd0 tx=0x7f4818005830 comp rx=0 tx=0).stop 2024-06-02T23:46:42.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.190+0000 7f4835094640 1 -- 172.21.15.96:0/1225371289 reap_dead start 2024-06-02T23:46:42.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.190+0000 7f4836af7640 1 -- 172.21.15.96:0/1225371289 shutdown_connections 2024-06-02T23:46:42.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.190+0000 7f4836af7640 1 -- 172.21.15.96:0/1225371289 >> 172.21.15.96:0/1225371289 conn(0x7f48300cfc30 msgr2=0x7f48300d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:42.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.190+0000 7f4836af7640 1 -- 172.21.15.96:0/1225371289 shutdown_connections 2024-06-02T23:46:42.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.190+0000 7f4836af7640 1 -- 172.21.15.96:0/1225371289 wait complete. 2024-06-02T23:46:42.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.191+0000 7f4836af7640 1 Processor -- start 2024-06-02T23:46:42.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.191+0000 7f4836af7640 1 -- start start 2024-06-02T23:46:42.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.192+0000 7f4836af7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 0x7f4830154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.192+0000 7f4836af7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4830155710 0x7f48300c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.192+0000 7f4836af7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4830157d90 0x7f4830158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.192+0000 7f4836af7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f48300731b0 con 0x7f4818004800 2024-06-02T23:46:42.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.192+0000 7f4836af7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4830073030 con 0x7f4830157d90 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.192+0000 7f4836af7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48300b2ac0 con 0x7f4830155710 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.192+0000 7f4834893640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 0x7f4830154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.192+0000 7f4834893640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 0x7f4830154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54520/0 (socket says 172.21.15.96:54520) 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4834893640 1 -- 172.21.15.96:0/166075549 learned_addr learned my addr 172.21.15.96:0/166075549 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f482ffff640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4830155710 0x7f48300c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4835094640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4830157d90 0x7f4830158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4834893640 1 -- 172.21.15.96:0/166075549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4830155710 msgr2=0x7f48300c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4834893640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4830155710 0x7f48300c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4834893640 1 -- 172.21.15.96:0/166075549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4830157d90 msgr2=0x7f4830158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4834893640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4830157d90 0x7f4830158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4834893640 1 -- 172.21.15.96:0/166075549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4830155b90 con 0x7f4818004800 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f482ffff640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4830155710 0x7f48300c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4835094640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4830157d90 0x7f4830158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4834893640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 0x7f4830154800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4820011910 tx=0x7f4820011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f482d7fa640 1 -- 172.21.15.96:0/166075549 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482000faf0 con 0x7f4818004800 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f482d7fa640 1 -- 172.21.15.96:0/166075549 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482000fc90 con 0x7f4818004800 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f482d7fa640 1 -- 172.21.15.96:0/166075549 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820014440 con 0x7f4818004800 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4836af7640 1 -- 172.21.15.96:0/166075549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4830156500 con 0x7f4818004800 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.193+0000 7f4836af7640 1 -- 172.21.15.96:0/166075549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4830153d20 con 0x7f4818004800 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.194+0000 7f4836af7640 1 -- 172.21.15.96:0/166075549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48300683e0 con 0x7f4818004800 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.195+0000 7f482d7fa640 1 -- 172.21.15.96:0/166075549 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4820012040 con 0x7f4818004800 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.195+0000 7f482d7fa640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f481c06be60 0x7f481c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.195+0000 7f482d7fa640 1 -- 172.21.15.96:0/166075549 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f482008b6c0 con 0x7f4818004800 2024-06-02T23:46:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.195+0000 7f482ffff640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f481c06be60 0x7f481c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.196+0000 7f482ffff640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f481c06be60 0x7f481c06e320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4824033000 tx=0x7f4824009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.200+0000 7f482d7fa640 1 -- 172.21.15.96:0/166075549 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4820019030 con 0x7f4818004800 2024-06-02T23:46:42.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.374+0000 7f4836af7640 1 -- 172.21.15.96:0/166075549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f483006f210 con 0x7f4818004800 2024-06-02T23:46:42.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.376+0000 7f482d7fa640 1 -- 172.21.15.96:0/166075549 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f4820059d30 con 0x7f4818004800 2024-06-02T23:46:42.376 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:42.376 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":24,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:30.096314+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:42.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 -- 172.21.15.96:0/166075549 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f481c06be60 msgr2=0x7f481c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f481c06be60 0x7f481c06e320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4824033000 tx=0x7f4824009030 comp rx=0 tx=0).stop 2024-06-02T23:46:42.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 -- 172.21.15.96:0/166075549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 msgr2=0x7f4830154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 0x7f4830154800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4820011910 tx=0x7f4820011dd0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 -- 172.21.15.96:0/166075549 shutdown_connections 2024-06-02T23:46:42.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4830157d90 0x7f4830158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4830155710 0x7f48300c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f481c06be60 0x7f481c06e320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 --2- 172.21.15.96:0/166075549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4818004800 0x7f4830154800 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 -- 172.21.15.96:0/166075549 >> 172.21.15.96:0/166075549 conn(0x7f48300cfc30 msgr2=0x7f483015dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:42.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 -- 172.21.15.96:0/166075549 shutdown_connections 2024-06-02T23:46:42.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.378+0000 7f4836af7640 1 -- 172.21.15.96:0/166075549 wait complete. 2024-06-02T23:46:42.389 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:42.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.488+0000 7f3411e15640 1 Processor -- start 2024-06-02T23:46:42.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.488+0000 7f3411e15640 1 -- start start 2024-06-02T23:46:42.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.489+0000 7f3411e15640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f340c16ea80 0x7f340c06cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.489+0000 7f3411e15640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340c0ce390 con 0x7f340c0cefa0 2024-06-02T23:46:42.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.489+0000 7f3411e15640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340c071510 con 0x7f340c071ee0 2024-06-02T23:46:42.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.489+0000 7f3411e15640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f340c0cbc90 con 0x7f340c16ea80 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.489+0000 7f340bfff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f340c0cefa0 0x7f340c16ee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46680/0 (socket says 172.21.15.96:46680) 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.489+0000 7f340bfff640 1 -- 172.21.15.96:0/556858152 learned_addr learned my addr 172.21.15.96:0/556858152 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340b7fe640 1 --2- 172.21.15.96:0/556858152 >> v2:172.21.15.162:3300/0 conn(0x7f340c16ea80 0x7f340c06cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115907950 0 0) 0x7f340c0ce390 con 0x7f340c0cefa0 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33f8003440 con 0x7f340c0cefa0 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 975774389 0 0) 0x7f33f8003440 con 0x7f340c0cefa0 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 >> v2:172.21.15.162:3300/0 conn(0x7f340c16ea80 msgr2=0x7f340c06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 --2- 172.21.15.96:0/556858152 >> v2:172.21.15.162:3300/0 conn(0x7f340c16ea80 0x7f340c06cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 >> v1:172.21.15.162:6789/0 conn(0x7f340c071ee0 legacy=0x7f340c0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c0cb9b0 con 0x7f340c0cefa0 2024-06-02T23:46:42.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f34040019f0 con 0x7f340c0cefa0 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 >> v1:172.21.15.96:6789/0 conn(0x7f340c0cefa0 legacy=0x7f340c16ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33f8003aa0 0x7f33f8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8008850 0x7f33f800acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33f800b4c0 0x7f33f800d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f340c0cbc90 con 0x7f33f800b4c0 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33f800e260 con 0x7f33f8008850 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f33f800e460 con 0x7f33f8003aa0 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340bfff640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33f800b4c0 0x7f33f800d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340b7fe640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33f8003aa0 0x7f33f8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f3403fff640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8008850 0x7f33f800acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340bfff640 1 -- 172.21.15.96:0/556858152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33f8003aa0 msgr2=0x7f33f8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:42.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340bfff640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33f8003aa0 0x7f33f8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340bfff640 1 -- 172.21.15.96:0/556858152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8008850 msgr2=0x7f33f800acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340bfff640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f8008850 0x7f33f800acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.490+0000 7f340bfff640 1 -- 172.21.15.96:0/556858152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f8003440 con 0x7f33f800b4c0 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.491+0000 7f340bfff640 1 -- 172.21.15.96:0/556858152 reap_dead start 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.491+0000 7f340bfff640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33f800b4c0 0x7f33f800d980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f340400a830 tx=0x7f33f8003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f66ddc1373ffd5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.491+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340400a480 con 0x7f33f800b4c0 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.491+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340402f070 con 0x7f33f800b4c0 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.491+0000 7f340affd640 1 -- 172.21.15.96:0/556858152 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340402bc90 con 0x7f33f800b4c0 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.492+0000 7f3411e15640 1 -- 172.21.15.96:0/556858152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33f800b4c0 msgr2=0x7f33f800d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.492+0000 7f3411e15640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33f800b4c0 0x7f33f800d980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f340400a830 tx=0x7f33f8003730 comp rx=0 tx=0).stop 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.492+0000 7f3411e15640 1 -- 172.21.15.96:0/556858152 shutdown_connections 2024-06-02T23:46:42.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.492+0000 7f3411e15640 1 --2- 172.21.15.96:0/556858152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33f800b4c0 0x7f33f800d980 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.492+0000 7f3411e15640 1 -- 172.21.15.96:0/556858152 >> 172.21.15.96:0/556858152 conn(0x7f340c0cfc30 msgr2=0x7f340c0d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:42.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.492+0000 7f3411e15640 1 -- 172.21.15.96:0/556858152 shutdown_connections 2024-06-02T23:46:42.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.492+0000 7f3411e15640 1 -- 172.21.15.96:0/556858152 wait complete. 2024-06-02T23:46:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.493+0000 7f3411e15640 1 Processor -- start 2024-06-02T23:46:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.493+0000 7f3411e15640 1 -- start start 2024-06-02T23:46:42.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3411e15640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f800b4c0 0x7f340c0aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3411e15640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f340c0aa430 0x7f340c08a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3411e15640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f340c08aeb0 0x7f340c200f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3411e15640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f340c071900 con 0x7f340c0aa430 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3411e15640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f340c16b290 con 0x7f33f800b4c0 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3411e15640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f340c071a80 con 0x7f340c08aeb0 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3403fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f340c0aa430 0x7f340c08a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3403fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f340c0aa430 0x7f340c08a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54538/0 (socket says 172.21.15.96:54538) 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3403fff640 1 -- 172.21.15.96:0/1295545674 learned_addr learned my addr 172.21.15.96:0/1295545674 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f340bfff640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f340c08aeb0 0x7f340c200f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f340b7fe640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f800b4c0 0x7f340c0aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3403fff640 1 -- 172.21.15.96:0/1295545674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f340c08aeb0 msgr2=0x7f340c200f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3403fff640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f340c08aeb0 0x7f340c200f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3403fff640 1 -- 172.21.15.96:0/1295545674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f800b4c0 msgr2=0x7f340c0aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3403fff640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f800b4c0 0x7f340c0aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3403fff640 1 -- 172.21.15.96:0/1295545674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c0a9670 con 0x7f340c0aa430 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f340b7fe640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f800b4c0 0x7f340c0aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f340bfff640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f340c08aeb0 0x7f340c200f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3403fff640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f340c0aa430 0x7f340c08a970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33f400f5c0 tx=0x7f33f400fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3408ff9640 1 -- 172.21.15.96:0/1295545674 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f40052e0 con 0x7f340c0aa430 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3408ff9640 1 -- 172.21.15.96:0/1295545674 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f4018070 con 0x7f340c0aa430 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3408ff9640 1 -- 172.21.15.96:0/1295545674 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f4003830 con 0x7f340c0aa430 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3411e15640 1 -- 172.21.15.96:0/1295545674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340c0a9950 con 0x7f340c0aa430 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.494+0000 7f3411e15640 1 -- 172.21.15.96:0/1295545674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340c0a9f10 con 0x7f340c0aa430 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.495+0000 7f3411e15640 1 -- 172.21.15.96:0/1295545674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340c08b2c0 con 0x7f340c0aa430 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.496+0000 7f3408ff9640 1 -- 172.21.15.96:0/1295545674 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33f40039d0 con 0x7f340c0aa430 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.496+0000 7f3408ff9640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f33ec06be30 0x7f33ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.496+0000 7f3408ff9640 1 -- 172.21.15.96:0/1295545674 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f33f408af20 con 0x7f340c0aa430 2024-06-02T23:46:42.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.496+0000 7f340b7fe640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f33ec06be30 0x7f33ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.497+0000 7f340b7fe640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f33ec06be30 0x7f33ec06e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f340c0c2f60 tx=0x7f33fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:42.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.501+0000 7f3408ff9640 1 -- 172.21.15.96:0/1295545674 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f33f4059590 con 0x7f340c0aa430 2024-06-02T23:46:42.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.675+0000 7f3411e15640 1 -- 172.21.15.96:0/1295545674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f340c0683e0 con 0x7f340c0aa430 2024-06-02T23:46:42.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.676+0000 7f3408ff9640 1 -- 172.21.15.96:0/1295545674 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f33f4058e90 con 0x7f340c0aa430 2024-06-02T23:46:42.677 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:42.677 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":24,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:30.096314+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:42.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 -- 172.21.15.96:0/1295545674 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f33ec06be30 msgr2=0x7f33ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f33ec06be30 0x7f33ec06e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f340c0c2f60 tx=0x7f33fc008040 comp rx=0 tx=0).stop 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 -- 172.21.15.96:0/1295545674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f340c0aa430 msgr2=0x7f340c08a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f340c0aa430 0x7f340c08a970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33f400f5c0 tx=0x7f33f400fa80 comp rx=0 tx=0).stop 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 -- 172.21.15.96:0/1295545674 shutdown_connections 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f340c08aeb0 0x7f340c200f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f33ec06be30 0x7f33ec06e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f340c0aa430 0x7f340c08a970 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 --2- 172.21.15.96:0/1295545674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33f800b4c0 0x7f340c0aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 -- 172.21.15.96:0/1295545674 >> 172.21.15.96:0/1295545674 conn(0x7f340c0cfc30 msgr2=0x7f340c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 -- 172.21.15.96:0/1295545674 shutdown_connections 2024-06-02T23:46:42.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.678+0000 7f3411e15640 1 -- 172.21.15.96:0/1295545674 wait complete. 2024-06-02T23:46:42.690 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T23:46:42.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.792+0000 7f4ce0e2c640 1 Processor -- start 2024-06-02T23:46:42.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.793+0000 7f4ce0e2c640 1 -- start start 2024-06-02T23:46:42.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.793+0000 7f4ce0e2c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4cdc0b0ec0 0x7f4cdc0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.793+0000 7f4ce0e2c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cdc0d2a00 con 0x7f4cdc0afef0 2024-06-02T23:46:42.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.793+0000 7f4ce0e2c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cdc0d2ce0 con 0x7f4cdc0ce890 2024-06-02T23:46:42.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.793+0000 7f4ce0e2c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4cdc0aea50 con 0x7f4cdc0b0ec0 2024-06-02T23:46:42.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.794+0000 7f4cdad9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4cdc0b0ec0 0x7f4cdc0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.794+0000 7f4cd9d9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4cdc0afef0 0x7f4cdc0ccb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46692/0 (socket says 172.21.15.96:46692) 2024-06-02T23:46:42.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.794+0000 7f4cd9d9b640 1 -- 172.21.15.96:0/1220048020 learned_addr learned my addr 172.21.15.96:0/1220048020 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:42.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.794+0000 7f4cdad9d640 1 -- 172.21.15.96:0/1220048020 >> v1:172.21.15.162:6789/0 conn(0x7f4cdc0ce890 legacy=0x7f4cdc15bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:42.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.794+0000 7f4cdad9d640 1 -- 172.21.15.96:0/1220048020 >> v1:172.21.15.96:6789/0 conn(0x7f4cdc0afef0 legacy=0x7f4cdc0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.794+0000 7f4cdad9d640 1 -- 172.21.15.96:0/1220048020 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc0cfcc0 con 0x7f4cdc0b0ec0 2024-06-02T23:46:42.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4cdad9d640 1 --2- 172.21.15.96:0/1220048020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0b0ec0 0x7f4cdc0cd210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009d90 tx=0x7f4cd402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcb20048e1c3dd9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:42.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4cd959a640 1 -- 172.21.15.96:0/1220048020 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4037070 con 0x7f4cdc0b0ec0 2024-06-02T23:46:42.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4cd959a640 1 -- 172.21.15.96:0/1220048020 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd4032640 con 0x7f4cdc0b0ec0 2024-06-02T23:46:42.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4cd959a640 1 -- 172.21.15.96:0/1220048020 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4032a10 con 0x7f4cdc0b0ec0 2024-06-02T23:46:42.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1220048020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0b0ec0 msgr2=0x7f4cdc0cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4ce0e2c640 1 --2- 172.21.15.96:0/1220048020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0b0ec0 0x7f4cdc0cd210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009d90 tx=0x7f4cd402a480 comp rx=0 tx=0).stop 2024-06-02T23:46:42.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1220048020 shutdown_connections 2024-06-02T23:46:42.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4ce0e2c640 1 --2- 172.21.15.96:0/1220048020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0b0ec0 0x7f4cdc0cd210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1220048020 >> 172.21.15.96:0/1220048020 conn(0x7f4cdc0d1e40 msgr2=0x7f4cdc0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:42.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1220048020 shutdown_connections 2024-06-02T23:46:42.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.795+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1220048020 wait complete. 2024-06-02T23:46:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.797+0000 7f4ce0e2c640 1 Processor -- start 2024-06-02T23:46:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.797+0000 7f4ce0e2c640 1 -- start start 2024-06-02T23:46:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.797+0000 7f4ce0e2c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cdc0afef0 0x7f4cdc1f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.797+0000 7f4ce0e2c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cdc0b0ec0 0x7f4cdc1f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.797+0000 7f4ce0e2c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0ce890 0x7f4cdc14d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.797+0000 7f4ce0e2c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc0d0fd0 con 0x7f4cdc0ce890 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.797+0000 7f4ce0e2c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc0d0e50 con 0x7f4cdc0b0ec0 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.797+0000 7f4ce0e2c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc0cec70 con 0x7f4cdc0afef0 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.797+0000 7f4cdad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0ce890 0x7f4cdc14d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cdad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0ce890 0x7f4cdc14d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54566/0 (socket says 172.21.15.96:54566) 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cdad9d640 1 -- 172.21.15.96:0/1528751545 learned_addr learned my addr 172.21.15.96:0/1528751545 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cda59c640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cdc0afef0 0x7f4cdc1f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cd9d9b640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cdc0b0ec0 0x7f4cdc1f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cdad9d640 1 -- 172.21.15.96:0/1528751545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cdc0afef0 msgr2=0x7f4cdc1f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cdad9d640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cdc0afef0 0x7f4cdc1f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cdad9d640 1 -- 172.21.15.96:0/1528751545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cdc0b0ec0 msgr2=0x7f4cdc1f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:42.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cdad9d640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cdc0b0ec0 0x7f4cdc1f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:42.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cdad9d640 1 -- 172.21.15.96:0/1528751545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc1f2c90 con 0x7f4cdc0ce890 2024-06-02T23:46:42.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cd9d9b640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cdc0b0ec0 0x7f4cdc1f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:42.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4cdad9d640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0ce890 0x7f4cdc14d160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009d90 tx=0x7f4cd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:42.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4ccaffd640 1 -- 172.21.15.96:0/1528751545 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4042020 con 0x7f4cdc0ce890 2024-06-02T23:46:42.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4ccaffd640 1 -- 172.21.15.96:0/1528751545 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd4030910 con 0x7f4cdc0ce890 2024-06-02T23:46:42.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4ccaffd640 1 -- 172.21.15.96:0/1528751545 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4037040 con 0x7f4cdc0ce890 2024-06-02T23:46:42.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1528751545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cdc1f2f70 con 0x7f4cdc0ce890 2024-06-02T23:46:42.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.798+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1528751545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cdc1f5d40 con 0x7f4cdc0ce890 2024-06-02T23:46:42.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.799+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1528751545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cdc068af0 con 0x7f4cdc0ce890 2024-06-02T23:46:42.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.800+0000 7f4ccaffd640 1 -- 172.21.15.96:0/1528751545 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cd4045020 con 0x7f4cdc0ce890 2024-06-02T23:46:42.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.800+0000 7f4ccaffd640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4cbc06be30 0x7f4cbc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:42.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.800+0000 7f4ccaffd640 1 -- 172.21.15.96:0/1528751545 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4cd40ac1d0 con 0x7f4cdc0ce890 2024-06-02T23:46:42.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.800+0000 7f4cda59c640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4cbc06be30 0x7f4cbc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:42.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.801+0000 7f4cda59c640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4cbc06be30 0x7f4cbc06e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc006fd0 tx=0x7f4ccc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:42.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:42.805+0000 7f4ccaffd640 1 -- 172.21.15.96:0/1528751545 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4cd404c030 con 0x7f4cdc0ce890 2024-06-02T23:46:43.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.012+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1528751545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4cdc0cf720 con 0x7f4cdc0ce890 2024-06-02T23:46:43.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.790+0000 7f4ccaffd640 1 -- 172.21.15.96:0/1528751545 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f4cd407a840 con 0x7f4cdc0ce890 2024-06-02T23:46:43.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1528751545 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4cbc06be30 msgr2=0x7f4cbc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:43.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4cbc06be30 0x7f4cbc06e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc006fd0 tx=0x7f4ccc008040 comp rx=0 tx=0).stop 2024-06-02T23:46:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1528751545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0ce890 msgr2=0x7f4cdc14d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0ce890 0x7f4cdc14d160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009d90 tx=0x7f4cd4004a40 comp rx=0 tx=0).stop 2024-06-02T23:46:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1528751545 shutdown_connections 2024-06-02T23:46:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4cbc06be30 0x7f4cbc06e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cdc0ce890 0x7f4cdc14d160 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cdc0b0ec0 0x7f4cdc1f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 --2- 172.21.15.96:0/1528751545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cdc0afef0 0x7f4cdc1f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1528751545 >> 172.21.15.96:0/1528751545 conn(0x7f4cdc0d1e40 msgr2=0x7f4cdc0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1528751545 shutdown_connections 2024-06-02T23:46:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.793+0000 7f4ce0e2c640 1 -- 172.21.15.96:0/1528751545 wait complete. 2024-06-02T23:46:43.807 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-06-02T23:46:43.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-02T23:46:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.914+0000 7f8f1f3f9640 1 Processor -- start 2024-06-02T23:46:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.914+0000 7f8f1f3f9640 1 -- start start 2024-06-02T23:46:43.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f1f3f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 0x7f8f1815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:43.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f1f3f9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f180738a0 con 0x7f8f180d0690 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f1f3f9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f180af980 con 0x7f8f180af430 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f1f3f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f18073670 con 0x7f8f180b0890 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f1d195640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f8f180d0690 0x7f8f180cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39852/0 (socket says 172.21.15.96:39852) 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f1d195640 1 -- 172.21.15.96:0/3433699506 learned_addr learned my addr 172.21.15.96:0/3433699506 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f1d996640 1 --2- 172.21.15.96:0/3433699506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 0x7f8f1815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f0ffff640 1 -- 172.21.15.96:0/3433699506 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 717328286 0 0) 0x7f8f180738a0 con 0x7f8f180d0690 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f0ffff640 1 -- 172.21.15.96:0/3433699506 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f04003520 con 0x7f8f180d0690 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f0ffff640 1 -- 172.21.15.96:0/3433699506 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788350960 0 0) 0x7f8f180af980 con 0x7f8f180af430 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f0ffff640 1 -- 172.21.15.96:0/3433699506 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f180738a0 con 0x7f8f180af430 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f0ffff640 1 -- 172.21.15.96:0/3433699506 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 14207329 0 0) 0x7f8f04003520 con 0x7f8f180d0690 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f1d996640 1 -- 172.21.15.96:0/3433699506 >> v1:172.21.15.162:6789/0 conn(0x7f8f180af430 legacy=0x7f8f180b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f1d996640 1 -- 172.21.15.96:0/3433699506 >> v1:172.21.15.96:6789/0 conn(0x7f8f180d0690 legacy=0x7f8f180cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.915+0000 7f8f1d996640 1 -- 172.21.15.96:0/3433699506 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f180afc60 con 0x7f8f180b0890 2024-06-02T23:46:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.916+0000 7f8f1d996640 1 --2- 172.21.15.96:0/3433699506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 0x7f8f1815bcd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009dc0 tx=0x7f8f1002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c327c260c1f8ea10 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.916+0000 7f8f0ffff640 1 -- 172.21.15.96:0/3433699506 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14001670 con 0x7f8f180b0890 2024-06-02T23:46:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.916+0000 7f8f0ffff640 1 -- 172.21.15.96:0/3433699506 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f10007540 con 0x7f8f180b0890 2024-06-02T23:46:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.916+0000 7f8f0ffff640 1 -- 172.21.15.96:0/3433699506 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10007910 con 0x7f8f180b0890 2024-06-02T23:46:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.917+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/3433699506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 msgr2=0x7f8f1815bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.917+0000 7f8f1f3f9640 1 --2- 172.21.15.96:0/3433699506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 0x7f8f1815bcd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009dc0 tx=0x7f8f1002a660 comp rx=0 tx=0).stop 2024-06-02T23:46:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.917+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/3433699506 shutdown_connections 2024-06-02T23:46:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.917+0000 7f8f1f3f9640 1 --2- 172.21.15.96:0/3433699506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 0x7f8f1815bcd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.917+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/3433699506 >> 172.21.15.96:0/3433699506 conn(0x7f8f18072b50 msgr2=0x7f8f18072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.917+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/3433699506 shutdown_connections 2024-06-02T23:46:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.917+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/3433699506 wait complete. 2024-06-02T23:46:43.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.918+0000 7f8f1f3f9640 1 Processor -- start 2024-06-02T23:46:43.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.918+0000 7f8f1f3f9640 1 -- start start 2024-06-02T23:46:43.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1f3f9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f180af430 0x7f8f1815c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:43.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1f3f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 0x7f8f1815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1f3f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f180d0690 0x7f8f1806e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1f3f9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8f180d12d0 con 0x7f8f180af430 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1f3f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f180cd010 con 0x7f8f180d0690 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1f3f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f180cdc40 con 0x7f8f180b0890 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d195640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f180af430 0x7f8f1815c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d195640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f180af430 0x7f8f1815c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54570/0 (socket says 172.21.15.96:54570) 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d195640 1 -- 172.21.15.96:0/1041084100 learned_addr learned my addr 172.21.15.96:0/1041084100 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1c994640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 0x7f8f1815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d996640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f180d0690 0x7f8f1806e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d195640 1 -- 172.21.15.96:0/1041084100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 msgr2=0x7f8f1815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d195640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 0x7f8f1815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d195640 1 -- 172.21.15.96:0/1041084100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f180d0690 msgr2=0x7f8f1806e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d195640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f180d0690 0x7f8f1806e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:43.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d195640 1 -- 172.21.15.96:0/1041084100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1809d1f0 con 0x7f8f180af430 2024-06-02T23:46:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1c994640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 0x7f8f1815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d996640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f180d0690 0x7f8f1806e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.919+0000 7f8f1d195640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f180af430 0x7f8f1815c950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400c5a0 tx=0x7f8f1400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.920+0000 7f8f0dffb640 1 -- 172.21.15.96:0/1041084100 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14017070 con 0x7f8f180af430 2024-06-02T23:46:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.920+0000 7f8f0dffb640 1 -- 172.21.15.96:0/1041084100 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f14005d00 con 0x7f8f180af430 2024-06-02T23:46:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.920+0000 7f8f0dffb640 1 -- 172.21.15.96:0/1041084100 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f140072b0 con 0x7f8f180af430 2024-06-02T23:46:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.920+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/1041084100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1809d740 con 0x7f8f180af430 2024-06-02T23:46:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.920+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/1041084100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1809dd00 con 0x7f8f180af430 2024-06-02T23:46:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.921+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/1041084100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f180683e0 con 0x7f8f180af430 2024-06-02T23:46:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.921+0000 7f8f0dffb640 1 -- 172.21.15.96:0/1041084100 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f1401a070 con 0x7f8f180af430 2024-06-02T23:46:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.922+0000 7f8f0dffb640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8efc06be30 0x7f8efc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.922+0000 7f8f0dffb640 1 -- 172.21.15.96:0/1041084100 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8f1408a620 con 0x7f8f180af430 2024-06-02T23:46:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.922+0000 7f8f1c994640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8efc06be30 0x7f8efc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:43.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.922+0000 7f8f1c994640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8efc06be30 0x7f8efc06e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f080011e0 tx=0x7f8f08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:43.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:43.926+0000 7f8f0dffb640 1 -- 172.21.15.96:0/1041084100 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8f14058c90 con 0x7f8f180af430 2024-06-02T23:46:44.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.136+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/1041084100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8f18067270 con 0x7f8f180af430 2024-06-02T23:46:44.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.797+0000 7f8f0dffb640 1 -- 172.21.15.96:0/1041084100 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f8f14058590 con 0x7f8f180af430 2024-06-02T23:46:44.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.800+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/1041084100 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8efc06be30 msgr2=0x7f8efc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.800+0000 7f8f1f3f9640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8efc06be30 0x7f8efc06e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f080011e0 tx=0x7f8f08009040 comp rx=0 tx=0).stop 2024-06-02T23:46:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.800+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/1041084100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f180af430 msgr2=0x7f8f1815c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.800+0000 7f8f1f3f9640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f180af430 0x7f8f1815c950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400c5a0 tx=0x7f8f1400ca60 comp rx=0 tx=0).stop 2024-06-02T23:46:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.800+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/1041084100 shutdown_connections 2024-06-02T23:46:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.800+0000 7f8f1f3f9640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f180d0690 0x7f8f1806e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.800+0000 7f8f1f3f9640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f180b0890 0x7f8f1815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.801+0000 7f8f1f3f9640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8efc06be30 0x7f8efc06e2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.801+0000 7f8f1f3f9640 1 --2- 172.21.15.96:0/1041084100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8f180af430 0x7f8f1815c950 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:44.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.801+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/1041084100 >> 172.21.15.96:0/1041084100 conn(0x7f8f18072b50 msgr2=0x7f8f180ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:44.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.801+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/1041084100 shutdown_connections 2024-06-02T23:46:44.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.801+0000 7f8f1f3f9640 1 -- 172.21.15.96:0/1041084100 wait complete. 2024-06-02T23:46:44.814 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-02T23:46:44.814 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:46:44.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.923+0000 7fa0ec072640 1 Processor -- start 2024-06-02T23:46:44.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.923+0000 7fa0ec072640 1 -- start start 2024-06-02T23:46:44.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0ec072640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e40cad30 0x7fa0e4165e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:44.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0ec072640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e4155950 con 0x7fa0e406ed20 2024-06-02T23:46:44.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0ec072640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e40cb2e0 con 0x7fa0e4155570 2024-06-02T23:46:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0ec072640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e40cb5c0 con 0x7fa0e40cad30 2024-06-02T23:46:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e960d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa0e406ed20 0x7fa0e40ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39858/0 (socket says 172.21.15.96:39858) 2024-06-02T23:46:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e960d640 1 -- 172.21.15.96:0/1018461497 learned_addr learned my addr 172.21.15.96:0/1018461497 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1693130821 0 0) 0x7fa0e4155950 con 0x7fa0e406ed20 2024-06-02T23:46:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0ea60f640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e40cad30 0x7fa0e4165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0d0003520 con 0x7fa0e406ed20 2024-06-02T23:46:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1435042952 0 0) 0x7fa0d0003520 con 0x7fa0e406ed20 2024-06-02T23:46:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e40cad30 msgr2=0x7fa0e4165e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:44.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e40cad30 0x7fa0e4165e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:44.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 >> v1:172.21.15.162:6789/0 conn(0x7fa0e4155570 legacy=0x7fa0e406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:44.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e40cb8a0 con 0x7fa0e406ed20 2024-06-02T23:46:44.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fa0d4001670 con 0x7fa0e406ed20 2024-06-02T23:46:44.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 >> v1:172.21.15.96:6789/0 conn(0x7fa0e406ed20 legacy=0x7fa0e40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:44.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0d00039e0 0x7fa0d0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:44.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e40cad30 0x7fa0d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:44.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.924+0000 7fa0e8e0c640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 0x7fa0d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:44.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e40cb5c0 con 0x7fa0d0004d40 2024-06-02T23:46:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d000ba70 con 0x7fa0d00039e0 2024-06-02T23:46:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d000de80 con 0x7fa0e40cad30 2024-06-02T23:46:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0ea60f640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 0x7fa0d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0e9e0e640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0d00039e0 0x7fa0d0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0e960d640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e40cad30 0x7fa0d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0ea60f640 1 -- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e40cad30 msgr2=0x7fa0d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0ea60f640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e40cad30 0x7fa0d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0ea60f640 1 -- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0d00039e0 msgr2=0x7fa0d0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0ea60f640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0d00039e0 0x7fa0d0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.925+0000 7fa0ea60f640 1 -- 172.21.15.96:0/1018461497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d0003520 con 0x7fa0d0004d40 2024-06-02T23:46:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0ea60f640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 0x7fa0d00051c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009f90 tx=0x7fa0d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930ced5c1f3512f9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc009c10 con 0x7fa0d0004d40 2024-06-02T23:46:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0dc036070 con 0x7fa0d0004d40 2024-06-02T23:46:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0e8e0c640 1 -- 172.21.15.96:0/1018461497 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc031850 con 0x7fa0d0004d40 2024-06-02T23:46:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0ec072640 1 -- 172.21.15.96:0/1018461497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 msgr2=0x7fa0d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0ec072640 1 --2- 172.21.15.96:0/1018461497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 0x7fa0d00051c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009f90 tx=0x7fa0d0005830 comp rx=0 tx=0).stop 2024-06-02T23:46:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0ea60f640 1 -- 172.21.15.96:0/1018461497 reap_dead start 2024-06-02T23:46:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0ec072640 1 -- 172.21.15.96:0/1018461497 shutdown_connections 2024-06-02T23:46:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0ec072640 1 -- 172.21.15.96:0/1018461497 >> 172.21.15.96:0/1018461497 conn(0x7fa0e40cfc30 msgr2=0x7fa0e40d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0ec072640 1 -- 172.21.15.96:0/1018461497 shutdown_connections 2024-06-02T23:46:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.926+0000 7fa0ec072640 1 -- 172.21.15.96:0/1018461497 wait complete. 2024-06-02T23:46:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.927+0000 7fa0ec072640 1 Processor -- start 2024-06-02T23:46:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.928+0000 7fa0ec072640 1 -- start start 2024-06-02T23:46:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.928+0000 7fa0ec072640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 0x7fa0e40c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:44.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.928+0000 7fa0ec072640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e41f3dc0 0x7fa0e40c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.928+0000 7fa0ec072640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e41e5710 0x7fa0e41e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.928+0000 7fa0ec072640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4073030 con 0x7fa0d0004d40 2024-06-02T23:46:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.928+0000 7fa0ec072640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e40717d0 con 0x7fa0e41f3dc0 2024-06-02T23:46:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.928+0000 7fa0ec072640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e40731b0 con 0x7fa0e41e5710 2024-06-02T23:46:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.928+0000 7fa0e9e0e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 0x7fa0e40c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.928+0000 7fa0e9e0e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 0x7fa0e40c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54588/0 (socket says 172.21.15.96:54588) 2024-06-02T23:46:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.928+0000 7fa0e9e0e640 1 -- 172.21.15.96:0/584678886 learned_addr learned my addr 172.21.15.96:0/584678886 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0ea60f640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e41e5710 0x7fa0e41e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0e9e0e640 1 -- 172.21.15.96:0/584678886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e41e5710 msgr2=0x7fa0e41e5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0e9e0e640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e41e5710 0x7fa0e41e5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0e960d640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e41f3dc0 0x7fa0e40c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0e9e0e640 1 -- 172.21.15.96:0/584678886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e41f3dc0 msgr2=0x7fa0e40c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0e9e0e640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e41f3dc0 0x7fa0e40c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0e9e0e640 1 -- 172.21.15.96:0/584678886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e40c62e0 con 0x7fa0d0004d40 2024-06-02T23:46:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0e9e0e640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 0x7fa0e40c4150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000f880 tx=0x7fa0e000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0da7fc640 1 -- 172.21.15.96:0/584678886 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0001d20 con 0x7fa0d0004d40 2024-06-02T23:46:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0da7fc640 1 -- 172.21.15.96:0/584678886 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e0018070 con 0x7fa0d0004d40 2024-06-02T23:46:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0da7fc640 1 -- 172.21.15.96:0/584678886 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000d730 con 0x7fa0d0004d40 2024-06-02T23:46:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0ec072640 1 -- 172.21.15.96:0/584678886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e40c65c0 con 0x7fa0d0004d40 2024-06-02T23:46:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.929+0000 7fa0ec072640 1 -- 172.21.15.96:0/584678886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e41f4240 con 0x7fa0d0004d40 2024-06-02T23:46:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.930+0000 7fa0ec072640 1 -- 172.21.15.96:0/584678886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e415b040 con 0x7fa0d0004d40 2024-06-02T23:46:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.930+0000 7fa0da7fc640 1 -- 172.21.15.96:0/584678886 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0e000d8d0 con 0x7fa0d0004d40 2024-06-02T23:46:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.931+0000 7fa0da7fc640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa0c806be30 0x7fa0c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:44.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.931+0000 7fa0da7fc640 1 -- 172.21.15.96:0/584678886 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa0e008af50 con 0x7fa0d0004d40 2024-06-02T23:46:44.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.931+0000 7fa0e960d640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa0c806be30 0x7fa0c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:44.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.931+0000 7fa0e960d640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa0c806be30 0x7fa0c806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4001050 tx=0x7fa0d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:44.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:44.935+0000 7fa0da7fc640 1 -- 172.21.15.96:0/584678886 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa0e415b040 con 0x7fa0d0004d40 2024-06-02T23:46:45.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.148+0000 7fa0ec072640 1 -- 172.21.15.96:0/584678886 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0e40683e0 con 0x7fa0d0004d40 2024-06-02T23:46:45.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.148+0000 7fa0da7fc640 1 -- 172.21.15.96:0/584678886 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7fa0e0059650 con 0x7fa0d0004d40 2024-06-02T23:46:45.152 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:45.152 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:46:25.060503+0000","modified":"2024-06-02T23:46:44.137908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 8 2024-06-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.151+0000 7fa0ec072640 1 -- 172.21.15.96:0/584678886 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa0c806be30 msgr2=0x7fa0c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.151+0000 7fa0ec072640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa0c806be30 0x7fa0c806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4001050 tx=0x7fa0d4009040 comp rx=0 tx=0).stop 2024-06-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.151+0000 7fa0ec072640 1 -- 172.21.15.96:0/584678886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 msgr2=0x7fa0e40c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.151+0000 7fa0ec072640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 0x7fa0e40c4150 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa0e000f880 tx=0x7fa0e000fd40 comp rx=0 tx=0).stop 2024-06-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.152+0000 7fa0ec072640 1 -- 172.21.15.96:0/584678886 shutdown_connections 2024-06-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.152+0000 7fa0ec072640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0e41e5710 0x7fa0e41e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.152+0000 7fa0ec072640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0e41f3dc0 0x7fa0e40c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.152+0000 7fa0ec072640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa0c806be30 0x7fa0c806e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.152+0000 7fa0ec072640 1 --2- 172.21.15.96:0/584678886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0d0004d40 0x7fa0e40c4150 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.152+0000 7fa0ec072640 1 -- 172.21.15.96:0/584678886 >> 172.21.15.96:0/584678886 conn(0x7fa0e40cfc30 msgr2=0x7fa0e406d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.152+0000 7fa0ec072640 1 -- 172.21.15.96:0/584678886 shutdown_connections 2024-06-02T23:46:45.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.152+0000 7fa0ec072640 1 -- 172.21.15.96:0/584678886 wait complete. 2024-06-02T23:46:45.167 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:45.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.269+0000 7faf88d12640 1 Processor -- start 2024-06-02T23:46:45.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.269+0000 7faf88d12640 1 -- start start 2024-06-02T23:46:45.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.270+0000 7faf88d12640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faf8406ea70 0x7faf84071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.270+0000 7faf88d12640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf840cae00 0x7faf840cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.270+0000 7faf88d12640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8406f210 con 0x7faf8415f5e0 2024-06-02T23:46:45.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.270+0000 7faf88d12640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7faf8406ef30 con 0x7faf840cae00 2024-06-02T23:46:45.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.270+0000 7faf88d12640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7faf840ca320 con 0x7faf8406ea70 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.271+0000 7faf82d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf840cae00 0x7faf840cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.271+0000 7faf82d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf840cae00 0x7faf840cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54596/0 (socket says 172.21.15.96:54596) 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.271+0000 7faf82d9d640 1 -- 172.21.15.96:0/1404441393 learned_addr learned my addr 172.21.15.96:0/1404441393 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.271+0000 7faf81d9b640 1 --2- 172.21.15.96:0/1404441393 >> v2:172.21.15.162:3300/0 conn(0x7faf8406ea70 0x7faf84071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.271+0000 7faf82d9d640 1 -- 172.21.15.96:0/1404441393 >> v2:172.21.15.162:3300/0 conn(0x7faf8406ea70 msgr2=0x7faf84071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.271+0000 7faf82d9d640 1 --2- 172.21.15.96:0/1404441393 >> v2:172.21.15.162:3300/0 conn(0x7faf8406ea70 0x7faf84071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.271+0000 7faf82d9d640 1 -- 172.21.15.96:0/1404441393 >> v1:172.21.15.162:6789/0 conn(0x7faf8415f5e0 legacy=0x7faf84071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.271+0000 7faf82d9d640 1 -- 172.21.15.96:0/1404441393 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf840ca600 con 0x7faf840cae00 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.271+0000 7faf81d9b640 1 --2- 172.21.15.96:0/1404441393 >> v2:172.21.15.162:3300/0 conn(0x7faf8406ea70 0x7faf84071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf82d9d640 1 --2- 172.21.15.96:0/1404441393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840cae00 0x7faf840cb210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faf840cc5f0 tx=0x7faf7c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d2d7fe617a0e63 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:45.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf8159a640 1 -- 172.21.15.96:0/1404441393 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c036070 con 0x7faf840cae00 2024-06-02T23:46:45.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf8159a640 1 -- 172.21.15.96:0/1404441393 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c031600 con 0x7faf840cae00 2024-06-02T23:46:45.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf8159a640 1 -- 172.21.15.96:0/1404441393 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0319d0 con 0x7faf840cae00 2024-06-02T23:46:45.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf88d12640 1 -- 172.21.15.96:0/1404441393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840cae00 msgr2=0x7faf840cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf88d12640 1 --2- 172.21.15.96:0/1404441393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840cae00 0x7faf840cb210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faf840cc5f0 tx=0x7faf7c02a730 comp rx=0 tx=0).stop 2024-06-02T23:46:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf88d12640 1 -- 172.21.15.96:0/1404441393 shutdown_connections 2024-06-02T23:46:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf88d12640 1 --2- 172.21.15.96:0/1404441393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840cae00 0x7faf840cb210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf88d12640 1 --2- 172.21.15.96:0/1404441393 >> v2:172.21.15.162:3300/0 conn(0x7faf8406ea70 0x7faf84071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf88d12640 1 -- 172.21.15.96:0/1404441393 >> 172.21.15.96:0/1404441393 conn(0x7faf840cfc30 msgr2=0x7faf840d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf88d12640 1 -- 172.21.15.96:0/1404441393 shutdown_connections 2024-06-02T23:46:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.272+0000 7faf88d12640 1 -- 172.21.15.96:0/1404441393 wait complete. 2024-06-02T23:46:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.274+0000 7faf88d12640 1 Processor -- start 2024-06-02T23:46:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.274+0000 7faf88d12640 1 -- start start 2024-06-02T23:46:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.274+0000 7faf88d12640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406ea70 0x7faf840cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf88d12640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cae00 0x7faf840c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf88d12640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf8415f5e0 0x7faf840ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf88d12640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7faf840731b0 con 0x7faf8415f5e0 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf88d12640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf84073030 con 0x7faf840cae00 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf88d12640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faf840b2ac0 con 0x7faf8406ea70 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf82d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf8415f5e0 0x7faf840ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf82d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf8415f5e0 0x7faf840ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54598/0 (socket says 172.21.15.96:54598) 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf82d9d640 1 -- 172.21.15.96:0/419766589 learned_addr learned my addr 172.21.15.96:0/419766589 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf8259c640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406ea70 0x7faf840cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf81d9b640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cae00 0x7faf840c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf82d9d640 1 -- 172.21.15.96:0/419766589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406ea70 msgr2=0x7faf840cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf82d9d640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406ea70 0x7faf840cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf82d9d640 1 -- 172.21.15.96:0/419766589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cae00 msgr2=0x7faf840c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf82d9d640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cae00 0x7faf840c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf82d9d640 1 -- 172.21.15.96:0/419766589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf840cdd40 con 0x7faf8415f5e0 2024-06-02T23:46:45.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf81d9b640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cae00 0x7faf840c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:45.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf82d9d640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf8415f5e0 0x7faf840ae660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009f40 tx=0x7faf7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:45.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf7affd640 1 -- 172.21.15.96:0/419766589 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c036050 con 0x7faf8415f5e0 2024-06-02T23:46:45.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf88d12640 1 -- 172.21.15.96:0/419766589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf840c8fe0 con 0x7faf8415f5e0 2024-06-02T23:46:45.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf7affd640 1 -- 172.21.15.96:0/419766589 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c042070 con 0x7faf8415f5e0 2024-06-02T23:46:45.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf7affd640 1 -- 172.21.15.96:0/419766589 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c009510 con 0x7faf8415f5e0 2024-06-02T23:46:45.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.275+0000 7faf88d12640 1 -- 172.21.15.96:0/419766589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8415e250 con 0x7faf8415f5e0 2024-06-02T23:46:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.276+0000 7faf88d12640 1 -- 172.21.15.96:0/419766589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf840683e0 con 0x7faf8415f5e0 2024-06-02T23:46:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.277+0000 7faf7affd640 1 -- 172.21.15.96:0/419766589 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faf7c007bf0 con 0x7faf8415f5e0 2024-06-02T23:46:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.277+0000 7faf7affd640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf6406be30 0x7faf6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.278+0000 7faf7affd640 1 -- 172.21.15.96:0/419766589 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faf7c0abfb0 con 0x7faf8415f5e0 2024-06-02T23:46:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.278+0000 7faf8259c640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf6406be30 0x7faf6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.278+0000 7faf8259c640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf6406be30 0x7faf6406e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faf74007fd0 tx=0x7faf74009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.282+0000 7faf7affd640 1 -- 172.21.15.96:0/419766589 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faf7c07a630 con 0x7faf8415f5e0 2024-06-02T23:46:45.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.463+0000 7faf88d12640 1 -- 172.21.15.96:0/419766589 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf840cbf70 con 0x7faf8415f5e0 2024-06-02T23:46:45.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.464+0000 7faf7affd640 1 -- 172.21.15.96:0/419766589 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7faf7c079f30 con 0x7faf8415f5e0 2024-06-02T23:46:45.465 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:45.465 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":24,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:30.096314+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 -- 172.21.15.96:0/419766589 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf6406be30 msgr2=0x7faf6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf6406be30 0x7faf6406e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faf74007fd0 tx=0x7faf74009040 comp rx=0 tx=0).stop 2024-06-02T23:46:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 -- 172.21.15.96:0/419766589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf8415f5e0 msgr2=0x7faf840ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf8415f5e0 0x7faf840ae660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009f40 tx=0x7faf7c004a40 comp rx=0 tx=0).stop 2024-06-02T23:46:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 -- 172.21.15.96:0/419766589 shutdown_connections 2024-06-02T23:46:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf6406be30 0x7faf6406e2f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf8415f5e0 0x7faf840ae660 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf840cae00 0x7faf840c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 --2- 172.21.15.96:0/419766589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf8406ea70 0x7faf840cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 -- 172.21.15.96:0/419766589 >> 172.21.15.96:0/419766589 conn(0x7faf840cfc30 msgr2=0x7faf8406cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:45.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 -- 172.21.15.96:0/419766589 shutdown_connections 2024-06-02T23:46:45.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.467+0000 7faf88d12640 1 -- 172.21.15.96:0/419766589 wait complete. 2024-06-02T23:46:45.479 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T23:46:45.480 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:46:45.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.581+0000 7fe3583e7640 1 Processor -- start 2024-06-02T23:46:45.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.582+0000 7fe3583e7640 1 -- start start 2024-06-02T23:46:45.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.582+0000 7fe3583e7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe350161900 0x7fe3500d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.582+0000 7fe3583e7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3500b4fa0 0x7fe3500d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.582+0000 7fe3583e7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3500d4a90 con 0x7fe3500b5510 2024-06-02T23:46:45.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe3583e7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe3500cf5c0 con 0x7fe350161900 2024-06-02T23:46:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe3583e7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe3500caf70 con 0x7fe3500b4fa0 2024-06-02T23:46:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe356183640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe350161900 0x7fe3500d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe355982640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe3500b5510 0x7fe3500d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:42170/0 (socket says 172.21.15.96:42170) 2024-06-02T23:46:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe355982640 1 -- 172.21.15.96:0/2432482154 learned_addr learned my addr 172.21.15.96:0/2432482154 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe356984640 1 --2- 172.21.15.96:0/2432482154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3500b4fa0 0x7fe3500d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe356183640 1 -- 172.21.15.96:0/2432482154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3500b4fa0 msgr2=0x7fe3500d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe356183640 1 --2- 172.21.15.96:0/2432482154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3500b4fa0 0x7fe3500d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe356183640 1 -- 172.21.15.96:0/2432482154 >> v1:172.21.15.162:6789/0 conn(0x7fe3500b5510 legacy=0x7fe3500d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe355181640 1 -- 172.21.15.96:0/2432482154 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326091786 0 0) 0x7fe3500d4a90 con 0x7fe3500b5510 2024-06-02T23:46:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.583+0000 7fe356183640 1 -- 172.21.15.96:0/2432482154 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3500d4d70 con 0x7fe350161900 2024-06-02T23:46:45.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.584+0000 7fe356183640 1 --2- 172.21.15.96:0/2432482154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe350161900 0x7fe3500d0a10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0097a0 tx=0x7fe34c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c0f43ffcc37c190 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:45.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.584+0000 7fe355181640 1 -- 172.21.15.96:0/2432482154 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c037070 con 0x7fe350161900 2024-06-02T23:46:45.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.584+0000 7fe355181640 1 -- 172.21.15.96:0/2432482154 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c032440 con 0x7fe350161900 2024-06-02T23:46:45.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.584+0000 7fe355181640 1 -- 172.21.15.96:0/2432482154 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c032810 con 0x7fe350161900 2024-06-02T23:46:45.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.585+0000 7fe3583e7640 1 -- 172.21.15.96:0/2432482154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe350161900 msgr2=0x7fe3500d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.585+0000 7fe3583e7640 1 --2- 172.21.15.96:0/2432482154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe350161900 0x7fe3500d0a10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0097a0 tx=0x7fe34c02a180 comp rx=0 tx=0).stop 2024-06-02T23:46:45.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.585+0000 7fe3583e7640 1 -- 172.21.15.96:0/2432482154 shutdown_connections 2024-06-02T23:46:45.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.585+0000 7fe3583e7640 1 --2- 172.21.15.96:0/2432482154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3500b4fa0 0x7fe3500d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.585+0000 7fe3583e7640 1 --2- 172.21.15.96:0/2432482154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe350161900 0x7fe3500d0a10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.585+0000 7fe3583e7640 1 -- 172.21.15.96:0/2432482154 >> 172.21.15.96:0/2432482154 conn(0x7fe35009d3b0 msgr2=0x7fe3500d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:45.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.585+0000 7fe3583e7640 1 -- 172.21.15.96:0/2432482154 shutdown_connections 2024-06-02T23:46:45.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.585+0000 7fe3583e7640 1 -- 172.21.15.96:0/2432482154 wait complete. 2024-06-02T23:46:45.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.586+0000 7fe3583e7640 1 Processor -- start 2024-06-02T23:46:45.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.586+0000 7fe3583e7640 1 -- start start 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe3583e7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3500b4fa0 0x7fe3500cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe3583e7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3500b5510 0x7fe3501545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe3583e7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe350161900 0x7fe3500b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe3583e7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe3500d4780 con 0x7fe350161900 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe3583e7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3500cfae0 con 0x7fe3500b4fa0 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe3583e7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe350161ce0 con 0x7fe3500b5510 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe356984640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe350161900 0x7fe3500b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe356984640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe350161900 0x7fe3500b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54610/0 (socket says 172.21.15.96:54610) 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe356984640 1 -- 172.21.15.96:0/800493011 learned_addr learned my addr 172.21.15.96:0/800493011 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe356183640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3500b4fa0 0x7fe3500cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe355982640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3500b5510 0x7fe3501545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe356984640 1 -- 172.21.15.96:0/800493011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3500b5510 msgr2=0x7fe3501545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe356984640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3500b5510 0x7fe3501545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe356984640 1 -- 172.21.15.96:0/800493011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3500b4fa0 msgr2=0x7fe3500cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe356984640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3500b4fa0 0x7fe3500cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe356984640 1 -- 172.21.15.96:0/800493011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe350156640 con 0x7fe350161900 2024-06-02T23:46:45.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe356984640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe350161900 0x7fe3500b8610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe34800efc0 tx=0x7fe34800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:45.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe346ffd640 1 -- 172.21.15.96:0/800493011 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348018020 con 0x7fe350161900 2024-06-02T23:46:45.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe346ffd640 1 -- 172.21.15.96:0/800493011 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe348014480 con 0x7fe350161900 2024-06-02T23:46:45.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe3583e7640 1 -- 172.21.15.96:0/800493011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe350156920 con 0x7fe350161900 2024-06-02T23:46:45.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe346ffd640 1 -- 172.21.15.96:0/800493011 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348014870 con 0x7fe350161900 2024-06-02T23:46:45.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.587+0000 7fe3583e7640 1 -- 172.21.15.96:0/800493011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe350156ee0 con 0x7fe350161900 2024-06-02T23:46:45.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.589+0000 7fe3583e7640 1 -- 172.21.15.96:0/800493011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3500683e0 con 0x7fe350161900 2024-06-02T23:46:45.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.589+0000 7fe346ffd640 1 -- 172.21.15.96:0/800493011 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe348005d10 con 0x7fe350161900 2024-06-02T23:46:45.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.589+0000 7fe346ffd640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe33406be30 0x7fe33406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.589+0000 7fe346ffd640 1 -- 172.21.15.96:0/800493011 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe34808bec0 con 0x7fe350161900 2024-06-02T23:46:45.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.589+0000 7fe356183640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe33406be30 0x7fe33406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.590+0000 7fe356183640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe33406be30 0x7fe33406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe34c034000 tx=0x7fe34c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:45.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.594+0000 7fe346ffd640 1 -- 172.21.15.96:0/800493011 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe348022030 con 0x7fe350161900 2024-06-02T23:46:45.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.774+0000 7fe3583e7640 1 -- 172.21.15.96:0/800493011 --> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3500d05e0 con 0x7fe33406be30 2024-06-02T23:46:45.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.782+0000 7fe346ffd640 1 -- 172.21.15.96:0/800493011 <== mgr.4113 v2:172.21.15.96:6832/1776728888 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fe3500d05e0 con 0x7fe33406be30 2024-06-02T23:46:45.786 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:45.787 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:46:45.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.785+0000 7fe3583e7640 1 -- 172.21.15.96:0/800493011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe33406be30 msgr2=0x7fe33406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.785+0000 7fe3583e7640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe33406be30 0x7fe33406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe34c034000 tx=0x7fe34c02e000 comp rx=0 tx=0).stop 2024-06-02T23:46:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.786+0000 7fe3583e7640 1 -- 172.21.15.96:0/800493011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe350161900 msgr2=0x7fe3500b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.786+0000 7fe3583e7640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe350161900 0x7fe3500b8610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe34800efc0 tx=0x7fe34800c490 comp rx=0 tx=0).stop 2024-06-02T23:46:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.786+0000 7fe3583e7640 1 -- 172.21.15.96:0/800493011 shutdown_connections 2024-06-02T23:46:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.786+0000 7fe3583e7640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe33406be30 0x7fe33406e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.786+0000 7fe3583e7640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe350161900 0x7fe3500b8610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.786+0000 7fe3583e7640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3500b5510 0x7fe3501545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.786+0000 7fe3583e7640 1 --2- 172.21.15.96:0/800493011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3500b4fa0 0x7fe3500cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.786+0000 7fe3583e7640 1 -- 172.21.15.96:0/800493011 >> 172.21.15.96:0/800493011 conn(0x7fe35009d3b0 msgr2=0x7fe35015f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.786+0000 7fe3583e7640 1 -- 172.21.15.96:0/800493011 shutdown_connections 2024-06-02T23:46:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.786+0000 7fe3583e7640 1 -- 172.21.15.96:0/800493011 wait complete. 2024-06-02T23:46:45.796 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-06-02T23:46:43.997840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002300"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519975+0000","last_change":"2024-06-02T23:46:24.723386+0000","last_active":"2024-06-02T23:46:32.519975+0000","last_peered":"2024-06-02T23:46:32.519975+0000","last_clean":"2024-06-02T23:46:32.519975+0000","last_became_active":"2024-06-02T23:46:24.723072+0000","last_became_peered":"2024-06-02T23:46:24.723072+0000","last_unstale":"2024-06-02T23:46:32.519975+0000","last_undegraded":"2024-06-02T23:46:32.519975+0000","last_fullsized":"2024-06-02T23:46:32.519975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:58.156345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519324+0000","last_change":"2024-06-02T23:46:25.728192+0000","last_active":"2024-06-02T23:46:32.519324+0000","last_peered":"2024-06-02T23:46:32.519324+0000","last_clean":"2024-06-02T23:46:32.519324+0000","last_became_active":"2024-06-02T23:46:25.727880+0000","last_became_peered":"2024-06-02T23:46:25.727880+0000","last_unstale":"2024-06-02T23:46:32.519324+0000","last_undegraded":"2024-06-02T23:46:32.519324+0000","last_fullsized":"2024-06-02T23:46:32.519324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519956+0000","last_change":"2024-06-02T23:46:30.061087+0000","last_active":"2024-06-02T23:46:32.519956+0000","last_peered":"2024-06-02T23:46:32.519956+0000","last_clean":"2024-06-02T23:46:32.519956+0000","last_became_active":"2024-06-02T23:46:30.060610+0000","last_became_peered":"2024-06-02T23:46:30.060610+0000","last_unstale":"2024-06-02T23:46:32.519956+0000","last_undegraded":"2024-06-02T23:46:32.519956+0000","last_fullsized":"2024-06-02T23:46:32.519956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:12:13.834338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519480+0000","last_change":"2024-06-02T23:46:24.719079+0000","last_active":"2024-06-02T23:46:32.519480+0000","last_peered":"2024-06-02T23:46:32.519480+0000","last_clean":"2024-06-02T23:46:32.519480+0000","last_became_active":"2024-06-02T23:46:24.718645+0000","last_became_peered":"2024-06-02T23:46:24.718645+0000","last_unstale":"2024-06-02T23:46:32.519480+0000","last_undegraded":"2024-06-02T23:46:32.519480+0000","last_fullsized":"2024-06-02T23:46:32.519480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:58.156345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519654+0000","last_change":"2024-06-02T23:46:25.726015+0000","last_active":"2024-06-02T23:46:32.519654+0000","last_peered":"2024-06-02T23:46:32.519654+0000","last_clean":"2024-06-02T23:46:32.519654+0000","last_became_active":"2024-06-02T23:46:25.725730+0000","last_became_peered":"2024-06-02T23:46:25.725730+0000","last_unstale":"2024-06-02T23:46:32.519654+0000","last_undegraded":"2024-06-02T23:46:32.519654+0000","last_fullsized":"2024-06-02T23:46:32.519654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:10.751775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761052+0000","last_change":"2024-06-02T23:46:29.747259+0000","last_active":"2024-06-02T23:46:30.761052+0000","last_peered":"2024-06-02T23:46:30.761052+0000","last_clean":"2024-06-02T23:46:30.761052+0000","last_became_active":"2024-06-02T23:46:29.746814+0000","last_became_peered":"2024-06-02T23:46:29.746814+0000","last_unstale":"2024-06-02T23:46:30.761052+0000","last_undegraded":"2024-06-02T23:46:30.761052+0000","last_fullsized":"2024-06-02T23:46:30.761052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:16.913415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520719+0000","last_change":"2024-06-02T23:46:24.728181+0000","last_active":"2024-06-02T23:46:32.520719+0000","last_peered":"2024-06-02T23:46:32.520719+0000","last_clean":"2024-06-02T23:46:32.520719+0000","last_became_active":"2024-06-02T23:46:24.727842+0000","last_became_peered":"2024-06-02T23:46:24.727842+0000","last_unstale":"2024-06-02T23:46:32.520719+0000","last_undegraded":"2024-06-02T23:46:32.520719+0000","last_fullsized":"2024-06-02T23:46:32.520719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020341+0000","last_change":"2024-06-02T23:46:25.725271+0000","last_active":"2024-06-02T23:46:32.020341+0000","last_peered":"2024-06-02T23:46:32.020341+0000","last_clean":"2024-06-02T23:46:32.020341+0000","last_became_active":"2024-06-02T23:46:25.725021+0000","last_became_peered":"2024-06-02T23:46:25.725021+0000","last_unstale":"2024-06-02T23:46:32.020341+0000","last_undegraded":"2024-06-02T23:46:32.020341+0000","last_fullsized":"2024-06-02T23:46:32.020341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:06.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760977+0000","last_change":"2024-06-02T23:46:29.747360+0000","last_active":"2024-06-02T23:46:30.760977+0000","last_peered":"2024-06-02T23:46:30.760977+0000","last_clean":"2024-06-02T23:46:30.760977+0000","last_became_active":"2024-06-02T23:46:29.746711+0000","last_became_peered":"2024-06-02T23:46:29.746711+0000","last_unstale":"2024-06-02T23:46:30.760977+0000","last_undegraded":"2024-06-02T23:46:30.760977+0000","last_fullsized":"2024-06-02T23:46:30.760977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:13.880688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519706+0000","last_change":"2024-06-02T23:46:24.728315+0000","last_active":"2024-06-02T23:46:32.519706+0000","last_peered":"2024-06-02T23:46:32.519706+0000","last_clean":"2024-06-02T23:46:32.519706+0000","last_became_active":"2024-06-02T23:46:24.728035+0000","last_became_peered":"2024-06-02T23:46:24.728035+0000","last_unstale":"2024-06-02T23:46:32.519706+0000","last_undegraded":"2024-06-02T23:46:32.519706+0000","last_fullsized":"2024-06-02T23:46:32.519706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020395+0000","last_change":"2024-06-02T23:46:25.725814+0000","last_active":"2024-06-02T23:46:32.020395+0000","last_peered":"2024-06-02T23:46:32.020395+0000","last_clean":"2024-06-02T23:46:32.020395+0000","last_became_active":"2024-06-02T23:46:25.725542+0000","last_became_peered":"2024-06-02T23:46:25.725542+0000","last_unstale":"2024-06-02T23:46:32.020395+0000","last_undegraded":"2024-06-02T23:46:32.020395+0000","last_fullsized":"2024-06-02T23:46:32.020395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:37.017923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760812+0000","last_change":"2024-06-02T23:46:29.748045+0000","last_active":"2024-06-02T23:46:30.760812+0000","last_peered":"2024-06-02T23:46:30.760812+0000","last_clean":"2024-06-02T23:46:30.760812+0000","last_became_active":"2024-06-02T23:46:29.747638+0000","last_became_peered":"2024-06-02T23:46:29.747638+0000","last_unstale":"2024-06-02T23:46:30.760812+0000","last_undegraded":"2024-06-02T23:46:30.760812+0000","last_fullsized":"2024-06-02T23:46:30.760812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:47.634910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520308+0000","last_change":"2024-06-02T23:46:25.724610+0000","last_active":"2024-06-02T23:46:32.520308+0000","last_peered":"2024-06-02T23:46:32.520308+0000","last_clean":"2024-06-02T23:46:32.520308+0000","last_became_active":"2024-06-02T23:46:25.724361+0000","last_became_peered":"2024-06-02T23:46:25.724361+0000","last_unstale":"2024-06-02T23:46:32.520308+0000","last_undegraded":"2024-06-02T23:46:32.520308+0000","last_fullsized":"2024-06-02T23:46:32.520308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520766+0000","last_change":"2024-06-02T23:46:24.725027+0000","last_active":"2024-06-02T23:46:32.520766+0000","last_peered":"2024-06-02T23:46:32.520766+0000","last_clean":"2024-06-02T23:46:32.520766+0000","last_became_active":"2024-06-02T23:46:24.724691+0000","last_became_peered":"2024-06-02T23:46:24.724691+0000","last_unstale":"2024-06-02T23:46:32.520766+0000","last_undegraded":"2024-06-02T23:46:32.520766+0000","last_fullsized":"2024-06-02T23:46:32.520766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:07.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761401+0000","last_change":"2024-06-02T23:46:29.750805+0000","last_active":"2024-06-02T23:46:30.761401+0000","last_peered":"2024-06-02T23:46:30.761401+0000","last_clean":"2024-06-02T23:46:30.761401+0000","last_became_active":"2024-06-02T23:46:29.750392+0000","last_became_peered":"2024-06-02T23:46:29.750392+0000","last_unstale":"2024-06-02T23:46:30.761401+0000","last_undegraded":"2024-06-02T23:46:30.761401+0000","last_fullsized":"2024-06-02T23:46:30.761401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519491+0000","last_change":"2024-06-02T23:46:25.730928+0000","last_active":"2024-06-02T23:46:32.519491+0000","last_peered":"2024-06-02T23:46:32.519491+0000","last_clean":"2024-06-02T23:46:32.519491+0000","last_became_active":"2024-06-02T23:46:25.730035+0000","last_became_peered":"2024-06-02T23:46:25.730035+0000","last_unstale":"2024-06-02T23:46:32.519491+0000","last_undegraded":"2024-06-02T23:46:32.519491+0000","last_fullsized":"2024-06-02T23:46:32.519491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519486+0000","last_change":"2024-06-02T23:46:24.726529+0000","last_active":"2024-06-02T23:46:32.519486+0000","last_peered":"2024-06-02T23:46:32.519486+0000","last_clean":"2024-06-02T23:46:32.519486+0000","last_became_active":"2024-06-02T23:46:24.726263+0000","last_became_peered":"2024-06-02T23:46:24.726263+0000","last_unstale":"2024-06-02T23:46:32.519486+0000","last_undegraded":"2024-06-02T23:46:32.519486+0000","last_fullsized":"2024-06-02T23:46:32.519486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:22.253427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760795+0000","last_change":"2024-06-02T23:46:29.747195+0000","last_active":"2024-06-02T23:46:30.760795+0000","last_peered":"2024-06-02T23:46:30.760795+0000","last_clean":"2024-06-02T23:46:30.760795+0000","last_became_active":"2024-06-02T23:46:29.746715+0000","last_became_peered":"2024-06-02T23:46:29.746715+0000","last_unstale":"2024-06-02T23:46:30.760795+0000","last_undegraded":"2024-06-02T23:46:30.760795+0000","last_fullsized":"2024-06-02T23:46:30.760795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:48.919181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520156+0000","last_change":"2024-06-02T23:46:25.730204+0000","last_active":"2024-06-02T23:46:32.520156+0000","last_peered":"2024-06-02T23:46:32.520156+0000","last_clean":"2024-06-02T23:46:32.520156+0000","last_became_active":"2024-06-02T23:46:25.728660+0000","last_became_peered":"2024-06-02T23:46:25.728660+0000","last_unstale":"2024-06-02T23:46:32.520156+0000","last_undegraded":"2024-06-02T23:46:32.520156+0000","last_fullsized":"2024-06-02T23:46:32.520156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518837+0000","last_change":"2024-06-02T23:46:24.725743+0000","last_active":"2024-06-02T23:46:32.518837+0000","last_peered":"2024-06-02T23:46:32.518837+0000","last_clean":"2024-06-02T23:46:32.518837+0000","last_became_active":"2024-06-02T23:46:24.725418+0000","last_became_peered":"2024-06-02T23:46:24.725418+0000","last_unstale":"2024-06-02T23:46:32.518837+0000","last_undegraded":"2024-06-02T23:46:32.518837+0000","last_fullsized":"2024-06-02T23:46:32.518837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:07.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520044+0000","last_change":"2024-06-02T23:46:30.062502+0000","last_active":"2024-06-02T23:46:32.520044+0000","last_peered":"2024-06-02T23:46:32.520044+0000","last_clean":"2024-06-02T23:46:32.520044+0000","last_became_active":"2024-06-02T23:46:30.062168+0000","last_became_peered":"2024-06-02T23:46:30.062168+0000","last_unstale":"2024-06-02T23:46:32.520044+0000","last_undegraded":"2024-06-02T23:46:32.520044+0000","last_fullsized":"2024-06-02T23:46:32.520044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:15.508248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761606+0000","last_change":"2024-06-02T23:46:25.729672+0000","last_active":"2024-06-02T23:46:30.761606+0000","last_peered":"2024-06-02T23:46:30.761606+0000","last_clean":"2024-06-02T23:46:30.761606+0000","last_became_active":"2024-06-02T23:46:25.729405+0000","last_became_peered":"2024-06-02T23:46:25.729405+0000","last_unstale":"2024-06-02T23:46:30.761606+0000","last_undegraded":"2024-06-02T23:46:30.761606+0000","last_fullsized":"2024-06-02T23:46:30.761606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:21.812182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519444+0000","last_change":"2024-06-02T23:46:24.725037+0000","last_active":"2024-06-02T23:46:32.519444+0000","last_peered":"2024-06-02T23:46:32.519444+0000","last_clean":"2024-06-02T23:46:32.519444+0000","last_became_active":"2024-06-02T23:46:24.724705+0000","last_became_peered":"2024-06-02T23:46:24.724705+0000","last_unstale":"2024-06-02T23:46:32.519444+0000","last_undegraded":"2024-06-02T23:46:32.519444+0000","last_fullsized":"2024-06-02T23:46:32.519444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760969+0000","last_change":"2024-06-02T23:46:29.745875+0000","last_active":"2024-06-02T23:46:30.760969+0000","last_peered":"2024-06-02T23:46:30.760969+0000","last_clean":"2024-06-02T23:46:30.760969+0000","last_became_active":"2024-06-02T23:46:29.745417+0000","last_became_peered":"2024-06-02T23:46:29.745417+0000","last_unstale":"2024-06-02T23:46:30.760969+0000","last_undegraded":"2024-06-02T23:46:30.760969+0000","last_fullsized":"2024-06-02T23:46:30.760969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:52.536406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520531+0000","last_change":"2024-06-02T23:46:25.726449+0000","last_active":"2024-06-02T23:46:32.520531+0000","last_peered":"2024-06-02T23:46:32.520531+0000","last_clean":"2024-06-02T23:46:32.520531+0000","last_became_active":"2024-06-02T23:46:25.725878+0000","last_became_peered":"2024-06-02T23:46:25.725878+0000","last_unstale":"2024-06-02T23:46:32.520531+0000","last_undegraded":"2024-06-02T23:46:32.520531+0000","last_fullsized":"2024-06-02T23:46:32.520531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520174+0000","last_change":"2024-06-02T23:46:24.723537+0000","last_active":"2024-06-02T23:46:32.520174+0000","last_peered":"2024-06-02T23:46:32.520174+0000","last_clean":"2024-06-02T23:46:32.520174+0000","last_became_active":"2024-06-02T23:46:24.723258+0000","last_became_peered":"2024-06-02T23:46:24.723258+0000","last_unstale":"2024-06-02T23:46:32.520174+0000","last_undegraded":"2024-06-02T23:46:32.520174+0000","last_fullsized":"2024-06-02T23:46:32.520174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760721+0000","last_change":"2024-06-02T23:46:30.059389+0000","last_active":"2024-06-02T23:46:30.760721+0000","last_peered":"2024-06-02T23:46:30.760721+0000","last_clean":"2024-06-02T23:46:30.760721+0000","last_became_active":"2024-06-02T23:46:30.058909+0000","last_became_peered":"2024-06-02T23:46:30.058909+0000","last_unstale":"2024-06-02T23:46:30.760721+0000","last_undegraded":"2024-06-02T23:46:30.760721+0000","last_fullsized":"2024-06-02T23:46:30.760721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:24.838590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519819+0000","last_change":"2024-06-02T23:46:25.738807+0000","last_active":"2024-06-02T23:46:32.519819+0000","last_peered":"2024-06-02T23:46:32.519819+0000","last_clean":"2024-06-02T23:46:32.519819+0000","last_became_active":"2024-06-02T23:46:25.738552+0000","last_became_peered":"2024-06-02T23:46:25.738552+0000","last_unstale":"2024-06-02T23:46:32.519819+0000","last_undegraded":"2024-06-02T23:46:32.519819+0000","last_fullsized":"2024-06-02T23:46:32.519819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519426+0000","last_change":"2024-06-02T23:46:24.717509+0000","last_active":"2024-06-02T23:46:32.519426+0000","last_peered":"2024-06-02T23:46:32.519426+0000","last_clean":"2024-06-02T23:46:32.519426+0000","last_became_active":"2024-06-02T23:46:24.716726+0000","last_became_peered":"2024-06-02T23:46:24.716726+0000","last_unstale":"2024-06-02T23:46:32.519426+0000","last_undegraded":"2024-06-02T23:46:32.519426+0000","last_fullsized":"2024-06-02T23:46:32.519426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520004+0000","last_change":"2024-06-02T23:46:30.060386+0000","last_active":"2024-06-02T23:46:32.520004+0000","last_peered":"2024-06-02T23:46:32.520004+0000","last_clean":"2024-06-02T23:46:32.520004+0000","last_became_active":"2024-06-02T23:46:30.058822+0000","last_became_peered":"2024-06-02T23:46:30.058822+0000","last_unstale":"2024-06-02T23:46:32.520004+0000","last_undegraded":"2024-06-02T23:46:32.520004+0000","last_fullsized":"2024-06-02T23:46:32.520004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:33.045570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521240+0000","last_change":"2024-06-02T23:46:25.735259+0000","last_active":"2024-06-02T23:46:32.521240+0000","last_peered":"2024-06-02T23:46:32.521240+0000","last_clean":"2024-06-02T23:46:32.521240+0000","last_became_active":"2024-06-02T23:46:25.734998+0000","last_became_peered":"2024-06-02T23:46:25.734998+0000","last_unstale":"2024-06-02T23:46:32.521240+0000","last_undegraded":"2024-06-02T23:46:32.521240+0000","last_fullsized":"2024-06-02T23:46:32.521240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520831+0000","last_change":"2024-06-02T23:46:24.725043+0000","last_active":"2024-06-02T23:46:32.520831+0000","last_peered":"2024-06-02T23:46:32.520831+0000","last_clean":"2024-06-02T23:46:32.520831+0000","last_became_active":"2024-06-02T23:46:24.724672+0000","last_became_peered":"2024-06-02T23:46:24.724672+0000","last_unstale":"2024-06-02T23:46:32.520831+0000","last_undegraded":"2024-06-02T23:46:32.520831+0000","last_fullsized":"2024-06-02T23:46:32.520831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:22.253427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519079+0000","last_change":"2024-06-02T23:46:30.061769+0000","last_active":"2024-06-02T23:46:32.519079+0000","last_peered":"2024-06-02T23:46:32.519079+0000","last_clean":"2024-06-02T23:46:32.519079+0000","last_became_active":"2024-06-02T23:46:30.061381+0000","last_became_peered":"2024-06-02T23:46:30.061381+0000","last_unstale":"2024-06-02T23:46:32.519079+0000","last_undegraded":"2024-06-02T23:46:32.519079+0000","last_fullsized":"2024-06-02T23:46:32.519079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020522+0000","last_change":"2024-06-02T23:46:25.733026+0000","last_active":"2024-06-02T23:46:32.020522+0000","last_peered":"2024-06-02T23:46:32.020522+0000","last_clean":"2024-06-02T23:46:32.020522+0000","last_became_active":"2024-06-02T23:46:25.732637+0000","last_became_peered":"2024-06-02T23:46:25.732637+0000","last_unstale":"2024-06-02T23:46:32.020522+0000","last_undegraded":"2024-06-02T23:46:32.020522+0000","last_fullsized":"2024-06-02T23:46:32.020522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:20.812410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521321+0000","last_change":"2024-06-02T23:46:24.725276+0000","last_active":"2024-06-02T23:46:32.521321+0000","last_peered":"2024-06-02T23:46:32.521321+0000","last_clean":"2024-06-02T23:46:32.521321+0000","last_became_active":"2024-06-02T23:46:24.725003+0000","last_became_peered":"2024-06-02T23:46:24.725003+0000","last_unstale":"2024-06-02T23:46:32.521321+0000","last_undegraded":"2024-06-02T23:46:32.521321+0000","last_fullsized":"2024-06-02T23:46:32.521321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519089+0000","last_change":"2024-06-02T23:46:29.748270+0000","last_active":"2024-06-02T23:46:32.519089+0000","last_peered":"2024-06-02T23:46:32.519089+0000","last_clean":"2024-06-02T23:46:32.519089+0000","last_became_active":"2024-06-02T23:46:29.746100+0000","last_became_peered":"2024-06-02T23:46:29.746100+0000","last_unstale":"2024-06-02T23:46:32.519089+0000","last_undegraded":"2024-06-02T23:46:32.519089+0000","last_fullsized":"2024-06-02T23:46:32.519089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761799+0000","last_change":"2024-06-02T23:46:25.721864+0000","last_active":"2024-06-02T23:46:30.761799+0000","last_peered":"2024-06-02T23:46:30.761799+0000","last_clean":"2024-06-02T23:46:30.761799+0000","last_became_active":"2024-06-02T23:46:25.721542+0000","last_became_peered":"2024-06-02T23:46:25.721542+0000","last_unstale":"2024-06-02T23:46:30.761799+0000","last_undegraded":"2024-06-02T23:46:30.761799+0000","last_fullsized":"2024-06-02T23:46:30.761799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:43.831493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020299+0000","last_change":"2024-06-02T23:46:24.721734+0000","last_active":"2024-06-02T23:46:32.020299+0000","last_peered":"2024-06-02T23:46:32.020299+0000","last_clean":"2024-06-02T23:46:32.020299+0000","last_became_active":"2024-06-02T23:46:24.721054+0000","last_became_peered":"2024-06-02T23:46:24.721054+0000","last_unstale":"2024-06-02T23:46:32.020299+0000","last_undegraded":"2024-06-02T23:46:32.020299+0000","last_fullsized":"2024-06-02T23:46:32.020299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521266+0000","last_change":"2024-06-02T23:46:29.747631+0000","last_active":"2024-06-02T23:46:32.521266+0000","last_peered":"2024-06-02T23:46:32.521266+0000","last_clean":"2024-06-02T23:46:32.521266+0000","last_became_active":"2024-06-02T23:46:29.747131+0000","last_became_peered":"2024-06-02T23:46:29.747131+0000","last_unstale":"2024-06-02T23:46:32.521266+0000","last_undegraded":"2024-06-02T23:46:32.521266+0000","last_fullsized":"2024-06-02T23:46:32.521266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:25:42.527465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521158+0000","last_change":"2024-06-02T23:46:25.730642+0000","last_active":"2024-06-02T23:46:32.521158+0000","last_peered":"2024-06-02T23:46:32.521158+0000","last_clean":"2024-06-02T23:46:32.521158+0000","last_became_active":"2024-06-02T23:46:25.730361+0000","last_became_peered":"2024-06-02T23:46:25.730361+0000","last_unstale":"2024-06-02T23:46:32.521158+0000","last_undegraded":"2024-06-02T23:46:32.521158+0000","last_fullsized":"2024-06-02T23:46:32.521158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760281+0000","last_change":"2024-06-02T23:46:24.723907+0000","last_active":"2024-06-02T23:46:30.760281+0000","last_peered":"2024-06-02T23:46:30.760281+0000","last_clean":"2024-06-02T23:46:30.760281+0000","last_became_active":"2024-06-02T23:46:24.723625+0000","last_became_peered":"2024-06-02T23:46:24.723625+0000","last_unstale":"2024-06-02T23:46:30.760281+0000","last_undegraded":"2024-06-02T23:46:30.760281+0000","last_fullsized":"2024-06-02T23:46:30.760281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520188+0000","last_change":"2024-06-02T23:46:29.750215+0000","last_active":"2024-06-02T23:46:32.520188+0000","last_peered":"2024-06-02T23:46:32.520188+0000","last_clean":"2024-06-02T23:46:32.520188+0000","last_became_active":"2024-06-02T23:46:29.749639+0000","last_became_peered":"2024-06-02T23:46:29.749639+0000","last_unstale":"2024-06-02T23:46:32.520188+0000","last_undegraded":"2024-06-02T23:46:32.520188+0000","last_fullsized":"2024-06-02T23:46:32.520188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:29.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518955+0000","last_change":"2024-06-02T23:46:25.715090+0000","last_active":"2024-06-02T23:46:32.518955+0000","last_peered":"2024-06-02T23:46:32.518955+0000","last_clean":"2024-06-02T23:46:32.518955+0000","last_became_active":"2024-06-02T23:46:25.714367+0000","last_became_peered":"2024-06-02T23:46:25.714367+0000","last_unstale":"2024-06-02T23:46:32.518955+0000","last_undegraded":"2024-06-02T23:46:32.518955+0000","last_fullsized":"2024-06-02T23:46:32.518955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519559+0000","last_change":"2024-06-02T23:46:24.727655+0000","last_active":"2024-06-02T23:46:32.519559+0000","last_peered":"2024-06-02T23:46:32.519559+0000","last_clean":"2024-06-02T23:46:32.519559+0000","last_became_active":"2024-06-02T23:46:24.727332+0000","last_became_peered":"2024-06-02T23:46:24.727332+0000","last_unstale":"2024-06-02T23:46:32.519559+0000","last_undegraded":"2024-06-02T23:46:32.519559+0000","last_fullsized":"2024-06-02T23:46:32.519559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520433+0000","last_change":"2024-06-02T23:46:30.058954+0000","last_active":"2024-06-02T23:46:32.520433+0000","last_peered":"2024-06-02T23:46:32.520433+0000","last_clean":"2024-06-02T23:46:32.520433+0000","last_became_active":"2024-06-02T23:46:30.058572+0000","last_became_peered":"2024-06-02T23:46:30.058572+0000","last_unstale":"2024-06-02T23:46:32.520433+0000","last_undegraded":"2024-06-02T23:46:32.520433+0000","last_fullsized":"2024-06-02T23:46:32.520433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:29.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519081+0000","last_change":"2024-06-02T23:46:25.733213+0000","last_active":"2024-06-02T23:46:32.519081+0000","last_peered":"2024-06-02T23:46:32.519081+0000","last_clean":"2024-06-02T23:46:32.519081+0000","last_became_active":"2024-06-02T23:46:25.732930+0000","last_became_peered":"2024-06-02T23:46:25.732930+0000","last_unstale":"2024-06-02T23:46:32.519081+0000","last_undegraded":"2024-06-02T23:46:32.519081+0000","last_fullsized":"2024-06-02T23:46:32.519081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020160+0000","last_change":"2024-06-02T23:46:24.721901+0000","last_active":"2024-06-02T23:46:32.020160+0000","last_peered":"2024-06-02T23:46:32.020160+0000","last_clean":"2024-06-02T23:46:32.020160+0000","last_became_active":"2024-06-02T23:46:24.721566+0000","last_became_peered":"2024-06-02T23:46:24.721566+0000","last_unstale":"2024-06-02T23:46:32.020160+0000","last_undegraded":"2024-06-02T23:46:32.020160+0000","last_fullsized":"2024-06-02T23:46:32.020160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519663+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:46:32.519663+0000","last_peered":"2024-06-02T23:46:32.519663+0000","last_clean":"2024-06-02T23:46:32.519663+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:46:32.519663+0000","last_undegraded":"2024-06-02T23:46:32.519663+0000","last_fullsized":"2024-06-02T23:46:32.519663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520077+0000","last_change":"2024-06-02T23:46:30.062637+0000","last_active":"2024-06-02T23:46:32.520077+0000","last_peered":"2024-06-02T23:46:32.520077+0000","last_clean":"2024-06-02T23:46:32.520077+0000","last_became_active":"2024-06-02T23:46:30.061399+0000","last_became_peered":"2024-06-02T23:46:30.061399+0000","last_unstale":"2024-06-02T23:46:32.520077+0000","last_undegraded":"2024-06-02T23:46:32.520077+0000","last_fullsized":"2024-06-02T23:46:32.520077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:13.880688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520556+0000","last_change":"2024-06-02T23:46:25.735716+0000","last_active":"2024-06-02T23:46:32.520556+0000","last_peered":"2024-06-02T23:46:32.520556+0000","last_clean":"2024-06-02T23:46:32.520556+0000","last_became_active":"2024-06-02T23:46:25.735260+0000","last_became_peered":"2024-06-02T23:46:25.735260+0000","last_unstale":"2024-06-02T23:46:32.520556+0000","last_undegraded":"2024-06-02T23:46:32.520556+0000","last_fullsized":"2024-06-02T23:46:32.520556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760537+0000","last_change":"2024-06-02T23:46:24.723946+0000","last_active":"2024-06-02T23:46:30.760537+0000","last_peered":"2024-06-02T23:46:30.760537+0000","last_clean":"2024-06-02T23:46:30.760537+0000","last_became_active":"2024-06-02T23:46:24.723650+0000","last_became_peered":"2024-06-02T23:46:24.723650+0000","last_unstale":"2024-06-02T23:46:30.760537+0000","last_undegraded":"2024-06-02T23:46:30.760537+0000","last_fullsized":"2024-06-02T23:46:30.760537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520181+0000","last_change":"2024-06-02T23:46:30.059124+0000","last_active":"2024-06-02T23:46:32.520181+0000","last_peered":"2024-06-02T23:46:32.520181+0000","last_clean":"2024-06-02T23:46:32.520181+0000","last_became_active":"2024-06-02T23:46:30.058661+0000","last_became_peered":"2024-06-02T23:46:30.058661+0000","last_unstale":"2024-06-02T23:46:32.520181+0000","last_undegraded":"2024-06-02T23:46:32.520181+0000","last_fullsized":"2024-06-02T23:46:32.520181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020428+0000","last_change":"2024-06-02T23:46:25.732804+0000","last_active":"2024-06-02T23:46:32.020428+0000","last_peered":"2024-06-02T23:46:32.020428+0000","last_clean":"2024-06-02T23:46:32.020428+0000","last_became_active":"2024-06-02T23:46:25.732456+0000","last_became_peered":"2024-06-02T23:46:25.732456+0000","last_unstale":"2024-06-02T23:46:32.020428+0000","last_undegraded":"2024-06-02T23:46:32.020428+0000","last_fullsized":"2024-06-02T23:46:32.020428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:12.887235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520544+0000","last_change":"2024-06-02T23:46:24.719921+0000","last_active":"2024-06-02T23:46:32.520544+0000","last_peered":"2024-06-02T23:46:32.520544+0000","last_clean":"2024-06-02T23:46:32.520544+0000","last_became_active":"2024-06-02T23:46:24.719648+0000","last_became_peered":"2024-06-02T23:46:24.719648+0000","last_unstale":"2024-06-02T23:46:32.520544+0000","last_undegraded":"2024-06-02T23:46:32.520544+0000","last_fullsized":"2024-06-02T23:46:32.520544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519336+0000","last_change":"2024-06-02T23:46:29.750616+0000","last_active":"2024-06-02T23:46:32.519336+0000","last_peered":"2024-06-02T23:46:32.519336+0000","last_clean":"2024-06-02T23:46:32.519336+0000","last_became_active":"2024-06-02T23:46:29.750269+0000","last_became_peered":"2024-06-02T23:46:29.750269+0000","last_unstale":"2024-06-02T23:46:32.519336+0000","last_undegraded":"2024-06-02T23:46:32.519336+0000","last_fullsized":"2024-06-02T23:46:32.519336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520532+0000","last_change":"2024-06-02T23:46:25.735799+0000","last_active":"2024-06-02T23:46:32.520532+0000","last_peered":"2024-06-02T23:46:32.520532+0000","last_clean":"2024-06-02T23:46:32.520532+0000","last_became_active":"2024-06-02T23:46:25.735543+0000","last_became_peered":"2024-06-02T23:46:25.735543+0000","last_unstale":"2024-06-02T23:46:32.520532+0000","last_undegraded":"2024-06-02T23:46:32.520532+0000","last_fullsized":"2024-06-02T23:46:32.520532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:37.017923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760515+0000","last_change":"2024-06-02T23:46:24.725885+0000","last_active":"2024-06-02T23:46:30.760515+0000","last_peered":"2024-06-02T23:46:30.760515+0000","last_clean":"2024-06-02T23:46:30.760515+0000","last_became_active":"2024-06-02T23:46:24.725536+0000","last_became_peered":"2024-06-02T23:46:24.725536+0000","last_unstale":"2024-06-02T23:46:30.760515+0000","last_undegraded":"2024-06-02T23:46:30.760515+0000","last_fullsized":"2024-06-02T23:46:30.760515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019834+0000","last_change":"2024-06-02T23:46:30.061677+0000","last_active":"2024-06-02T23:46:32.019834+0000","last_peered":"2024-06-02T23:46:32.019834+0000","last_clean":"2024-06-02T23:46:32.019834+0000","last_became_active":"2024-06-02T23:46:30.060775+0000","last_became_peered":"2024-06-02T23:46:30.060775+0000","last_unstale":"2024-06-02T23:46:32.019834+0000","last_undegraded":"2024-06-02T23:46:32.019834+0000","last_fullsized":"2024-06-02T23:46:32.019834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:33.045570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520258+0000","last_change":"2024-06-02T23:46:25.730305+0000","last_active":"2024-06-02T23:46:32.520258+0000","last_peered":"2024-06-02T23:46:32.520258+0000","last_clean":"2024-06-02T23:46:32.520258+0000","last_became_active":"2024-06-02T23:46:25.730021+0000","last_became_peered":"2024-06-02T23:46:25.730021+0000","last_unstale":"2024-06-02T23:46:32.520258+0000","last_undegraded":"2024-06-02T23:46:32.520258+0000","last_fullsized":"2024-06-02T23:46:32.520258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:55.355993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761363+0000","last_change":"2024-06-02T23:46:24.715701+0000","last_active":"2024-06-02T23:46:30.761363+0000","last_peered":"2024-06-02T23:46:30.761363+0000","last_clean":"2024-06-02T23:46:30.761363+0000","last_became_active":"2024-06-02T23:46:24.715390+0000","last_became_peered":"2024-06-02T23:46:24.715390+0000","last_unstale":"2024-06-02T23:46:30.761363+0000","last_undegraded":"2024-06-02T23:46:30.761363+0000","last_fullsized":"2024-06-02T23:46:30.761363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:58.235763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760636+0000","last_change":"2024-06-02T23:46:29.746332+0000","last_active":"2024-06-02T23:46:30.760636+0000","last_peered":"2024-06-02T23:46:30.760636+0000","last_clean":"2024-06-02T23:46:30.760636+0000","last_became_active":"2024-06-02T23:46:29.745413+0000","last_became_peered":"2024-06-02T23:46:29.745413+0000","last_unstale":"2024-06-02T23:46:30.760636+0000","last_undegraded":"2024-06-02T23:46:30.760636+0000","last_fullsized":"2024-06-02T23:46:30.760636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:19.371522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519802+0000","last_change":"2024-06-02T23:46:25.725887+0000","last_active":"2024-06-02T23:46:32.519802+0000","last_peered":"2024-06-02T23:46:32.519802+0000","last_clean":"2024-06-02T23:46:32.519802+0000","last_became_active":"2024-06-02T23:46:25.725612+0000","last_became_peered":"2024-06-02T23:46:25.725612+0000","last_unstale":"2024-06-02T23:46:32.519802+0000","last_undegraded":"2024-06-02T23:46:32.519802+0000","last_fullsized":"2024-06-02T23:46:32.519802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760127+0000","last_change":"2024-06-02T23:46:24.724594+0000","last_active":"2024-06-02T23:46:30.760127+0000","last_peered":"2024-06-02T23:46:30.760127+0000","last_clean":"2024-06-02T23:46:30.760127+0000","last_became_active":"2024-06-02T23:46:24.723922+0000","last_became_peered":"2024-06-02T23:46:24.723922+0000","last_unstale":"2024-06-02T23:46:30.760127+0000","last_undegraded":"2024-06-02T23:46:30.760127+0000","last_fullsized":"2024-06-02T23:46:30.760127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520293+0000","last_change":"2024-06-02T23:46:29.747557+0000","last_active":"2024-06-02T23:46:32.520293+0000","last_peered":"2024-06-02T23:46:32.520293+0000","last_clean":"2024-06-02T23:46:32.520293+0000","last_became_active":"2024-06-02T23:46:29.747197+0000","last_became_peered":"2024-06-02T23:46:29.747197+0000","last_unstale":"2024-06-02T23:46:32.520293+0000","last_undegraded":"2024-06-02T23:46:32.520293+0000","last_fullsized":"2024-06-02T23:46:32.520293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:15.508248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519514+0000","last_change":"2024-06-02T23:46:25.724028+0000","last_active":"2024-06-02T23:46:32.519514+0000","last_peered":"2024-06-02T23:46:32.519514+0000","last_clean":"2024-06-02T23:46:32.519514+0000","last_became_active":"2024-06-02T23:46:25.723772+0000","last_became_peered":"2024-06-02T23:46:25.723772+0000","last_unstale":"2024-06-02T23:46:32.519514+0000","last_undegraded":"2024-06-02T23:46:32.519514+0000","last_fullsized":"2024-06-02T23:46:32.519514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519626+0000","last_change":"2024-06-02T23:46:24.719789+0000","last_active":"2024-06-02T23:46:32.519626+0000","last_peered":"2024-06-02T23:46:32.519626+0000","last_clean":"2024-06-02T23:46:32.519626+0000","last_became_active":"2024-06-02T23:46:24.719492+0000","last_became_peered":"2024-06-02T23:46:24.719492+0000","last_unstale":"2024-06-02T23:46:32.519626+0000","last_undegraded":"2024-06-02T23:46:32.519626+0000","last_fullsized":"2024-06-02T23:46:32.519626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519714+0000","last_change":"2024-06-02T23:46:30.060001+0000","last_active":"2024-06-02T23:46:32.519714+0000","last_peered":"2024-06-02T23:46:32.519714+0000","last_clean":"2024-06-02T23:46:32.519714+0000","last_became_active":"2024-06-02T23:46:30.059636+0000","last_became_peered":"2024-06-02T23:46:30.059636+0000","last_unstale":"2024-06-02T23:46:32.519714+0000","last_undegraded":"2024-06-02T23:46:32.519714+0000","last_fullsized":"2024-06-02T23:46:32.519714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:25:42.527465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520625+0000","last_change":"2024-06-02T23:46:25.731503+0000","last_active":"2024-06-02T23:46:32.520625+0000","last_peered":"2024-06-02T23:46:32.520625+0000","last_clean":"2024-06-02T23:46:32.520625+0000","last_became_active":"2024-06-02T23:46:25.726384+0000","last_became_peered":"2024-06-02T23:46:25.726384+0000","last_unstale":"2024-06-02T23:46:32.520625+0000","last_undegraded":"2024-06-02T23:46:32.520625+0000","last_fullsized":"2024-06-02T23:46:32.520625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:11.482068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020231+0000","last_change":"2024-06-02T23:46:24.717644+0000","last_active":"2024-06-02T23:46:32.020231+0000","last_peered":"2024-06-02T23:46:32.020231+0000","last_clean":"2024-06-02T23:46:32.020231+0000","last_became_active":"2024-06-02T23:46:24.717376+0000","last_became_peered":"2024-06-02T23:46:24.717376+0000","last_unstale":"2024-06-02T23:46:32.020231+0000","last_undegraded":"2024-06-02T23:46:32.020231+0000","last_fullsized":"2024-06-02T23:46:32.020231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520673+0000","last_change":"2024-06-02T23:46:30.059757+0000","last_active":"2024-06-02T23:46:32.520673+0000","last_peered":"2024-06-02T23:46:32.520673+0000","last_clean":"2024-06-02T23:46:32.520673+0000","last_became_active":"2024-06-02T23:46:30.059322+0000","last_became_peered":"2024-06-02T23:46:30.059322+0000","last_unstale":"2024-06-02T23:46:32.520673+0000","last_undegraded":"2024-06-02T23:46:32.520673+0000","last_fullsized":"2024-06-02T23:46:32.520673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:23.721847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519530+0000","last_change":"2024-06-02T23:46:25.728180+0000","last_active":"2024-06-02T23:46:32.519530+0000","last_peered":"2024-06-02T23:46:32.519530+0000","last_clean":"2024-06-02T23:46:32.519530+0000","last_became_active":"2024-06-02T23:46:25.727929+0000","last_became_peered":"2024-06-02T23:46:25.727929+0000","last_unstale":"2024-06-02T23:46:32.519530+0000","last_undegraded":"2024-06-02T23:46:32.519530+0000","last_fullsized":"2024-06-02T23:46:32.519530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:13:41.243193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520755+0000","last_change":"2024-06-02T23:46:24.720640+0000","last_active":"2024-06-02T23:46:32.520755+0000","last_peered":"2024-06-02T23:46:32.520755+0000","last_clean":"2024-06-02T23:46:32.520755+0000","last_became_active":"2024-06-02T23:46:24.718963+0000","last_became_peered":"2024-06-02T23:46:24.718963+0000","last_unstale":"2024-06-02T23:46:32.520755+0000","last_undegraded":"2024-06-02T23:46:32.520755+0000","last_fullsized":"2024-06-02T23:46:32.520755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:48:20.465639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020392+0000","last_change":"2024-06-02T23:46:30.061979+0000","last_active":"2024-06-02T23:46:32.020392+0000","last_peered":"2024-06-02T23:46:32.020392+0000","last_clean":"2024-06-02T23:46:32.020392+0000","last_became_active":"2024-06-02T23:46:30.060895+0000","last_became_peered":"2024-06-02T23:46:30.060895+0000","last_unstale":"2024-06-02T23:46:32.020392+0000","last_undegraded":"2024-06-02T23:46:32.020392+0000","last_fullsized":"2024-06-02T23:46:32.020392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:45:39.641287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520442+0000","last_change":"2024-06-02T23:46:25.735883+0000","last_active":"2024-06-02T23:46:32.520442+0000","last_peered":"2024-06-02T23:46:32.520442+0000","last_clean":"2024-06-02T23:46:32.520442+0000","last_became_active":"2024-06-02T23:46:25.735603+0000","last_became_peered":"2024-06-02T23:46:25.735603+0000","last_unstale":"2024-06-02T23:46:32.520442+0000","last_undegraded":"2024-06-02T23:46:32.520442+0000","last_fullsized":"2024-06-02T23:46:32.520442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:35.130935+0000","last_change":"2024-06-02T23:46:24.721360+0000","last_active":"2024-06-02T23:46:35.130935+0000","last_peered":"2024-06-02T23:46:35.130935+0000","last_clean":"2024-06-02T23:46:35.130935+0000","last_became_active":"2024-06-02T23:46:24.721084+0000","last_became_peered":"2024-06-02T23:46:24.721084+0000","last_unstale":"2024-06-02T23:46:35.130935+0000","last_undegraded":"2024-06-02T23:46:35.130935+0000","last_fullsized":"2024-06-02T23:46:35.130935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519296+0000","last_change":"2024-06-02T23:46:29.746644+0000","last_active":"2024-06-02T23:46:32.519296+0000","last_peered":"2024-06-02T23:46:32.519296+0000","last_clean":"2024-06-02T23:46:32.519296+0000","last_became_active":"2024-06-02T23:46:29.746228+0000","last_became_peered":"2024-06-02T23:46:29.746228+0000","last_unstale":"2024-06-02T23:46:32.519296+0000","last_undegraded":"2024-06-02T23:46:32.519296+0000","last_fullsized":"2024-06-02T23:46:32.519296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:10.654147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761249+0000","last_change":"2024-06-02T23:46:25.728089+0000","last_active":"2024-06-02T23:46:30.761249+0000","last_peered":"2024-06-02T23:46:30.761249+0000","last_clean":"2024-06-02T23:46:30.761249+0000","last_became_active":"2024-06-02T23:46:25.726955+0000","last_became_peered":"2024-06-02T23:46:25.726955+0000","last_unstale":"2024-06-02T23:46:30.761249+0000","last_undegraded":"2024-06-02T23:46:30.761249+0000","last_fullsized":"2024-06-02T23:46:30.761249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:35.672297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520452+0000","last_change":"2024-06-02T23:46:24.725891+0000","last_active":"2024-06-02T23:46:32.520452+0000","last_peered":"2024-06-02T23:46:32.520452+0000","last_clean":"2024-06-02T23:46:32.520452+0000","last_became_active":"2024-06-02T23:46:24.725584+0000","last_became_peered":"2024-06-02T23:46:24.725584+0000","last_unstale":"2024-06-02T23:46:32.520452+0000","last_undegraded":"2024-06-02T23:46:32.520452+0000","last_fullsized":"2024-06-02T23:46:32.520452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761588+0000","last_change":"2024-06-02T23:46:29.745572+0000","last_active":"2024-06-02T23:46:30.761588+0000","last_peered":"2024-06-02T23:46:30.761588+0000","last_clean":"2024-06-02T23:46:30.761588+0000","last_became_active":"2024-06-02T23:46:29.744992+0000","last_became_peered":"2024-06-02T23:46:29.744992+0000","last_unstale":"2024-06-02T23:46:30.761588+0000","last_undegraded":"2024-06-02T23:46:30.761588+0000","last_fullsized":"2024-06-02T23:46:30.761588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519822+0000","last_change":"2024-06-02T23:46:25.725605+0000","last_active":"2024-06-02T23:46:32.519822+0000","last_peered":"2024-06-02T23:46:32.519822+0000","last_clean":"2024-06-02T23:46:32.519822+0000","last_became_active":"2024-06-02T23:46:25.725274+0000","last_became_peered":"2024-06-02T23:46:25.725274+0000","last_unstale":"2024-06-02T23:46:32.519822+0000","last_undegraded":"2024-06-02T23:46:32.519822+0000","last_fullsized":"2024-06-02T23:46:32.519822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020509+0000","last_change":"2024-06-02T23:46:24.715879+0000","last_active":"2024-06-02T23:46:32.020509+0000","last_peered":"2024-06-02T23:46:32.020509+0000","last_clean":"2024-06-02T23:46:32.020509+0000","last_became_active":"2024-06-02T23:46:24.715573+0000","last_became_peered":"2024-06-02T23:46:24.715573+0000","last_unstale":"2024-06-02T23:46:32.020509+0000","last_undegraded":"2024-06-02T23:46:32.020509+0000","last_fullsized":"2024-06-02T23:46:32.020509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520072+0000","last_change":"2024-06-02T23:46:29.747846+0000","last_active":"2024-06-02T23:46:32.520072+0000","last_peered":"2024-06-02T23:46:32.520072+0000","last_clean":"2024-06-02T23:46:32.520072+0000","last_became_active":"2024-06-02T23:46:29.747447+0000","last_became_peered":"2024-06-02T23:46:29.747447+0000","last_unstale":"2024-06-02T23:46:32.520072+0000","last_undegraded":"2024-06-02T23:46:32.520072+0000","last_fullsized":"2024-06-02T23:46:32.520072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:45:39.641287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020419+0000","last_change":"2024-06-02T23:46:25.724680+0000","last_active":"2024-06-02T23:46:32.020419+0000","last_peered":"2024-06-02T23:46:32.020419+0000","last_clean":"2024-06-02T23:46:32.020419+0000","last_became_active":"2024-06-02T23:46:25.724407+0000","last_became_peered":"2024-06-02T23:46:25.724407+0000","last_unstale":"2024-06-02T23:46:32.020419+0000","last_undegraded":"2024-06-02T23:46:32.020419+0000","last_fullsized":"2024-06-02T23:46:32.020419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:09.854508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520034+0000","last_change":"2024-06-02T23:46:24.722854+0000","last_active":"2024-06-02T23:46:32.520034+0000","last_peered":"2024-06-02T23:46:32.520034+0000","last_clean":"2024-06-02T23:46:32.520034+0000","last_became_active":"2024-06-02T23:46:24.722517+0000","last_became_peered":"2024-06-02T23:46:24.722517+0000","last_unstale":"2024-06-02T23:46:32.520034+0000","last_undegraded":"2024-06-02T23:46:32.520034+0000","last_fullsized":"2024-06-02T23:46:32.520034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520095+0000","last_change":"2024-06-02T23:46:30.059124+0000","last_active":"2024-06-02T23:46:32.520095+0000","last_peered":"2024-06-02T23:46:32.520095+0000","last_clean":"2024-06-02T23:46:32.520095+0000","last_became_active":"2024-06-02T23:46:30.058701+0000","last_became_peered":"2024-06-02T23:46:30.058701+0000","last_unstale":"2024-06-02T23:46:32.520095+0000","last_undegraded":"2024-06-02T23:46:32.520095+0000","last_fullsized":"2024-06-02T23:46:32.520095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:03:32.967430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520137+0000","last_change":"2024-06-02T23:46:30.060519+0000","last_active":"2024-06-02T23:46:32.520137+0000","last_peered":"2024-06-02T23:46:32.520137+0000","last_clean":"2024-06-02T23:46:32.520137+0000","last_became_active":"2024-06-02T23:46:30.060121+0000","last_became_peered":"2024-06-02T23:46:30.060121+0000","last_unstale":"2024-06-02T23:46:32.520137+0000","last_undegraded":"2024-06-02T23:46:32.520137+0000","last_fullsized":"2024-06-02T23:46:32.520137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:10.654147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518734+0000","last_change":"2024-06-02T23:46:25.732314+0000","last_active":"2024-06-02T23:46:32.518734+0000","last_peered":"2024-06-02T23:46:32.518734+0000","last_clean":"2024-06-02T23:46:32.518734+0000","last_became_active":"2024-06-02T23:46:25.732022+0000","last_became_peered":"2024-06-02T23:46:25.732022+0000","last_unstale":"2024-06-02T23:46:32.518734+0000","last_undegraded":"2024-06-02T23:46:32.518734+0000","last_fullsized":"2024-06-02T23:46:32.518734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019991+0000","last_change":"2024-06-02T23:46:24.716182+0000","last_active":"2024-06-02T23:46:32.019991+0000","last_peered":"2024-06-02T23:46:32.019991+0000","last_clean":"2024-06-02T23:46:32.019991+0000","last_became_active":"2024-06-02T23:46:24.715906+0000","last_became_peered":"2024-06-02T23:46:24.715906+0000","last_unstale":"2024-06-02T23:46:32.019991+0000","last_undegraded":"2024-06-02T23:46:32.019991+0000","last_fullsized":"2024-06-02T23:46:32.019991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519713+0000","last_change":"2024-06-02T23:46:29.750554+0000","last_active":"2024-06-02T23:46:32.519713+0000","last_peered":"2024-06-02T23:46:32.519713+0000","last_clean":"2024-06-02T23:46:32.519713+0000","last_became_active":"2024-06-02T23:46:29.750212+0000","last_became_peered":"2024-06-02T23:46:29.750212+0000","last_unstale":"2024-06-02T23:46:32.519713+0000","last_undegraded":"2024-06-02T23:46:32.519713+0000","last_fullsized":"2024-06-02T23:46:32.519713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:24.838590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520102+0000","last_change":"2024-06-02T23:46:25.730716+0000","last_active":"2024-06-02T23:46:32.520102+0000","last_peered":"2024-06-02T23:46:32.520102+0000","last_clean":"2024-06-02T23:46:32.520102+0000","last_became_active":"2024-06-02T23:46:25.730447+0000","last_became_peered":"2024-06-02T23:46:25.730447+0000","last_unstale":"2024-06-02T23:46:32.520102+0000","last_undegraded":"2024-06-02T23:46:32.520102+0000","last_fullsized":"2024-06-02T23:46:32.520102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520355+0000","last_change":"2024-06-02T23:46:24.718681+0000","last_active":"2024-06-02T23:46:32.520355+0000","last_peered":"2024-06-02T23:46:32.520355+0000","last_clean":"2024-06-02T23:46:32.520355+0000","last_became_active":"2024-06-02T23:46:24.717312+0000","last_became_peered":"2024-06-02T23:46:24.717312+0000","last_unstale":"2024-06-02T23:46:32.520355+0000","last_undegraded":"2024-06-02T23:46:32.520355+0000","last_fullsized":"2024-06-02T23:46:32.520355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:53.696691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520419+0000","last_change":"2024-06-02T23:46:24.719033+0000","last_active":"2024-06-02T23:46:32.520419+0000","last_peered":"2024-06-02T23:46:32.520419+0000","last_clean":"2024-06-02T23:46:32.520419+0000","last_became_active":"2024-06-02T23:46:24.718726+0000","last_became_peered":"2024-06-02T23:46:24.718726+0000","last_unstale":"2024-06-02T23:46:32.520419+0000","last_undegraded":"2024-06-02T23:46:32.520419+0000","last_fullsized":"2024-06-02T23:46:32.520419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520671+0000","last_change":"2024-06-02T23:46:25.714066+0000","last_active":"2024-06-02T23:46:32.520671+0000","last_peered":"2024-06-02T23:46:32.520671+0000","last_clean":"2024-06-02T23:46:32.520671+0000","last_became_active":"2024-06-02T23:46:25.713761+0000","last_became_peered":"2024-06-02T23:46:25.713761+0000","last_unstale":"2024-06-02T23:46:32.520671+0000","last_undegraded":"2024-06-02T23:46:32.520671+0000","last_fullsized":"2024-06-02T23:46:32.520671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760380+0000","last_change":"2024-06-02T23:46:29.745968+0000","last_active":"2024-06-02T23:46:30.760380+0000","last_peered":"2024-06-02T23:46:30.760380+0000","last_clean":"2024-06-02T23:46:30.760380+0000","last_became_active":"2024-06-02T23:46:29.745547+0000","last_became_peered":"2024-06-02T23:46:29.745547+0000","last_unstale":"2024-06-02T23:46:30.760380+0000","last_undegraded":"2024-06-02T23:46:30.760380+0000","last_fullsized":"2024-06-02T23:46:30.760380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:14.777955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519569+0000","last_change":"2024-06-02T23:46:24.724513+0000","last_active":"2024-06-02T23:46:32.519569+0000","last_peered":"2024-06-02T23:46:32.519569+0000","last_clean":"2024-06-02T23:46:32.519569+0000","last_became_active":"2024-06-02T23:46:24.723129+0000","last_became_peered":"2024-06-02T23:46:24.723129+0000","last_unstale":"2024-06-02T23:46:32.519569+0000","last_undegraded":"2024-06-02T23:46:32.519569+0000","last_fullsized":"2024-06-02T23:46:32.519569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761185+0000","last_change":"2024-06-02T23:46:25.728059+0000","last_active":"2024-06-02T23:46:30.761185+0000","last_peered":"2024-06-02T23:46:30.761185+0000","last_clean":"2024-06-02T23:46:30.761185+0000","last_became_active":"2024-06-02T23:46:25.726707+0000","last_became_peered":"2024-06-02T23:46:25.726707+0000","last_unstale":"2024-06-02T23:46:30.761185+0000","last_undegraded":"2024-06-02T23:46:30.761185+0000","last_fullsized":"2024-06-02T23:46:30.761185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:28.357265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520439+0000","last_change":"2024-06-02T23:46:29.751586+0000","last_active":"2024-06-02T23:46:32.520439+0000","last_peered":"2024-06-02T23:46:32.520439+0000","last_clean":"2024-06-02T23:46:32.520439+0000","last_became_active":"2024-06-02T23:46:29.751242+0000","last_became_peered":"2024-06-02T23:46:29.751242+0000","last_unstale":"2024-06-02T23:46:32.520439+0000","last_undegraded":"2024-06-02T23:46:32.520439+0000","last_fullsized":"2024-06-02T23:46:32.520439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:44.019486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519290+0000","last_change":"2024-06-02T23:46:25.724423+0000","last_active":"2024-06-02T23:46:32.519290+0000","last_peered":"2024-06-02T23:46:32.519290+0000","last_clean":"2024-06-02T23:46:32.519290+0000","last_became_active":"2024-06-02T23:46:25.723880+0000","last_became_peered":"2024-06-02T23:46:25.723880+0000","last_unstale":"2024-06-02T23:46:32.519290+0000","last_undegraded":"2024-06-02T23:46:32.519290+0000","last_fullsized":"2024-06-02T23:46:32.519290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760154+0000","last_change":"2024-06-02T23:46:25.733710+0000","last_active":"2024-06-02T23:46:30.760154+0000","last_peered":"2024-06-02T23:46:30.760154+0000","last_clean":"2024-06-02T23:46:30.760154+0000","last_became_active":"2024-06-02T23:46:25.733419+0000","last_became_peered":"2024-06-02T23:46:25.733419+0000","last_unstale":"2024-06-02T23:46:30.760154+0000","last_undegraded":"2024-06-02T23:46:30.760154+0000","last_fullsized":"2024-06-02T23:46:30.760154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:23.259628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020177+0000","last_change":"2024-06-02T23:46:25.732210+0000","last_active":"2024-06-02T23:46:32.020177+0000","last_peered":"2024-06-02T23:46:32.020177+0000","last_clean":"2024-06-02T23:46:32.020177+0000","last_became_active":"2024-06-02T23:46:25.731930+0000","last_became_peered":"2024-06-02T23:46:25.731930+0000","last_unstale":"2024-06-02T23:46:32.020177+0000","last_undegraded":"2024-06-02T23:46:32.020177+0000","last_fullsized":"2024-06-02T23:46:32.020177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520584+0000","last_change":"2024-06-02T23:46:25.733626+0000","last_active":"2024-06-02T23:46:32.520584+0000","last_peered":"2024-06-02T23:46:32.520584+0000","last_clean":"2024-06-02T23:46:32.520584+0000","last_became_active":"2024-06-02T23:46:25.733343+0000","last_became_peered":"2024-06-02T23:46:25.733343+0000","last_unstale":"2024-06-02T23:46:32.520584+0000","last_undegraded":"2024-06-02T23:46:32.520584+0000","last_fullsized":"2024-06-02T23:46:32.520584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520773+0000","last_change":"2024-06-02T23:46:25.730607+0000","last_active":"2024-06-02T23:46:32.520773+0000","last_peered":"2024-06-02T23:46:32.520773+0000","last_clean":"2024-06-02T23:46:32.520773+0000","last_became_active":"2024-06-02T23:46:25.728526+0000","last_became_peered":"2024-06-02T23:46:25.728526+0000","last_unstale":"2024-06-02T23:46:32.520773+0000","last_undegraded":"2024-06-02T23:46:32.520773+0000","last_fullsized":"2024-06-02T23:46:32.520773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520287+0000","last_change":"2024-06-02T23:46:25.732586+0000","last_active":"2024-06-02T23:46:32.520287+0000","last_peered":"2024-06-02T23:46:32.520287+0000","last_clean":"2024-06-02T23:46:32.520287+0000","last_became_active":"2024-06-02T23:46:25.732332+0000","last_became_peered":"2024-06-02T23:46:25.732332+0000","last_unstale":"2024-06-02T23:46:32.520287+0000","last_undegraded":"2024-06-02T23:46:32.520287+0000","last_fullsized":"2024-06-02T23:46:32.520287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520449+0000","last_change":"2024-06-02T23:46:25.726741+0000","last_active":"2024-06-02T23:46:32.520449+0000","last_peered":"2024-06-02T23:46:32.520449+0000","last_clean":"2024-06-02T23:46:32.520449+0000","last_became_active":"2024-06-02T23:46:25.726480+0000","last_became_peered":"2024-06-02T23:46:25.726480+0000","last_unstale":"2024-06-02T23:46:32.520449+0000","last_undegraded":"2024-06-02T23:46:32.520449+0000","last_fullsized":"2024-06-02T23:46:32.520449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519721+0000","last_change":"2024-06-02T23:46:25.732734+0000","last_active":"2024-06-02T23:46:32.519721+0000","last_peered":"2024-06-02T23:46:32.519721+0000","last_clean":"2024-06-02T23:46:32.519721+0000","last_became_active":"2024-06-02T23:46:25.732444+0000","last_became_peered":"2024-06-02T23:46:25.732444+0000","last_unstale":"2024-06-02T23:46:32.519721+0000","last_undegraded":"2024-06-02T23:46:32.519721+0000","last_fullsized":"2024-06-02T23:46:32.519721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019988+0000","last_change":"2024-06-02T23:46:25.733224+0000","last_active":"2024-06-02T23:46:32.019988+0000","last_peered":"2024-06-02T23:46:32.019988+0000","last_clean":"2024-06-02T23:46:32.019988+0000","last_became_active":"2024-06-02T23:46:25.732945+0000","last_became_peered":"2024-06-02T23:46:25.732945+0000","last_unstale":"2024-06-02T23:46:32.019988+0000","last_undegraded":"2024-06-02T23:46:32.019988+0000","last_fullsized":"2024-06-02T23:46:32.019988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520271+0000","last_change":"2024-06-02T23:46:25.727647+0000","last_active":"2024-06-02T23:46:32.520271+0000","last_peered":"2024-06-02T23:46:32.520271+0000","last_clean":"2024-06-02T23:46:32.520271+0000","last_became_active":"2024-06-02T23:46:25.727364+0000","last_became_peered":"2024-06-02T23:46:25.727364+0000","last_unstale":"2024-06-02T23:46:32.520271+0000","last_undegraded":"2024-06-02T23:46:32.520271+0000","last_fullsized":"2024-06-02T23:46:32.520271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020096+0000","last_change":"2024-06-02T23:46:25.727678+0000","last_active":"2024-06-02T23:46:32.020096+0000","last_peered":"2024-06-02T23:46:32.020096+0000","last_clean":"2024-06-02T23:46:32.020096+0000","last_became_active":"2024-06-02T23:46:25.727392+0000","last_became_peered":"2024-06-02T23:46:25.727392+0000","last_unstale":"2024-06-02T23:46:32.020096+0000","last_undegraded":"2024-06-02T23:46:32.020096+0000","last_fullsized":"2024-06-02T23:46:32.020096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519179+0000","last_change":"2024-06-02T23:46:25.722139+0000","last_active":"2024-06-02T23:46:32.519179+0000","last_peered":"2024-06-02T23:46:32.519179+0000","last_clean":"2024-06-02T23:46:32.519179+0000","last_became_active":"2024-06-02T23:46:25.721804+0000","last_became_peered":"2024-06-02T23:46:25.721804+0000","last_unstale":"2024-06-02T23:46:32.519179+0000","last_undegraded":"2024-06-02T23:46:32.519179+0000","last_fullsized":"2024-06-02T23:46:32.519179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519769+0000","last_change":"2024-06-02T23:46:25.728123+0000","last_active":"2024-06-02T23:46:32.519769+0000","last_peered":"2024-06-02T23:46:32.519769+0000","last_clean":"2024-06-02T23:46:32.519769+0000","last_became_active":"2024-06-02T23:46:25.727805+0000","last_became_peered":"2024-06-02T23:46:25.727805+0000","last_unstale":"2024-06-02T23:46:32.519769+0000","last_undegraded":"2024-06-02T23:46:32.519769+0000","last_fullsized":"2024-06-02T23:46:32.519769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520780+0000","last_change":"2024-06-02T23:46:25.735497+0000","last_active":"2024-06-02T23:46:32.520780+0000","last_peered":"2024-06-02T23:46:32.520780+0000","last_clean":"2024-06-02T23:46:32.520780+0000","last_became_active":"2024-06-02T23:46:25.734887+0000","last_became_peered":"2024-06-02T23:46:25.734887+0000","last_unstale":"2024-06-02T23:46:32.520780+0000","last_undegraded":"2024-06-02T23:46:32.520780+0000","last_fullsized":"2024-06-02T23:46:32.520780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:20.812410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760496+0000","last_change":"2024-06-02T23:46:25.734490+0000","last_active":"2024-06-02T23:46:30.760496+0000","last_peered":"2024-06-02T23:46:30.760496+0000","last_clean":"2024-06-02T23:46:30.760496+0000","last_became_active":"2024-06-02T23:46:25.734206+0000","last_became_peered":"2024-06-02T23:46:25.734206+0000","last_unstale":"2024-06-02T23:46:30.760496+0000","last_undegraded":"2024-06-02T23:46:30.760496+0000","last_fullsized":"2024-06-02T23:46:30.760496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:08.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020711+0000","last_change":"2024-06-02T23:46:25.736811+0000","last_active":"2024-06-02T23:46:32.020711+0000","last_peered":"2024-06-02T23:46:32.020711+0000","last_clean":"2024-06-02T23:46:32.020711+0000","last_became_active":"2024-06-02T23:46:25.736568+0000","last_became_peered":"2024-06-02T23:46:25.736568+0000","last_unstale":"2024-06-02T23:46:32.020711+0000","last_undegraded":"2024-06-02T23:46:32.020711+0000","last_fullsized":"2024-06-02T23:46:32.020711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:55.355993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019835+0000","last_change":"2024-06-02T23:46:25.722197+0000","last_active":"2024-06-02T23:46:32.019835+0000","last_peered":"2024-06-02T23:46:32.019835+0000","last_clean":"2024-06-02T23:46:32.019835+0000","last_became_active":"2024-06-02T23:46:25.721911+0000","last_became_peered":"2024-06-02T23:46:25.721911+0000","last_unstale":"2024-06-02T23:46:32.019835+0000","last_undegraded":"2024-06-02T23:46:32.019835+0000","last_fullsized":"2024-06-02T23:46:32.019835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518775+0000","last_change":"2024-06-02T23:46:25.727178+0000","last_active":"2024-06-02T23:46:32.518775+0000","last_peered":"2024-06-02T23:46:32.518775+0000","last_clean":"2024-06-02T23:46:32.518775+0000","last_became_active":"2024-06-02T23:46:25.726888+0000","last_became_peered":"2024-06-02T23:46:25.726888+0000","last_unstale":"2024-06-02T23:46:32.518775+0000","last_undegraded":"2024-06-02T23:46:32.518775+0000","last_fullsized":"2024-06-02T23:46:32.518775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519434+0000","last_change":"2024-06-02T23:46:25.725940+0000","last_active":"2024-06-02T23:46:32.519434+0000","last_peered":"2024-06-02T23:46:32.519434+0000","last_clean":"2024-06-02T23:46:32.519434+0000","last_became_active":"2024-06-02T23:46:25.725534+0000","last_became_peered":"2024-06-02T23:46:25.725534+0000","last_unstale":"2024-06-02T23:46:32.519434+0000","last_undegraded":"2024-06-02T23:46:32.519434+0000","last_fullsized":"2024-06-02T23:46:32.519434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:32.885581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519416+0000","last_change":"2024-06-02T23:46:25.730569+0000","last_active":"2024-06-02T23:46:32.519416+0000","last_peered":"2024-06-02T23:46:32.519416+0000","last_clean":"2024-06-02T23:46:32.519416+0000","last_became_active":"2024-06-02T23:46:25.728481+0000","last_became_peered":"2024-06-02T23:46:25.728481+0000","last_unstale":"2024-06-02T23:46:32.519416+0000","last_undegraded":"2024-06-02T23:46:32.519416+0000","last_fullsized":"2024-06-02T23:46:32.519416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761074+0000","last_change":"2024-06-02T23:46:25.730619+0000","last_active":"2024-06-02T23:46:30.761074+0000","last_peered":"2024-06-02T23:46:30.761074+0000","last_clean":"2024-06-02T23:46:30.761074+0000","last_became_active":"2024-06-02T23:46:25.730319+0000","last_became_peered":"2024-06-02T23:46:25.730319+0000","last_unstale":"2024-06-02T23:46:30.761074+0000","last_undegraded":"2024-06-02T23:46:30.761074+0000","last_fullsized":"2024-06-02T23:46:30.761074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:08.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520090+0000","last_change":"2024-06-02T23:46:25.733651+0000","last_active":"2024-06-02T23:46:32.520090+0000","last_peered":"2024-06-02T23:46:32.520090+0000","last_clean":"2024-06-02T23:46:32.520090+0000","last_became_active":"2024-06-02T23:46:25.733349+0000","last_became_peered":"2024-06-02T23:46:25.733349+0000","last_unstale":"2024-06-02T23:46:32.520090+0000","last_undegraded":"2024-06-02T23:46:32.520090+0000","last_fullsized":"2024-06-02T23:46:32.520090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520283+0000","last_change":"2024-06-02T23:46:25.727878+0000","last_active":"2024-06-02T23:46:32.520283+0000","last_peered":"2024-06-02T23:46:32.520283+0000","last_clean":"2024-06-02T23:46:32.520283+0000","last_became_active":"2024-06-02T23:46:25.727594+0000","last_became_peered":"2024-06-02T23:46:25.727594+0000","last_unstale":"2024-06-02T23:46:32.520283+0000","last_undegraded":"2024-06-02T23:46:32.520283+0000","last_fullsized":"2024-06-02T23:46:32.520283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520435+0000","last_change":"2024-06-02T23:46:25.734791+0000","last_active":"2024-06-02T23:46:32.520435+0000","last_peered":"2024-06-02T23:46:32.520435+0000","last_clean":"2024-06-02T23:46:32.520435+0000","last_became_active":"2024-06-02T23:46:25.734514+0000","last_became_peered":"2024-06-02T23:46:25.734514+0000","last_unstale":"2024-06-02T23:46:32.520435+0000","last_undegraded":"2024-06-02T23:46:32.520435+0000","last_fullsized":"2024-06-02T23:46:32.520435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:09.854508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519886+0000","last_change":"2024-06-02T23:46:25.736896+0000","last_active":"2024-06-02T23:46:32.519886+0000","last_peered":"2024-06-02T23:46:32.519886+0000","last_clean":"2024-06-02T23:46:32.519886+0000","last_became_active":"2024-06-02T23:46:25.736216+0000","last_became_peered":"2024-06-02T23:46:25.736216+0000","last_unstale":"2024-06-02T23:46:32.519886+0000","last_undegraded":"2024-06-02T23:46:32.519886+0000","last_fullsized":"2024-06-02T23:46:32.519886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:10.751775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519694+0000","last_change":"2024-06-02T23:46:25.723384+0000","last_active":"2024-06-02T23:46:32.519694+0000","last_peered":"2024-06-02T23:46:32.519694+0000","last_clean":"2024-06-02T23:46:32.519694+0000","last_became_active":"2024-06-02T23:46:25.722938+0000","last_became_peered":"2024-06-02T23:46:25.722938+0000","last_unstale":"2024-06-02T23:46:32.519694+0000","last_undegraded":"2024-06-02T23:46:32.519694+0000","last_fullsized":"2024-06-02T23:46:32.519694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020020+0000","last_change":"2024-06-02T23:46:25.729629+0000","last_active":"2024-06-02T23:46:32.020020+0000","last_peered":"2024-06-02T23:46:32.020020+0000","last_clean":"2024-06-02T23:46:32.020020+0000","last_became_active":"2024-06-02T23:46:25.729363+0000","last_became_peered":"2024-06-02T23:46:25.729363+0000","last_unstale":"2024-06-02T23:46:32.020020+0000","last_undegraded":"2024-06-02T23:46:32.020020+0000","last_fullsized":"2024-06-02T23:46:32.020020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520515+0000","last_change":"2024-06-02T23:46:25.734931+0000","last_active":"2024-06-02T23:46:32.520515+0000","last_peered":"2024-06-02T23:46:32.520515+0000","last_clean":"2024-06-02T23:46:32.520515+0000","last_became_active":"2024-06-02T23:46:25.734577+0000","last_became_peered":"2024-06-02T23:46:25.734577+0000","last_unstale":"2024-06-02T23:46:32.520515+0000","last_undegraded":"2024-06-02T23:46:32.520515+0000","last_fullsized":"2024-06-02T23:46:32.520515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:06.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020302+0000","last_change":"2024-06-02T23:46:25.732610+0000","last_active":"2024-06-02T23:46:32.020302+0000","last_peered":"2024-06-02T23:46:32.020302+0000","last_clean":"2024-06-02T23:46:32.020302+0000","last_became_active":"2024-06-02T23:46:25.731714+0000","last_became_peered":"2024-06-02T23:46:25.731714+0000","last_unstale":"2024-06-02T23:46:32.020302+0000","last_undegraded":"2024-06-02T23:46:32.020302+0000","last_fullsized":"2024-06-02T23:46:32.020302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519731+0000","last_change":"2024-06-02T23:46:25.729533+0000","last_active":"2024-06-02T23:46:32.519731+0000","last_peered":"2024-06-02T23:46:32.519731+0000","last_clean":"2024-06-02T23:46:32.519731+0000","last_became_active":"2024-06-02T23:46:25.729234+0000","last_became_peered":"2024-06-02T23:46:25.729234+0000","last_unstale":"2024-06-02T23:46:32.519731+0000","last_undegraded":"2024-06-02T23:46:32.519731+0000","last_fullsized":"2024-06-02T23:46:32.519731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519199+0000","last_change":"2024-06-02T23:46:25.727031+0000","last_active":"2024-06-02T23:46:32.519199+0000","last_peered":"2024-06-02T23:46:32.519199+0000","last_clean":"2024-06-02T23:46:32.519199+0000","last_became_active":"2024-06-02T23:46:25.726700+0000","last_became_peered":"2024-06-02T23:46:25.726700+0000","last_unstale":"2024-06-02T23:46:32.519199+0000","last_undegraded":"2024-06-02T23:46:32.519199+0000","last_fullsized":"2024-06-02T23:46:32.519199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520212+0000","last_change":"2024-06-02T23:46:25.731930+0000","last_active":"2024-06-02T23:46:32.520212+0000","last_peered":"2024-06-02T23:46:32.520212+0000","last_clean":"2024-06-02T23:46:32.520212+0000","last_became_active":"2024-06-02T23:46:25.730679+0000","last_became_peered":"2024-06-02T23:46:25.730679+0000","last_unstale":"2024-06-02T23:46:32.520212+0000","last_undegraded":"2024-06-02T23:46:32.520212+0000","last_fullsized":"2024-06-02T23:46:32.520212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:12.887235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:46:45.802 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:46:45.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.937+0000 7f202446b640 1 Processor -- start 2024-06-02T23:46:45.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.937+0000 7f202446b640 1 -- start start 2024-06-02T23:46:45.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.938+0000 7f202446b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f201c161900 0x7f201c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.938+0000 7f202446b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f201c0b5510 0x7f201c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.938+0000 7f202446b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f201c0d4a90 con 0x7f201c0b4fa0 2024-06-02T23:46:45.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.938+0000 7f202446b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f201c0cf5c0 con 0x7f201c161900 2024-06-02T23:46:45.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.938+0000 7f202446b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f201c0caf70 con 0x7f201c0b5510 2024-06-02T23:46:45.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.938+0000 7f2022207640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f201c161900 0x7f201c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.938+0000 7f2022a08640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f201c0b4fa0 0x7f201c0d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39862/0 (socket says 172.21.15.96:39862) 2024-06-02T23:46:45.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.938+0000 7f2022a08640 1 -- 172.21.15.96:0/2755947585 learned_addr learned my addr 172.21.15.96:0/2755947585 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:45.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.938+0000 7f2022207640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f201c161900 0x7f201c0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54620/0 (socket says 172.21.15.96:54620) 2024-06-02T23:46:45.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.939+0000 7f2021a06640 1 --2- 172.21.15.96:0/2755947585 >> v2:172.21.15.162:3300/0 conn(0x7f201c0b5510 0x7f201c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.939+0000 7f2022207640 1 -- 172.21.15.96:0/2755947585 >> v2:172.21.15.162:3300/0 conn(0x7f201c0b5510 msgr2=0x7f201c0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:45.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.939+0000 7f2022207640 1 --2- 172.21.15.96:0/2755947585 >> v2:172.21.15.162:3300/0 conn(0x7f201c0b5510 0x7f201c0d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.939+0000 7f2022207640 1 -- 172.21.15.96:0/2755947585 >> v1:172.21.15.96:6789/0 conn(0x7f201c0b4fa0 legacy=0x7f201c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.939+0000 7f2021205640 1 -- 172.21.15.96:0/2755947585 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285790109 0 0) 0x7f201c0d4a90 con 0x7f201c0b4fa0 2024-06-02T23:46:45.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.939+0000 7f2022207640 1 -- 172.21.15.96:0/2755947585 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c0d4d70 con 0x7f201c161900 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.940+0000 7f2022207640 1 --2- 172.21.15.96:0/2755947585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 0x7f201c0d0a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f201c08cc50 tx=0x7f200c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9123f6f35beddb3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.940+0000 7f2021205640 1 -- 172.21.15.96:0/2755947585 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c037070 con 0x7f201c161900 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.940+0000 7f2021205640 1 -- 172.21.15.96:0/2755947585 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f200c032440 con 0x7f201c161900 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.940+0000 7f2021205640 1 -- 172.21.15.96:0/2755947585 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c02ae60 con 0x7f201c161900 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.940+0000 7f202446b640 1 -- 172.21.15.96:0/2755947585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 msgr2=0x7f201c0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.940+0000 7f202446b640 1 --2- 172.21.15.96:0/2755947585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 0x7f201c0d0a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f201c08cc50 tx=0x7f200c02a110 comp rx=0 tx=0).stop 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.941+0000 7f202446b640 1 -- 172.21.15.96:0/2755947585 shutdown_connections 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.941+0000 7f202446b640 1 --2- 172.21.15.96:0/2755947585 >> v2:172.21.15.162:3300/0 conn(0x7f201c0b5510 0x7f201c0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.941+0000 7f202446b640 1 --2- 172.21.15.96:0/2755947585 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 0x7f201c0d0a10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.941+0000 7f202446b640 1 -- 172.21.15.96:0/2755947585 >> 172.21.15.96:0/2755947585 conn(0x7f201c09d3b0 msgr2=0x7f201c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:45.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.941+0000 7f202446b640 1 -- 172.21.15.96:0/2755947585 shutdown_connections 2024-06-02T23:46:45.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.941+0000 7f202446b640 1 -- 172.21.15.96:0/2755947585 wait complete. 2024-06-02T23:46:45.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.942+0000 7f202446b640 1 Processor -- start 2024-06-02T23:46:45.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.942+0000 7f202446b640 1 -- start start 2024-06-02T23:46:45.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.942+0000 7f202446b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f201c0b4fa0 0x7f201c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f202446b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0b5510 0x7f201c0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f202446b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 0x7f201c0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f202446b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f201c0d4780 con 0x7f201c161900 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f202446b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f201c0cfae0 con 0x7f201c0b5510 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f202446b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f201c161ce0 con 0x7f201c0b4fa0 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2022a08640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 0x7f201c0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2022a08640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 0x7f201c0ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54626/0 (socket says 172.21.15.96:54626) 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2022a08640 1 -- 172.21.15.96:0/1250842416 learned_addr learned my addr 172.21.15.96:0/1250842416 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2021a06640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0b5510 0x7f201c0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2022207640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f201c0b4fa0 0x7f201c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2022a08640 1 -- 172.21.15.96:0/1250842416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f201c0b4fa0 msgr2=0x7f201c1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2022a08640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f201c0b4fa0 0x7f201c1551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2022a08640 1 -- 172.21.15.96:0/1250842416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0b5510 msgr2=0x7f201c0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2022a08640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0b5510 0x7f201c0c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2022a08640 1 -- 172.21.15.96:0/1250842416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c155a20 con 0x7f201c161900 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2021a06640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0b5510 0x7f201c0c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2022a08640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 0x7f201c0ccd80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f201400c7a0 tx=0x7f201400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2012ffd640 1 -- 172.21.15.96:0/1250842416 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014018070 con 0x7f201c161900 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2012ffd640 1 -- 172.21.15.96:0/1250842416 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201400a640 con 0x7f201c161900 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f202446b640 1 -- 172.21.15.96:0/1250842416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c155d00 con 0x7f201c161900 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f2012ffd640 1 -- 172.21.15.96:0/1250842416 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201400aa70 con 0x7f201c161900 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.943+0000 7f202446b640 1 -- 172.21.15.96:0/1250842416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c155710 con 0x7f201c161900 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.944+0000 7f202446b640 1 -- 172.21.15.96:0/1250842416 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f201c0683e0 con 0x7f201c161900 2024-06-02T23:46:45.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.945+0000 7f2012ffd640 1 -- 172.21.15.96:0/1250842416 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f201400ac10 con 0x7f201c161900 2024-06-02T23:46:45.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.945+0000 7f2012ffd640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f200006be30 0x7f200006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:45.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.945+0000 7f2012ffd640 1 -- 172.21.15.96:0/1250842416 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f201408a910 con 0x7f201c161900 2024-06-02T23:46:45.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.945+0000 7f2022207640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f200006be30 0x7f200006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:45.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.946+0000 7f2022207640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f200006be30 0x7f200006e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f200c034000 tx=0x7f200c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:45.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:45.950+0000 7f2012ffd640 1 -- 172.21.15.96:0/1250842416 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2014058f00 con 0x7f201c161900 2024-06-02T23:46:46.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.129+0000 7f202446b640 1 -- 172.21.15.96:0/1250842416 --> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f201c156e20 con 0x7f200006be30 2024-06-02T23:46:46.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.136+0000 7f2012ffd640 1 -- 172.21.15.96:0/1250842416 <== mgr.4113 v2:172.21.15.96:6832/1776728888 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f201c156e20 con 0x7f200006be30 2024-06-02T23:46:46.140 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:46.142 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:46:46.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 -- 172.21.15.96:0/1250842416 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f200006be30 msgr2=0x7f200006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f200006be30 0x7f200006e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f200c034000 tx=0x7f200c02e000 comp rx=0 tx=0).stop 2024-06-02T23:46:46.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 -- 172.21.15.96:0/1250842416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 msgr2=0x7f201c0ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 0x7f201c0ccd80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f201400c7a0 tx=0x7f201400cc60 comp rx=0 tx=0).stop 2024-06-02T23:46:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 -- 172.21.15.96:0/1250842416 shutdown_connections 2024-06-02T23:46:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f200006be30 0x7f200006e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f201c161900 0x7f201c0ccd80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0b5510 0x7f201c0c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 --2- 172.21.15.96:0/1250842416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f201c0b4fa0 0x7f201c1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 -- 172.21.15.96:0/1250842416 >> 172.21.15.96:0/1250842416 conn(0x7f201c09d3b0 msgr2=0x7f201c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 -- 172.21.15.96:0/1250842416 shutdown_connections 2024-06-02T23:46:46.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.140+0000 7f202446b640 1 -- 172.21.15.96:0/1250842416 wait complete. 2024-06-02T23:46:46.151 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-06-02T23:46:45.998177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002362"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519975+0000","last_change":"2024-06-02T23:46:24.723386+0000","last_active":"2024-06-02T23:46:32.519975+0000","last_peered":"2024-06-02T23:46:32.519975+0000","last_clean":"2024-06-02T23:46:32.519975+0000","last_became_active":"2024-06-02T23:46:24.723072+0000","last_became_peered":"2024-06-02T23:46:24.723072+0000","last_unstale":"2024-06-02T23:46:32.519975+0000","last_undegraded":"2024-06-02T23:46:32.519975+0000","last_fullsized":"2024-06-02T23:46:32.519975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:58.156345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519324+0000","last_change":"2024-06-02T23:46:25.728192+0000","last_active":"2024-06-02T23:46:32.519324+0000","last_peered":"2024-06-02T23:46:32.519324+0000","last_clean":"2024-06-02T23:46:32.519324+0000","last_became_active":"2024-06-02T23:46:25.727880+0000","last_became_peered":"2024-06-02T23:46:25.727880+0000","last_unstale":"2024-06-02T23:46:32.519324+0000","last_undegraded":"2024-06-02T23:46:32.519324+0000","last_fullsized":"2024-06-02T23:46:32.519324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519956+0000","last_change":"2024-06-02T23:46:30.061087+0000","last_active":"2024-06-02T23:46:32.519956+0000","last_peered":"2024-06-02T23:46:32.519956+0000","last_clean":"2024-06-02T23:46:32.519956+0000","last_became_active":"2024-06-02T23:46:30.060610+0000","last_became_peered":"2024-06-02T23:46:30.060610+0000","last_unstale":"2024-06-02T23:46:32.519956+0000","last_undegraded":"2024-06-02T23:46:32.519956+0000","last_fullsized":"2024-06-02T23:46:32.519956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:12:13.834338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519480+0000","last_change":"2024-06-02T23:46:24.719079+0000","last_active":"2024-06-02T23:46:32.519480+0000","last_peered":"2024-06-02T23:46:32.519480+0000","last_clean":"2024-06-02T23:46:32.519480+0000","last_became_active":"2024-06-02T23:46:24.718645+0000","last_became_peered":"2024-06-02T23:46:24.718645+0000","last_unstale":"2024-06-02T23:46:32.519480+0000","last_undegraded":"2024-06-02T23:46:32.519480+0000","last_fullsized":"2024-06-02T23:46:32.519480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:58.156345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519654+0000","last_change":"2024-06-02T23:46:25.726015+0000","last_active":"2024-06-02T23:46:32.519654+0000","last_peered":"2024-06-02T23:46:32.519654+0000","last_clean":"2024-06-02T23:46:32.519654+0000","last_became_active":"2024-06-02T23:46:25.725730+0000","last_became_peered":"2024-06-02T23:46:25.725730+0000","last_unstale":"2024-06-02T23:46:32.519654+0000","last_undegraded":"2024-06-02T23:46:32.519654+0000","last_fullsized":"2024-06-02T23:46:32.519654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:10.751775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761052+0000","last_change":"2024-06-02T23:46:29.747259+0000","last_active":"2024-06-02T23:46:30.761052+0000","last_peered":"2024-06-02T23:46:30.761052+0000","last_clean":"2024-06-02T23:46:30.761052+0000","last_became_active":"2024-06-02T23:46:29.746814+0000","last_became_peered":"2024-06-02T23:46:29.746814+0000","last_unstale":"2024-06-02T23:46:30.761052+0000","last_undegraded":"2024-06-02T23:46:30.761052+0000","last_fullsized":"2024-06-02T23:46:30.761052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:16.913415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520719+0000","last_change":"2024-06-02T23:46:24.728181+0000","last_active":"2024-06-02T23:46:32.520719+0000","last_peered":"2024-06-02T23:46:32.520719+0000","last_clean":"2024-06-02T23:46:32.520719+0000","last_became_active":"2024-06-02T23:46:24.727842+0000","last_became_peered":"2024-06-02T23:46:24.727842+0000","last_unstale":"2024-06-02T23:46:32.520719+0000","last_undegraded":"2024-06-02T23:46:32.520719+0000","last_fullsized":"2024-06-02T23:46:32.520719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020341+0000","last_change":"2024-06-02T23:46:25.725271+0000","last_active":"2024-06-02T23:46:32.020341+0000","last_peered":"2024-06-02T23:46:32.020341+0000","last_clean":"2024-06-02T23:46:32.020341+0000","last_became_active":"2024-06-02T23:46:25.725021+0000","last_became_peered":"2024-06-02T23:46:25.725021+0000","last_unstale":"2024-06-02T23:46:32.020341+0000","last_undegraded":"2024-06-02T23:46:32.020341+0000","last_fullsized":"2024-06-02T23:46:32.020341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:06.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760977+0000","last_change":"2024-06-02T23:46:29.747360+0000","last_active":"2024-06-02T23:46:30.760977+0000","last_peered":"2024-06-02T23:46:30.760977+0000","last_clean":"2024-06-02T23:46:30.760977+0000","last_became_active":"2024-06-02T23:46:29.746711+0000","last_became_peered":"2024-06-02T23:46:29.746711+0000","last_unstale":"2024-06-02T23:46:30.760977+0000","last_undegraded":"2024-06-02T23:46:30.760977+0000","last_fullsized":"2024-06-02T23:46:30.760977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:13.880688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519706+0000","last_change":"2024-06-02T23:46:24.728315+0000","last_active":"2024-06-02T23:46:32.519706+0000","last_peered":"2024-06-02T23:46:32.519706+0000","last_clean":"2024-06-02T23:46:32.519706+0000","last_became_active":"2024-06-02T23:46:24.728035+0000","last_became_peered":"2024-06-02T23:46:24.728035+0000","last_unstale":"2024-06-02T23:46:32.519706+0000","last_undegraded":"2024-06-02T23:46:32.519706+0000","last_fullsized":"2024-06-02T23:46:32.519706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020395+0000","last_change":"2024-06-02T23:46:25.725814+0000","last_active":"2024-06-02T23:46:32.020395+0000","last_peered":"2024-06-02T23:46:32.020395+0000","last_clean":"2024-06-02T23:46:32.020395+0000","last_became_active":"2024-06-02T23:46:25.725542+0000","last_became_peered":"2024-06-02T23:46:25.725542+0000","last_unstale":"2024-06-02T23:46:32.020395+0000","last_undegraded":"2024-06-02T23:46:32.020395+0000","last_fullsized":"2024-06-02T23:46:32.020395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:37.017923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760812+0000","last_change":"2024-06-02T23:46:29.748045+0000","last_active":"2024-06-02T23:46:30.760812+0000","last_peered":"2024-06-02T23:46:30.760812+0000","last_clean":"2024-06-02T23:46:30.760812+0000","last_became_active":"2024-06-02T23:46:29.747638+0000","last_became_peered":"2024-06-02T23:46:29.747638+0000","last_unstale":"2024-06-02T23:46:30.760812+0000","last_undegraded":"2024-06-02T23:46:30.760812+0000","last_fullsized":"2024-06-02T23:46:30.760812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:47.634910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520308+0000","last_change":"2024-06-02T23:46:25.724610+0000","last_active":"2024-06-02T23:46:32.520308+0000","last_peered":"2024-06-02T23:46:32.520308+0000","last_clean":"2024-06-02T23:46:32.520308+0000","last_became_active":"2024-06-02T23:46:25.724361+0000","last_became_peered":"2024-06-02T23:46:25.724361+0000","last_unstale":"2024-06-02T23:46:32.520308+0000","last_undegraded":"2024-06-02T23:46:32.520308+0000","last_fullsized":"2024-06-02T23:46:32.520308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520766+0000","last_change":"2024-06-02T23:46:24.725027+0000","last_active":"2024-06-02T23:46:32.520766+0000","last_peered":"2024-06-02T23:46:32.520766+0000","last_clean":"2024-06-02T23:46:32.520766+0000","last_became_active":"2024-06-02T23:46:24.724691+0000","last_became_peered":"2024-06-02T23:46:24.724691+0000","last_unstale":"2024-06-02T23:46:32.520766+0000","last_undegraded":"2024-06-02T23:46:32.520766+0000","last_fullsized":"2024-06-02T23:46:32.520766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:07.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761401+0000","last_change":"2024-06-02T23:46:29.750805+0000","last_active":"2024-06-02T23:46:30.761401+0000","last_peered":"2024-06-02T23:46:30.761401+0000","last_clean":"2024-06-02T23:46:30.761401+0000","last_became_active":"2024-06-02T23:46:29.750392+0000","last_became_peered":"2024-06-02T23:46:29.750392+0000","last_unstale":"2024-06-02T23:46:30.761401+0000","last_undegraded":"2024-06-02T23:46:30.761401+0000","last_fullsized":"2024-06-02T23:46:30.761401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519491+0000","last_change":"2024-06-02T23:46:25.730928+0000","last_active":"2024-06-02T23:46:32.519491+0000","last_peered":"2024-06-02T23:46:32.519491+0000","last_clean":"2024-06-02T23:46:32.519491+0000","last_became_active":"2024-06-02T23:46:25.730035+0000","last_became_peered":"2024-06-02T23:46:25.730035+0000","last_unstale":"2024-06-02T23:46:32.519491+0000","last_undegraded":"2024-06-02T23:46:32.519491+0000","last_fullsized":"2024-06-02T23:46:32.519491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519486+0000","last_change":"2024-06-02T23:46:24.726529+0000","last_active":"2024-06-02T23:46:32.519486+0000","last_peered":"2024-06-02T23:46:32.519486+0000","last_clean":"2024-06-02T23:46:32.519486+0000","last_became_active":"2024-06-02T23:46:24.726263+0000","last_became_peered":"2024-06-02T23:46:24.726263+0000","last_unstale":"2024-06-02T23:46:32.519486+0000","last_undegraded":"2024-06-02T23:46:32.519486+0000","last_fullsized":"2024-06-02T23:46:32.519486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:22.253427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760795+0000","last_change":"2024-06-02T23:46:29.747195+0000","last_active":"2024-06-02T23:46:30.760795+0000","last_peered":"2024-06-02T23:46:30.760795+0000","last_clean":"2024-06-02T23:46:30.760795+0000","last_became_active":"2024-06-02T23:46:29.746715+0000","last_became_peered":"2024-06-02T23:46:29.746715+0000","last_unstale":"2024-06-02T23:46:30.760795+0000","last_undegraded":"2024-06-02T23:46:30.760795+0000","last_fullsized":"2024-06-02T23:46:30.760795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:48.919181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520156+0000","last_change":"2024-06-02T23:46:25.730204+0000","last_active":"2024-06-02T23:46:32.520156+0000","last_peered":"2024-06-02T23:46:32.520156+0000","last_clean":"2024-06-02T23:46:32.520156+0000","last_became_active":"2024-06-02T23:46:25.728660+0000","last_became_peered":"2024-06-02T23:46:25.728660+0000","last_unstale":"2024-06-02T23:46:32.520156+0000","last_undegraded":"2024-06-02T23:46:32.520156+0000","last_fullsized":"2024-06-02T23:46:32.520156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518837+0000","last_change":"2024-06-02T23:46:24.725743+0000","last_active":"2024-06-02T23:46:32.518837+0000","last_peered":"2024-06-02T23:46:32.518837+0000","last_clean":"2024-06-02T23:46:32.518837+0000","last_became_active":"2024-06-02T23:46:24.725418+0000","last_became_peered":"2024-06-02T23:46:24.725418+0000","last_unstale":"2024-06-02T23:46:32.518837+0000","last_undegraded":"2024-06-02T23:46:32.518837+0000","last_fullsized":"2024-06-02T23:46:32.518837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:07.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520044+0000","last_change":"2024-06-02T23:46:30.062502+0000","last_active":"2024-06-02T23:46:32.520044+0000","last_peered":"2024-06-02T23:46:32.520044+0000","last_clean":"2024-06-02T23:46:32.520044+0000","last_became_active":"2024-06-02T23:46:30.062168+0000","last_became_peered":"2024-06-02T23:46:30.062168+0000","last_unstale":"2024-06-02T23:46:32.520044+0000","last_undegraded":"2024-06-02T23:46:32.520044+0000","last_fullsized":"2024-06-02T23:46:32.520044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:15.508248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761606+0000","last_change":"2024-06-02T23:46:25.729672+0000","last_active":"2024-06-02T23:46:30.761606+0000","last_peered":"2024-06-02T23:46:30.761606+0000","last_clean":"2024-06-02T23:46:30.761606+0000","last_became_active":"2024-06-02T23:46:25.729405+0000","last_became_peered":"2024-06-02T23:46:25.729405+0000","last_unstale":"2024-06-02T23:46:30.761606+0000","last_undegraded":"2024-06-02T23:46:30.761606+0000","last_fullsized":"2024-06-02T23:46:30.761606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:21.812182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519444+0000","last_change":"2024-06-02T23:46:24.725037+0000","last_active":"2024-06-02T23:46:32.519444+0000","last_peered":"2024-06-02T23:46:32.519444+0000","last_clean":"2024-06-02T23:46:32.519444+0000","last_became_active":"2024-06-02T23:46:24.724705+0000","last_became_peered":"2024-06-02T23:46:24.724705+0000","last_unstale":"2024-06-02T23:46:32.519444+0000","last_undegraded":"2024-06-02T23:46:32.519444+0000","last_fullsized":"2024-06-02T23:46:32.519444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760969+0000","last_change":"2024-06-02T23:46:29.745875+0000","last_active":"2024-06-02T23:46:30.760969+0000","last_peered":"2024-06-02T23:46:30.760969+0000","last_clean":"2024-06-02T23:46:30.760969+0000","last_became_active":"2024-06-02T23:46:29.745417+0000","last_became_peered":"2024-06-02T23:46:29.745417+0000","last_unstale":"2024-06-02T23:46:30.760969+0000","last_undegraded":"2024-06-02T23:46:30.760969+0000","last_fullsized":"2024-06-02T23:46:30.760969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:52.536406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520531+0000","last_change":"2024-06-02T23:46:25.726449+0000","last_active":"2024-06-02T23:46:32.520531+0000","last_peered":"2024-06-02T23:46:32.520531+0000","last_clean":"2024-06-02T23:46:32.520531+0000","last_became_active":"2024-06-02T23:46:25.725878+0000","last_became_peered":"2024-06-02T23:46:25.725878+0000","last_unstale":"2024-06-02T23:46:32.520531+0000","last_undegraded":"2024-06-02T23:46:32.520531+0000","last_fullsized":"2024-06-02T23:46:32.520531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520174+0000","last_change":"2024-06-02T23:46:24.723537+0000","last_active":"2024-06-02T23:46:32.520174+0000","last_peered":"2024-06-02T23:46:32.520174+0000","last_clean":"2024-06-02T23:46:32.520174+0000","last_became_active":"2024-06-02T23:46:24.723258+0000","last_became_peered":"2024-06-02T23:46:24.723258+0000","last_unstale":"2024-06-02T23:46:32.520174+0000","last_undegraded":"2024-06-02T23:46:32.520174+0000","last_fullsized":"2024-06-02T23:46:32.520174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760721+0000","last_change":"2024-06-02T23:46:30.059389+0000","last_active":"2024-06-02T23:46:30.760721+0000","last_peered":"2024-06-02T23:46:30.760721+0000","last_clean":"2024-06-02T23:46:30.760721+0000","last_became_active":"2024-06-02T23:46:30.058909+0000","last_became_peered":"2024-06-02T23:46:30.058909+0000","last_unstale":"2024-06-02T23:46:30.760721+0000","last_undegraded":"2024-06-02T23:46:30.760721+0000","last_fullsized":"2024-06-02T23:46:30.760721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:24.838590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519819+0000","last_change":"2024-06-02T23:46:25.738807+0000","last_active":"2024-06-02T23:46:32.519819+0000","last_peered":"2024-06-02T23:46:32.519819+0000","last_clean":"2024-06-02T23:46:32.519819+0000","last_became_active":"2024-06-02T23:46:25.738552+0000","last_became_peered":"2024-06-02T23:46:25.738552+0000","last_unstale":"2024-06-02T23:46:32.519819+0000","last_undegraded":"2024-06-02T23:46:32.519819+0000","last_fullsized":"2024-06-02T23:46:32.519819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519426+0000","last_change":"2024-06-02T23:46:24.717509+0000","last_active":"2024-06-02T23:46:32.519426+0000","last_peered":"2024-06-02T23:46:32.519426+0000","last_clean":"2024-06-02T23:46:32.519426+0000","last_became_active":"2024-06-02T23:46:24.716726+0000","last_became_peered":"2024-06-02T23:46:24.716726+0000","last_unstale":"2024-06-02T23:46:32.519426+0000","last_undegraded":"2024-06-02T23:46:32.519426+0000","last_fullsized":"2024-06-02T23:46:32.519426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520004+0000","last_change":"2024-06-02T23:46:30.060386+0000","last_active":"2024-06-02T23:46:32.520004+0000","last_peered":"2024-06-02T23:46:32.520004+0000","last_clean":"2024-06-02T23:46:32.520004+0000","last_became_active":"2024-06-02T23:46:30.058822+0000","last_became_peered":"2024-06-02T23:46:30.058822+0000","last_unstale":"2024-06-02T23:46:32.520004+0000","last_undegraded":"2024-06-02T23:46:32.520004+0000","last_fullsized":"2024-06-02T23:46:32.520004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:33.045570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521240+0000","last_change":"2024-06-02T23:46:25.735259+0000","last_active":"2024-06-02T23:46:32.521240+0000","last_peered":"2024-06-02T23:46:32.521240+0000","last_clean":"2024-06-02T23:46:32.521240+0000","last_became_active":"2024-06-02T23:46:25.734998+0000","last_became_peered":"2024-06-02T23:46:25.734998+0000","last_unstale":"2024-06-02T23:46:32.521240+0000","last_undegraded":"2024-06-02T23:46:32.521240+0000","last_fullsized":"2024-06-02T23:46:32.521240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520831+0000","last_change":"2024-06-02T23:46:24.725043+0000","last_active":"2024-06-02T23:46:32.520831+0000","last_peered":"2024-06-02T23:46:32.520831+0000","last_clean":"2024-06-02T23:46:32.520831+0000","last_became_active":"2024-06-02T23:46:24.724672+0000","last_became_peered":"2024-06-02T23:46:24.724672+0000","last_unstale":"2024-06-02T23:46:32.520831+0000","last_undegraded":"2024-06-02T23:46:32.520831+0000","last_fullsized":"2024-06-02T23:46:32.520831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:22.253427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519079+0000","last_change":"2024-06-02T23:46:30.061769+0000","last_active":"2024-06-02T23:46:32.519079+0000","last_peered":"2024-06-02T23:46:32.519079+0000","last_clean":"2024-06-02T23:46:32.519079+0000","last_became_active":"2024-06-02T23:46:30.061381+0000","last_became_peered":"2024-06-02T23:46:30.061381+0000","last_unstale":"2024-06-02T23:46:32.519079+0000","last_undegraded":"2024-06-02T23:46:32.519079+0000","last_fullsized":"2024-06-02T23:46:32.519079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020522+0000","last_change":"2024-06-02T23:46:25.733026+0000","last_active":"2024-06-02T23:46:32.020522+0000","last_peered":"2024-06-02T23:46:32.020522+0000","last_clean":"2024-06-02T23:46:32.020522+0000","last_became_active":"2024-06-02T23:46:25.732637+0000","last_became_peered":"2024-06-02T23:46:25.732637+0000","last_unstale":"2024-06-02T23:46:32.020522+0000","last_undegraded":"2024-06-02T23:46:32.020522+0000","last_fullsized":"2024-06-02T23:46:32.020522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:20.812410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521321+0000","last_change":"2024-06-02T23:46:24.725276+0000","last_active":"2024-06-02T23:46:32.521321+0000","last_peered":"2024-06-02T23:46:32.521321+0000","last_clean":"2024-06-02T23:46:32.521321+0000","last_became_active":"2024-06-02T23:46:24.725003+0000","last_became_peered":"2024-06-02T23:46:24.725003+0000","last_unstale":"2024-06-02T23:46:32.521321+0000","last_undegraded":"2024-06-02T23:46:32.521321+0000","last_fullsized":"2024-06-02T23:46:32.521321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519089+0000","last_change":"2024-06-02T23:46:29.748270+0000","last_active":"2024-06-02T23:46:32.519089+0000","last_peered":"2024-06-02T23:46:32.519089+0000","last_clean":"2024-06-02T23:46:32.519089+0000","last_became_active":"2024-06-02T23:46:29.746100+0000","last_became_peered":"2024-06-02T23:46:29.746100+0000","last_unstale":"2024-06-02T23:46:32.519089+0000","last_undegraded":"2024-06-02T23:46:32.519089+0000","last_fullsized":"2024-06-02T23:46:32.519089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761799+0000","last_change":"2024-06-02T23:46:25.721864+0000","last_active":"2024-06-02T23:46:30.761799+0000","last_peered":"2024-06-02T23:46:30.761799+0000","last_clean":"2024-06-02T23:46:30.761799+0000","last_became_active":"2024-06-02T23:46:25.721542+0000","last_became_peered":"2024-06-02T23:46:25.721542+0000","last_unstale":"2024-06-02T23:46:30.761799+0000","last_undegraded":"2024-06-02T23:46:30.761799+0000","last_fullsized":"2024-06-02T23:46:30.761799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:43.831493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020299+0000","last_change":"2024-06-02T23:46:24.721734+0000","last_active":"2024-06-02T23:46:32.020299+0000","last_peered":"2024-06-02T23:46:32.020299+0000","last_clean":"2024-06-02T23:46:32.020299+0000","last_became_active":"2024-06-02T23:46:24.721054+0000","last_became_peered":"2024-06-02T23:46:24.721054+0000","last_unstale":"2024-06-02T23:46:32.020299+0000","last_undegraded":"2024-06-02T23:46:32.020299+0000","last_fullsized":"2024-06-02T23:46:32.020299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521266+0000","last_change":"2024-06-02T23:46:29.747631+0000","last_active":"2024-06-02T23:46:32.521266+0000","last_peered":"2024-06-02T23:46:32.521266+0000","last_clean":"2024-06-02T23:46:32.521266+0000","last_became_active":"2024-06-02T23:46:29.747131+0000","last_became_peered":"2024-06-02T23:46:29.747131+0000","last_unstale":"2024-06-02T23:46:32.521266+0000","last_undegraded":"2024-06-02T23:46:32.521266+0000","last_fullsized":"2024-06-02T23:46:32.521266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:25:42.527465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521158+0000","last_change":"2024-06-02T23:46:25.730642+0000","last_active":"2024-06-02T23:46:32.521158+0000","last_peered":"2024-06-02T23:46:32.521158+0000","last_clean":"2024-06-02T23:46:32.521158+0000","last_became_active":"2024-06-02T23:46:25.730361+0000","last_became_peered":"2024-06-02T23:46:25.730361+0000","last_unstale":"2024-06-02T23:46:32.521158+0000","last_undegraded":"2024-06-02T23:46:32.521158+0000","last_fullsized":"2024-06-02T23:46:32.521158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760281+0000","last_change":"2024-06-02T23:46:24.723907+0000","last_active":"2024-06-02T23:46:30.760281+0000","last_peered":"2024-06-02T23:46:30.760281+0000","last_clean":"2024-06-02T23:46:30.760281+0000","last_became_active":"2024-06-02T23:46:24.723625+0000","last_became_peered":"2024-06-02T23:46:24.723625+0000","last_unstale":"2024-06-02T23:46:30.760281+0000","last_undegraded":"2024-06-02T23:46:30.760281+0000","last_fullsized":"2024-06-02T23:46:30.760281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520188+0000","last_change":"2024-06-02T23:46:29.750215+0000","last_active":"2024-06-02T23:46:32.520188+0000","last_peered":"2024-06-02T23:46:32.520188+0000","last_clean":"2024-06-02T23:46:32.520188+0000","last_became_active":"2024-06-02T23:46:29.749639+0000","last_became_peered":"2024-06-02T23:46:29.749639+0000","last_unstale":"2024-06-02T23:46:32.520188+0000","last_undegraded":"2024-06-02T23:46:32.520188+0000","last_fullsized":"2024-06-02T23:46:32.520188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:29.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518955+0000","last_change":"2024-06-02T23:46:25.715090+0000","last_active":"2024-06-02T23:46:32.518955+0000","last_peered":"2024-06-02T23:46:32.518955+0000","last_clean":"2024-06-02T23:46:32.518955+0000","last_became_active":"2024-06-02T23:46:25.714367+0000","last_became_peered":"2024-06-02T23:46:25.714367+0000","last_unstale":"2024-06-02T23:46:32.518955+0000","last_undegraded":"2024-06-02T23:46:32.518955+0000","last_fullsized":"2024-06-02T23:46:32.518955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519559+0000","last_change":"2024-06-02T23:46:24.727655+0000","last_active":"2024-06-02T23:46:32.519559+0000","last_peered":"2024-06-02T23:46:32.519559+0000","last_clean":"2024-06-02T23:46:32.519559+0000","last_became_active":"2024-06-02T23:46:24.727332+0000","last_became_peered":"2024-06-02T23:46:24.727332+0000","last_unstale":"2024-06-02T23:46:32.519559+0000","last_undegraded":"2024-06-02T23:46:32.519559+0000","last_fullsized":"2024-06-02T23:46:32.519559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520433+0000","last_change":"2024-06-02T23:46:30.058954+0000","last_active":"2024-06-02T23:46:32.520433+0000","last_peered":"2024-06-02T23:46:32.520433+0000","last_clean":"2024-06-02T23:46:32.520433+0000","last_became_active":"2024-06-02T23:46:30.058572+0000","last_became_peered":"2024-06-02T23:46:30.058572+0000","last_unstale":"2024-06-02T23:46:32.520433+0000","last_undegraded":"2024-06-02T23:46:32.520433+0000","last_fullsized":"2024-06-02T23:46:32.520433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:29.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519081+0000","last_change":"2024-06-02T23:46:25.733213+0000","last_active":"2024-06-02T23:46:32.519081+0000","last_peered":"2024-06-02T23:46:32.519081+0000","last_clean":"2024-06-02T23:46:32.519081+0000","last_became_active":"2024-06-02T23:46:25.732930+0000","last_became_peered":"2024-06-02T23:46:25.732930+0000","last_unstale":"2024-06-02T23:46:32.519081+0000","last_undegraded":"2024-06-02T23:46:32.519081+0000","last_fullsized":"2024-06-02T23:46:32.519081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020160+0000","last_change":"2024-06-02T23:46:24.721901+0000","last_active":"2024-06-02T23:46:32.020160+0000","last_peered":"2024-06-02T23:46:32.020160+0000","last_clean":"2024-06-02T23:46:32.020160+0000","last_became_active":"2024-06-02T23:46:24.721566+0000","last_became_peered":"2024-06-02T23:46:24.721566+0000","last_unstale":"2024-06-02T23:46:32.020160+0000","last_undegraded":"2024-06-02T23:46:32.020160+0000","last_fullsized":"2024-06-02T23:46:32.020160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519663+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:46:32.519663+0000","last_peered":"2024-06-02T23:46:32.519663+0000","last_clean":"2024-06-02T23:46:32.519663+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:46:32.519663+0000","last_undegraded":"2024-06-02T23:46:32.519663+0000","last_fullsized":"2024-06-02T23:46:32.519663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520077+0000","last_change":"2024-06-02T23:46:30.062637+0000","last_active":"2024-06-02T23:46:32.520077+0000","last_peered":"2024-06-02T23:46:32.520077+0000","last_clean":"2024-06-02T23:46:32.520077+0000","last_became_active":"2024-06-02T23:46:30.061399+0000","last_became_peered":"2024-06-02T23:46:30.061399+0000","last_unstale":"2024-06-02T23:46:32.520077+0000","last_undegraded":"2024-06-02T23:46:32.520077+0000","last_fullsized":"2024-06-02T23:46:32.520077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:13.880688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520556+0000","last_change":"2024-06-02T23:46:25.735716+0000","last_active":"2024-06-02T23:46:32.520556+0000","last_peered":"2024-06-02T23:46:32.520556+0000","last_clean":"2024-06-02T23:46:32.520556+0000","last_became_active":"2024-06-02T23:46:25.735260+0000","last_became_peered":"2024-06-02T23:46:25.735260+0000","last_unstale":"2024-06-02T23:46:32.520556+0000","last_undegraded":"2024-06-02T23:46:32.520556+0000","last_fullsized":"2024-06-02T23:46:32.520556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760537+0000","last_change":"2024-06-02T23:46:24.723946+0000","last_active":"2024-06-02T23:46:30.760537+0000","last_peered":"2024-06-02T23:46:30.760537+0000","last_clean":"2024-06-02T23:46:30.760537+0000","last_became_active":"2024-06-02T23:46:24.723650+0000","last_became_peered":"2024-06-02T23:46:24.723650+0000","last_unstale":"2024-06-02T23:46:30.760537+0000","last_undegraded":"2024-06-02T23:46:30.760537+0000","last_fullsized":"2024-06-02T23:46:30.760537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520181+0000","last_change":"2024-06-02T23:46:30.059124+0000","last_active":"2024-06-02T23:46:32.520181+0000","last_peered":"2024-06-02T23:46:32.520181+0000","last_clean":"2024-06-02T23:46:32.520181+0000","last_became_active":"2024-06-02T23:46:30.058661+0000","last_became_peered":"2024-06-02T23:46:30.058661+0000","last_unstale":"2024-06-02T23:46:32.520181+0000","last_undegraded":"2024-06-02T23:46:32.520181+0000","last_fullsized":"2024-06-02T23:46:32.520181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020428+0000","last_change":"2024-06-02T23:46:25.732804+0000","last_active":"2024-06-02T23:46:32.020428+0000","last_peered":"2024-06-02T23:46:32.020428+0000","last_clean":"2024-06-02T23:46:32.020428+0000","last_became_active":"2024-06-02T23:46:25.732456+0000","last_became_peered":"2024-06-02T23:46:25.732456+0000","last_unstale":"2024-06-02T23:46:32.020428+0000","last_undegraded":"2024-06-02T23:46:32.020428+0000","last_fullsized":"2024-06-02T23:46:32.020428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:12.887235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520544+0000","last_change":"2024-06-02T23:46:24.719921+0000","last_active":"2024-06-02T23:46:32.520544+0000","last_peered":"2024-06-02T23:46:32.520544+0000","last_clean":"2024-06-02T23:46:32.520544+0000","last_became_active":"2024-06-02T23:46:24.719648+0000","last_became_peered":"2024-06-02T23:46:24.719648+0000","last_unstale":"2024-06-02T23:46:32.520544+0000","last_undegraded":"2024-06-02T23:46:32.520544+0000","last_fullsized":"2024-06-02T23:46:32.520544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519336+0000","last_change":"2024-06-02T23:46:29.750616+0000","last_active":"2024-06-02T23:46:32.519336+0000","last_peered":"2024-06-02T23:46:32.519336+0000","last_clean":"2024-06-02T23:46:32.519336+0000","last_became_active":"2024-06-02T23:46:29.750269+0000","last_became_peered":"2024-06-02T23:46:29.750269+0000","last_unstale":"2024-06-02T23:46:32.519336+0000","last_undegraded":"2024-06-02T23:46:32.519336+0000","last_fullsized":"2024-06-02T23:46:32.519336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520532+0000","last_change":"2024-06-02T23:46:25.735799+0000","last_active":"2024-06-02T23:46:32.520532+0000","last_peered":"2024-06-02T23:46:32.520532+0000","last_clean":"2024-06-02T23:46:32.520532+0000","last_became_active":"2024-06-02T23:46:25.735543+0000","last_became_peered":"2024-06-02T23:46:25.735543+0000","last_unstale":"2024-06-02T23:46:32.520532+0000","last_undegraded":"2024-06-02T23:46:32.520532+0000","last_fullsized":"2024-06-02T23:46:32.520532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:37.017923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760515+0000","last_change":"2024-06-02T23:46:24.725885+0000","last_active":"2024-06-02T23:46:30.760515+0000","last_peered":"2024-06-02T23:46:30.760515+0000","last_clean":"2024-06-02T23:46:30.760515+0000","last_became_active":"2024-06-02T23:46:24.725536+0000","last_became_peered":"2024-06-02T23:46:24.725536+0000","last_unstale":"2024-06-02T23:46:30.760515+0000","last_undegraded":"2024-06-02T23:46:30.760515+0000","last_fullsized":"2024-06-02T23:46:30.760515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019834+0000","last_change":"2024-06-02T23:46:30.061677+0000","last_active":"2024-06-02T23:46:32.019834+0000","last_peered":"2024-06-02T23:46:32.019834+0000","last_clean":"2024-06-02T23:46:32.019834+0000","last_became_active":"2024-06-02T23:46:30.060775+0000","last_became_peered":"2024-06-02T23:46:30.060775+0000","last_unstale":"2024-06-02T23:46:32.019834+0000","last_undegraded":"2024-06-02T23:46:32.019834+0000","last_fullsized":"2024-06-02T23:46:32.019834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:33.045570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520258+0000","last_change":"2024-06-02T23:46:25.730305+0000","last_active":"2024-06-02T23:46:32.520258+0000","last_peered":"2024-06-02T23:46:32.520258+0000","last_clean":"2024-06-02T23:46:32.520258+0000","last_became_active":"2024-06-02T23:46:25.730021+0000","last_became_peered":"2024-06-02T23:46:25.730021+0000","last_unstale":"2024-06-02T23:46:32.520258+0000","last_undegraded":"2024-06-02T23:46:32.520258+0000","last_fullsized":"2024-06-02T23:46:32.520258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:55.355993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761363+0000","last_change":"2024-06-02T23:46:24.715701+0000","last_active":"2024-06-02T23:46:30.761363+0000","last_peered":"2024-06-02T23:46:30.761363+0000","last_clean":"2024-06-02T23:46:30.761363+0000","last_became_active":"2024-06-02T23:46:24.715390+0000","last_became_peered":"2024-06-02T23:46:24.715390+0000","last_unstale":"2024-06-02T23:46:30.761363+0000","last_undegraded":"2024-06-02T23:46:30.761363+0000","last_fullsized":"2024-06-02T23:46:30.761363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:58.235763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760636+0000","last_change":"2024-06-02T23:46:29.746332+0000","last_active":"2024-06-02T23:46:30.760636+0000","last_peered":"2024-06-02T23:46:30.760636+0000","last_clean":"2024-06-02T23:46:30.760636+0000","last_became_active":"2024-06-02T23:46:29.745413+0000","last_became_peered":"2024-06-02T23:46:29.745413+0000","last_unstale":"2024-06-02T23:46:30.760636+0000","last_undegraded":"2024-06-02T23:46:30.760636+0000","last_fullsized":"2024-06-02T23:46:30.760636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:19.371522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519802+0000","last_change":"2024-06-02T23:46:25.725887+0000","last_active":"2024-06-02T23:46:32.519802+0000","last_peered":"2024-06-02T23:46:32.519802+0000","last_clean":"2024-06-02T23:46:32.519802+0000","last_became_active":"2024-06-02T23:46:25.725612+0000","last_became_peered":"2024-06-02T23:46:25.725612+0000","last_unstale":"2024-06-02T23:46:32.519802+0000","last_undegraded":"2024-06-02T23:46:32.519802+0000","last_fullsized":"2024-06-02T23:46:32.519802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760127+0000","last_change":"2024-06-02T23:46:24.724594+0000","last_active":"2024-06-02T23:46:30.760127+0000","last_peered":"2024-06-02T23:46:30.760127+0000","last_clean":"2024-06-02T23:46:30.760127+0000","last_became_active":"2024-06-02T23:46:24.723922+0000","last_became_peered":"2024-06-02T23:46:24.723922+0000","last_unstale":"2024-06-02T23:46:30.760127+0000","last_undegraded":"2024-06-02T23:46:30.760127+0000","last_fullsized":"2024-06-02T23:46:30.760127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520293+0000","last_change":"2024-06-02T23:46:29.747557+0000","last_active":"2024-06-02T23:46:32.520293+0000","last_peered":"2024-06-02T23:46:32.520293+0000","last_clean":"2024-06-02T23:46:32.520293+0000","last_became_active":"2024-06-02T23:46:29.747197+0000","last_became_peered":"2024-06-02T23:46:29.747197+0000","last_unstale":"2024-06-02T23:46:32.520293+0000","last_undegraded":"2024-06-02T23:46:32.520293+0000","last_fullsized":"2024-06-02T23:46:32.520293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:15.508248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519514+0000","last_change":"2024-06-02T23:46:25.724028+0000","last_active":"2024-06-02T23:46:32.519514+0000","last_peered":"2024-06-02T23:46:32.519514+0000","last_clean":"2024-06-02T23:46:32.519514+0000","last_became_active":"2024-06-02T23:46:25.723772+0000","last_became_peered":"2024-06-02T23:46:25.723772+0000","last_unstale":"2024-06-02T23:46:32.519514+0000","last_undegraded":"2024-06-02T23:46:32.519514+0000","last_fullsized":"2024-06-02T23:46:32.519514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519626+0000","last_change":"2024-06-02T23:46:24.719789+0000","last_active":"2024-06-02T23:46:32.519626+0000","last_peered":"2024-06-02T23:46:32.519626+0000","last_clean":"2024-06-02T23:46:32.519626+0000","last_became_active":"2024-06-02T23:46:24.719492+0000","last_became_peered":"2024-06-02T23:46:24.719492+0000","last_unstale":"2024-06-02T23:46:32.519626+0000","last_undegraded":"2024-06-02T23:46:32.519626+0000","last_fullsized":"2024-06-02T23:46:32.519626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519714+0000","last_change":"2024-06-02T23:46:30.060001+0000","last_active":"2024-06-02T23:46:32.519714+0000","last_peered":"2024-06-02T23:46:32.519714+0000","last_clean":"2024-06-02T23:46:32.519714+0000","last_became_active":"2024-06-02T23:46:30.059636+0000","last_became_peered":"2024-06-02T23:46:30.059636+0000","last_unstale":"2024-06-02T23:46:32.519714+0000","last_undegraded":"2024-06-02T23:46:32.519714+0000","last_fullsized":"2024-06-02T23:46:32.519714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:25:42.527465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520625+0000","last_change":"2024-06-02T23:46:25.731503+0000","last_active":"2024-06-02T23:46:32.520625+0000","last_peered":"2024-06-02T23:46:32.520625+0000","last_clean":"2024-06-02T23:46:32.520625+0000","last_became_active":"2024-06-02T23:46:25.726384+0000","last_became_peered":"2024-06-02T23:46:25.726384+0000","last_unstale":"2024-06-02T23:46:32.520625+0000","last_undegraded":"2024-06-02T23:46:32.520625+0000","last_fullsized":"2024-06-02T23:46:32.520625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:11.482068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020231+0000","last_change":"2024-06-02T23:46:24.717644+0000","last_active":"2024-06-02T23:46:32.020231+0000","last_peered":"2024-06-02T23:46:32.020231+0000","last_clean":"2024-06-02T23:46:32.020231+0000","last_became_active":"2024-06-02T23:46:24.717376+0000","last_became_peered":"2024-06-02T23:46:24.717376+0000","last_unstale":"2024-06-02T23:46:32.020231+0000","last_undegraded":"2024-06-02T23:46:32.020231+0000","last_fullsized":"2024-06-02T23:46:32.020231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520673+0000","last_change":"2024-06-02T23:46:30.059757+0000","last_active":"2024-06-02T23:46:32.520673+0000","last_peered":"2024-06-02T23:46:32.520673+0000","last_clean":"2024-06-02T23:46:32.520673+0000","last_became_active":"2024-06-02T23:46:30.059322+0000","last_became_peered":"2024-06-02T23:46:30.059322+0000","last_unstale":"2024-06-02T23:46:32.520673+0000","last_undegraded":"2024-06-02T23:46:32.520673+0000","last_fullsized":"2024-06-02T23:46:32.520673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:23.721847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519530+0000","last_change":"2024-06-02T23:46:25.728180+0000","last_active":"2024-06-02T23:46:32.519530+0000","last_peered":"2024-06-02T23:46:32.519530+0000","last_clean":"2024-06-02T23:46:32.519530+0000","last_became_active":"2024-06-02T23:46:25.727929+0000","last_became_peered":"2024-06-02T23:46:25.727929+0000","last_unstale":"2024-06-02T23:46:32.519530+0000","last_undegraded":"2024-06-02T23:46:32.519530+0000","last_fullsized":"2024-06-02T23:46:32.519530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:13:41.243193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520755+0000","last_change":"2024-06-02T23:46:24.720640+0000","last_active":"2024-06-02T23:46:32.520755+0000","last_peered":"2024-06-02T23:46:32.520755+0000","last_clean":"2024-06-02T23:46:32.520755+0000","last_became_active":"2024-06-02T23:46:24.718963+0000","last_became_peered":"2024-06-02T23:46:24.718963+0000","last_unstale":"2024-06-02T23:46:32.520755+0000","last_undegraded":"2024-06-02T23:46:32.520755+0000","last_fullsized":"2024-06-02T23:46:32.520755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:48:20.465639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020392+0000","last_change":"2024-06-02T23:46:30.061979+0000","last_active":"2024-06-02T23:46:32.020392+0000","last_peered":"2024-06-02T23:46:32.020392+0000","last_clean":"2024-06-02T23:46:32.020392+0000","last_became_active":"2024-06-02T23:46:30.060895+0000","last_became_peered":"2024-06-02T23:46:30.060895+0000","last_unstale":"2024-06-02T23:46:32.020392+0000","last_undegraded":"2024-06-02T23:46:32.020392+0000","last_fullsized":"2024-06-02T23:46:32.020392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:45:39.641287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520442+0000","last_change":"2024-06-02T23:46:25.735883+0000","last_active":"2024-06-02T23:46:32.520442+0000","last_peered":"2024-06-02T23:46:32.520442+0000","last_clean":"2024-06-02T23:46:32.520442+0000","last_became_active":"2024-06-02T23:46:25.735603+0000","last_became_peered":"2024-06-02T23:46:25.735603+0000","last_unstale":"2024-06-02T23:46:32.520442+0000","last_undegraded":"2024-06-02T23:46:32.520442+0000","last_fullsized":"2024-06-02T23:46:32.520442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:35.130935+0000","last_change":"2024-06-02T23:46:24.721360+0000","last_active":"2024-06-02T23:46:35.130935+0000","last_peered":"2024-06-02T23:46:35.130935+0000","last_clean":"2024-06-02T23:46:35.130935+0000","last_became_active":"2024-06-02T23:46:24.721084+0000","last_became_peered":"2024-06-02T23:46:24.721084+0000","last_unstale":"2024-06-02T23:46:35.130935+0000","last_undegraded":"2024-06-02T23:46:35.130935+0000","last_fullsized":"2024-06-02T23:46:35.130935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519296+0000","last_change":"2024-06-02T23:46:29.746644+0000","last_active":"2024-06-02T23:46:32.519296+0000","last_peered":"2024-06-02T23:46:32.519296+0000","last_clean":"2024-06-02T23:46:32.519296+0000","last_became_active":"2024-06-02T23:46:29.746228+0000","last_became_peered":"2024-06-02T23:46:29.746228+0000","last_unstale":"2024-06-02T23:46:32.519296+0000","last_undegraded":"2024-06-02T23:46:32.519296+0000","last_fullsized":"2024-06-02T23:46:32.519296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:10.654147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761249+0000","last_change":"2024-06-02T23:46:25.728089+0000","last_active":"2024-06-02T23:46:30.761249+0000","last_peered":"2024-06-02T23:46:30.761249+0000","last_clean":"2024-06-02T23:46:30.761249+0000","last_became_active":"2024-06-02T23:46:25.726955+0000","last_became_peered":"2024-06-02T23:46:25.726955+0000","last_unstale":"2024-06-02T23:46:30.761249+0000","last_undegraded":"2024-06-02T23:46:30.761249+0000","last_fullsized":"2024-06-02T23:46:30.761249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:35.672297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520452+0000","last_change":"2024-06-02T23:46:24.725891+0000","last_active":"2024-06-02T23:46:32.520452+0000","last_peered":"2024-06-02T23:46:32.520452+0000","last_clean":"2024-06-02T23:46:32.520452+0000","last_became_active":"2024-06-02T23:46:24.725584+0000","last_became_peered":"2024-06-02T23:46:24.725584+0000","last_unstale":"2024-06-02T23:46:32.520452+0000","last_undegraded":"2024-06-02T23:46:32.520452+0000","last_fullsized":"2024-06-02T23:46:32.520452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761588+0000","last_change":"2024-06-02T23:46:29.745572+0000","last_active":"2024-06-02T23:46:30.761588+0000","last_peered":"2024-06-02T23:46:30.761588+0000","last_clean":"2024-06-02T23:46:30.761588+0000","last_became_active":"2024-06-02T23:46:29.744992+0000","last_became_peered":"2024-06-02T23:46:29.744992+0000","last_unstale":"2024-06-02T23:46:30.761588+0000","last_undegraded":"2024-06-02T23:46:30.761588+0000","last_fullsized":"2024-06-02T23:46:30.761588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519822+0000","last_change":"2024-06-02T23:46:25.725605+0000","last_active":"2024-06-02T23:46:32.519822+0000","last_peered":"2024-06-02T23:46:32.519822+0000","last_clean":"2024-06-02T23:46:32.519822+0000","last_became_active":"2024-06-02T23:46:25.725274+0000","last_became_peered":"2024-06-02T23:46:25.725274+0000","last_unstale":"2024-06-02T23:46:32.519822+0000","last_undegraded":"2024-06-02T23:46:32.519822+0000","last_fullsized":"2024-06-02T23:46:32.519822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020509+0000","last_change":"2024-06-02T23:46:24.715879+0000","last_active":"2024-06-02T23:46:32.020509+0000","last_peered":"2024-06-02T23:46:32.020509+0000","last_clean":"2024-06-02T23:46:32.020509+0000","last_became_active":"2024-06-02T23:46:24.715573+0000","last_became_peered":"2024-06-02T23:46:24.715573+0000","last_unstale":"2024-06-02T23:46:32.020509+0000","last_undegraded":"2024-06-02T23:46:32.020509+0000","last_fullsized":"2024-06-02T23:46:32.020509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520072+0000","last_change":"2024-06-02T23:46:29.747846+0000","last_active":"2024-06-02T23:46:32.520072+0000","last_peered":"2024-06-02T23:46:32.520072+0000","last_clean":"2024-06-02T23:46:32.520072+0000","last_became_active":"2024-06-02T23:46:29.747447+0000","last_became_peered":"2024-06-02T23:46:29.747447+0000","last_unstale":"2024-06-02T23:46:32.520072+0000","last_undegraded":"2024-06-02T23:46:32.520072+0000","last_fullsized":"2024-06-02T23:46:32.520072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:45:39.641287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020419+0000","last_change":"2024-06-02T23:46:25.724680+0000","last_active":"2024-06-02T23:46:32.020419+0000","last_peered":"2024-06-02T23:46:32.020419+0000","last_clean":"2024-06-02T23:46:32.020419+0000","last_became_active":"2024-06-02T23:46:25.724407+0000","last_became_peered":"2024-06-02T23:46:25.724407+0000","last_unstale":"2024-06-02T23:46:32.020419+0000","last_undegraded":"2024-06-02T23:46:32.020419+0000","last_fullsized":"2024-06-02T23:46:32.020419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:09.854508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520034+0000","last_change":"2024-06-02T23:46:24.722854+0000","last_active":"2024-06-02T23:46:32.520034+0000","last_peered":"2024-06-02T23:46:32.520034+0000","last_clean":"2024-06-02T23:46:32.520034+0000","last_became_active":"2024-06-02T23:46:24.722517+0000","last_became_peered":"2024-06-02T23:46:24.722517+0000","last_unstale":"2024-06-02T23:46:32.520034+0000","last_undegraded":"2024-06-02T23:46:32.520034+0000","last_fullsized":"2024-06-02T23:46:32.520034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520095+0000","last_change":"2024-06-02T23:46:30.059124+0000","last_active":"2024-06-02T23:46:32.520095+0000","last_peered":"2024-06-02T23:46:32.520095+0000","last_clean":"2024-06-02T23:46:32.520095+0000","last_became_active":"2024-06-02T23:46:30.058701+0000","last_became_peered":"2024-06-02T23:46:30.058701+0000","last_unstale":"2024-06-02T23:46:32.520095+0000","last_undegraded":"2024-06-02T23:46:32.520095+0000","last_fullsized":"2024-06-02T23:46:32.520095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:03:32.967430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520137+0000","last_change":"2024-06-02T23:46:30.060519+0000","last_active":"2024-06-02T23:46:32.520137+0000","last_peered":"2024-06-02T23:46:32.520137+0000","last_clean":"2024-06-02T23:46:32.520137+0000","last_became_active":"2024-06-02T23:46:30.060121+0000","last_became_peered":"2024-06-02T23:46:30.060121+0000","last_unstale":"2024-06-02T23:46:32.520137+0000","last_undegraded":"2024-06-02T23:46:32.520137+0000","last_fullsized":"2024-06-02T23:46:32.520137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:10.654147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518734+0000","last_change":"2024-06-02T23:46:25.732314+0000","last_active":"2024-06-02T23:46:32.518734+0000","last_peered":"2024-06-02T23:46:32.518734+0000","last_clean":"2024-06-02T23:46:32.518734+0000","last_became_active":"2024-06-02T23:46:25.732022+0000","last_became_peered":"2024-06-02T23:46:25.732022+0000","last_unstale":"2024-06-02T23:46:32.518734+0000","last_undegraded":"2024-06-02T23:46:32.518734+0000","last_fullsized":"2024-06-02T23:46:32.518734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019991+0000","last_change":"2024-06-02T23:46:24.716182+0000","last_active":"2024-06-02T23:46:32.019991+0000","last_peered":"2024-06-02T23:46:32.019991+0000","last_clean":"2024-06-02T23:46:32.019991+0000","last_became_active":"2024-06-02T23:46:24.715906+0000","last_became_peered":"2024-06-02T23:46:24.715906+0000","last_unstale":"2024-06-02T23:46:32.019991+0000","last_undegraded":"2024-06-02T23:46:32.019991+0000","last_fullsized":"2024-06-02T23:46:32.019991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519713+0000","last_change":"2024-06-02T23:46:29.750554+0000","last_active":"2024-06-02T23:46:32.519713+0000","last_peered":"2024-06-02T23:46:32.519713+0000","last_clean":"2024-06-02T23:46:32.519713+0000","last_became_active":"2024-06-02T23:46:29.750212+0000","last_became_peered":"2024-06-02T23:46:29.750212+0000","last_unstale":"2024-06-02T23:46:32.519713+0000","last_undegraded":"2024-06-02T23:46:32.519713+0000","last_fullsized":"2024-06-02T23:46:32.519713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:24.838590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520102+0000","last_change":"2024-06-02T23:46:25.730716+0000","last_active":"2024-06-02T23:46:32.520102+0000","last_peered":"2024-06-02T23:46:32.520102+0000","last_clean":"2024-06-02T23:46:32.520102+0000","last_became_active":"2024-06-02T23:46:25.730447+0000","last_became_peered":"2024-06-02T23:46:25.730447+0000","last_unstale":"2024-06-02T23:46:32.520102+0000","last_undegraded":"2024-06-02T23:46:32.520102+0000","last_fullsized":"2024-06-02T23:46:32.520102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520355+0000","last_change":"2024-06-02T23:46:24.718681+0000","last_active":"2024-06-02T23:46:32.520355+0000","last_peered":"2024-06-02T23:46:32.520355+0000","last_clean":"2024-06-02T23:46:32.520355+0000","last_became_active":"2024-06-02T23:46:24.717312+0000","last_became_peered":"2024-06-02T23:46:24.717312+0000","last_unstale":"2024-06-02T23:46:32.520355+0000","last_undegraded":"2024-06-02T23:46:32.520355+0000","last_fullsized":"2024-06-02T23:46:32.520355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:53.696691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520419+0000","last_change":"2024-06-02T23:46:24.719033+0000","last_active":"2024-06-02T23:46:32.520419+0000","last_peered":"2024-06-02T23:46:32.520419+0000","last_clean":"2024-06-02T23:46:32.520419+0000","last_became_active":"2024-06-02T23:46:24.718726+0000","last_became_peered":"2024-06-02T23:46:24.718726+0000","last_unstale":"2024-06-02T23:46:32.520419+0000","last_undegraded":"2024-06-02T23:46:32.520419+0000","last_fullsized":"2024-06-02T23:46:32.520419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520671+0000","last_change":"2024-06-02T23:46:25.714066+0000","last_active":"2024-06-02T23:46:32.520671+0000","last_peered":"2024-06-02T23:46:32.520671+0000","last_clean":"2024-06-02T23:46:32.520671+0000","last_became_active":"2024-06-02T23:46:25.713761+0000","last_became_peered":"2024-06-02T23:46:25.713761+0000","last_unstale":"2024-06-02T23:46:32.520671+0000","last_undegraded":"2024-06-02T23:46:32.520671+0000","last_fullsized":"2024-06-02T23:46:32.520671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760380+0000","last_change":"2024-06-02T23:46:29.745968+0000","last_active":"2024-06-02T23:46:30.760380+0000","last_peered":"2024-06-02T23:46:30.760380+0000","last_clean":"2024-06-02T23:46:30.760380+0000","last_became_active":"2024-06-02T23:46:29.745547+0000","last_became_peered":"2024-06-02T23:46:29.745547+0000","last_unstale":"2024-06-02T23:46:30.760380+0000","last_undegraded":"2024-06-02T23:46:30.760380+0000","last_fullsized":"2024-06-02T23:46:30.760380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:14.777955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519569+0000","last_change":"2024-06-02T23:46:24.724513+0000","last_active":"2024-06-02T23:46:32.519569+0000","last_peered":"2024-06-02T23:46:32.519569+0000","last_clean":"2024-06-02T23:46:32.519569+0000","last_became_active":"2024-06-02T23:46:24.723129+0000","last_became_peered":"2024-06-02T23:46:24.723129+0000","last_unstale":"2024-06-02T23:46:32.519569+0000","last_undegraded":"2024-06-02T23:46:32.519569+0000","last_fullsized":"2024-06-02T23:46:32.519569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761185+0000","last_change":"2024-06-02T23:46:25.728059+0000","last_active":"2024-06-02T23:46:30.761185+0000","last_peered":"2024-06-02T23:46:30.761185+0000","last_clean":"2024-06-02T23:46:30.761185+0000","last_became_active":"2024-06-02T23:46:25.726707+0000","last_became_peered":"2024-06-02T23:46:25.726707+0000","last_unstale":"2024-06-02T23:46:30.761185+0000","last_undegraded":"2024-06-02T23:46:30.761185+0000","last_fullsized":"2024-06-02T23:46:30.761185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:28.357265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520439+0000","last_change":"2024-06-02T23:46:29.751586+0000","last_active":"2024-06-02T23:46:32.520439+0000","last_peered":"2024-06-02T23:46:32.520439+0000","last_clean":"2024-06-02T23:46:32.520439+0000","last_became_active":"2024-06-02T23:46:29.751242+0000","last_became_peered":"2024-06-02T23:46:29.751242+0000","last_unstale":"2024-06-02T23:46:32.520439+0000","last_undegraded":"2024-06-02T23:46:32.520439+0000","last_fullsized":"2024-06-02T23:46:32.520439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:44.019486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519290+0000","last_change":"2024-06-02T23:46:25.724423+0000","last_active":"2024-06-02T23:46:32.519290+0000","last_peered":"2024-06-02T23:46:32.519290+0000","last_clean":"2024-06-02T23:46:32.519290+0000","last_became_active":"2024-06-02T23:46:25.723880+0000","last_became_peered":"2024-06-02T23:46:25.723880+0000","last_unstale":"2024-06-02T23:46:32.519290+0000","last_undegraded":"2024-06-02T23:46:32.519290+0000","last_fullsized":"2024-06-02T23:46:32.519290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760154+0000","last_change":"2024-06-02T23:46:25.733710+0000","last_active":"2024-06-02T23:46:30.760154+0000","last_peered":"2024-06-02T23:46:30.760154+0000","last_clean":"2024-06-02T23:46:30.760154+0000","last_became_active":"2024-06-02T23:46:25.733419+0000","last_became_peered":"2024-06-02T23:46:25.733419+0000","last_unstale":"2024-06-02T23:46:30.760154+0000","last_undegraded":"2024-06-02T23:46:30.760154+0000","last_fullsized":"2024-06-02T23:46:30.760154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:23.259628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020177+0000","last_change":"2024-06-02T23:46:25.732210+0000","last_active":"2024-06-02T23:46:32.020177+0000","last_peered":"2024-06-02T23:46:32.020177+0000","last_clean":"2024-06-02T23:46:32.020177+0000","last_became_active":"2024-06-02T23:46:25.731930+0000","last_became_peered":"2024-06-02T23:46:25.731930+0000","last_unstale":"2024-06-02T23:46:32.020177+0000","last_undegraded":"2024-06-02T23:46:32.020177+0000","last_fullsized":"2024-06-02T23:46:32.020177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520584+0000","last_change":"2024-06-02T23:46:25.733626+0000","last_active":"2024-06-02T23:46:32.520584+0000","last_peered":"2024-06-02T23:46:32.520584+0000","last_clean":"2024-06-02T23:46:32.520584+0000","last_became_active":"2024-06-02T23:46:25.733343+0000","last_became_peered":"2024-06-02T23:46:25.733343+0000","last_unstale":"2024-06-02T23:46:32.520584+0000","last_undegraded":"2024-06-02T23:46:32.520584+0000","last_fullsized":"2024-06-02T23:46:32.520584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520773+0000","last_change":"2024-06-02T23:46:25.730607+0000","last_active":"2024-06-02T23:46:32.520773+0000","last_peered":"2024-06-02T23:46:32.520773+0000","last_clean":"2024-06-02T23:46:32.520773+0000","last_became_active":"2024-06-02T23:46:25.728526+0000","last_became_peered":"2024-06-02T23:46:25.728526+0000","last_unstale":"2024-06-02T23:46:32.520773+0000","last_undegraded":"2024-06-02T23:46:32.520773+0000","last_fullsized":"2024-06-02T23:46:32.520773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520287+0000","last_change":"2024-06-02T23:46:25.732586+0000","last_active":"2024-06-02T23:46:32.520287+0000","last_peered":"2024-06-02T23:46:32.520287+0000","last_clean":"2024-06-02T23:46:32.520287+0000","last_became_active":"2024-06-02T23:46:25.732332+0000","last_became_peered":"2024-06-02T23:46:25.732332+0000","last_unstale":"2024-06-02T23:46:32.520287+0000","last_undegraded":"2024-06-02T23:46:32.520287+0000","last_fullsized":"2024-06-02T23:46:32.520287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520449+0000","last_change":"2024-06-02T23:46:25.726741+0000","last_active":"2024-06-02T23:46:32.520449+0000","last_peered":"2024-06-02T23:46:32.520449+0000","last_clean":"2024-06-02T23:46:32.520449+0000","last_became_active":"2024-06-02T23:46:25.726480+0000","last_became_peered":"2024-06-02T23:46:25.726480+0000","last_unstale":"2024-06-02T23:46:32.520449+0000","last_undegraded":"2024-06-02T23:46:32.520449+0000","last_fullsized":"2024-06-02T23:46:32.520449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519721+0000","last_change":"2024-06-02T23:46:25.732734+0000","last_active":"2024-06-02T23:46:32.519721+0000","last_peered":"2024-06-02T23:46:32.519721+0000","last_clean":"2024-06-02T23:46:32.519721+0000","last_became_active":"2024-06-02T23:46:25.732444+0000","last_became_peered":"2024-06-02T23:46:25.732444+0000","last_unstale":"2024-06-02T23:46:32.519721+0000","last_undegraded":"2024-06-02T23:46:32.519721+0000","last_fullsized":"2024-06-02T23:46:32.519721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019988+0000","last_change":"2024-06-02T23:46:25.733224+0000","last_active":"2024-06-02T23:46:32.019988+0000","last_peered":"2024-06-02T23:46:32.019988+0000","last_clean":"2024-06-02T23:46:32.019988+0000","last_became_active":"2024-06-02T23:46:25.732945+0000","last_became_peered":"2024-06-02T23:46:25.732945+0000","last_unstale":"2024-06-02T23:46:32.019988+0000","last_undegraded":"2024-06-02T23:46:32.019988+0000","last_fullsized":"2024-06-02T23:46:32.019988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520271+0000","last_change":"2024-06-02T23:46:25.727647+0000","last_active":"2024-06-02T23:46:32.520271+0000","last_peered":"2024-06-02T23:46:32.520271+0000","last_clean":"2024-06-02T23:46:32.520271+0000","last_became_active":"2024-06-02T23:46:25.727364+0000","last_became_peered":"2024-06-02T23:46:25.727364+0000","last_unstale":"2024-06-02T23:46:32.520271+0000","last_undegraded":"2024-06-02T23:46:32.520271+0000","last_fullsized":"2024-06-02T23:46:32.520271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020096+0000","last_change":"2024-06-02T23:46:25.727678+0000","last_active":"2024-06-02T23:46:32.020096+0000","last_peered":"2024-06-02T23:46:32.020096+0000","last_clean":"2024-06-02T23:46:32.020096+0000","last_became_active":"2024-06-02T23:46:25.727392+0000","last_became_peered":"2024-06-02T23:46:25.727392+0000","last_unstale":"2024-06-02T23:46:32.020096+0000","last_undegraded":"2024-06-02T23:46:32.020096+0000","last_fullsized":"2024-06-02T23:46:32.020096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519179+0000","last_change":"2024-06-02T23:46:25.722139+0000","last_active":"2024-06-02T23:46:32.519179+0000","last_peered":"2024-06-02T23:46:32.519179+0000","last_clean":"2024-06-02T23:46:32.519179+0000","last_became_active":"2024-06-02T23:46:25.721804+0000","last_became_peered":"2024-06-02T23:46:25.721804+0000","last_unstale":"2024-06-02T23:46:32.519179+0000","last_undegraded":"2024-06-02T23:46:32.519179+0000","last_fullsized":"2024-06-02T23:46:32.519179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519769+0000","last_change":"2024-06-02T23:46:25.728123+0000","last_active":"2024-06-02T23:46:32.519769+0000","last_peered":"2024-06-02T23:46:32.519769+0000","last_clean":"2024-06-02T23:46:32.519769+0000","last_became_active":"2024-06-02T23:46:25.727805+0000","last_became_peered":"2024-06-02T23:46:25.727805+0000","last_unstale":"2024-06-02T23:46:32.519769+0000","last_undegraded":"2024-06-02T23:46:32.519769+0000","last_fullsized":"2024-06-02T23:46:32.519769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520780+0000","last_change":"2024-06-02T23:46:25.735497+0000","last_active":"2024-06-02T23:46:32.520780+0000","last_peered":"2024-06-02T23:46:32.520780+0000","last_clean":"2024-06-02T23:46:32.520780+0000","last_became_active":"2024-06-02T23:46:25.734887+0000","last_became_peered":"2024-06-02T23:46:25.734887+0000","last_unstale":"2024-06-02T23:46:32.520780+0000","last_undegraded":"2024-06-02T23:46:32.520780+0000","last_fullsized":"2024-06-02T23:46:32.520780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:20.812410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760496+0000","last_change":"2024-06-02T23:46:25.734490+0000","last_active":"2024-06-02T23:46:30.760496+0000","last_peered":"2024-06-02T23:46:30.760496+0000","last_clean":"2024-06-02T23:46:30.760496+0000","last_became_active":"2024-06-02T23:46:25.734206+0000","last_became_peered":"2024-06-02T23:46:25.734206+0000","last_unstale":"2024-06-02T23:46:30.760496+0000","last_undegraded":"2024-06-02T23:46:30.760496+0000","last_fullsized":"2024-06-02T23:46:30.760496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:08.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020711+0000","last_change":"2024-06-02T23:46:25.736811+0000","last_active":"2024-06-02T23:46:32.020711+0000","last_peered":"2024-06-02T23:46:32.020711+0000","last_clean":"2024-06-02T23:46:32.020711+0000","last_became_active":"2024-06-02T23:46:25.736568+0000","last_became_peered":"2024-06-02T23:46:25.736568+0000","last_unstale":"2024-06-02T23:46:32.020711+0000","last_undegraded":"2024-06-02T23:46:32.020711+0000","last_fullsized":"2024-06-02T23:46:32.020711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:55.355993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019835+0000","last_change":"2024-06-02T23:46:25.722197+0000","last_active":"2024-06-02T23:46:32.019835+0000","last_peered":"2024-06-02T23:46:32.019835+0000","last_clean":"2024-06-02T23:46:32.019835+0000","last_became_active":"2024-06-02T23:46:25.721911+0000","last_became_peered":"2024-06-02T23:46:25.721911+0000","last_unstale":"2024-06-02T23:46:32.019835+0000","last_undegraded":"2024-06-02T23:46:32.019835+0000","last_fullsized":"2024-06-02T23:46:32.019835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518775+0000","last_change":"2024-06-02T23:46:25.727178+0000","last_active":"2024-06-02T23:46:32.518775+0000","last_peered":"2024-06-02T23:46:32.518775+0000","last_clean":"2024-06-02T23:46:32.518775+0000","last_became_active":"2024-06-02T23:46:25.726888+0000","last_became_peered":"2024-06-02T23:46:25.726888+0000","last_unstale":"2024-06-02T23:46:32.518775+0000","last_undegraded":"2024-06-02T23:46:32.518775+0000","last_fullsized":"2024-06-02T23:46:32.518775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519434+0000","last_change":"2024-06-02T23:46:25.725940+0000","last_active":"2024-06-02T23:46:32.519434+0000","last_peered":"2024-06-02T23:46:32.519434+0000","last_clean":"2024-06-02T23:46:32.519434+0000","last_became_active":"2024-06-02T23:46:25.725534+0000","last_became_peered":"2024-06-02T23:46:25.725534+0000","last_unstale":"2024-06-02T23:46:32.519434+0000","last_undegraded":"2024-06-02T23:46:32.519434+0000","last_fullsized":"2024-06-02T23:46:32.519434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:32.885581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519416+0000","last_change":"2024-06-02T23:46:25.730569+0000","last_active":"2024-06-02T23:46:32.519416+0000","last_peered":"2024-06-02T23:46:32.519416+0000","last_clean":"2024-06-02T23:46:32.519416+0000","last_became_active":"2024-06-02T23:46:25.728481+0000","last_became_peered":"2024-06-02T23:46:25.728481+0000","last_unstale":"2024-06-02T23:46:32.519416+0000","last_undegraded":"2024-06-02T23:46:32.519416+0000","last_fullsized":"2024-06-02T23:46:32.519416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761074+0000","last_change":"2024-06-02T23:46:25.730619+0000","last_active":"2024-06-02T23:46:30.761074+0000","last_peered":"2024-06-02T23:46:30.761074+0000","last_clean":"2024-06-02T23:46:30.761074+0000","last_became_active":"2024-06-02T23:46:25.730319+0000","last_became_peered":"2024-06-02T23:46:25.730319+0000","last_unstale":"2024-06-02T23:46:30.761074+0000","last_undegraded":"2024-06-02T23:46:30.761074+0000","last_fullsized":"2024-06-02T23:46:30.761074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:08.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520090+0000","last_change":"2024-06-02T23:46:25.733651+0000","last_active":"2024-06-02T23:46:32.520090+0000","last_peered":"2024-06-02T23:46:32.520090+0000","last_clean":"2024-06-02T23:46:32.520090+0000","last_became_active":"2024-06-02T23:46:25.733349+0000","last_became_peered":"2024-06-02T23:46:25.733349+0000","last_unstale":"2024-06-02T23:46:32.520090+0000","last_undegraded":"2024-06-02T23:46:32.520090+0000","last_fullsized":"2024-06-02T23:46:32.520090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520283+0000","last_change":"2024-06-02T23:46:25.727878+0000","last_active":"2024-06-02T23:46:32.520283+0000","last_peered":"2024-06-02T23:46:32.520283+0000","last_clean":"2024-06-02T23:46:32.520283+0000","last_became_active":"2024-06-02T23:46:25.727594+0000","last_became_peered":"2024-06-02T23:46:25.727594+0000","last_unstale":"2024-06-02T23:46:32.520283+0000","last_undegraded":"2024-06-02T23:46:32.520283+0000","last_fullsized":"2024-06-02T23:46:32.520283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520435+0000","last_change":"2024-06-02T23:46:25.734791+0000","last_active":"2024-06-02T23:46:32.520435+0000","last_peered":"2024-06-02T23:46:32.520435+0000","last_clean":"2024-06-02T23:46:32.520435+0000","last_became_active":"2024-06-02T23:46:25.734514+0000","last_became_peered":"2024-06-02T23:46:25.734514+0000","last_unstale":"2024-06-02T23:46:32.520435+0000","last_undegraded":"2024-06-02T23:46:32.520435+0000","last_fullsized":"2024-06-02T23:46:32.520435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:09.854508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519886+0000","last_change":"2024-06-02T23:46:25.736896+0000","last_active":"2024-06-02T23:46:32.519886+0000","last_peered":"2024-06-02T23:46:32.519886+0000","last_clean":"2024-06-02T23:46:32.519886+0000","last_became_active":"2024-06-02T23:46:25.736216+0000","last_became_peered":"2024-06-02T23:46:25.736216+0000","last_unstale":"2024-06-02T23:46:32.519886+0000","last_undegraded":"2024-06-02T23:46:32.519886+0000","last_fullsized":"2024-06-02T23:46:32.519886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:10.751775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519694+0000","last_change":"2024-06-02T23:46:25.723384+0000","last_active":"2024-06-02T23:46:32.519694+0000","last_peered":"2024-06-02T23:46:32.519694+0000","last_clean":"2024-06-02T23:46:32.519694+0000","last_became_active":"2024-06-02T23:46:25.722938+0000","last_became_peered":"2024-06-02T23:46:25.722938+0000","last_unstale":"2024-06-02T23:46:32.519694+0000","last_undegraded":"2024-06-02T23:46:32.519694+0000","last_fullsized":"2024-06-02T23:46:32.519694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020020+0000","last_change":"2024-06-02T23:46:25.729629+0000","last_active":"2024-06-02T23:46:32.020020+0000","last_peered":"2024-06-02T23:46:32.020020+0000","last_clean":"2024-06-02T23:46:32.020020+0000","last_became_active":"2024-06-02T23:46:25.729363+0000","last_became_peered":"2024-06-02T23:46:25.729363+0000","last_unstale":"2024-06-02T23:46:32.020020+0000","last_undegraded":"2024-06-02T23:46:32.020020+0000","last_fullsized":"2024-06-02T23:46:32.020020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520515+0000","last_change":"2024-06-02T23:46:25.734931+0000","last_active":"2024-06-02T23:46:32.520515+0000","last_peered":"2024-06-02T23:46:32.520515+0000","last_clean":"2024-06-02T23:46:32.520515+0000","last_became_active":"2024-06-02T23:46:25.734577+0000","last_became_peered":"2024-06-02T23:46:25.734577+0000","last_unstale":"2024-06-02T23:46:32.520515+0000","last_undegraded":"2024-06-02T23:46:32.520515+0000","last_fullsized":"2024-06-02T23:46:32.520515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:06.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020302+0000","last_change":"2024-06-02T23:46:25.732610+0000","last_active":"2024-06-02T23:46:32.020302+0000","last_peered":"2024-06-02T23:46:32.020302+0000","last_clean":"2024-06-02T23:46:32.020302+0000","last_became_active":"2024-06-02T23:46:25.731714+0000","last_became_peered":"2024-06-02T23:46:25.731714+0000","last_unstale":"2024-06-02T23:46:32.020302+0000","last_undegraded":"2024-06-02T23:46:32.020302+0000","last_fullsized":"2024-06-02T23:46:32.020302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519731+0000","last_change":"2024-06-02T23:46:25.729533+0000","last_active":"2024-06-02T23:46:32.519731+0000","last_peered":"2024-06-02T23:46:32.519731+0000","last_clean":"2024-06-02T23:46:32.519731+0000","last_became_active":"2024-06-02T23:46:25.729234+0000","last_became_peered":"2024-06-02T23:46:25.729234+0000","last_unstale":"2024-06-02T23:46:32.519731+0000","last_undegraded":"2024-06-02T23:46:32.519731+0000","last_fullsized":"2024-06-02T23:46:32.519731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519199+0000","last_change":"2024-06-02T23:46:25.727031+0000","last_active":"2024-06-02T23:46:32.519199+0000","last_peered":"2024-06-02T23:46:32.519199+0000","last_clean":"2024-06-02T23:46:32.519199+0000","last_became_active":"2024-06-02T23:46:25.726700+0000","last_became_peered":"2024-06-02T23:46:25.726700+0000","last_unstale":"2024-06-02T23:46:32.519199+0000","last_undegraded":"2024-06-02T23:46:32.519199+0000","last_fullsized":"2024-06-02T23:46:32.519199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520212+0000","last_change":"2024-06-02T23:46:25.731930+0000","last_active":"2024-06-02T23:46:32.520212+0000","last_peered":"2024-06-02T23:46:32.520212+0000","last_clean":"2024-06-02T23:46:32.520212+0000","last_became_active":"2024-06-02T23:46:25.730679+0000","last_became_peered":"2024-06-02T23:46:25.730679+0000","last_unstale":"2024-06-02T23:46:32.520212+0000","last_undegraded":"2024-06-02T23:46:32.520212+0000","last_fullsized":"2024-06-02T23:46:32.520212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:12.887235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:46:46.157 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T23:46:46.157 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-02T23:46:46.157 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-06-02T23:46:46.157 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-06-02T23:46:46.158 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-06-02T23:46:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.293+0000 7f8e54409640 1 Processor -- start 2024-06-02T23:46:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.293+0000 7f8e54409640 1 -- start start 2024-06-02T23:46:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e54409640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8e4c161900 0x7f8e4c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e54409640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b4fa0 0x7f8e4c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e54409640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e4c0d4a90 con 0x7f8e4c0b5510 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e54409640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8e4c0cf5c0 con 0x7f8e4c161900 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e54409640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4c0caf70 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e521a5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8e4c161900 0x7f8e4c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e529a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b4fa0 0x7f8e4c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e519a4640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8e4c0b5510 0x7f8e4c0d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:42172/0 (socket says 172.21.15.96:42172) 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e519a4640 1 -- 172.21.15.96:0/3768809731 learned_addr learned my addr 172.21.15.96:0/3768809731 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e511a3640 1 -- 172.21.15.96:0/3768809731 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322642112 0 0) 0x7f8e4c0d4a90 con 0x7f8e4c0b5510 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e511a3640 1 -- 172.21.15.96:0/3768809731 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e38003520 con 0x7f8e4c0b5510 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e521a5640 1 -- 172.21.15.96:0/3768809731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b4fa0 msgr2=0x7f8e4c0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e521a5640 1 --2- 172.21.15.96:0/3768809731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b4fa0 0x7f8e4c0d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e521a5640 1 -- 172.21.15.96:0/3768809731 >> v1:172.21.15.162:6789/0 conn(0x7f8e4c0b5510 legacy=0x7f8e4c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e521a5640 1 -- 172.21.15.96:0/3768809731 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c0d4d70 con 0x7f8e4c161900 2024-06-02T23:46:46.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.294+0000 7f8e529a6640 1 --2- 172.21.15.96:0/3768809731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b4fa0 0x7f8e4c0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.295+0000 7f8e521a5640 1 --2- 172.21.15.96:0/3768809731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e4c161900 0x7f8e4c0d0a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e480097a0 tx=0x7f8e4802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8961195e6644603 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.295+0000 7f8e511a3640 1 -- 172.21.15.96:0/3768809731 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48037070 con 0x7f8e4c161900 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.295+0000 7f8e511a3640 1 -- 172.21.15.96:0/3768809731 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e48032440 con 0x7f8e4c161900 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.295+0000 7f8e511a3640 1 -- 172.21.15.96:0/3768809731 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48032810 con 0x7f8e4c161900 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.296+0000 7f8e54409640 1 -- 172.21.15.96:0/3768809731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e4c161900 msgr2=0x7f8e4c0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.296+0000 7f8e54409640 1 --2- 172.21.15.96:0/3768809731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e4c161900 0x7f8e4c0d0a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e480097a0 tx=0x7f8e4802a180 comp rx=0 tx=0).stop 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.296+0000 7f8e54409640 1 -- 172.21.15.96:0/3768809731 shutdown_connections 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.296+0000 7f8e54409640 1 --2- 172.21.15.96:0/3768809731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b4fa0 0x7f8e4c0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.296+0000 7f8e54409640 1 --2- 172.21.15.96:0/3768809731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e4c161900 0x7f8e4c0d0a10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.296+0000 7f8e54409640 1 -- 172.21.15.96:0/3768809731 >> 172.21.15.96:0/3768809731 conn(0x7f8e4c09d3b0 msgr2=0x7f8e4c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:46.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.296+0000 7f8e54409640 1 -- 172.21.15.96:0/3768809731 shutdown_connections 2024-06-02T23:46:46.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.296+0000 7f8e54409640 1 -- 172.21.15.96:0/3768809731 wait complete. 2024-06-02T23:46:46.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.297+0000 7f8e54409640 1 Processor -- start 2024-06-02T23:46:46.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.297+0000 7f8e54409640 1 -- start start 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e54409640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4c0b4fa0 0x7f8e4c156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e54409640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b5510 0x7f8e4c154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e54409640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e4c161900 0x7f8e4c15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e54409640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c0d4780 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e54409640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c0cfae0 con 0x7f8e4c161900 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e54409640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4c161ce0 con 0x7f8e4c0b5510 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e521a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4c0b4fa0 0x7f8e4c156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e521a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4c0b4fa0 0x7f8e4c156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54632/0 (socket says 172.21.15.96:54632) 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e521a5640 1 -- 172.21.15.96:0/1117480048 learned_addr learned my addr 172.21.15.96:0/1117480048 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e519a4640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b5510 0x7f8e4c154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e529a6640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e4c161900 0x7f8e4c15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e521a5640 1 -- 172.21.15.96:0/1117480048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b5510 msgr2=0x7f8e4c154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e521a5640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b5510 0x7f8e4c154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e521a5640 1 -- 172.21.15.96:0/1117480048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e4c161900 msgr2=0x7f8e4c15ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e521a5640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e4c161900 0x7f8e4c15ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e521a5640 1 -- 172.21.15.96:0/1117480048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c0cc110 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e521a5640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4c0b4fa0 0x7f8e4c156130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098c0 tx=0x7f8e480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e42ffd640 1 -- 172.21.15.96:0/1117480048 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48041030 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e42ffd640 1 -- 172.21.15.96:0/1117480048 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4803d420 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e54409640 1 -- 172.21.15.96:0/1117480048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4c1550d0 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.298+0000 7f8e42ffd640 1 -- 172.21.15.96:0/1117480048 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48037040 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.299+0000 7f8e54409640 1 -- 172.21.15.96:0/1117480048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4c155930 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.299+0000 7f8e54409640 1 -- 172.21.15.96:0/1117480048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4c0683e0 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.300+0000 7f8e42ffd640 1 -- 172.21.15.96:0/1117480048 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e48044070 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.300+0000 7f8e42ffd640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8e3006be30 0x7f8e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.301+0000 7f8e519a4640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8e3006be30 0x7f8e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.301+0000 7f8e42ffd640 1 -- 172.21.15.96:0/1117480048 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8e480ab660 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.301+0000 7f8e519a4640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8e3006be30 0x7f8e3006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0a1ff0 tx=0x7f8e3c007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:46.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.305+0000 7f8e42ffd640 1 -- 172.21.15.96:0/1117480048 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8e48079ce0 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.531+0000 7f8e54409640 1 -- 172.21.15.96:0/1117480048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8e4c0d05e0 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.534+0000 7f8e42ffd640 1 -- 172.21.15.96:0/1117480048 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172937 (secure 0 0 0) 0x7f8e480795e0 con 0x7f8e4c0b4fa0 2024-06-02T23:46:46.536 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:46.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.536+0000 7f8e54409640 1 -- 172.21.15.96:0/1117480048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8e3006be30 msgr2=0x7f8e3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8e3006be30 0x7f8e3006e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0a1ff0 tx=0x7f8e3c007d30 comp rx=0 tx=0).stop 2024-06-02T23:46:46.537 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 -- 172.21.15.96:0/1117480048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4c0b4fa0 msgr2=0x7f8e4c156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4c0b4fa0 0x7f8e4c156130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8e480098c0 tx=0x7f8e480046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 -- 172.21.15.96:0/1117480048 shutdown_connections 2024-06-02T23:46:46.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e4c161900 0x7f8e4c15ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4c0b5510 0x7f8e4c154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8e3006be30 0x7f8e3006e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 --2- 172.21.15.96:0/1117480048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4c0b4fa0 0x7f8e4c156130 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 -- 172.21.15.96:0/1117480048 >> 172.21.15.96:0/1117480048 conn(0x7f8e4c09d3b0 msgr2=0x7f8e4c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:46.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 -- 172.21.15.96:0/1117480048 shutdown_connections 2024-06-02T23:46:46.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.537+0000 7f8e54409640 1 -- 172.21.15.96:0/1117480048 wait complete. 2024-06-02T23:46:46.548 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":1776728888},{"type":"v1","addr":"172.21.15.96:6833","nonce":1776728888}]},"active_addr":"172.21.15.96:6833/1776728888","active_change":"2024-06-02T23:46:05.987607+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3970369200}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":78106757}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2390098734}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1293902884}]}]} 2024-06-02T23:46:46.551 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-06-02T23:46:46.551 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-06-02T23:46:46.551 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:46.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.651+0000 7f8917215640 1 Processor -- start 2024-06-02T23:46:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.651+0000 7f8917215640 1 -- start start 2024-06-02T23:46:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f8917215640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f891006b3c0 0x7f891006b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f8917215640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89100cebe0 0x7f891015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f8917215640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89101600e0 0x7f89100afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f8917215640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f89100af1c0 con 0x7f89101600e0 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f8917215640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8910160b40 con 0x7f891006b3c0 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f8917215640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f891006bce0 con 0x7f89100cebe0 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f89157b2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89101600e0 0x7f89100afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f89157b2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f89101600e0 0x7f89100afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54634/0 (socket says 172.21.15.96:54634) 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f89157b2640 1 -- 172.21.15.96:0/912803148 learned_addr learned my addr 172.21.15.96:0/912803148 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f8914fb1640 1 --2- 172.21.15.96:0/912803148 >> v2:172.21.15.162:3300/0 conn(0x7f891006b3c0 0x7f891006b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f890ffff640 1 --2- 172.21.15.96:0/912803148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89100cebe0 0x7f891015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f89157b2640 1 -- 172.21.15.96:0/912803148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89100cebe0 msgr2=0x7f891015fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f89157b2640 1 --2- 172.21.15.96:0/912803148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89100cebe0 0x7f891015fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f89157b2640 1 -- 172.21.15.96:0/912803148 >> v2:172.21.15.162:3300/0 conn(0x7f891006b3c0 msgr2=0x7f891006b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f89157b2640 1 --2- 172.21.15.96:0/912803148 >> v2:172.21.15.162:3300/0 conn(0x7f891006b3c0 0x7f891006b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.652+0000 7f89157b2640 1 -- 172.21.15.96:0/912803148 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8910160580 con 0x7f89101600e0 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.653+0000 7f89157b2640 1 --2- 172.21.15.96:0/912803148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 0x7f89100afbf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f89100ce7b0 tx=0x7f890802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1352327c25986150 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:46.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.653+0000 7f890f7fe640 1 -- 172.21.15.96:0/912803148 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908036070 con 0x7f89101600e0 2024-06-02T23:46:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.653+0000 7f890f7fe640 1 -- 172.21.15.96:0/912803148 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8908031600 con 0x7f89101600e0 2024-06-02T23:46:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.653+0000 7f890f7fe640 1 -- 172.21.15.96:0/912803148 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89080319d0 con 0x7f89101600e0 2024-06-02T23:46:46.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.654+0000 7f8917215640 1 -- 172.21.15.96:0/912803148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 msgr2=0x7f89100afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.654+0000 7f8917215640 1 --2- 172.21.15.96:0/912803148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 0x7f89100afbf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f89100ce7b0 tx=0x7f890802a6a0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.654+0000 7f8917215640 1 -- 172.21.15.96:0/912803148 shutdown_connections 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.654+0000 7f8917215640 1 --2- 172.21.15.96:0/912803148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 0x7f89100afbf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.654+0000 7f8917215640 1 --2- 172.21.15.96:0/912803148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89100cebe0 0x7f891015fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.654+0000 7f8917215640 1 --2- 172.21.15.96:0/912803148 >> v2:172.21.15.162:3300/0 conn(0x7f891006b3c0 0x7f891006b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.654+0000 7f8917215640 1 -- 172.21.15.96:0/912803148 >> 172.21.15.96:0/912803148 conn(0x7f89100b2950 msgr2=0x7f89100b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.654+0000 7f8917215640 1 -- 172.21.15.96:0/912803148 shutdown_connections 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.654+0000 7f8917215640 1 -- 172.21.15.96:0/912803148 wait complete. 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.655+0000 7f8917215640 1 Processor -- start 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.655+0000 7f8917215640 1 -- start start 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f8917215640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891006b3c0 0x7f891014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f8917215640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100cebe0 0x7f89100b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f8917215640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 0x7f89100b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f8917215640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f89100af6d0 con 0x7f89101600e0 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f8917215640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89100af3f0 con 0x7f89100cebe0 2024-06-02T23:46:46.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f8917215640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f891015d3f0 con 0x7f891006b3c0 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f89157b2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 0x7f89100b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f89157b2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 0x7f89100b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54642/0 (socket says 172.21.15.96:54642) 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f89157b2640 1 -- 172.21.15.96:0/930981530 learned_addr learned my addr 172.21.15.96:0/930981530 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f8914fb1640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891006b3c0 0x7f891014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f890ffff640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100cebe0 0x7f89100b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f89157b2640 1 -- 172.21.15.96:0/930981530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891006b3c0 msgr2=0x7f891014c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f89157b2640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891006b3c0 0x7f891014c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f89157b2640 1 -- 172.21.15.96:0/930981530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100cebe0 msgr2=0x7f89100b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f89157b2640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100cebe0 0x7f89100b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f89157b2640 1 -- 172.21.15.96:0/930981530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891009e8f0 con 0x7f89101600e0 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.656+0000 7f89157b2640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 0x7f89100b1840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f890802ac90 tx=0x7f8908004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.657+0000 7f890d7fa640 1 -- 172.21.15.96:0/930981530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908041020 con 0x7f89101600e0 2024-06-02T23:46:46.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.657+0000 7f890d7fa640 1 -- 172.21.15.96:0/930981530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89080077a0 con 0x7f89101600e0 2024-06-02T23:46:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.657+0000 7f8917215640 1 -- 172.21.15.96:0/930981530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891009ebd0 con 0x7f89101600e0 2024-06-02T23:46:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.657+0000 7f890d7fa640 1 -- 172.21.15.96:0/930981530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908036040 con 0x7f89101600e0 2024-06-02T23:46:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.657+0000 7f8917215640 1 -- 172.21.15.96:0/930981530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891009ab00 con 0x7f89101600e0 2024-06-02T23:46:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.658+0000 7f8917215640 1 -- 172.21.15.96:0/930981530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89100683e0 con 0x7f89101600e0 2024-06-02T23:46:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.658+0000 7f890d7fa640 1 -- 172.21.15.96:0/930981530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8908044020 con 0x7f89101600e0 2024-06-02T23:46:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.659+0000 7f890d7fa640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f88fc06be30 0x7f88fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.659+0000 7f890d7fa640 1 -- 172.21.15.96:0/930981530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f89080abd50 con 0x7f89101600e0 2024-06-02T23:46:46.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.659+0000 7f8914fb1640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f88fc06be30 0x7f88fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.659+0000 7f8914fb1640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f88fc06be30 0x7f88fc06e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8900009a30 tx=0x7f8900008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:46.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.663+0000 7f890d7fa640 1 -- 172.21.15.96:0/930981530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f89080af030 con 0x7f89101600e0 2024-06-02T23:46:46.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.839+0000 7f8917215640 1 -- 172.21.15.96:0/930981530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89100b3200 con 0x7f89101600e0 2024-06-02T23:46:46.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.840+0000 7f890d7fa640 1 -- 172.21.15.96:0/930981530 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f890804b030 con 0x7f89101600e0 2024-06-02T23:46:46.841 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:46.841 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":24,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:30.096314+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.842+0000 7f8917215640 1 -- 172.21.15.96:0/930981530 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f88fc06be30 msgr2=0x7f88fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.842+0000 7f8917215640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f88fc06be30 0x7f88fc06e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8900009a30 tx=0x7f8900008040 comp rx=0 tx=0).stop 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.842+0000 7f8917215640 1 -- 172.21.15.96:0/930981530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 msgr2=0x7f89100b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.842+0000 7f8917215640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 0x7f89100b1840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f890802ac90 tx=0x7f8908004a40 comp rx=0 tx=0).stop 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.842+0000 7f8917215640 1 -- 172.21.15.96:0/930981530 shutdown_connections 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.842+0000 7f8917215640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f88fc06be30 0x7f88fc06e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.842+0000 7f8917215640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89101600e0 0x7f89100b1840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.842+0000 7f8917215640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100cebe0 0x7f89100b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.842+0000 7f8917215640 1 --2- 172.21.15.96:0/930981530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f891006b3c0 0x7f891014c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.842+0000 7f8917215640 1 -- 172.21.15.96:0/930981530 >> 172.21.15.96:0/930981530 conn(0x7f89100b2950 msgr2=0x7f89100cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.843+0000 7f8917215640 1 -- 172.21.15.96:0/930981530 shutdown_connections 2024-06-02T23:46:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.843+0000 7f8917215640 1 -- 172.21.15.96:0/930981530 wait complete. 2024-06-02T23:46:46.854 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-06-02T23:46:46.854 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:46.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.954+0000 7f60ba577640 1 Processor -- start 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.954+0000 7f60ba577640 1 -- start start 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.954+0000 7f60ba577640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4155570 0x7f60b406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.954+0000 7f60ba577640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f60b406eb50 0x7f60b40ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.954+0000 7f60ba577640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b4155950 con 0x7f60b40cab60 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60ba577640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f60b406efb0 con 0x7f60b406eb50 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60ba577640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f60b40cb2e0 con 0x7f60b4155570 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b8b14640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f60b40cab60 0x7f60b415eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39868/0 (socket says 172.21.15.96:39868) 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b8b14640 1 -- 172.21.15.96:0/3371292938 learned_addr learned my addr 172.21.15.96:0/3371292938 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892883770 0 0) 0x7f60b4155950 con 0x7f60b40cab60 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f609c003520 con 0x7f60b40cab60 2024-06-02T23:46:46.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b3fff640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4155570 0x7f60b406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b37fe640 1 --2- 172.21.15.96:0/3371292938 >> v2:172.21.15.162:3300/0 conn(0x7f60b406eb50 0x7f60b40ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3358053297 0 0) 0x7f609c003520 con 0x7f60b40cab60 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4155570 msgr2=0x7f60b406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4155570 0x7f60b406e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 >> v2:172.21.15.162:3300/0 conn(0x7f60b406eb50 msgr2=0x7f60b40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 --2- 172.21.15.96:0/3371292938 >> v2:172.21.15.162:3300/0 conn(0x7f60b406eb50 0x7f60b40ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b40cb5c0 con 0x7f60b40cab60 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f60ac0019f0 con 0x7f60b40cab60 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 >> v1:172.21.15.96:6789/0 conn(0x7f60b40cab60 legacy=0x7f60b415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f609c0039b0 0x7f609c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4155570 0x7f609c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f60b40cb2e0 con 0x7f609c0039b0 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f609c00b9c0 con 0x7f609c004d40 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f609c00bb40 con 0x7f60b4155570 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b3fff640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f609c0039b0 0x7f609c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b37fe640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4155570 0x7f609c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.955+0000 7f60b8b14640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.956+0000 7f60b3fff640 1 -- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4155570 msgr2=0x7f609c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.956+0000 7f60b3fff640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4155570 0x7f609c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.956+0000 7f60b3fff640 1 -- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c004d40 msgr2=0x7f609c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.956+0000 7f60b3fff640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.956+0000 7f60b3fff640 1 -- 172.21.15.96:0/3371292938 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c003520 con 0x7f609c0039b0 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.956+0000 7f60b8b14640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.956+0000 7f60b3fff640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f609c0039b0 0x7f609c003dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009ac0 tx=0x7f609c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5c6d2f72993bcd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.957+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4036070 con 0x7f609c0039b0 2024-06-02T23:46:46.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.957+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a4031400 con 0x7f609c0039b0 2024-06-02T23:46:46.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.957+0000 7f60b2ffd640 1 -- 172.21.15.96:0/3371292938 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4009690 con 0x7f609c0039b0 2024-06-02T23:46:46.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.957+0000 7f60ba577640 1 -- 172.21.15.96:0/3371292938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f609c0039b0 msgr2=0x7f609c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.957+0000 7f60ba577640 1 --2- 172.21.15.96:0/3371292938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f609c0039b0 0x7f609c003dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009ac0 tx=0x7f609c005830 comp rx=0 tx=0).stop 2024-06-02T23:46:46.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.957+0000 7f60b8b14640 1 -- 172.21.15.96:0/3371292938 reap_dead start 2024-06-02T23:46:46.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.957+0000 7f60ba577640 1 -- 172.21.15.96:0/3371292938 shutdown_connections 2024-06-02T23:46:46.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.957+0000 7f60ba577640 1 -- 172.21.15.96:0/3371292938 >> 172.21.15.96:0/3371292938 conn(0x7f60b40cfc30 msgr2=0x7f60b40d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:46.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.957+0000 7f60ba577640 1 -- 172.21.15.96:0/3371292938 shutdown_connections 2024-06-02T23:46:46.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.957+0000 7f60ba577640 1 -- 172.21.15.96:0/3371292938 wait complete. 2024-06-02T23:46:46.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.958+0000 7f60ba577640 1 Processor -- start 2024-06-02T23:46:46.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.958+0000 7f60ba577640 1 -- start start 2024-06-02T23:46:46.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60ba577640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c0039b0 0x7f60b4158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60ba577640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40c29a0 0x7f60b4158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60ba577640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4071e70 0x7f60b40722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60ba577640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f60b40caff0 con 0x7f60b40c29a0 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60ba577640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4071b00 con 0x7f609c0039b0 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60ba577640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f60b40717d0 con 0x7f60b4071e70 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60b37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40c29a0 0x7f60b4158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60b37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40c29a0 0x7f60b4158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54654/0 (socket says 172.21.15.96:54654) 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60b37fe640 1 -- 172.21.15.96:0/2785823904 learned_addr learned my addr 172.21.15.96:0/2785823904 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60b8b14640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4071e70 0x7f60b40722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.959+0000 7f60b3fff640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c0039b0 0x7f60b4158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60b37fe640 1 -- 172.21.15.96:0/2785823904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4071e70 msgr2=0x7f60b40722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60b37fe640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4071e70 0x7f60b40722f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60b37fe640 1 -- 172.21.15.96:0/2785823904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c0039b0 msgr2=0x7f60b4158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60b37fe640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c0039b0 0x7f60b4158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60b37fe640 1 -- 172.21.15.96:0/2785823904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b40c6e20 con 0x7f60b40c29a0 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60b37fe640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40c29a0 0x7f60b4158a50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f60a8011a70 tx=0x7f60a8011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:46.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60b0ff9640 1 -- 172.21.15.96:0/2785823904 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a800fb50 con 0x7f60b40c29a0 2024-06-02T23:46:46.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60b0ff9640 1 -- 172.21.15.96:0/2785823904 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a800fcf0 con 0x7f60b40c29a0 2024-06-02T23:46:46.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60ba577640 1 -- 172.21.15.96:0/2785823904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b40c7100 con 0x7f60b40c29a0 2024-06-02T23:46:46.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60b0ff9640 1 -- 172.21.15.96:0/2785823904 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a800fea0 con 0x7f60b40c29a0 2024-06-02T23:46:46.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.960+0000 7f60ba577640 1 -- 172.21.15.96:0/2785823904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b40c76c0 con 0x7f60b40c29a0 2024-06-02T23:46:46.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.961+0000 7f60ba577640 1 -- 172.21.15.96:0/2785823904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b40b15e0 con 0x7f60b40c29a0 2024-06-02T23:46:46.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.961+0000 7f60b0ff9640 1 -- 172.21.15.96:0/2785823904 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60a8012040 con 0x7f60b40c29a0 2024-06-02T23:46:46.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.962+0000 7f60b0ff9640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f60a006be30 0x7f60a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:46.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.962+0000 7f60b0ff9640 1 -- 172.21.15.96:0/2785823904 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f60a808b8b0 con 0x7f60b40c29a0 2024-06-02T23:46:46.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.962+0000 7f60b3fff640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f60a006be30 0x7f60a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:46.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.962+0000 7f60b3fff640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f60a006be30 0x7f60a006e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60a4033000 tx=0x7f60a4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:46.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:46.966+0000 7f60b0ff9640 1 -- 172.21.15.96:0/2785823904 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f60b40b15e0 con 0x7f60b40c29a0 2024-06-02T23:46:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.138+0000 7f60ba577640 1 -- 172.21.15.96:0/2785823904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60b40683e0 con 0x7f60b40c29a0 2024-06-02T23:46:47.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.139+0000 7f60b0ff9640 1 -- 172.21.15.96:0/2785823904 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f60a8019030 con 0x7f60b40c29a0 2024-06-02T23:46:47.140 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:47.140 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":24,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:30.096314+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:47.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.141+0000 7f60ba577640 1 -- 172.21.15.96:0/2785823904 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f60a006be30 msgr2=0x7f60a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.141+0000 7f60ba577640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f60a006be30 0x7f60a006e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60a4033000 tx=0x7f60a4008030 comp rx=0 tx=0).stop 2024-06-02T23:46:47.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.141+0000 7f60ba577640 1 -- 172.21.15.96:0/2785823904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40c29a0 msgr2=0x7f60b4158a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.141+0000 7f60ba577640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40c29a0 0x7f60b4158a50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f60a8011a70 tx=0x7f60a8011f30 comp rx=0 tx=0).stop 2024-06-02T23:46:47.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.141+0000 7f60ba577640 1 -- 172.21.15.96:0/2785823904 shutdown_connections 2024-06-02T23:46:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.141+0000 7f60ba577640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60b4071e70 0x7f60b40722f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.141+0000 7f60ba577640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f60a006be30 0x7f60a006e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.141+0000 7f60ba577640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f60b40c29a0 0x7f60b4158a50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.141+0000 7f60ba577640 1 --2- 172.21.15.96:0/2785823904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c0039b0 0x7f60b4158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.141+0000 7f60ba577640 1 -- 172.21.15.96:0/2785823904 >> 172.21.15.96:0/2785823904 conn(0x7f60b40cfc30 msgr2=0x7f60b4153470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.142+0000 7f60ba577640 1 -- 172.21.15.96:0/2785823904 shutdown_connections 2024-06-02T23:46:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.142+0000 7f60ba577640 1 -- 172.21.15.96:0/2785823904 wait complete. 2024-06-02T23:46:47.153 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-06-02T23:46:47.153 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-06-02T23:46:47.154 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-06-02T23:46:47.154 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-06-02T23:46:47.155 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-06-02T23:46:47.155 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-06-02T23:46:47.155 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-06-02T23:46:47.156 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-06-02T23:46:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.325+0000 7f93c24df640 1 Processor -- start 2024-06-02T23:46:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.326+0000 7fa97c9c1640 1 Processor -- start 2024-06-02T23:46:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.326+0000 7f077759e640 1 Processor -- start 2024-06-02T23:46:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.326+0000 7fa97c9c1640 1 -- start start 2024-06-02T23:46:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.325+0000 7f93c24df640 1 -- start start 2024-06-02T23:46:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.326+0000 7fc898012640 1 Processor -- start 2024-06-02T23:46:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.326+0000 7f077759e640 1 -- start start 2024-06-02T23:46:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7f93c24df640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f93bc0d2d10 0x7f93bc0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7f93c24df640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93bc15e810 con 0x7f93bc0d4b40 2024-06-02T23:46:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7f93c24df640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93bc0b70c0 con 0x7f93bc15e430 2024-06-02T23:46:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7f93c24df640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f93bc0b6e70 con 0x7f93bc0d2d10 2024-06-02T23:46:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7fa97c9c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780ae6b0 0x7fa9780d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7f93bb7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f93bc0d2d10 0x7f93bc0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f077759e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0778162740 0x7f077806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f077759e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f07780b5900 0x7f07780b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f077759e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0778166a50 con 0x7f077809bda0 2024-06-02T23:46:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f077759e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f07780b6270 con 0x7f07780b5900 2024-06-02T23:46:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f077759e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0778166d30 con 0x7f0778162740 2024-06-02T23:46:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7fa97659c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa97815ae40 0x7fa9780b51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:42200/0 (socket says 172.21.15.96:42200) 2024-06-02T23:46:47.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7fa976d9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa9780d1100 0x7fa97806e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39892/0 (socket says 172.21.15.96:39892) 2024-06-02T23:46:47.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7fa96ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780ae6b0 0x7fa9780d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7fa96ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780ae6b0 0x7fa9780d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38608/0 (socket says 172.21.15.96:38608) 2024-06-02T23:46:47.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7fa97c9c1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97815b220 con 0x7fa9780d1100 2024-06-02T23:46:47.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7fa97c9c1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9780aed00 con 0x7fa97815ae40 2024-06-02T23:46:47.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7fa97c9c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9780b58c0 con 0x7fa9780ae6b0 2024-06-02T23:46:47.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7fa97659c640 1 -- 172.21.15.96:0/950727685 learned_addr learned my addr 172.21.15.96:0/950727685 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:47.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7f93bbfff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f93bc15e430 0x7f93bc0d2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:42186/0 (socket says 172.21.15.96:42186) 2024-06-02T23:46:47.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7f93bbfff640 1 -- 172.21.15.96:0/3379692386 learned_addr learned my addr 172.21.15.96:0/3379692386 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:47.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.326+0000 7fc898012640 1 -- start start 2024-06-02T23:46:47.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7fc898012640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8900b31f0 0x7fc89006d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7fc898012640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc89015a8d0 con 0x7fc8900b2d40 2024-06-02T23:46:47.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7fc898012640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8901409b0 con 0x7fc8901405d0 2024-06-02T23:46:47.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.327+0000 7fc898012640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc890072a20 con 0x7fc8900b31f0 2024-06-02T23:46:47.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7fc8955ad640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc8900b2d40 0x7fc89006cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39894/0 (socket says 172.21.15.96:39894) 2024-06-02T23:46:47.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7fc8955ad640 1 -- 172.21.15.96:0/2618015485 learned_addr learned my addr 172.21.15.96:0/2618015485 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:47.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7fc8965af640 1 --2- 172.21.15.96:0/2618015485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8900b31f0 0x7fc89006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7ff68d55a640 1 Processor -- start 2024-06-02T23:46:47.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7ff68d55a640 1 -- start start 2024-06-02T23:46:47.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f077659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0778162740 0x7f077806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f077659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0778162740 0x7f077806c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38632/0 (socket says 172.21.15.96:38632) 2024-06-02T23:46:47.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f077659c640 1 -- 172.21.15.96:0/4267493240 learned_addr learned my addr 172.21.15.96:0/4267493240 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7f077659c640 1 -- 172.21.15.96:0/4267493240 >> v2:172.21.15.96:3300/0 conn(0x7f07780b5900 msgr2=0x7f07780b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7f077659c640 1 --2- 172.21.15.96:0/4267493240 >> v2:172.21.15.96:3300/0 conn(0x7f07780b5900 0x7f07780b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7f077659c640 1 -- 172.21.15.96:0/4267493240 >> v1:172.21.15.162:6789/0 conn(0x7f077809bda0 legacy=0x7f0778166190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7f077659c640 1 -- 172.21.15.96:0/4267493240 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0778167010 con 0x7f0778162740 2024-06-02T23:46:47.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f380d462640 1 Processor -- start 2024-06-02T23:46:47.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f93baffd640 1 -- 172.21.15.96:0/3379692386 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264596003 0 0) 0x7f93bc0b70c0 con 0x7f93bc15e430 2024-06-02T23:46:47.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f93baffd640 1 -- 172.21.15.96:0/3379692386 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93a4003520 con 0x7f93bc15e430 2024-06-02T23:46:47.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f93bb7fe640 1 -- 172.21.15.96:0/3379692386 >> v1:172.21.15.162:6789/0 conn(0x7f93bc15e430 legacy=0x7f93bc0d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7f93bb7fe640 1 -- 172.21.15.96:0/3379692386 >> v1:172.21.15.96:6789/0 conn(0x7f93bc0d4b40 legacy=0x7f93bc0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7f93bb7fe640 1 -- 172.21.15.96:0/3379692386 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc0b73a0 con 0x7f93bc0d2d10 2024-06-02T23:46:47.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7fc894dac640 1 -- 172.21.15.96:0/2618015485 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776005983 0 0) 0x7fc8901409b0 con 0x7fc8901405d0 2024-06-02T23:46:47.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.328+0000 7fc894dac640 1 -- 172.21.15.96:0/2618015485 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc87c003520 con 0x7fc8901405d0 2024-06-02T23:46:47.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7fc8965af640 1 -- 172.21.15.96:0/2618015485 >> v1:172.21.15.162:6789/0 conn(0x7fc8901405d0 legacy=0x7fc8900712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7fc8965af640 1 -- 172.21.15.96:0/2618015485 >> v1:172.21.15.96:6789/0 conn(0x7fc8900b2d40 legacy=0x7fc89006cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7fc8965af640 1 -- 172.21.15.96:0/2618015485 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc890071e10 con 0x7fc8900b31f0 2024-06-02T23:46:47.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff68d55a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688070ed0 0x7ff6880727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff68d55a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff688072dd0 0x7ff68806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff68d55a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff6880712b0 0x7ff6880ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff68d55a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff68815d010 con 0x7ff6880712b0 2024-06-02T23:46:47.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff68d55a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff68815d2f0 con 0x7ff688072dd0 2024-06-02T23:46:47.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff68d55a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff68806cef0 con 0x7ff688070ed0 2024-06-02T23:46:47.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7f11a5cfc640 1 Processor -- start 2024-06-02T23:46:47.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff686ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688070ed0 0x7ff6880727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff6877fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff6880712b0 0x7ff6880ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff686ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688070ed0 0x7ff6880727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38640/0 (socket says 172.21.15.96:38640) 2024-06-02T23:46:47.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff686ffd640 1 -- 172.21.15.96:0/554930456 learned_addr learned my addr 172.21.15.96:0/554930456 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7fa975d9b640 1 -- 172.21.15.96:0/950727685 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510619360 0 0) 0x7fa97815b220 con 0x7fa9780d1100 2024-06-02T23:46:47.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff6877fe640 1 --2- 172.21.15.96:0/554930456 >> v2:172.21.15.96:3300/0 conn(0x7ff6880712b0 0x7ff6880ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54694/0 (socket says 172.21.15.96:54694) 2024-06-02T23:46:47.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7ff6867fc640 1 --2- 172.21.15.96:0/554930456 >> v2:172.21.15.162:3300/0 conn(0x7ff688072dd0 0x7ff68806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7fa975d9b640 1 -- 172.21.15.96:0/950727685 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa964005730 con 0x7fa9780d1100 2024-06-02T23:46:47.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7fa975d9b640 1 -- 172.21.15.96:0/950727685 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851113665 0 0) 0x7fa9780aed00 con 0x7fa97815ae40 2024-06-02T23:46:47.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7fa975d9b640 1 -- 172.21.15.96:0/950727685 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa97815b220 con 0x7fa97815ae40 2024-06-02T23:46:47.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7fa96ffff640 1 -- 172.21.15.96:0/950727685 >> v1:172.21.15.162:6789/0 conn(0x7fa97815ae40 legacy=0x7fa9780b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7fa96ffff640 1 -- 172.21.15.96:0/950727685 >> v1:172.21.15.96:6789/0 conn(0x7fa9780d1100 legacy=0x7fa97806e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7f077659c640 1 --2- 172.21.15.96:0/4267493240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0778162740 0x7f077806c770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0768009870 tx=0x7f076802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=453b0dc13b1d0a66 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7f077559a640 1 -- 172.21.15.96:0/4267493240 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0768037070 con 0x7f0778162740 2024-06-02T23:46:47.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7f077559a640 1 -- 172.21.15.96:0/4267493240 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0768032440 con 0x7f0778162740 2024-06-02T23:46:47.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7f077559a640 1 -- 172.21.15.96:0/4267493240 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0768032810 con 0x7f0778162740 2024-06-02T23:46:47.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7fa96ffff640 1 -- 172.21.15.96:0/950727685 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9780aefe0 con 0x7fa9780ae6b0 2024-06-02T23:46:47.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7f380d462640 1 -- start start 2024-06-02T23:46:47.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7ff686ffd640 1 -- 172.21.15.96:0/554930456 >> v2:172.21.15.162:3300/0 conn(0x7ff688072dd0 msgr2=0x7ff68806edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7ff686ffd640 1 --2- 172.21.15.96:0/554930456 >> v2:172.21.15.162:3300/0 conn(0x7ff688072dd0 0x7ff68806edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7ff686ffd640 1 -- 172.21.15.96:0/554930456 >> v2:172.21.15.96:3300/0 conn(0x7ff6880712b0 msgr2=0x7ff6880ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7ff686ffd640 1 --2- 172.21.15.96:0/554930456 >> v2:172.21.15.96:3300/0 conn(0x7ff6880712b0 0x7ff6880ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7ff686ffd640 1 -- 172.21.15.96:0/554930456 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68806d1d0 con 0x7ff688070ed0 2024-06-02T23:46:47.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7ff3d58a3640 1 Processor -- start 2024-06-02T23:46:47.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.330+0000 7f93bb7fe640 1 --2- 172.21.15.96:0/3379692386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93bc0d2d10 0x7f93bc0b4bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93b00097a0 tx=0x7f93b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a9819f58567790 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7ff3d58a3640 1 -- start start 2024-06-02T23:46:47.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.329+0000 7f11a5cfc640 1 -- start start 2024-06-02T23:46:47.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f11a5cfc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11a015cc80 0x7f11a006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7fa96ffff640 1 --2- 172.21.15.96:0/950727685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780ae6b0 0x7fa9780d0bc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa9600097d0 tx=0x7fa96002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a4e7936c2b68b89 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f93baffd640 1 -- 172.21.15.96:0/3379692386 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0037070 con 0x7f93bc0d2d10 2024-06-02T23:46:47.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f93baffd640 1 -- 172.21.15.96:0/3379692386 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b0032440 con 0x7f93bc0d2d10 2024-06-02T23:46:47.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f93baffd640 1 -- 172.21.15.96:0/3379692386 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0032810 con 0x7f93bc0d2d10 2024-06-02T23:46:47.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f11a5cfc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11a006e490 0x7f11a00c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f11a5cfc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f11a00c35e0 0x7f11a0166100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f11a5cfc640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f11a00cddd0 con 0x7f11a00c35e0 2024-06-02T23:46:47.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f11a5cfc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f11a006f290 con 0x7f11a015cc80 2024-06-02T23:46:47.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7fc8965af640 1 --2- 172.21.15.96:0/2618015485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8900b31f0 0x7fc89006d420 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0090e0 tx=0x7fc88c02b440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f72dc63fe34c48 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f11a5cfc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f11a006e9f0 con 0x7f11a006e490 2024-06-02T23:46:47.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f380d462640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f38080b55b0 0x7f38080d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f380d462640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f38080d4b10 0x7f3808166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7ff686ffd640 1 --2- 172.21.15.96:0/554930456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688070ed0 0x7ff6880727b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff688075110 tx=0x7ff67802a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de9ae4671baa713f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f380d462640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3808162db0 con 0x7f38080d2340 2024-06-02T23:46:47.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f380d462640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f38080cfc70 con 0x7f38080b55b0 2024-06-02T23:46:47.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f380d462640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f38080cedc0 con 0x7f38080d4b10 2024-06-02T23:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f077759e640 1 -- 172.21.15.96:0/4267493240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0778162740 msgr2=0x7f077806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f077759e640 1 --2- 172.21.15.96:0/4267493240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0778162740 0x7f077806c770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0768009870 tx=0x7f076802a250 comp rx=0 tx=0).stop 2024-06-02T23:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f119f7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11a015cc80 0x7f11a006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f119f7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11a015cc80 0x7f11a006df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:55676/0 (socket says 172.21.15.96:55676) 2024-06-02T23:46:47.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f119f7fe640 1 -- 172.21.15.96:0/225979828 learned_addr learned my addr 172.21.15.96:0/225979828 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f119effd640 1 --2- 172.21.15.96:0/225979828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11a006e490 0x7f11a00c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7fc894dac640 1 -- 172.21.15.96:0/2618015485 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c037070 con 0x7fc8900b31f0 2024-06-02T23:46:47.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f077759e640 1 -- 172.21.15.96:0/4267493240 shutdown_connections 2024-06-02T23:46:47.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f077759e640 1 --2- 172.21.15.96:0/4267493240 >> v2:172.21.15.96:3300/0 conn(0x7f07780b5900 0x7f07780b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f077759e640 1 --2- 172.21.15.96:0/4267493240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0778162740 0x7f077806c770 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f077759e640 1 -- 172.21.15.96:0/4267493240 >> 172.21.15.96:0/4267493240 conn(0x7f07780d0900 msgr2=0x7f07780d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f380cc61640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f38080d2340 0x7f38080b6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:42228/0 (socket says 172.21.15.96:42228) 2024-06-02T23:46:47.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f380cc61640 1 -- 172.21.15.96:0/961080026 learned_addr learned my addr 172.21.15.96:0/961080026 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:47.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f119ffff640 1 --2- 172.21.15.96:0/225979828 >> v2:172.21.15.96:3300/0 conn(0x7f11a00c35e0 0x7f11a0166100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f077759e640 1 -- 172.21.15.96:0/4267493240 shutdown_connections 2024-06-02T23:46:47.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7fc894dac640 1 -- 172.21.15.96:0/2618015485 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc88c030710 con 0x7fc8900b31f0 2024-06-02T23:46:47.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f38077fe640 1 --2- 172.21.15.96:0/961080026 >> v2:172.21.15.162:3300/0 conn(0x7f38080d4b10 0x7f3808166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f119f7fe640 1 -- 172.21.15.96:0/225979828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11a006e490 msgr2=0x7f11a00c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f119f7fe640 1 --2- 172.21.15.96:0/225979828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11a006e490 0x7f11a00c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f119f7fe640 1 -- 172.21.15.96:0/225979828 >> v2:172.21.15.96:3300/0 conn(0x7f11a00c35e0 msgr2=0x7f11a0166100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f119f7fe640 1 --2- 172.21.15.96:0/225979828 >> v2:172.21.15.96:3300/0 conn(0x7f11a00c35e0 0x7f11a0166100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f119f7fe640 1 -- 172.21.15.96:0/225979828 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a006ecd0 con 0x7f11a015cc80 2024-06-02T23:46:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f119ffff640 1 --2- 172.21.15.96:0/225979828 >> v2:172.21.15.96:3300/0 conn(0x7f11a00c35e0 0x7f11a0166100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7ff685ffb640 1 -- 172.21.15.96:0/554930456 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678037070 con 0x7ff688070ed0 2024-06-02T23:46:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7ff685ffb640 1 -- 172.21.15.96:0/554930456 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678032440 con 0x7ff688070ed0 2024-06-02T23:46:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f38077fe640 1 -- 172.21.15.96:0/961080026 >> v2:172.21.15.96:3300/0 conn(0x7f38080b55b0 msgr2=0x7f38080d0100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-02T23:46:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7ff685ffb640 1 -- 172.21.15.96:0/554930456 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678032810 con 0x7ff688070ed0 2024-06-02T23:46:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f93c24df640 1 -- 172.21.15.96:0/3379692386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93bc0d2d10 msgr2=0x7f93bc0b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f93c24df640 1 --2- 172.21.15.96:0/3379692386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93bc0d2d10 0x7f93bc0b4bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f93b00097a0 tx=0x7f93b002a230 comp rx=0 tx=0).stop 2024-06-02T23:46:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7fa975d9b640 1 -- 172.21.15.96:0/950727685 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960037070 con 0x7fa9780ae6b0 2024-06-02T23:46:47.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7fa975d9b640 1 -- 172.21.15.96:0/950727685 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa960032440 con 0x7fa9780ae6b0 2024-06-02T23:46:47.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7fa975d9b640 1 -- 172.21.15.96:0/950727685 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960037070 con 0x7fa9780ae6b0 2024-06-02T23:46:47.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f3807fff640 1 --2- 172.21.15.96:0/961080026 >> v2:172.21.15.96:3300/0 conn(0x7f38080b55b0 0x7f38080d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f38077fe640 1 --2- 172.21.15.96:0/961080026 >> v2:172.21.15.96:3300/0 conn(0x7f38080b55b0 0x7f38080d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f38077fe640 1 -- 172.21.15.96:0/961080026 >> v1:172.21.15.162:6789/0 conn(0x7f38080d2340 legacy=0x7f38080b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f93c24df640 1 -- 172.21.15.96:0/3379692386 shutdown_connections 2024-06-02T23:46:47.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f93c24df640 1 --2- 172.21.15.96:0/3379692386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93bc0d2d10 0x7f93bc0b4bd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f93c24df640 1 -- 172.21.15.96:0/3379692386 >> 172.21.15.96:0/3379692386 conn(0x7f93bc0d4020 msgr2=0x7f93bc0d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7fc894dac640 1 -- 172.21.15.96:0/2618015485 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c030b20 con 0x7fc8900b31f0 2024-06-02T23:46:47.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7fc898012640 1 -- 172.21.15.96:0/2618015485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8900b31f0 msgr2=0x7fc89006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7fc898012640 1 --2- 172.21.15.96:0/2618015485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8900b31f0 0x7fc89006d420 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc88c0090e0 tx=0x7fc88c02b440 comp rx=0 tx=0).stop 2024-06-02T23:46:47.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7fc898012640 1 -- 172.21.15.96:0/2618015485 shutdown_connections 2024-06-02T23:46:47.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7fc898012640 1 --2- 172.21.15.96:0/2618015485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8900b31f0 0x7fc89006d420 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7fc898012640 1 -- 172.21.15.96:0/2618015485 >> 172.21.15.96:0/2618015485 conn(0x7fc8900b1730 msgr2=0x7fc8900b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7ff3d58a3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff3c8055400 0x7ff3c80382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7ff3ce7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff3c8055400 0x7ff3c80382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7ff3ce7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff3c8055400 0x7ff3c80382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54716/0 (socket says 172.21.15.96:54716) 2024-06-02T23:46:47.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7ff3ce7fc640 1 -- 172.21.15.96:0/1147909166 learned_addr learned my addr 172.21.15.96:0/1147909166 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7ff3d58a3640 1 --2- 172.21.15.96:0/1147909166 >> v2:172.21.15.162:3300/0 conn(0x7ff3c80e81b0 0x7ff3c80e85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1147909166 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c8053930 con 0x7ff3c80e7730 2024-06-02T23:46:47.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.331+0000 7f077759e640 1 -- 172.21.15.96:0/4267493240 wait complete. 2024-06-02T23:46:47.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7fc898012640 1 -- 172.21.15.96:0/2618015485 shutdown_connections 2024-06-02T23:46:47.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1147909166 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c8038820 con 0x7ff3c8055400 2024-06-02T23:46:47.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff3cffff640 1 --2- 172.21.15.96:0/1147909166 >> v2:172.21.15.162:3300/0 conn(0x7ff3c80e81b0 0x7ff3c80e85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff68d55a640 1 -- 172.21.15.96:0/554930456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688070ed0 msgr2=0x7ff6880727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff68d55a640 1 --2- 172.21.15.96:0/554930456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688070ed0 0x7ff6880727b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff688075110 tx=0x7ff67802a1d0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1147909166 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c80e8b20 con 0x7ff3c80e81b0 2024-06-02T23:46:47.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f38077fe640 1 -- 172.21.15.96:0/961080026 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38080cf060 con 0x7f38080d4b10 2024-06-02T23:46:47.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.332+0000 7f3807fff640 1 --2- 172.21.15.96:0/961080026 >> v2:172.21.15.96:3300/0 conn(0x7f38080b55b0 0x7f38080d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:47.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff68d55a640 1 -- 172.21.15.96:0/554930456 shutdown_connections 2024-06-02T23:46:47.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff68d55a640 1 --2- 172.21.15.96:0/554930456 >> v2:172.21.15.96:3300/0 conn(0x7ff6880712b0 0x7ff6880ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff68d55a640 1 --2- 172.21.15.96:0/554930456 >> v2:172.21.15.162:3300/0 conn(0x7ff688072dd0 0x7ff68806edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff68d55a640 1 --2- 172.21.15.96:0/554930456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688070ed0 0x7ff6880727b0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff688075110 tx=0x7ff67802a1d0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff68d55a640 1 -- 172.21.15.96:0/554930456 >> 172.21.15.96:0/554930456 conn(0x7ff6880cfb90 msgr2=0x7ff6880cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7fa97c9c1640 1 -- 172.21.15.96:0/950727685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780ae6b0 msgr2=0x7fa9780d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7fa97c9c1640 1 --2- 172.21.15.96:0/950727685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780ae6b0 0x7fa9780d0bc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa9600097d0 tx=0x7fa96002a210 comp rx=0 tx=0).stop 2024-06-02T23:46:47.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7f119f7fe640 1 --2- 172.21.15.96:0/225979828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a015cc80 0x7f11a006df50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11a006d8b0 tx=0x7f119802a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=808c680b01d60395 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7f119e7fc640 1 -- 172.21.15.96:0/225979828 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1198036070 con 0x7f11a015cc80 2024-06-02T23:46:47.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7f119e7fc640 1 -- 172.21.15.96:0/225979828 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1198031600 con 0x7f11a015cc80 2024-06-02T23:46:47.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7f119e7fc640 1 -- 172.21.15.96:0/225979828 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11980319d0 con 0x7f11a015cc80 2024-06-02T23:46:47.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7fc898012640 1 -- 172.21.15.96:0/2618015485 wait complete. 2024-06-02T23:46:47.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff68d55a640 1 -- 172.21.15.96:0/554930456 shutdown_connections 2024-06-02T23:46:47.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff68d55a640 1 -- 172.21.15.96:0/554930456 wait complete. 2024-06-02T23:46:47.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7f38077fe640 1 --2- 172.21.15.96:0/961080026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080d4b10 0x7f3808166eb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3808166400 tx=0x7f37f802a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57684ad2a270fa40 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f3806ffd640 1 -- 172.21.15.96:0/961080026 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8037070 con 0x7f38080d4b10 2024-06-02T23:46:47.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f93c24df640 1 -- 172.21.15.96:0/3379692386 shutdown_connections 2024-06-02T23:46:47.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f3806ffd640 1 -- 172.21.15.96:0/961080026 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f802ad30 con 0x7f38080d4b10 2024-06-02T23:46:47.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f3806ffd640 1 -- 172.21.15.96:0/961080026 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8032660 con 0x7f38080d4b10 2024-06-02T23:46:47.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f077759e640 1 Processor -- start 2024-06-02T23:46:47.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f077759e640 1 -- start start 2024-06-02T23:46:47.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff3ce7fc640 1 -- 172.21.15.96:0/1147909166 >> v2:172.21.15.162:3300/0 conn(0x7ff3c80e81b0 msgr2=0x7ff3c80e85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff3ce7fc640 1 --2- 172.21.15.96:0/1147909166 >> v2:172.21.15.162:3300/0 conn(0x7ff3c80e81b0 0x7ff3c80e85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff3ce7fc640 1 -- 172.21.15.96:0/1147909166 >> v1:172.21.15.162:6789/0 conn(0x7ff3c80e7730 legacy=0x7ff3c8006380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.333+0000 7ff3ce7fc640 1 -- 172.21.15.96:0/1147909166 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c8053c10 con 0x7ff3c8055400 2024-06-02T23:46:47.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7fa97c9c1640 1 -- 172.21.15.96:0/950727685 shutdown_connections 2024-06-02T23:46:47.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f11a5cfc640 1 -- 172.21.15.96:0/225979828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a015cc80 msgr2=0x7f11a006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f11a5cfc640 1 --2- 172.21.15.96:0/225979828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a015cc80 0x7f11a006df50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11a006d8b0 tx=0x7f119802a6a0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7fa97c9c1640 1 --2- 172.21.15.96:0/950727685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780ae6b0 0x7fa9780d0bc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7fa97c9c1640 1 -- 172.21.15.96:0/950727685 >> 172.21.15.96:0/950727685 conn(0x7fa97806c4d0 msgr2=0x7fa97806c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7fc898012640 1 Processor -- start 2024-06-02T23:46:47.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f11a5cfc640 1 -- 172.21.15.96:0/225979828 shutdown_connections 2024-06-02T23:46:47.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f11a5cfc640 1 --2- 172.21.15.96:0/225979828 >> v2:172.21.15.96:3300/0 conn(0x7f11a00c35e0 0x7f11a0166100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f11a5cfc640 1 --2- 172.21.15.96:0/225979828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11a006e490 0x7f11a00c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f11a5cfc640 1 --2- 172.21.15.96:0/225979828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a015cc80 0x7f11a006df50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f11a5cfc640 1 -- 172.21.15.96:0/225979828 >> 172.21.15.96:0/225979828 conn(0x7f11a00b1c00 msgr2=0x7f11a00b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7fc898012640 1 -- start start 2024-06-02T23:46:47.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f93c24df640 1 -- 172.21.15.96:0/3379692386 wait complete. 2024-06-02T23:46:47.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f380d462640 1 -- 172.21.15.96:0/961080026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080d4b10 msgr2=0x7f3808166eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7f380d462640 1 --2- 172.21.15.96:0/961080026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080d4b10 0x7f3808166eb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3808166400 tx=0x7f37f802a0a0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f380d462640 1 -- 172.21.15.96:0/961080026 shutdown_connections 2024-06-02T23:46:47.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.334+0000 7ff3ce7fc640 1 --2- 172.21.15.96:0/1147909166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3c8055400 0x7ff3c80382e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8057eb0 tx=0x7ff3c402a450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26a36738c942fcc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f11a5cfc640 1 -- 172.21.15.96:0/225979828 shutdown_connections 2024-06-02T23:46:47.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f380d462640 1 --2- 172.21.15.96:0/961080026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080d4b10 0x7f3808166eb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f380d462640 1 --2- 172.21.15.96:0/961080026 >> v2:172.21.15.96:3300/0 conn(0x7f38080b55b0 0x7f38080d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f380d462640 1 -- 172.21.15.96:0/961080026 >> 172.21.15.96:0/961080026 conn(0x7f38080d3f80 msgr2=0x7f38080d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7ff3cdffb640 1 -- 172.21.15.96:0/1147909166 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4036070 con 0x7ff3c8055400 2024-06-02T23:46:47.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7ff3cdffb640 1 -- 172.21.15.96:0/1147909166 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c4031600 con 0x7ff3c8055400 2024-06-02T23:46:47.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7ff3cdffb640 1 -- 172.21.15.96:0/1147909166 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40319d0 con 0x7ff3c8055400 2024-06-02T23:46:47.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7ff68d55a640 1 Processor -- start 2024-06-02T23:46:47.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7ff68d55a640 1 -- start start 2024-06-02T23:46:47.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f380d462640 1 -- 172.21.15.96:0/961080026 shutdown_connections 2024-06-02T23:46:47.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f380d462640 1 -- 172.21.15.96:0/961080026 wait complete. 2024-06-02T23:46:47.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7fc898012640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8900b2d40 0x7fc89013b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7fc898012640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8900b31f0 0x7fc890157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7fa97c9c1640 1 -- 172.21.15.96:0/950727685 shutdown_connections 2024-06-02T23:46:47.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7fc898012640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8901405d0 0x7fc890158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7fc898012640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc8900726b0 con 0x7fc8900b31f0 2024-06-02T23:46:47.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7fc898012640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8900723d0 con 0x7fc8900b2d40 2024-06-02T23:46:47.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7fc898012640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8900b3620 con 0x7fc8901405d0 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f077759e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077809bda0 0x7f07780cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f077759e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07780b5900 0x7f0778200920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f077759e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0778162740 0x7f0778160e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f077659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077809bda0 0x7f07780cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f077659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077809bda0 0x7f07780cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38658/0 (socket says 172.21.15.96:38658) 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f0776d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0778162740 0x7f0778160e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f0776d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0778162740 0x7f0778160e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54720/0 (socket says 172.21.15.96:54720) 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f077659c640 1 -- 172.21.15.96:0/3334838031 learned_addr learned my addr 172.21.15.96:0/3334838031 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f077759e640 1 -- 172.21.15.96:0/3334838031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f077809c200 con 0x7f0778162740 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f077759e640 1 -- 172.21.15.96:0/3334838031 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07780b74a0 con 0x7f07780b5900 2024-06-02T23:46:47.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f077759e640 1 -- 172.21.15.96:0/3334838031 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f07780b79c0 con 0x7f077809bda0 2024-06-02T23:46:47.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8965af640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8901405d0 0x7fc890158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8965af640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8901405d0 0x7fc890158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38660/0 (socket says 172.21.15.96:38660) 2024-06-02T23:46:47.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fa97c9c1640 1 -- 172.21.15.96:0/950727685 wait complete. 2024-06-02T23:46:47.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8965af640 1 -- 172.21.15.96:0/2169320567 learned_addr learned my addr 172.21.15.96:0/2169320567 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc895dae640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8900b2d40 0x7fc89013b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.335+0000 7f11a5cfc640 1 -- 172.21.15.96:0/225979828 wait complete. 2024-06-02T23:46:47.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8965af640 1 -- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8900b2d40 msgr2=0x7fc89013b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7f0775d9b640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07780b5900 0x7f0778200920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8965af640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8900b2d40 0x7fc89013b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8955ad640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8900b31f0 0x7fc890157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8965af640 1 -- 172.21.15.96:0/2169320567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8900b31f0 msgr2=0x7fc890157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8965af640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8900b31f0 0x7fc890157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7f11a5cfc640 1 Processor -- start 2024-06-02T23:46:47.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8965af640 1 -- 172.21.15.96:0/2169320567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89013bae0 con 0x7fc8901405d0 2024-06-02T23:46:47.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7f0776d9d640 1 -- 172.21.15.96:0/3334838031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077809bda0 msgr2=0x7f07780cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7f0776d9d640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f077809bda0 0x7f07780cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7f0776d9d640 1 -- 172.21.15.96:0/3334838031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07780b5900 msgr2=0x7f0778200920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7f0776d9d640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07780b5900 0x7f0778200920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7f0776d9d640 1 -- 172.21.15.96:0/3334838031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0778161700 con 0x7f0778162740 2024-06-02T23:46:47.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7f93c24df640 1 Processor -- start 2024-06-02T23:46:47.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7f11a5cfc640 1 -- start start 2024-06-02T23:46:47.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8955ad640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8900b31f0 0x7fc890157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:47.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7fc8965af640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8901405d0 0x7fc890158fb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009200 tx=0x7fc88c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff68d55a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6880712b0 0x7ff68815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff68d55a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688072dd0 0x7ff6881f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff686ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6880712b0 0x7ff68815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff686ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6880712b0 0x7ff68815b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:55728/0 (socket says 172.21.15.96:55728) 2024-06-02T23:46:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff68d55a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6881f3dc0 0x7ff6881f3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff686ffd640 1 -- 172.21.15.96:0/3200837415 learned_addr learned my addr 172.21.15.96:0/3200837415 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff6867fc640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688072dd0 0x7ff6881f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff6877fe640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6881f3dc0 0x7ff6881f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff688071d30 con 0x7ff6881f3dc0 2024-06-02T23:46:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff688071bb0 con 0x7ff6880712b0 2024-06-02T23:46:47.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.336+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff68806d4b0 con 0x7ff688072dd0 2024-06-02T23:46:47.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1147909166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3c8055400 msgr2=0x7ff3c80382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7ff3d58a3640 1 --2- 172.21.15.96:0/1147909166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3c8055400 0x7ff3c80382e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8057eb0 tx=0x7ff3c402a450 comp rx=0 tx=0).stop 2024-06-02T23:46:47.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7f0776d9d640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0778162740 0x7f0778160e00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f077000be20 tx=0x7f077000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7f0766ffd640 1 -- 172.21.15.96:0/3334838031 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770019070 con 0x7f0778162740 2024-06-02T23:46:47.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7f077759e640 1 -- 172.21.15.96:0/3334838031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07780c7b50 con 0x7f0778162740 2024-06-02T23:46:47.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7f077759e640 1 -- 172.21.15.96:0/3334838031 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07780c8110 con 0x7f0778162740 2024-06-02T23:46:47.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7fa97c9c1640 1 Processor -- start 2024-06-02T23:46:47.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7fa97c9c1640 1 -- start start 2024-06-02T23:46:47.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7f380d462640 1 Processor -- start 2024-06-02T23:46:47.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7f380d462640 1 -- start start 2024-06-02T23:46:47.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7f93c24df640 1 -- start start 2024-06-02T23:46:47.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f93c24df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc0d4b40 0x7f93bc0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f93c24df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93bc15e430 0x7f93bc151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f11a5cfc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a006e490 0x7f11a00b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f11a5cfc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a00c35e0 0x7f11a00b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f11a5cfc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11a015cc80 0x7f11a00c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f11a5cfc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f11a0166640 con 0x7f11a00c35e0 2024-06-02T23:46:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f11a5cfc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f11a00af560 con 0x7f11a006e490 2024-06-02T23:46:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f11a5cfc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f11a01667c0 con 0x7f11a015cc80 2024-06-02T23:46:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7ff6867fc640 1 -- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6880712b0 msgr2=0x7ff68815b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7ff6867fc640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6880712b0 0x7ff68815b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7ff6867fc640 1 -- 172.21.15.96:0/3200837415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6881f3dc0 msgr2=0x7ff6881f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7ff6867fc640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6881f3dc0 0x7ff6881f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7ff6867fc640 1 -- 172.21.15.96:0/3200837415 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68815b760 con 0x7ff688072dd0 2024-06-02T23:46:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7ff6867fc640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688072dd0 0x7ff6881f3220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff680008930 tx=0x7ff680008df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f0766ffd640 1 -- 172.21.15.96:0/3334838031 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0770014440 con 0x7f0778162740 2024-06-02T23:46:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f0766ffd640 1 -- 172.21.15.96:0/3334838031 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770014830 con 0x7f0778162740 2024-06-02T23:46:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f93c24df640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93bc0cb0f0 0x7f93bc15fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7fc8867fc640 1 -- 172.21.15.96:0/2169320567 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c037070 con 0x7fc8901405d0 2024-06-02T23:46:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7fc8867fc640 1 -- 172.21.15.96:0/2169320567 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc88c038040 con 0x7fc8901405d0 2024-06-02T23:46:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7fc8867fc640 1 -- 172.21.15.96:0/2169320567 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88c032d80 con 0x7fc8901405d0 2024-06-02T23:46:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7fc898012640 1 -- 172.21.15.96:0/2169320567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc890157f10 con 0x7fc8901405d0 2024-06-02T23:46:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f93bbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc0d4b40 0x7f93bc0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7f93bbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc0d4b40 0x7f93bc0ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:55750/0 (socket says 172.21.15.96:55750) 2024-06-02T23:46:47.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7fc898012640 1 -- 172.21.15.96:0/2169320567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8901584d0 con 0x7fc8901405d0 2024-06-02T23:46:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f119f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a006e490 0x7f11a00b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f380d462640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38080b55b0 0x7f380815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f380d462640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080d2340 0x7f38081f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f119effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a00c35e0 0x7f11a00b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f119effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a00c35e0 0x7f11a00b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54756/0 (socket says 172.21.15.96:54756) 2024-06-02T23:46:47.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f119effd640 1 -- 172.21.15.96:0/2602505927 learned_addr learned my addr 172.21.15.96:0/2602505927 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f3807fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38080b55b0 0x7f380815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f3807fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38080b55b0 0x7f380815ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38712/0 (socket says 172.21.15.96:38712) 2024-06-02T23:46:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f3807fff640 1 -- 172.21.15.96:0/262994603 learned_addr learned my addr 172.21.15.96:0/262994603 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f38077fe640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080d2340 0x7f38081f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f380d462640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38080d4b10 0x7f38080b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f380d462640 1 -- 172.21.15.96:0/262994603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f38080cf900 con 0x7f38080d4b10 2024-06-02T23:46:47.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f380d462640 1 -- 172.21.15.96:0/262994603 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38080cf620 con 0x7f38080d2340 2024-06-02T23:46:47.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f380d462640 1 -- 172.21.15.96:0/262994603 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f38080d27d0 con 0x7f38080b55b0 2024-06-02T23:46:47.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f380cc61640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38080d4b10 0x7f38080b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1147909166 shutdown_connections 2024-06-02T23:46:47.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7ff3d58a3640 1 --2- 172.21.15.96:0/1147909166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3c8055400 0x7ff3c80382e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7ff3d58a3640 1 --2- 172.21.15.96:0/1147909166 >> v2:172.21.15.162:3300/0 conn(0x7ff3c80e81b0 0x7ff3c80e85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1147909166 >> 172.21.15.96:0/1147909166 conn(0x7ff3c8059140 msgr2=0x7ff3c8059520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7f0766ffd640 1 -- 172.21.15.96:0/3334838031 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f077001c070 con 0x7f0778162740 2024-06-02T23:46:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f0766ffd640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f075806be30 0x7f075806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa97c9c1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9780ae6b0 0x7fa97815b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa97c9c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780d1100 0x7fa978153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa97c9c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97815ae40 0x7fa97814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa97659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9780ae6b0 0x7fa97815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa97c9c1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa9780af880 con 0x7fa9780ae6b0 2024-06-02T23:46:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa97659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9780ae6b0 0x7fa97815b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54790/0 (socket says 172.21.15.96:54790) 2024-06-02T23:46:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa97659c640 1 -- 172.21.15.96:0/2302346451 learned_addr learned my addr 172.21.15.96:0/2302346451 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa97c9c1640 1 -- 172.21.15.96:0/2302346451 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9780af5a0 con 0x7fa97815ae40 2024-06-02T23:46:47.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa97c9c1640 1 -- 172.21.15.96:0/2302346451 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa97806ed00 con 0x7fa9780d1100 2024-06-02T23:46:47.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93c24df640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc0b5820 con 0x7f93bc0cb0f0 2024-06-02T23:46:47.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93c24df640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc0b7960 con 0x7f93bc0d4b40 2024-06-02T23:46:47.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93c24df640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f93bc0d1260 con 0x7f93bc15e430 2024-06-02T23:46:47.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93c0a7c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93bc0cb0f0 0x7f93bc15fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93bbfff640 1 -- 172.21.15.96:0/2001394771 learned_addr learned my addr 172.21.15.96:0/2001394771 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f119ffff640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11a015cc80 0x7f11a00c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fc898012640 1 -- 172.21.15.96:0/2169320567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc878001030 con 0x7fc8901405d0 2024-06-02T23:46:47.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7ff66f7fe640 1 -- 172.21.15.96:0/3200837415 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68001c070 con 0x7ff688072dd0 2024-06-02T23:46:47.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.337+0000 7ff66f7fe640 1 -- 172.21.15.96:0/3200837415 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff680013c40 con 0x7ff688072dd0 2024-06-02T23:46:47.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7ff6877fe640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6881f3dc0 0x7ff6881f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:47.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.338+0000 7ff66f7fe640 1 -- 172.21.15.96:0/3200837415 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68000f070 con 0x7ff688072dd0 2024-06-02T23:46:47.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6880c7370 con 0x7ff688072dd0 2024-06-02T23:46:47.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.339+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6880c7630 con 0x7ff688072dd0 2024-06-02T23:46:47.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7ff66d7fa640 1 -- 172.21.15.96:0/3200837415 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff660001030 con 0x7ff688072dd0 2024-06-02T23:46:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1147909166 shutdown_connections 2024-06-02T23:46:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1147909166 wait complete. 2024-06-02T23:46:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f38077fe640 1 -- 172.21.15.96:0/262994603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38080b55b0 msgr2=0x7f380815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f38077fe640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38080b55b0 0x7f380815ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f38077fe640 1 -- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38080d4b10 msgr2=0x7f38080b8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f38077fe640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38080d4b10 0x7f38080b8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f38077fe640 1 -- 172.21.15.96:0/262994603 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38080b9a10 con 0x7f38080d2340 2024-06-02T23:46:47.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f380cc61640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f38080d4b10 0x7f38080b8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93bb7fe640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93bc15e430 0x7f93bc151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93bbfff640 1 -- 172.21.15.96:0/2001394771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93bc15e430 msgr2=0x7f93bc151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93bbfff640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f93bc15e430 0x7f93bc151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93bbfff640 1 -- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93bc0cb0f0 msgr2=0x7f93bc15fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93bbfff640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93bc0cb0f0 0x7f93bc15fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f93bbfff640 1 -- 172.21.15.96:0/2001394771 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc151940 con 0x7f93bc0d4b40 2024-06-02T23:46:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f077659c640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f075806be30 0x7f075806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f0766ffd640 1 -- 172.21.15.96:0/3334838031 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f077008b100 con 0x7f0778162740 2024-06-02T23:46:47.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa96ffff640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780d1100 0x7fa978153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7fa976d9d640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97815ae40 0x7fa97814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.340+0000 7f38077fe640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080d2340 0x7f38081f8650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f37f8031000 tx=0x7f37f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7fa97659c640 1 -- 172.21.15.96:0/2302346451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780d1100 msgr2=0x7fa978153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7fa97659c640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9780d1100 0x7fa978153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7fa97659c640 1 -- 172.21.15.96:0/2302346451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97815ae40 msgr2=0x7fa97814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7fa97659c640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97815ae40 0x7fa97814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7fa97659c640 1 -- 172.21.15.96:0/2302346451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9781e4350 con 0x7fa9780ae6b0 2024-06-02T23:46:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7fa97659c640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9780ae6b0 0x7fa97815b410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c430 tx=0x7fa96800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7fc8867fc640 1 -- 172.21.15.96:0/2169320567 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc88c0305d0 con 0x7fc8901405d0 2024-06-02T23:46:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f93bbfff640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc0d4b40 0x7f93bc0ca4a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c560 tx=0x7f93ac00ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f93b8ff9640 1 -- 172.21.15.96:0/2001394771 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac017070 con 0x7f93bc0d4b40 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f93b8ff9640 1 -- 172.21.15.96:0/2001394771 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ac005ce0 con 0x7f93bc0d4b40 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f93b8ff9640 1 -- 172.21.15.96:0/2001394771 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac0072b0 con 0x7f93bc0d4b40 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93bc0cb5b0 con 0x7f93bc0d4b40 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93bc0cbb70 con 0x7f93bc0d4b40 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f3804ff9640 1 -- 172.21.15.96:0/262994603 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8037050 con 0x7f38080d2340 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f3804ff9640 1 -- 172.21.15.96:0/262994603 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f8038040 con 0x7f38080d2340 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f3804ff9640 1 -- 172.21.15.96:0/262994603 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8004490 con 0x7f38080d2340 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f380d462640 1 -- 172.21.15.96:0/262994603 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38080b6d90 con 0x7f38080d2340 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f380d462640 1 -- 172.21.15.96:0/262994603 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38080b7350 con 0x7f38080d2340 2024-06-02T23:46:47.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7f37ee7fc640 1 -- 172.21.15.96:0/262994603 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f380804f760 con 0x7f38080d2340 2024-06-02T23:46:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7f119ffff640 1 -- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a006e490 msgr2=0x7f11a00b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7f119ffff640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a006e490 0x7f11a00b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7f119ffff640 1 -- 172.21.15.96:0/2602505927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a00c35e0 msgr2=0x7f11a00b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7ff3d58a3640 1 Processor -- start 2024-06-02T23:46:47.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7fc8867fc640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc87406bf00 0x7fc87406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f0764ff9640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] conn(0x7f075c001650 0x7f075c003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f0764ff9640 1 -- 172.21.15.96:0/3334838031 --> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f075c006bb0 con 0x7f075c001650 2024-06-02T23:46:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f077659c640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f075806be30 0x7f075806e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07680090b0 tx=0x7f076802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7f0775d9b640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] conn(0x7f075c001650 0x7f075c003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7fc8867fc640 1 -- 172.21.15.96:0/2169320567 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc88c0ac020 con 0x7fc8901405d0 2024-06-02T23:46:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7fc895dae640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc87406bf00 0x7fc87406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7fc8867fc640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] conn(0x7fc874075680 0x7fc874077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7fc8867fc640 1 -- 172.21.15.96:0/2169320567 --> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc88c008eb0 con 0x7fc874075680 2024-06-02T23:46:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7fc8867fc640 1 -- 172.21.15.96:0/2169320567 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc88c0ac410 con 0x7fc8901405d0 2024-06-02T23:46:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7ff66f7fe640 1 -- 172.21.15.96:0/3200837415 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff680005d10 con 0x7ff688072dd0 2024-06-02T23:46:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7ff3d58a3640 1 -- start start 2024-06-02T23:46:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.341+0000 7ff66f7fe640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff67406beb0 0x7ff67406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7ff66f7fe640 1 -- 172.21.15.96:0/3200837415 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff68008c5e0 con 0x7ff688072dd0 2024-06-02T23:46:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7ff66f7fe640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] conn(0x7ff674075630 0x7ff674077a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7ff66f7fe640 1 -- 172.21.15.96:0/3200837415 --> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff674078140 con 0x7ff674075630 2024-06-02T23:46:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7fc8955ad640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] conn(0x7fc874075680 0x7fc874077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7ff66f7fe640 1 -- 172.21.15.96:0/3200837415 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff68008c9d0 con 0x7ff688072dd0 2024-06-02T23:46:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7ff686ffd640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff67406beb0 0x7ff67406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7ff6877fe640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] conn(0x7ff674075630 0x7ff674077a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7ff686ffd640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff67406beb0 0x7ff67406e370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff67802a210 tx=0x7ff67802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7fa96effd640 1 -- 172.21.15.96:0/2302346451 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968017070 con 0x7fa9780ae6b0 2024-06-02T23:46:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7fa96effd640 1 -- 172.21.15.96:0/2302346451 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa968005ce0 con 0x7fa9780ae6b0 2024-06-02T23:46:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7fa96effd640 1 -- 172.21.15.96:0/2302346451 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968007310 con 0x7fa9780ae6b0 2024-06-02T23:46:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.342+0000 7fa97c9c1640 1 -- 172.21.15.96:0/2302346451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9781e4630 con 0x7fa9780ae6b0 2024-06-02T23:46:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7fa97c9c1640 1 -- 172.21.15.96:0/2302346451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9781e4bf0 con 0x7fa9780ae6b0 2024-06-02T23:46:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7fc895dae640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc87406bf00 0x7fc87406e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc8800011e0 tx=0x7fc880009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7f119ffff640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a00c35e0 0x7f11a00b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7f119ffff640 1 -- 172.21.15.96:0/2602505927 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a00b2e10 con 0x7f11a015cc80 2024-06-02T23:46:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7f3804ff9640 1 -- 172.21.15.96:0/262994603 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37f8003610 con 0x7f38080d2340 2024-06-02T23:46:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7ff6877fe640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] conn(0x7ff674075630 0x7ff674077a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7f93b8ff9640 1 -- 172.21.15.96:0/2001394771 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93ac01a070 con 0x7f93bc0d4b40 2024-06-02T23:46:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.343+0000 7f119effd640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11a00c35e0 0x7f11a00b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f0775d9b640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] conn(0x7f075c001650 0x7f075c003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f119ffff640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11a015cc80 0x7f11a00c9720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f119000e7e0 tx=0x7f119000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f3804ff9640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37f406bf00 0x7f37f406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f3804ff9640 1 -- 172.21.15.96:0/262994603 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f37f80ab760 con 0x7f38080d2340 2024-06-02T23:46:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f3804ff9640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] conn(0x7f37f4075680 0x7f37f4077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7ff3d58a3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3c8055400 0x7ff3c80d96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f3804ff9640 1 -- 172.21.15.96:0/262994603 --> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37f800af30 con 0x7f37f4075680 2024-06-02T23:46:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f3804ff9640 1 -- 172.21.15.96:0/262994603 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f37f80b2050 con 0x7f38080d2340 2024-06-02T23:46:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f1187fff640 1 -- 172.21.15.96:0/2602505927 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119000f040 con 0x7f11a015cc80 2024-06-02T23:46:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f1187fff640 1 -- 172.21.15.96:0/2602505927 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1190004030 con 0x7f11a015cc80 2024-06-02T23:46:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7f0766ffd640 1 -- 172.21.15.96:0/3334838031 <== osd.0 v2:172.21.15.96:6816/2024861809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f075c006bb0 con 0x7f075c001650 2024-06-02T23:46:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7f380cc61640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] conn(0x7f37f4075680 0x7f37f4077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7f3807fff640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37f406bf00 0x7f37f406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f93b8ff9640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f93a806bf00 0x7f93a806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7f93b8ff9640 1 -- 172.21.15.96:0/2001394771 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f93ac08a5d0 con 0x7f93bc0d4b40 2024-06-02T23:46:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7f93c24df640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] conn(0x7f939c001650 0x7f939c003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 --> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f939c006bb0 con 0x7f939c001650 2024-06-02T23:46:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7f93c0a7c640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] conn(0x7f939c001650 0x7f939c003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a00b30f0 con 0x7f11a015cc80 2024-06-02T23:46:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a00b36b0 con 0x7f11a015cc80 2024-06-02T23:46:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7f1187fff640 1 -- 172.21.15.96:0/2602505927 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190004400 con 0x7f11a015cc80 2024-06-02T23:46:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7fc8955ad640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] conn(0x7fc874075680 0x7fc874077ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.346+0000 7fc8867fc640 1 -- 172.21.15.96:0/2169320567 <== osd.5 v2:172.21.15.162:6807/2259495148 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc88c008eb0 con 0x7fc874075680 2024-06-02T23:46:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.344+0000 7ff66f7fe640 1 -- 172.21.15.96:0/3200837415 <== osd.6 v2:172.21.15.162:6800/1800327622 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff674078140 con 0x7ff674075630 2024-06-02T23:46:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3d58a3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3c80e7730 0x7ff3c800d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3d58a3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3c80e81b0 0x7ff3c80d81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3ceffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3c8055400 0x7ff3c80d96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3ce7fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3c80e7730 0x7ff3c800d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3ce7fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3c80e7730 0x7ff3c800d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38742/0 (socket says 172.21.15.96:38742) 2024-06-02T23:46:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3ceffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3c8055400 0x7ff3c80d96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54794/0 (socket says 172.21.15.96:54794) 2024-06-02T23:46:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3c80e81b0 0x7ff3c80d81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3c80e81b0 0x7ff3c80d81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:55770/0 (socket says 172.21.15.96:55770) 2024-06-02T23:46:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3ce7fc640 1 -- 172.21.15.96:0/1086822112 learned_addr learned my addr 172.21.15.96:0/1086822112 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c8053ef0 con 0x7ff3c8055400 2024-06-02T23:46:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c8057b60 con 0x7ff3c80e81b0 2024-06-02T23:46:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c8056d10 con 0x7ff3c80e7730 2024-06-02T23:46:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.346+0000 7f93c0a7c640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] conn(0x7f939c001650 0x7f939c003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.346+0000 7f3807fff640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37f406bf00 0x7f37f406e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00aab0 tx=0x7f37fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.346+0000 7ff3cffff640 1 -- 172.21.15.96:0/1086822112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3c80e7730 msgr2=0x7ff3c800d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.346+0000 7ff3cffff640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3c80e7730 0x7ff3c800d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.346+0000 7ff3cffff640 1 -- 172.21.15.96:0/1086822112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3c8055400 msgr2=0x7ff3c80d96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.346+0000 7ff3cffff640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3c8055400 0x7ff3c80d96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.346+0000 7ff3cffff640 1 -- 172.21.15.96:0/1086822112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c804f970 con 0x7ff3c80e81b0 2024-06-02T23:46:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.346+0000 7f380cc61640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] conn(0x7f37f4075680 0x7f37f4077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.345+0000 7fa96cff9640 1 -- 172.21.15.96:0/2302346451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9781e4100 con 0x7fa9780ae6b0 2024-06-02T23:46:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.346+0000 7f93bb7fe640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f93a806bf00 0x7f93a806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.347+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11a0068af0 con 0x7f11a015cc80 2024-06-02T23:46:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.347+0000 7f93b8ff9640 1 -- 172.21.15.96:0/2001394771 <== osd.3 v2:172.21.15.96:6800/1530888449 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f939c006bb0 con 0x7f939c001650 2024-06-02T23:46:47.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.347+0000 7f93bb7fe640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f93a806bf00 0x7f93a806e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93b0034000 tx=0x7f93b002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.347+0000 7f3804ff9640 1 -- 172.21.15.96:0/262994603 <== osd.2 v2:172.21.15.96:6824/2465470784 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f37f800af30 con 0x7f37f4075680 2024-06-02T23:46:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.347+0000 7f1187fff640 1 -- 172.21.15.96:0/2602505927 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f119000c6d0 con 0x7f11a015cc80 2024-06-02T23:46:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.348+0000 7f1187fff640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f118c06be30 0x7f118c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.347+0000 7ff3cffff640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3c80e81b0 0x7ff3c80d81a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0075840 tx=0x7ff3d0074170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.348+0000 7ff3b7fff640 1 -- 172.21.15.96:0/1086822112 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0090070 con 0x7ff3c80e81b0 2024-06-02T23:46:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.348+0000 7ff3b7fff640 1 -- 172.21.15.96:0/1086822112 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d0073840 con 0x7ff3c80e81b0 2024-06-02T23:46:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.348+0000 7ff3b7fff640 1 -- 172.21.15.96:0/1086822112 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d006c680 con 0x7ff3c80e81b0 2024-06-02T23:46:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c80d9c20 con 0x7ff3c80e81b0 2024-06-02T23:46:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c80d73e0 con 0x7ff3c80e81b0 2024-06-02T23:46:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.348+0000 7fa96effd640 1 -- 172.21.15.96:0/2302346451 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa96801a070 con 0x7fa9780ae6b0 2024-06-02T23:46:47.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7fa96effd640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa95806bf00 0x7fa95806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.348+0000 7f1187fff640 1 -- 172.21.15.96:0/2602505927 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f119008ae20 con 0x7f11a015cc80 2024-06-02T23:46:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.348+0000 7f1187fff640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] conn(0x7f118c075530 0x7f118c077970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.348+0000 7f1187fff640 1 -- 172.21.15.96:0/2602505927 --> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1190022e50 con 0x7f118c075530 2024-06-02T23:46:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.348+0000 7f1187fff640 1 -- 172.21.15.96:0/2602505927 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f119008d480 con 0x7f11a015cc80 2024-06-02T23:46:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7f119f7fe640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f118c06be30 0x7f118c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7fa96effd640 1 -- 172.21.15.96:0/2302346451 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa96808a580 con 0x7fa9780ae6b0 2024-06-02T23:46:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7fa96effd640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] conn(0x7fa958075680 0x7fa958077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7fa96effd640 1 -- 172.21.15.96:0/2302346451 --> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa968010e50 con 0x7fa958075680 2024-06-02T23:46:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7fa96effd640 1 -- 172.21.15.96:0/2302346451 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa968091050 con 0x7fa9780ae6b0 2024-06-02T23:46:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7f119effd640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] conn(0x7f118c075530 0x7f118c077970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.350+0000 7f119f7fe640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f118c06be30 0x7f118c06e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1198033000 tx=0x7f1198009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7fa976d9d640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] conn(0x7fa958075680 0x7fa958077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.349+0000 7fa96ffff640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa95806bf00 0x7fa95806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.350+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff3c80059c0 con 0x7ff3c80e81b0 2024-06-02T23:46:47.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.350+0000 7fa96ffff640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa95806bf00 0x7fa95806e3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa960034000 tx=0x7fa96002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.350+0000 7fa976d9d640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] conn(0x7fa958075680 0x7fa958077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.350+0000 7ff3b7fff640 1 -- 172.21.15.96:0/1086822112 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3d009b060 con 0x7ff3c80e81b0 2024-06-02T23:46:47.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.351+0000 7ff3b7fff640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3bc06be80 0x7ff3bc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.351+0000 7ff3b7fff640 1 -- 172.21.15.96:0/1086822112 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff3d0105db0 con 0x7ff3c80e81b0 2024-06-02T23:46:47.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.351+0000 7ff3b7fff640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] conn(0x7ff3bc0755f0 0x7ff3bc077a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.352+0000 7f119effd640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] conn(0x7f118c075530 0x7f118c077970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.351+0000 7ff3b7fff640 1 -- 172.21.15.96:0/1086822112 --> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3d008ce50 con 0x7ff3bc0755f0 2024-06-02T23:46:47.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.352+0000 7fa96effd640 1 -- 172.21.15.96:0/2302346451 <== osd.1 v2:172.21.15.96:6808/3077632507 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa968010e50 con 0x7fa958075680 2024-06-02T23:46:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.351+0000 7ff3b7fff640 1 -- 172.21.15.96:0/1086822112 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff3d01083d0 con 0x7ff3c80e81b0 2024-06-02T23:46:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.352+0000 7ff3ce7fc640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] conn(0x7ff3bc0755f0 0x7ff3bc077a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.352+0000 7ff3ceffd640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3bc06be80 0x7ff3bc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.352+0000 7ff3ce7fc640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] conn(0x7ff3bc0755f0 0x7ff3bc077a30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.352+0000 7ff3ceffd640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3bc06be80 0x7ff3bc06e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff3c804c1e0 tx=0x7ff3c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.353+0000 7f1187fff640 1 -- 172.21.15.96:0/2602505927 <== osd.4 v2:172.21.15.162:6816/3130662630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1190022e50 con 0x7f118c075530 2024-06-02T23:46:47.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.353+0000 7ff3b7fff640 1 -- 172.21.15.96:0/1086822112 <== osd.7 v2:172.21.15.162:6823/334757134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3d008ce50 con 0x7ff3bc0755f0 2024-06-02T23:46:47.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.376+0000 7ff66d7fa640 1 -- 172.21.15.96:0/3200837415 --> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff660002dd0 con 0x7ff674075630 2024-06-02T23:46:47.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.376+0000 7ff66f7fe640 1 -- 172.21.15.96:0/3200837415 <== osd.6 v2:172.21.15.162:6800/1800327622 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff660002dd0 con 0x7ff674075630 2024-06-02T23:46:47.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.377+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] conn(0x7ff674075630 msgr2=0x7ff674077a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.377+0000 7ff68d55a640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] conn(0x7ff674075630 0x7ff674077a70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.377+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff67406beb0 msgr2=0x7ff67406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7ff68d55a640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff67406beb0 0x7ff67406e370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff67802a210 tx=0x7ff67802e000 comp rx=0 tx=0).stop 2024-06-02T23:46:47.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7fc898012640 1 -- 172.21.15.96:0/2169320567 --> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc878002dd0 con 0x7fc874075680 2024-06-02T23:46:47.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688072dd0 msgr2=0x7ff6881f3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7ff68d55a640 1 --2- 172.21.15.96:0/3200837415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff688072dd0 0x7ff6881f3220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff680008930 tx=0x7ff680008df0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7ff6877fe640 1 -- 172.21.15.96:0/3200837415 reap_dead start 2024-06-02T23:46:47.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 shutdown_connections 2024-06-02T23:46:47.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 --> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f939c005c90 con 0x7f939c001650 2024-06-02T23:46:47.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 >> 172.21.15.96:0/3200837415 conn(0x7ff6880cfb90 msgr2=0x7ff6880cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 shutdown_connections 2024-06-02T23:46:47.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7ff68d55a640 1 -- 172.21.15.96:0/3200837415 wait complete. 2024-06-02T23:46:47.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.378+0000 7fc8867fc640 1 -- 172.21.15.96:0/2169320567 <== osd.5 v2:172.21.15.162:6807/2259495148 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc878002dd0 con 0x7fc874075680 2024-06-02T23:46:47.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.379+0000 7f93b8ff9640 1 -- 172.21.15.96:0/2001394771 <== osd.3 v2:172.21.15.96:6800/1530888449 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f939c005c90 con 0x7f939c001650 2024-06-02T23:46:47.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.379+0000 7f0764ff9640 1 -- 172.21.15.96:0/3334838031 --> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f075c005c90 con 0x7f075c001650 2024-06-02T23:46:47.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.379+0000 7fc873fff640 1 -- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] conn(0x7fc874075680 msgr2=0x7fc874077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.379+0000 7fc873fff640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] conn(0x7fc874075680 0x7fc874077ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.379+0000 7f0766ffd640 1 -- 172.21.15.96:0/3334838031 <== osd.0 v2:172.21.15.96:6816/2024861809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f075c005c90 con 0x7f075c001650 2024-06-02T23:46:47.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f37ee7fc640 1 -- 172.21.15.96:0/262994603 --> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f38080b9f00 con 0x7f37f4075680 2024-06-02T23:46:47.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7fc873fff640 1 -- 172.21.15.96:0/2169320567 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc87406bf00 msgr2=0x7fc87406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7fc873fff640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc87406bf00 0x7fc87406e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc8800011e0 tx=0x7fc880009040 comp rx=0 tx=0).stop 2024-06-02T23:46:47.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7fc873fff640 1 -- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8901405d0 msgr2=0x7fc890158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7fc873fff640 1 --2- 172.21.15.96:0/2169320567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8901405d0 0x7fc890158fb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009200 tx=0x7fc88c0046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7fc8965af640 1 -- 172.21.15.96:0/2169320567 reap_dead start 2024-06-02T23:46:47.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] conn(0x7f939c001650 msgr2=0x7f939c003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f93c24df640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] conn(0x7f939c001650 0x7f939c003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f0764ff9640 1 -- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] conn(0x7f075c001650 msgr2=0x7f075c003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f0764ff9640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] conn(0x7f075c001650 0x7f075c003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7fc873fff640 1 -- 172.21.15.96:0/2169320567 shutdown_connections 2024-06-02T23:46:47.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7fc873fff640 1 -- 172.21.15.96:0/2169320567 >> 172.21.15.96:0/2169320567 conn(0x7fc8900b1730 msgr2=0x7fc89015cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f93a806bf00 msgr2=0x7f93a806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f93c24df640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f93a806bf00 0x7f93a806e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93b0034000 tx=0x7f93b002e000 comp rx=0 tx=0).stop 2024-06-02T23:46:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc0d4b40 msgr2=0x7f93bc0ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f93c24df640 1 --2- 172.21.15.96:0/2001394771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93bc0d4b40 0x7f93bc0ca4a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c560 tx=0x7f93ac00ca20 comp rx=0 tx=0).stop 2024-06-02T23:46:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f93c0a7c640 1 -- 172.21.15.96:0/2001394771 reap_dead start 2024-06-02T23:46:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 shutdown_connections 2024-06-02T23:46:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 >> 172.21.15.96:0/2001394771 conn(0x7f93bc0d4020 msgr2=0x7f93bc0b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7f3804ff9640 1 -- 172.21.15.96:0/262994603 <== osd.2 v2:172.21.15.96:6824/2465470784 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f38080b9f00 con 0x7f37f4075680 2024-06-02T23:46:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.380+0000 7fc873fff640 1 -- 172.21.15.96:0/2169320567 shutdown_connections 2024-06-02T23:46:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7fc873fff640 1 -- 172.21.15.96:0/2169320567 wait complete. 2024-06-02T23:46:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f0764ff9640 1 -- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f075806be30 msgr2=0x7f075806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f0764ff9640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f075806be30 0x7f075806e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f07680090b0 tx=0x7f076802e000 comp rx=0 tx=0).stop 2024-06-02T23:46:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f0764ff9640 1 -- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0778162740 msgr2=0x7f0778160e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f0764ff9640 1 --2- 172.21.15.96:0/3334838031 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0778162740 0x7f0778160e00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f077000be20 tx=0x7f077000bf10 comp rx=0 tx=0).stop 2024-06-02T23:46:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f0776d9d640 1 -- 172.21.15.96:0/3334838031 reap_dead start 2024-06-02T23:46:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f0764ff9640 1 -- 172.21.15.96:0/3334838031 shutdown_connections 2024-06-02T23:46:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f0764ff9640 1 -- 172.21.15.96:0/3334838031 >> 172.21.15.96:0/3334838031 conn(0x7f07780d0900 msgr2=0x7f077806ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f37ee7fc640 1 -- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] conn(0x7f37f4075680 msgr2=0x7f37f4077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f37ee7fc640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] conn(0x7f37f4075680 0x7f37f4077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 shutdown_connections 2024-06-02T23:46:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f93c24df640 1 -- 172.21.15.96:0/2001394771 wait complete. 2024-06-02T23:46:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f37ee7fc640 1 -- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37f406bf00 msgr2=0x7f37f406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f37ee7fc640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37f406bf00 0x7f37f406e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00aab0 tx=0x7f37fc008040 comp rx=0 tx=0).stop 2024-06-02T23:46:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f37ee7fc640 1 -- 172.21.15.96:0/262994603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080d2340 msgr2=0x7f38081f8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f37ee7fc640 1 --2- 172.21.15.96:0/262994603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38080d2340 0x7f38081f8650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f37f8031000 tx=0x7f37f80046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f0764ff9640 1 -- 172.21.15.96:0/3334838031 shutdown_connections 2024-06-02T23:46:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.381+0000 7f0764ff9640 1 -- 172.21.15.96:0/3334838031 wait complete. 2024-06-02T23:46:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.382+0000 7f380cc61640 1 -- 172.21.15.96:0/262994603 reap_dead start 2024-06-02T23:46:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.382+0000 7f37ee7fc640 1 -- 172.21.15.96:0/262994603 shutdown_connections 2024-06-02T23:46:47.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.382+0000 7f37ee7fc640 1 -- 172.21.15.96:0/262994603 >> 172.21.15.96:0/262994603 conn(0x7f38080d3f80 msgr2=0x7f38081640e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.382+0000 7fa96cff9640 1 -- 172.21.15.96:0/2302346451 --> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa978068af0 con 0x7fa958075680 2024-06-02T23:46:47.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7fa96effd640 1 -- 172.21.15.96:0/2302346451 <== osd.1 v2:172.21.15.96:6808/3077632507 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa978068af0 con 0x7fa958075680 2024-06-02T23:46:47.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7fa96cff9640 1 -- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] conn(0x7fa958075680 msgr2=0x7fa958077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7fa96cff9640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] conn(0x7fa958075680 0x7fa958077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7f37ee7fc640 1 -- 172.21.15.96:0/262994603 shutdown_connections 2024-06-02T23:46:47.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 --> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11a00ba670 con 0x7f118c075530 2024-06-02T23:46:47.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 --> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff3c80d6c40 con 0x7ff3bc0755f0 2024-06-02T23:46:47.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7fa96cff9640 1 -- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa95806bf00 msgr2=0x7fa95806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7fa96cff9640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa95806bf00 0x7fa95806e3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa960034000 tx=0x7fa96002e000 comp rx=0 tx=0).stop 2024-06-02T23:46:47.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7fa96cff9640 1 -- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9780ae6b0 msgr2=0x7fa97815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7fa96cff9640 1 --2- 172.21.15.96:0/2302346451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9780ae6b0 0x7fa97815b410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c430 tx=0x7fa96800c8f0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7fa976d9d640 1 -- 172.21.15.96:0/2302346451 reap_dead start 2024-06-02T23:46:47.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7fa96cff9640 1 -- 172.21.15.96:0/2302346451 shutdown_connections 2024-06-02T23:46:47.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.383+0000 7fa96cff9640 1 -- 172.21.15.96:0/2302346451 >> 172.21.15.96:0/2302346451 conn(0x7fa97806c4d0 msgr2=0x7fa97806c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.384+0000 7f37ee7fc640 1 -- 172.21.15.96:0/262994603 wait complete. 2024-06-02T23:46:47.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.384+0000 7fa96cff9640 1 -- 172.21.15.96:0/2302346451 shutdown_connections 2024-06-02T23:46:47.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.384+0000 7ff3b7fff640 1 -- 172.21.15.96:0/1086822112 <== osd.7 v2:172.21.15.162:6823/334757134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff3c80d6c40 con 0x7ff3bc0755f0 2024-06-02T23:46:47.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.384+0000 7fa96cff9640 1 -- 172.21.15.96:0/2302346451 wait complete. 2024-06-02T23:46:47.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.384+0000 7f1187fff640 1 -- 172.21.15.96:0/2602505927 <== osd.4 v2:172.21.15.162:6816/3130662630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f11a00ba670 con 0x7f118c075530 2024-06-02T23:46:47.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.384+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 >> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] conn(0x7ff3bc0755f0 msgr2=0x7ff3bc077a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.384+0000 7ff3d58a3640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] conn(0x7ff3bc0755f0 0x7ff3bc077a30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] conn(0x7f118c075530 msgr2=0x7f118c077970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3bc06be80 msgr2=0x7ff3bc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7f11a5cfc640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] conn(0x7f118c075530 0x7f118c077970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7ff3d58a3640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3bc06be80 0x7ff3bc06e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff3c804c1e0 tx=0x7ff3c0009040 comp rx=0 tx=0).stop 2024-06-02T23:46:47.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3c80e81b0 msgr2=0x7ff3c80d81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f118c06be30 msgr2=0x7f118c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7f11a5cfc640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f118c06be30 0x7f118c06e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1198033000 tx=0x7f1198009000 comp rx=0 tx=0).stop 2024-06-02T23:46:47.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11a015cc80 msgr2=0x7f11a00c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7f11a5cfc640 1 --2- 172.21.15.96:0/2602505927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11a015cc80 0x7f11a00c9720 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f119000e7e0 tx=0x7f119000eca0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7ff3d58a3640 1 --2- 172.21.15.96:0/1086822112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3c80e81b0 0x7ff3c80d81a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0075840 tx=0x7ff3d0074170 comp rx=0 tx=0).stop 2024-06-02T23:46:47.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7f119ffff640 1 -- 172.21.15.96:0/2602505927 reap_dead start 2024-06-02T23:46:47.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7ff3cffff640 1 -- 172.21.15.96:0/1086822112 reap_dead start 2024-06-02T23:46:47.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 shutdown_connections 2024-06-02T23:46:47.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 shutdown_connections 2024-06-02T23:46:47.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 >> 172.21.15.96:0/1086822112 conn(0x7ff3c8059140 msgr2=0x7ff3c80ea570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.385+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 >> 172.21.15.96:0/2602505927 conn(0x7f11a00b1c00 msgr2=0x7f11a00ae5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.386+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 shutdown_connections 2024-06-02T23:46:47.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.386+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 shutdown_connections 2024-06-02T23:46:47.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.386+0000 7ff3d58a3640 1 -- 172.21.15.96:0/1086822112 wait complete. 2024-06-02T23:46:47.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.386+0000 7f11a5cfc640 1 -- 172.21.15.96:0/2602505927 wait complete. 2024-06-02T23:46:47.432 INFO:teuthology.orchestra.run.smithi096.stdout:55834574858 2024-06-02T23:46:47.433 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-02T23:46:47.433 INFO:teuthology.orchestra.run.smithi096.stdout:55834574858 2024-06-02T23:46:47.434 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-02T23:46:47.434 INFO:teuthology.orchestra.run.smithi096.stdout:55834574858 2024-06-02T23:46:47.435 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-02T23:46:47.435 INFO:teuthology.orchestra.run.smithi096.stdout:55834574856 2024-06-02T23:46:47.436 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-02T23:46:47.436 INFO:teuthology.orchestra.run.smithi096.stdout:55834574858 2024-06-02T23:46:47.437 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-02T23:46:47.437 INFO:teuthology.orchestra.run.smithi096.stdout:55834574858 2024-06-02T23:46:47.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-02T23:46:47.438 INFO:teuthology.orchestra.run.smithi096.stdout:55834574856 2024-06-02T23:46:47.439 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-02T23:46:47.439 INFO:teuthology.orchestra.run.smithi096.stdout:55834574857 2024-06-02T23:46:47.440 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-02T23:46:47.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.641+0000 7f37d9d14640 1 Processor -- start 2024-06-02T23:46:47.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.641+0000 7f37d9d14640 1 -- start start 2024-06-02T23:46:47.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.642+0000 7f7e33f09640 1 Processor -- start 2024-06-02T23:46:47.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7f37d9d14640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f37d40d0720 0x7f37d4154360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7f7e33f09640 1 -- start start 2024-06-02T23:46:47.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7f37d9d14640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d4071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7f37d9d14640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d4161120 con 0x7f37d40cad50 2024-06-02T23:46:47.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7f37d9d14640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f37d40cd800 con 0x7f37d40d0720 2024-06-02T23:46:47.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7f37d9d14640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37d4072240 con 0x7f37d40718c0 2024-06-02T23:46:47.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7f37d37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f37d40d0720 0x7f37d4154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7f37caffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d4071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7f37caffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d4071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38756/0 (socket says 172.21.15.96:38756) 2024-06-02T23:46:47.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7f37caffd640 1 -- 172.21.15.96:0/1155260070 learned_addr learned my addr 172.21.15.96:0/1155260070 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7feb90b90640 1 Processor -- start 2024-06-02T23:46:47.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7fbda4712640 1 Processor -- start 2024-06-02T23:46:47.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.643+0000 7fbda4712640 1 -- start start 2024-06-02T23:46:47.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f37caffd640 1 -- 172.21.15.96:0/1155260070 >> v2:172.21.15.162:3300/0 conn(0x7f37d40d0720 msgr2=0x7f37d4154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f37caffd640 1 --2- 172.21.15.96:0/1155260070 >> v2:172.21.15.162:3300/0 conn(0x7f37d40d0720 0x7f37d4154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f37caffd640 1 -- 172.21.15.96:0/1155260070 >> v1:172.21.15.162:6789/0 conn(0x7f37d40cad50 legacy=0x7f37d40cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f37caffd640 1 -- 172.21.15.96:0/1155260070 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d40cbaa0 con 0x7f37d40718c0 2024-06-02T23:46:47.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f7e33f09640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404b3c0 0x7f7e24034020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f7e33f09640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7e2404f4d0 0x7f7e2404f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f7e33f09640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e24054c10 con 0x7f7e2404fe90 2024-06-02T23:46:47.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f7e33f09640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7e240062e0 con 0x7f7e2404f4d0 2024-06-02T23:46:47.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f7e33f09640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7e24053a50 con 0x7f7e2404b3c0 2024-06-02T23:46:47.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f7e31ca5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404b3c0 0x7f7e24034020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f7e31ca5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404b3c0 0x7f7e24034020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38760/0 (socket says 172.21.15.96:38760) 2024-06-02T23:46:47.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7f7e31ca5640 1 -- 172.21.15.96:0/3898686468 learned_addr learned my addr 172.21.15.96:0/3898686468 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f7c6359e640 1 Processor -- start 2024-06-02T23:46:47.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f7c6359e640 1 -- start start 2024-06-02T23:46:47.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f7e314a4640 1 --2- 172.21.15.96:0/3898686468 >> v2:172.21.15.96:3300/0 conn(0x7f7e2404f4d0 0x7f7e2404f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f37caffd640 1 --2- 172.21.15.96:0/1155260070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d4071d00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f37d40733a0 tx=0x7f37c402a740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7176cf29985bdb20 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f6b61bd6640 1 Processor -- start 2024-06-02T23:46:47.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.644+0000 7feb90b90640 1 -- start start 2024-06-02T23:46:47.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7feb90b90640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7feb8c071f90 0x7feb8c0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7feb90b90640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 0x7feb8c0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7feb90b90640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c0cde60 con 0x7feb8c15a0b0 2024-06-02T23:46:47.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7feb90b90640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7feb8c0cea70 con 0x7feb8c071f90 2024-06-02T23:46:47.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7feb90b90640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c0ce140 con 0x7feb8c0cef00 2024-06-02T23:46:47.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f6b61bd6640 1 -- start start 2024-06-02T23:46:47.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f37d2ffd640 1 -- 172.21.15.96:0/1155260070 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4036070 con 0x7f37d40718c0 2024-06-02T23:46:47.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f7e30ca3640 1 -- 172.21.15.96:0/3898686468 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3316705100 0 0) 0x7f7e24054c10 con 0x7f7e2404fe90 2024-06-02T23:46:47.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f7e30ca3640 1 -- 172.21.15.96:0/3898686468 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e18003520 con 0x7f7e2404fe90 2024-06-02T23:46:47.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f7e31ca5640 1 -- 172.21.15.96:0/3898686468 >> v2:172.21.15.96:3300/0 conn(0x7f7e2404f4d0 msgr2=0x7f7e2404f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f7e31ca5640 1 --2- 172.21.15.96:0/3898686468 >> v2:172.21.15.96:3300/0 conn(0x7f7e2404f4d0 0x7f7e2404f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f7e31ca5640 1 -- 172.21.15.96:0/3898686468 >> v1:172.21.15.162:6789/0 conn(0x7f7e2404fe90 legacy=0x7f7e240eb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7f7e31ca5640 1 -- 172.21.15.96:0/3898686468 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e24053d30 con 0x7f7e2404b3c0 2024-06-02T23:46:47.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.646+0000 7f37d2ffd640 1 -- 172.21.15.96:0/1155260070 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c4031600 con 0x7f37d40718c0 2024-06-02T23:46:47.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7fbda4712640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd9c06efc0 0x7fbd9c0cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7fbda4712640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c0ca8f0 0x7fbd9c15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7fbda4712640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c15b580 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7fbda4712640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbd9c06e880 con 0x7fbd9c06efc0 2024-06-02T23:46:47.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7fbda4712640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9c06d070 con 0x7fbd9c0ca8f0 2024-06-02T23:46:47.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7fbda1cad640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbd9c15a7e0 0x7fbd9c0ca1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39900/0 (socket says 172.21.15.96:39900) 2024-06-02T23:46:47.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.645+0000 7fbda1cad640 1 -- 172.21.15.96:0/2824339005 learned_addr learned my addr 172.21.15.96:0/2824339005 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:47.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.646+0000 7fbda24ae640 1 --2- 172.21.15.96:0/2824339005 >> v2:172.21.15.162:3300/0 conn(0x7fbd9c06efc0 0x7fbd9c0cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.646+0000 7fbda2caf640 1 --2- 172.21.15.96:0/2824339005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c0ca8f0 0x7fbd9c15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.646+0000 7fbda2caf640 1 -- 172.21.15.96:0/2824339005 >> v2:172.21.15.162:3300/0 conn(0x7fbd9c06efc0 msgr2=0x7fbd9c0cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.646+0000 7fbda2caf640 1 --2- 172.21.15.96:0/2824339005 >> v2:172.21.15.162:3300/0 conn(0x7fbd9c06efc0 0x7fbd9c0cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.646+0000 7fbda2caf640 1 -- 172.21.15.96:0/2824339005 >> v1:172.21.15.96:6789/0 conn(0x7fbd9c15a7e0 legacy=0x7fbd9c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.646+0000 7f7c6359e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c6413cd90 0x7f7c64070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.646+0000 7fbda2caf640 1 -- 172.21.15.96:0/2824339005 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c06d350 con 0x7fbd9c0ca8f0 2024-06-02T23:46:47.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f37d9d14640 1 -- 172.21.15.96:0/1155260070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 msgr2=0x7f37d4071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f37d9d14640 1 --2- 172.21.15.96:0/1155260070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d4071d00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f37d40733a0 tx=0x7f37c402a740 comp rx=0 tx=0).stop 2024-06-02T23:46:47.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f0c29548640 1 Processor -- start 2024-06-02T23:46:47.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.646+0000 7f6b61bd6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6b5c14bd60 0x7f6b5c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b61bd6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6b5c1629d0 0x7f6b5c06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f7c6259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c6413cd90 0x7f7c64070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f7c6259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7c6413cd90 0x7f7c64070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54826/0 (socket says 172.21.15.96:54826) 2024-06-02T23:46:47.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f7c6259c640 1 -- 172.21.15.96:0/3308778669 learned_addr learned my addr 172.21.15.96:0/3308778669 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f7c6359e640 1 --2- 172.21.15.96:0/3308778669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c640b21b0 0x7f7c640712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f37d9d14640 1 -- 172.21.15.96:0/1155260070 shutdown_connections 2024-06-02T23:46:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f37d9d14640 1 --2- 172.21.15.96:0/1155260070 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d4071d00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f37d9d14640 1 --2- 172.21.15.96:0/1155260070 >> v2:172.21.15.162:3300/0 conn(0x7f37d40d0720 0x7f37d4154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f37d9d14640 1 -- 172.21.15.96:0/1155260070 >> 172.21.15.96:0/1155260070 conn(0x7f37d40cfc30 msgr2=0x7f37d40d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f37d9d14640 1 -- 172.21.15.96:0/1155260070 shutdown_connections 2024-06-02T23:46:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b60bd4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6b5c14bd60 0x7f6b5c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b60bd4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6b5c14bd60 0x7f6b5c071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54836/0 (socket says 172.21.15.96:54836) 2024-06-02T23:46:47.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b60bd4640 1 -- 172.21.15.96:0/2372505734 learned_addr learned my addr 172.21.15.96:0/2372505734 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2372505734 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b5c072610 con 0x7f6b5c072090 2024-06-02T23:46:47.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2372505734 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f6b5c0b32f0 con 0x7f6b5c14bd60 2024-06-02T23:46:47.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2372505734 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6b5c0b29c0 con 0x7f6b5c1629d0 2024-06-02T23:46:47.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b5bfff640 1 --2- 172.21.15.96:0/2372505734 >> v2:172.21.15.162:3300/0 conn(0x7f6b5c1629d0 0x7f6b5c06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f7e31ca5640 1 --2- 172.21.15.96:0/3898686468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404b3c0 0x7f7e24034020 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c06a3a0 tx=0x7f7e2c069160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e8bde54e73631be server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f37d9d14640 1 -- 172.21.15.96:0/1155260070 wait complete. 2024-06-02T23:46:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f7c6359e640 1 -- 172.21.15.96:0/3308778669 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c641403d0 con 0x7f7c6413d630 2024-06-02T23:46:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f7c6359e640 1 -- 172.21.15.96:0/3308778669 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7c6406d420 con 0x7f7c6413cd90 2024-06-02T23:46:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f7c6359e640 1 -- 172.21.15.96:0/3308778669 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6406cdd0 con 0x7f7c640b21b0 2024-06-02T23:46:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f7c61d9b640 1 --2- 172.21.15.96:0/3308778669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c640b21b0 0x7f7c640712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7faee045d640 1 Processor -- start 2024-06-02T23:46:47.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b60bd4640 1 -- 172.21.15.96:0/2372505734 >> v2:172.21.15.162:3300/0 conn(0x7f6b5c1629d0 msgr2=0x7f6b5c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b60bd4640 1 --2- 172.21.15.96:0/2372505734 >> v2:172.21.15.162:3300/0 conn(0x7f6b5c1629d0 0x7f6b5c06cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b60bd4640 1 -- 172.21.15.96:0/2372505734 >> v1:172.21.15.162:6789/0 conn(0x7f6b5c072090 legacy=0x7f6b5c165fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f6b60bd4640 1 -- 172.21.15.96:0/2372505734 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5c0b2ca0 con 0x7f6b5c14bd60 2024-06-02T23:46:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7f0c29548640 1 -- start start 2024-06-02T23:46:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f0c29548640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c24071f90 0x7f0c240cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f0c29548640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0c240cef00 0x7f0c240cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f0c29548640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c240cde60 con 0x7f0c2415a0b0 2024-06-02T23:46:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f0c29548640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0c240cea70 con 0x7f0c24071f90 2024-06-02T23:46:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f0c29548640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0c240ce140 con 0x7f0c240cef00 2024-06-02T23:46:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f0c227fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c24071f90 0x7f0c240cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f0c227fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c24071f90 0x7f0c240cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54846/0 (socket says 172.21.15.96:54846) 2024-06-02T23:46:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f0c227fc640 1 -- 172.21.15.96:0/2259908976 learned_addr learned my addr 172.21.15.96:0/2259908976 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f6b60bd4640 1 --2- 172.21.15.96:0/2372505734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c14bd60 0x7f6b5c071b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0b3470 tx=0x7f6b5002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5314f4fbbd6d20aa server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7feb8a59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7feb8c15a0b0 0x7feb8c071880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39916/0 (socket says 172.21.15.96:39916) 2024-06-02T23:46:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7feb8a59c640 1 -- 172.21.15.96:0/4242891979 learned_addr learned my addr 172.21.15.96:0/4242891979 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7feb89d9b640 1 --2- 172.21.15.96:0/4242891979 >> v2:172.21.15.96:3300/0 conn(0x7feb8c071f90 0x7feb8c0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.647+0000 7feb8ad9d640 1 --2- 172.21.15.96:0/4242891979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 0x7feb8c0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7feb8959a640 1 -- 172.21.15.96:0/4242891979 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716388619 0 0) 0x7feb8c0cde60 con 0x7feb8c15a0b0 2024-06-02T23:46:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7feb8959a640 1 -- 172.21.15.96:0/4242891979 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb78003520 con 0x7feb8c15a0b0 2024-06-02T23:46:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7feb89d9b640 1 -- 172.21.15.96:0/4242891979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 msgr2=0x7feb8c0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.665 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7feb89d9b640 1 --2- 172.21.15.96:0/4242891979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 0x7feb8c0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7feb89d9b640 1 -- 172.21.15.96:0/4242891979 >> v1:172.21.15.96:6789/0 conn(0x7feb8c15a0b0 legacy=0x7feb8c071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7feb89d9b640 1 -- 172.21.15.96:0/4242891979 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c0ce420 con 0x7feb8c071f90 2024-06-02T23:46:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f37d9d14640 1 Processor -- start 2024-06-02T23:46:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7faee045d640 1 -- start start 2024-06-02T23:46:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7feb89d9b640 1 --2- 172.21.15.96:0/4242891979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb8c071f90 0x7feb8c0cd760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb8400bd20 tx=0x7feb8402a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724a4ce30ed42018 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f0c227fc640 1 -- 172.21.15.96:0/2259908976 >> v2:172.21.15.162:3300/0 conn(0x7f0c240cef00 msgr2=0x7f0c240cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f7c6259c640 1 -- 172.21.15.96:0/3308778669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c640b21b0 msgr2=0x7f7c640712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f7c6259c640 1 --2- 172.21.15.96:0/3308778669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c640b21b0 0x7f7c640712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f7c6259c640 1 -- 172.21.15.96:0/3308778669 >> v1:172.21.15.96:6789/0 conn(0x7f7c6413d630 legacy=0x7f7c6413f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f7c6259c640 1 -- 172.21.15.96:0/3308778669 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6406d0b0 con 0x7f7c6413cd90 2024-06-02T23:46:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f7e30ca3640 1 -- 172.21.15.96:0/3898686468 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c06d640 con 0x7f7e2404b3c0 2024-06-02T23:46:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f7e30ca3640 1 -- 172.21.15.96:0/3898686468 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c06d820 con 0x7f7e2404b3c0 2024-06-02T23:46:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.648+0000 7f7e30ca3640 1 -- 172.21.15.96:0/3898686468 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c06dc90 con 0x7f7e2404b3c0 2024-06-02T23:46:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7fbda2caf640 1 --2- 172.21.15.96:0/2824339005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c0ca8f0 0x7fbd9c15ac50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbd980097a0 tx=0x7fbd9802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c12d8cd826bc30 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f7e33f09640 1 -- 172.21.15.96:0/3898686468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404b3c0 msgr2=0x7f7e24034020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f7e33f09640 1 --2- 172.21.15.96:0/3898686468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404b3c0 0x7f7e24034020 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c06a3a0 tx=0x7f7e2c069160 comp rx=0 tx=0).stop 2024-06-02T23:46:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f7e33f09640 1 -- 172.21.15.96:0/3898686468 shutdown_connections 2024-06-02T23:46:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f7e33f09640 1 --2- 172.21.15.96:0/3898686468 >> v2:172.21.15.96:3300/0 conn(0x7f7e2404f4d0 0x7f7e2404f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f7e33f09640 1 --2- 172.21.15.96:0/3898686468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404b3c0 0x7f7e24034020 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f7e33f09640 1 -- 172.21.15.96:0/3898686468 >> 172.21.15.96:0/3898686468 conn(0x7f7e2400a400 msgr2=0x7f7e2400a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f7e33f09640 1 -- 172.21.15.96:0/3898686468 shutdown_connections 2024-06-02T23:46:47.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f7e33f09640 1 -- 172.21.15.96:0/3898686468 wait complete. 2024-06-02T23:46:47.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7faee045d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faed815e310 0x7faed80d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7faee045d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faed80d2d40 0x7faed80b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7faee045d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faed815e6f0 con 0x7faed80d4c60 2024-06-02T23:46:47.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7faee045d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7faed80cef60 con 0x7faed815e310 2024-06-02T23:46:47.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7faee045d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7faed80cf240 con 0x7faed80d2d40 2024-06-02T23:46:47.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f7c6259c640 1 --2- 172.21.15.96:0/3308778669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c6413cd90 0x7f7c64070db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c54008c80 tx=0x7f7c540076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e941dd562150be42 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f0c237fe640 1 --2- 172.21.15.96:0/2259908976 >> v2:172.21.15.162:3300/0 conn(0x7f0c240cef00 0x7f0c240cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f0c227fc640 1 --2- 172.21.15.96:0/2259908976 >> v2:172.21.15.162:3300/0 conn(0x7f0c240cef00 0x7f0c240cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f0c227fc640 1 -- 172.21.15.96:0/2259908976 >> v1:172.21.15.162:6789/0 conn(0x7f0c2415a0b0 legacy=0x7f0c24071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f0c227fc640 1 -- 172.21.15.96:0/2259908976 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240ce420 con 0x7f0c24071f90 2024-06-02T23:46:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f6b5b7fe640 1 -- 172.21.15.96:0/2372505734 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50037070 con 0x7f6b5c14bd60 2024-06-02T23:46:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f6b5b7fe640 1 -- 172.21.15.96:0/2372505734 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b50032440 con 0x7f6b5c14bd60 2024-06-02T23:46:47.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f6b5b7fe640 1 -- 172.21.15.96:0/2372505734 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b500327f0 con 0x7f6b5c14bd60 2024-06-02T23:46:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7f7c6159a640 1 -- 172.21.15.96:0/3308778669 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54033020 con 0x7f7c6413cd90 2024-06-02T23:46:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7feb8959a640 1 -- 172.21.15.96:0/4242891979 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84038070 con 0x7feb8c071f90 2024-06-02T23:46:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7feb8959a640 1 -- 172.21.15.96:0/4242891979 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb84030480 con 0x7feb8c071f90 2024-06-02T23:46:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7feb8959a640 1 -- 172.21.15.96:0/4242891979 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84030850 con 0x7feb8c071f90 2024-06-02T23:46:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7fbda14ac640 1 -- 172.21.15.96:0/2824339005 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98037070 con 0x7fbd9c0ca8f0 2024-06-02T23:46:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7fbda14ac640 1 -- 172.21.15.96:0/2824339005 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9802ad10 con 0x7fbd9c0ca8f0 2024-06-02T23:46:47.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7fbda14ac640 1 -- 172.21.15.96:0/2824339005 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98032660 con 0x7fbd9c0ca8f0 2024-06-02T23:46:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7faede9fa640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faed80d2d40 0x7faed80b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7faede9fa640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faed80d2d40 0x7faed80b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:55820/0 (socket says 172.21.15.96:55820) 2024-06-02T23:46:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.649+0000 7faede9fa640 1 -- 172.21.15.96:0/199041822 learned_addr learned my addr 172.21.15.96:0/199041822 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7faede1f9640 1 --2- 172.21.15.96:0/199041822 >> v2:172.21.15.96:3300/0 conn(0x7faed815e310 0x7faed80d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f7c6159a640 1 -- 172.21.15.96:0/3308778669 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5402f610 con 0x7f7c6413cd90 2024-06-02T23:46:47.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f7c6159a640 1 -- 172.21.15.96:0/3308778669 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5402fa00 con 0x7f7c6413cd90 2024-06-02T23:46:47.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7faede9fa640 1 -- 172.21.15.96:0/199041822 >> v2:172.21.15.96:3300/0 conn(0x7faed815e310 msgr2=0x7faed80d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:47.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f37d9d14640 1 -- start start 2024-06-02T23:46:47.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7faede9fa640 1 --2- 172.21.15.96:0/199041822 >> v2:172.21.15.96:3300/0 conn(0x7faed815e310 0x7faed80d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7faede9fa640 1 -- 172.21.15.96:0/199041822 >> v1:172.21.15.162:6789/0 conn(0x7faed80d4c60 legacy=0x7faed80d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7faede9fa640 1 -- 172.21.15.96:0/199041822 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed80cf520 con 0x7faed80d2d40 2024-06-02T23:46:47.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2372505734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c14bd60 msgr2=0x7f6b5c071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f6b61bd6640 1 --2- 172.21.15.96:0/2372505734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c14bd60 0x7f6b5c071b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0b3470 tx=0x7f6b5002a1f0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f0c227fc640 1 --2- 172.21.15.96:0/2259908976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c24071f90 0x7f0c240cd760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c240c3640 tx=0x7f0c1c02cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7645329718e5a635 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2372505734 shutdown_connections 2024-06-02T23:46:47.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f6b61bd6640 1 --2- 172.21.15.96:0/2372505734 >> v2:172.21.15.162:3300/0 conn(0x7f6b5c1629d0 0x7f6b5c06cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f6b61bd6640 1 --2- 172.21.15.96:0/2372505734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c14bd60 0x7f6b5c071b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2372505734 >> 172.21.15.96:0/2372505734 conn(0x7f6b5c0b16c0 msgr2=0x7f6b5c0b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2372505734 shutdown_connections 2024-06-02T23:46:47.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7feb90b90640 1 -- 172.21.15.96:0/4242891979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb8c071f90 msgr2=0x7feb8c0cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7feb90b90640 1 --2- 172.21.15.96:0/4242891979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb8c071f90 0x7feb8c0cd760 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb8400bd20 tx=0x7feb8402a580 comp rx=0 tx=0).stop 2024-06-02T23:46:47.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.650+0000 7f7e33f09640 1 Processor -- start 2024-06-02T23:46:47.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f7e33f09640 1 -- start start 2024-06-02T23:46:47.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7fbda4712640 1 -- 172.21.15.96:0/2824339005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c0ca8f0 msgr2=0x7fbd9c15ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7fbda4712640 1 --2- 172.21.15.96:0/2824339005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c0ca8f0 0x7fbd9c15ac50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbd980097a0 tx=0x7fbd9802a080 comp rx=0 tx=0).stop 2024-06-02T23:46:47.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f0c21ffb640 1 -- 172.21.15.96:0/2259908976 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c02d890 con 0x7f0c24071f90 2024-06-02T23:46:47.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7faede1f9640 1 --2- 172.21.15.96:0/199041822 >> v2:172.21.15.96:3300/0 conn(0x7faed815e310 0x7faed80d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:47.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7fbda4712640 1 -- 172.21.15.96:0/2824339005 shutdown_connections 2024-06-02T23:46:47.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7fbda4712640 1 --2- 172.21.15.96:0/2824339005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c0ca8f0 0x7fbd9c15ac50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7fbda4712640 1 --2- 172.21.15.96:0/2824339005 >> v2:172.21.15.162:3300/0 conn(0x7fbd9c06efc0 0x7fbd9c0cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7fbda4712640 1 -- 172.21.15.96:0/2824339005 >> 172.21.15.96:0/2824339005 conn(0x7fbd9c0cfb90 msgr2=0x7fbd9c0cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f0c21ffb640 1 -- 172.21.15.96:0/2259908976 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c02da30 con 0x7f0c24071f90 2024-06-02T23:46:47.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2372505734 wait complete. 2024-06-02T23:46:47.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f0c21ffb640 1 -- 172.21.15.96:0/2259908976 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c02d890 con 0x7f0c24071f90 2024-06-02T23:46:47.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7feb90b90640 1 -- 172.21.15.96:0/4242891979 shutdown_connections 2024-06-02T23:46:47.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f37d9d14640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f37d9d14640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37d40cad50 0x7f37d415e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f37d9d14640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d40d0720 0x7f37d414b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7feb90b90640 1 --2- 172.21.15.96:0/4242891979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 0x7feb8c0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f37d9d14640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f37d40cc340 con 0x7f37d40d0720 2024-06-02T23:46:47.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7feb90b90640 1 --2- 172.21.15.96:0/4242891979 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb8c071f90 0x7feb8c0cd760 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7feb90b90640 1 -- 172.21.15.96:0/4242891979 >> 172.21.15.96:0/4242891979 conn(0x7feb8c0cfb90 msgr2=0x7feb8c0cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7fbda4712640 1 -- 172.21.15.96:0/2824339005 shutdown_connections 2024-06-02T23:46:47.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7feb90b90640 1 -- 172.21.15.96:0/4242891979 shutdown_connections 2024-06-02T23:46:47.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f37d9d14640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37d40cc060 con 0x7f37d40cad50 2024-06-02T23:46:47.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f37d9d14640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37d41548a0 con 0x7f37d40718c0 2024-06-02T23:46:47.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f7c6359e640 1 -- 172.21.15.96:0/3308778669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c6413cd90 msgr2=0x7f7c64070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7f7c6359e640 1 --2- 172.21.15.96:0/3308778669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c6413cd90 0x7f7c64070db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c54008c80 tx=0x7f7c540076d0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37d37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37d3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d40d0720 0x7f37d414b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37d37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d414c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38794/0 (socket says 172.21.15.96:38794) 2024-06-02T23:46:47.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37d37fe640 1 -- 172.21.15.96:0/1788708131 learned_addr learned my addr 172.21.15.96:0/1788708131 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37caffd640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37d40cad50 0x7f37d415e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7feb90b90640 1 -- 172.21.15.96:0/4242891979 wait complete. 2024-06-02T23:46:47.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f0c29548640 1 -- 172.21.15.96:0/2259908976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c24071f90 msgr2=0x7f0c240cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f0c29548640 1 --2- 172.21.15.96:0/2259908976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c24071f90 0x7f0c240cd760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c240c3640 tx=0x7f0c1c02cd50 comp rx=0 tx=0).stop 2024-06-02T23:46:47.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.651+0000 7fbda4712640 1 -- 172.21.15.96:0/2824339005 wait complete. 2024-06-02T23:46:47.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7faede9fa640 1 --2- 172.21.15.96:0/199041822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed80d2d40 0x7faed80b39a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faed80cb0d0 tx=0x7faed002a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94996537f3254e28 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f0c29548640 1 -- 172.21.15.96:0/2259908976 shutdown_connections 2024-06-02T23:46:47.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f0c29548640 1 --2- 172.21.15.96:0/2259908976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c24071f90 0x7f0c240cd760 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f0c29548640 1 --2- 172.21.15.96:0/2259908976 >> v2:172.21.15.162:3300/0 conn(0x7f0c240cef00 0x7f0c240cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f0c29548640 1 -- 172.21.15.96:0/2259908976 >> 172.21.15.96:0/2259908976 conn(0x7f0c240cfb90 msgr2=0x7f0c240cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7faedd1f7640 1 -- 172.21.15.96:0/199041822 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0036070 con 0x7faed80d2d40 2024-06-02T23:46:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7faedd1f7640 1 -- 172.21.15.96:0/199041822 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed0031600 con 0x7faed80d2d40 2024-06-02T23:46:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7faedd1f7640 1 -- 172.21.15.96:0/199041822 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0031a10 con 0x7faed80d2d40 2024-06-02T23:46:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37d37fe640 1 -- 172.21.15.96:0/1788708131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37d40cad50 msgr2=0x7f37d415e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37d37fe640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37d40cad50 0x7f37d415e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37d37fe640 1 -- 172.21.15.96:0/1788708131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d40d0720 msgr2=0x7f37d414b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37d37fe640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d40d0720 0x7f37d414b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37d37fe640 1 -- 172.21.15.96:0/1788708131 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d415b8f0 con 0x7f37d40718c0 2024-06-02T23:46:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f7e33f09640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e2404b3c0 0x7f7e240df4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f7e33f09640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404f4d0 0x7f7e24186120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f7e33f09640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2404fe90 0x7f7e2404e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f7e33f09640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7e24054830 con 0x7f7e2404fe90 2024-06-02T23:46:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f7e33f09640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2404b7a0 con 0x7f7e2404b3c0 2024-06-02T23:46:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f7e33f09640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7e240549b0 con 0x7f7e2404f4d0 2024-06-02T23:46:47.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f7c6359e640 1 -- 172.21.15.96:0/3308778669 shutdown_connections 2024-06-02T23:46:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7c6359e640 1 --2- 172.21.15.96:0/3308778669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c640b21b0 0x7f7c640712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7c6359e640 1 --2- 172.21.15.96:0/3308778669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c6413cd90 0x7f7c64070db0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7c6359e640 1 -- 172.21.15.96:0/3308778669 >> 172.21.15.96:0/3308778669 conn(0x7f7c640b16c0 msgr2=0x7f7c640b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e324a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2404fe90 0x7f7e2404e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e324a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2404fe90 0x7f7e2404e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54862/0 (socket says 172.21.15.96:54862) 2024-06-02T23:46:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e324a6640 1 -- 172.21.15.96:0/1601407597 learned_addr learned my addr 172.21.15.96:0/1601407597 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f37d37fe640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d414c0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00e8a0 tx=0x7f37bc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7c6359e640 1 -- 172.21.15.96:0/3308778669 shutdown_connections 2024-06-02T23:46:47.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7c6359e640 1 -- 172.21.15.96:0/3308778669 wait complete. 2024-06-02T23:46:47.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e314a4640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404f4d0 0x7f7e24186120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e31ca5640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e2404b3c0 0x7f7e240df4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e324a6640 1 -- 172.21.15.96:0/1601407597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404f4d0 msgr2=0x7f7e24186120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e324a6640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404f4d0 0x7f7e24186120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e324a6640 1 -- 172.21.15.96:0/1601407597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e2404b3c0 msgr2=0x7f7e240df4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e324a6640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e2404b3c0 0x7f7e240df4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e324a6640 1 -- 172.21.15.96:0/1601407597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e240e9160 con 0x7f7e2404fe90 2024-06-02T23:46:47.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f6b61bd6640 1 Processor -- start 2024-06-02T23:46:47.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e31ca5640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e2404b3c0 0x7f7e240df4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:47.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f6b61bd6640 1 -- start start 2024-06-02T23:46:47.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7f7e324a6640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2404fe90 0x7f7e2404e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c440 tx=0x7f7e1c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7faee045d640 1 -- 172.21.15.96:0/199041822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed80d2d40 msgr2=0x7faed80b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.653+0000 7faee045d640 1 --2- 172.21.15.96:0/199041822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed80d2d40 0x7faed80b39a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faed80cb0d0 tx=0x7faed002a750 comp rx=0 tx=0).stop 2024-06-02T23:46:47.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7feb90b90640 1 Processor -- start 2024-06-02T23:46:47.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7faee045d640 1 -- 172.21.15.96:0/199041822 shutdown_connections 2024-06-02T23:46:47.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7f7e227fc640 1 -- 172.21.15.96:0/1601407597 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c017070 con 0x7f7e2404fe90 2024-06-02T23:46:47.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7faee045d640 1 --2- 172.21.15.96:0/199041822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed80d2d40 0x7faed80b39a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7faee045d640 1 --2- 172.21.15.96:0/199041822 >> v2:172.21.15.96:3300/0 conn(0x7faed815e310 0x7faed80d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7faee045d640 1 -- 172.21.15.96:0/199041822 >> 172.21.15.96:0/199041822 conn(0x7faed809d340 msgr2=0x7faed80d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:47.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7fbda4712640 1 Processor -- start 2024-06-02T23:46:47.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7faee045d640 1 -- 172.21.15.96:0/199041822 shutdown_connections 2024-06-02T23:46:47.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7fbda4712640 1 -- start start 2024-06-02T23:46:47.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7feb90b90640 1 -- start start 2024-06-02T23:46:47.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7faee045d640 1 -- 172.21.15.96:0/199041822 wait complete. 2024-06-02T23:46:47.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b61bd6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5c072090 0x7f6b5c0ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b61bd6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b5c14bd60 0x7f6b5c144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b61bd6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c1629d0 0x7f6b5c144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda4712640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c06efc0 0x7fbd9c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda4712640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9c0ca8f0 0x7fbd9c1424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b61bd6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c06ee40 con 0x7f6b5c1629d0 2024-06-02T23:46:47.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b61bd6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c14c140 con 0x7f6b5c072090 2024-06-02T23:46:47.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b61bd6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5c06d070 con 0x7f6b5c14bd60 2024-06-02T23:46:47.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb90b90640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb8c071f90 0x7feb8c0c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda4712640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c15a7e0 0x7fbd9c14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda4712640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c06d870 con 0x7fbd9c0ca8f0 2024-06-02T23:46:47.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda4712640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c15df80 con 0x7fbd9c06efc0 2024-06-02T23:46:47.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda4712640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9c06d9f0 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb90b90640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 0x7feb8c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb90b90640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb8c15a0b0 0x7feb8c153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb90b90640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c15a610 con 0x7feb8c15a0b0 2024-06-02T23:46:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb90b90640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c15a490 con 0x7feb8c071f90 2024-06-02T23:46:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb90b90640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c0d0680 con 0x7feb8c0cef00 2024-06-02T23:46:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb8a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb8c071f90 0x7feb8c0c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f7c6359e640 1 Processor -- start 2024-06-02T23:46:47.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b613d5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c1629d0 0x7f6b5c144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b60bd4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5c072090 0x7f6b5c0ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b613d5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c1629d0 0x7f6b5c144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54870/0 (socket says 172.21.15.96:54870) 2024-06-02T23:46:47.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b613d5640 1 -- 172.21.15.96:0/2704533491 learned_addr learned my addr 172.21.15.96:0/2704533491 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb89d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 0x7feb8c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb8ad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb8c15a0b0 0x7feb8c153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb8a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb8c071f90 0x7feb8c0c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:55842/0 (socket says 172.21.15.96:55842) 2024-06-02T23:46:47.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7feb8a59c640 1 -- 172.21.15.96:0/3883930057 learned_addr learned my addr 172.21.15.96:0/3883930057 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f6b5bfff640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b5c14bd60 0x7f6b5c144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7f7e33f09640 1 -- 172.21.15.96:0/1601407597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e240e9440 con 0x7f7e2404fe90 2024-06-02T23:46:47.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7f7e33f09640 1 -- 172.21.15.96:0/1601407597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e240e9a00 con 0x7f7e2404fe90 2024-06-02T23:46:47.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda1cad640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9c0ca8f0 0x7fbd9c1424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda24ae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c06efc0 0x7fbd9c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda1cad640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9c0ca8f0 0x7fbd9c1424b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54880/0 (socket says 172.21.15.96:54880) 2024-06-02T23:46:47.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda1cad640 1 -- 172.21.15.96:0/3279088839 learned_addr learned my addr 172.21.15.96:0/3279088839 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7fbda2caf640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c15a7e0 0x7fbd9c14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f0c29548640 1 -- 172.21.15.96:0/2259908976 shutdown_connections 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.652+0000 7f0c29548640 1 -- 172.21.15.96:0/2259908976 wait complete. 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7f0c29548640 1 Processor -- start 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.654+0000 7f0c29548640 1 -- start start 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f0c29548640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c24071f90 0x7f0c241f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f0c29548640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240cef00 0x7f0c240c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f0c29548640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c2415a0b0 0x7f0c240c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f0c29548640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2415a610 con 0x7f0c24071f90 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f0c29548640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2415a490 con 0x7f0c240cef00 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.655+0000 7f0c29548640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c240d0680 con 0x7f0c2415a0b0 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f0c227fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240cef00 0x7f0c240c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f0c227fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240cef00 0x7f0c240c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:55870/0 (socket says 172.21.15.96:55870) 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f0c227fc640 1 -- 172.21.15.96:0/4198278289 learned_addr learned my addr 172.21.15.96:0/4198278289 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f0c237fe640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c2415a0b0 0x7f0c240c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f7c6359e640 1 -- start start 2024-06-02T23:46:47.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f37d0ff9640 1 -- 172.21.15.96:0/1788708131 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc017070 con 0x7f37d40718c0 2024-06-02T23:46:47.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f37d9d14640 1 -- 172.21.15.96:0/1788708131 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d40b3960 con 0x7f37d40718c0 2024-06-02T23:46:47.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f37d9d14640 1 -- 172.21.15.96:0/1788708131 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d4147870 con 0x7f37d40718c0 2024-06-02T23:46:47.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f37d0ff9640 1 -- 172.21.15.96:0/1788708131 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37bc00ee90 con 0x7f37d40718c0 2024-06-02T23:46:47.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f37d0ff9640 1 -- 172.21.15.96:0/1788708131 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00cb80 con 0x7f37d40718c0 2024-06-02T23:46:47.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7faee045d640 1 Processor -- start 2024-06-02T23:46:47.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f6b5bfff640 1 -- 172.21.15.96:0/2704533491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5c072090 msgr2=0x7f6b5c0ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f6b5bfff640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5c072090 0x7f6b5c0ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f6b5bfff640 1 -- 172.21.15.96:0/2704533491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c1629d0 msgr2=0x7f6b5c144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f6b5bfff640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c1629d0 0x7f6b5c144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f6b5bfff640 1 -- 172.21.15.96:0/2704533491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5c0aa160 con 0x7f6b5c14bd60 2024-06-02T23:46:47.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f6b5bfff640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b5c14bd60 0x7f6b5c144630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800d550 tx=0x7f6b4800da10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7feb8ad9d640 1 -- 172.21.15.96:0/3883930057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 msgr2=0x7feb8c1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7feb8ad9d640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 0x7feb8c1530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7feb8ad9d640 1 -- 172.21.15.96:0/3883930057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb8c071f90 msgr2=0x7feb8c0c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7feb8ad9d640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb8c071f90 0x7feb8c0c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7feb8ad9d640 1 -- 172.21.15.96:0/3883930057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c0c82c0 con 0x7feb8c15a0b0 2024-06-02T23:46:47.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7faee045d640 1 -- start start 2024-06-02T23:46:47.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7feb8a59c640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb8c071f90 0x7feb8c0c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:47.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7feb89d9b640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 0x7feb8c1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:47.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7f0c22ffd640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c24071f90 0x7f0c241f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7fbda2caf640 1 -- 172.21.15.96:0/3279088839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c06efc0 msgr2=0x7fbd9c15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7fbda2caf640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c06efc0 0x7fbd9c15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7fbda2caf640 1 -- 172.21.15.96:0/3279088839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9c0ca8f0 msgr2=0x7fbd9c1424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7fbda2caf640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9c0ca8f0 0x7fbd9c1424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7fbda2caf640 1 -- 172.21.15.96:0/3279088839 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c142db0 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.656+0000 7fbda1cad640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9c0ca8f0 0x7fbd9c1424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:47.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7c6359e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c640b21b0 0x7f7c64153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7c6359e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6413cd90 0x7f7c641405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7c6359e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c6413d630 0x7f7c64154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7c6359e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6413fd30 con 0x7f7c6413d630 2024-06-02T23:46:47.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7c6359e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6413d380 con 0x7f7c640b21b0 2024-06-02T23:46:47.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7c6359e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6413feb0 con 0x7f7c6413cd90 2024-06-02T23:46:47.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7fbda24ae640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c06efc0 0x7fbd9c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:47.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7c6259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c640b21b0 0x7f7c64153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f0c227fc640 1 -- 172.21.15.96:0/4198278289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c2415a0b0 msgr2=0x7f0c240c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f0c227fc640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c2415a0b0 0x7f0c240c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f0c227fc640 1 -- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c24071f90 msgr2=0x7f0c241f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f0c227fc640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c24071f90 0x7f0c241f3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f0c227fc640 1 -- 172.21.15.96:0/4198278289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240c71a0 con 0x7f0c240cef00 2024-06-02T23:46:47.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f0c22ffd640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c24071f90 0x7f0c241f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:47.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7c6259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c640b21b0 0x7f7c64153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:55876/0 (socket says 172.21.15.96:55876) 2024-06-02T23:46:47.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7c6259c640 1 -- 172.21.15.96:0/1611874516 learned_addr learned my addr 172.21.15.96:0/1611874516 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7faee045d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faed80d2d40 0x7faed80ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7feb8ad9d640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb8c15a0b0 0x7feb8c153620 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00d530 tx=0x7feb7c00d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7fbda2caf640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c15a7e0 0x7fbd9c14e040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0751e0 tx=0x7fbd980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7c61d9b640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6413cd90 0x7f7c641405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7faee045d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faed80d4c60 0x7faed81fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f6b597fa640 1 -- 172.21.15.96:0/2704533491 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b480125f0 con 0x7f6b5c14bd60 2024-06-02T23:46:47.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7faede1f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faed80d2d40 0x7faed80ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7faede1f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faed80d2d40 0x7faed80ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38860/0 (socket says 172.21.15.96:38860) 2024-06-02T23:46:47.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7faede1f9640 1 -- 172.21.15.96:0/3144177931 learned_addr learned my addr 172.21.15.96:0/3144177931 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:47.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f6b597fa640 1 -- 172.21.15.96:0/2704533491 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b48019070 con 0x7f6b5c14bd60 2024-06-02T23:46:47.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f6b597fa640 1 -- 172.21.15.96:0/2704533491 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48012990 con 0x7f6b5c14bd60 2024-06-02T23:46:47.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7faedd9f8640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faed80d4c60 0x7faed81fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7faee045d640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed815e310 0x7faed80b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7fbd92ffd640 1 -- 172.21.15.96:0/3279088839 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98037050 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f7c62d9d640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c6413d630 0x7f7c64154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7faed80ced00 con 0x7faed80d4c60 2024-06-02T23:46:47.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faed80ceb80 con 0x7faed815e310 2024-06-02T23:46:47.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faed80d2180 con 0x7faed80d2d40 2024-06-02T23:46:47.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7fbda4712640 1 -- 172.21.15.96:0/3279088839 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9c143090 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7fbda4712640 1 -- 172.21.15.96:0/3279088839 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9c0c0e10 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7fbd92ffd640 1 -- 172.21.15.96:0/3279088839 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd98038040 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7faede9fa640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed815e310 0x7faed80b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f7c6259c640 1 -- 172.21.15.96:0/1611874516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6413cd90 msgr2=0x7f7c641405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f7c6259c640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6413cd90 0x7f7c641405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f7c6259c640 1 -- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c6413d630 msgr2=0x7f7c64154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f7c6259c640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c6413d630 0x7f7c64154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f7c6259c640 1 -- 172.21.15.96:0/1611874516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c64138050 con 0x7f7c640b21b0 2024-06-02T23:46:47.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7fbd92ffd640 1 -- 172.21.15.96:0/3279088839 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd98037050 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f7c62d9d640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c6413d630 0x7f7c64154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:47.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2704533491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5c154ba0 con 0x7f6b5c14bd60 2024-06-02T23:46:47.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2704533491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b5c155160 con 0x7f6b5c14bd60 2024-06-02T23:46:47.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f7c6259c640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c640b21b0 0x7f7c64153be0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400b4d0 tx=0x7f7c54004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f37d9d14640 1 -- 172.21.15.96:0/1788708131 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b8005290 con 0x7f37d40718c0 2024-06-02T23:46:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7faede9fa640 1 -- 172.21.15.96:0/3144177931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faed80d2d40 msgr2=0x7faed80ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7faede9fa640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faed80d2d40 0x7faed80ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7faede9fa640 1 -- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faed80d4c60 msgr2=0x7faed81fb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7feb82ffd640 1 -- 172.21.15.96:0/3883930057 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0125f0 con 0x7feb8c15a0b0 2024-06-02T23:46:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7feb82ffd640 1 -- 172.21.15.96:0/3883930057 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c019070 con 0x7feb8c15a0b0 2024-06-02T23:46:47.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7feb82ffd640 1 -- 172.21.15.96:0/3883930057 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0129b0 con 0x7feb8c15a0b0 2024-06-02T23:46:47.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7e227fc640 1 -- 172.21.15.96:0/1601407597 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c0035f0 con 0x7f7e2404fe90 2024-06-02T23:46:47.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.657+0000 7f7e227fc640 1 -- 172.21.15.96:0/1601407597 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0039e0 con 0x7f7e2404fe90 2024-06-02T23:46:47.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f7e227fc640 1 -- 172.21.15.96:0/1601407597 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e1c01a070 con 0x7f7e2404fe90 2024-06-02T23:46:47.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7f7c5affd640 1 -- 172.21.15.96:0/1611874516 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54046070 con 0x7f7c640b21b0 2024-06-02T23:46:47.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7faede9fa640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faed80d4c60 0x7faed81fb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:47.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7faede9fa640 1 -- 172.21.15.96:0/3144177931 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed80b52f0 con 0x7faed815e310 2024-06-02T23:46:47.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7f7c6359e640 1 -- 172.21.15.96:0/1611874516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c64140ea0 con 0x7f7c640b21b0 2024-06-02T23:46:47.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7f7c5affd640 1 -- 172.21.15.96:0/1611874516 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c54004450 con 0x7f7c640b21b0 2024-06-02T23:46:47.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7f7c6359e640 1 -- 172.21.15.96:0/1611874516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c64154120 con 0x7f7c640b21b0 2024-06-02T23:46:47.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7faedd9f8640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faed80d4c60 0x7faed81fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:47.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7faede9fa640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed815e310 0x7faed80b4db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faed0030000 tx=0x7faed0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7feb90b90640 1 -- 172.21.15.96:0/3883930057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c0c5450 con 0x7feb8c15a0b0 2024-06-02T23:46:47.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7fbd92ffd640 1 -- 172.21.15.96:0/3279088839 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd98004230 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7faeceffd640 1 -- 172.21.15.96:0/3144177931 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0041020 con 0x7faed815e310 2024-06-02T23:46:47.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7faeceffd640 1 -- 172.21.15.96:0/3144177931 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faed0008730 con 0x7faed815e310 2024-06-02T23:46:47.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed80b5570 con 0x7faed815e310 2024-06-02T23:46:47.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7feb90b90640 1 -- 172.21.15.96:0/3883930057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c0c5a10 con 0x7feb8c15a0b0 2024-06-02T23:46:47.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7feb90b90640 1 -- 172.21.15.96:0/3883930057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8c0c6020 con 0x7feb8c15a0b0 2024-06-02T23:46:47.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed80b5b30 con 0x7faed815e310 2024-06-02T23:46:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7f0c227fc640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240cef00 0x7f0c240c6c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c000f80 tx=0x7f0c1c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7f0c0b7fe640 1 -- 172.21.15.96:0/4198278289 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c003da0 con 0x7f0c240cef00 2024-06-02T23:46:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7f0c0b7fe640 1 -- 172.21.15.96:0/4198278289 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c044070 con 0x7f0c240cef00 2024-06-02T23:46:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7f7c5affd640 1 -- 172.21.15.96:0/1611874516 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54033070 con 0x7f7c640b21b0 2024-06-02T23:46:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7f37d0ff9640 1 -- 172.21.15.96:0/1788708131 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37bc01a070 con 0x7f37d40718c0 2024-06-02T23:46:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7f37d0ff9640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37b406bf00 0x7f37b406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7f37d0ff9640 1 -- 172.21.15.96:0/1788708131 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f37bc08aef0 con 0x7f37d40718c0 2024-06-02T23:46:47.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7f37caffd640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37b406bf00 0x7f37b406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7f7e227fc640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7e1006bf00 0x7f7e1006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.659+0000 7f7e227fc640 1 -- 172.21.15.96:0/1601407597 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7e1c08a540 con 0x7f7e2404fe90 2024-06-02T23:46:47.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.658+0000 7f7e33f09640 1 -- 172.21.15.96:0/1601407597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e240057e0 con 0x7f7e2404fe90 2024-06-02T23:46:47.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7f7e31ca5640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7e1006bf00 0x7f7e1006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7fbd92ffd640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbd8006c230 0x7fbd8006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7fbda4712640 1 -- 172.21.15.96:0/3279088839 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd84005290 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7fbd92ffd640 1 -- 172.21.15.96:0/3279088839 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbd98004030 con 0x7fbd9c15a7e0 2024-06-02T23:46:47.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7faeceffd640 1 -- 172.21.15.96:0/3144177931 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0036040 con 0x7faed815e310 2024-06-02T23:46:47.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7f37caffd640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37b406bf00 0x7f37b406e3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f37c4033000 tx=0x7f37c4009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7f7e31ca5640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7e1006bf00 0x7f7e1006e3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7e2403b080 tx=0x7f7e2c06f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7f0c29548640 1 -- 172.21.15.96:0/4198278289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2414ed90 con 0x7f0c240cef00 2024-06-02T23:46:47.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7f0c29548640 1 -- 172.21.15.96:0/4198278289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2415abf0 con 0x7f0c240cef00 2024-06-02T23:46:47.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7f0c0b7fe640 1 -- 172.21.15.96:0/4198278289 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c004280 con 0x7f0c240cef00 2024-06-02T23:46:47.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.660+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2704533491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b5c073fc0 con 0x7f6b5c14bd60 2024-06-02T23:46:47.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7fbda24ae640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbd8006c230 0x7fbd8006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.662+0000 7f6b597fa640 1 -- 172.21.15.96:0/2704533491 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b48012b30 con 0x7f6b5c14bd60 2024-06-02T23:46:47.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.661+0000 7f7c6359e640 1 -- 172.21.15.96:0/1611874516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c6415ccd0 con 0x7f7c640b21b0 2024-06-02T23:46:47.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.662+0000 7faeceffd640 1 -- 172.21.15.96:0/3144177931 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faed0044020 con 0x7faed815e310 2024-06-02T23:46:47.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.662+0000 7f7c5affd640 1 -- 172.21.15.96:0/1611874516 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c54036020 con 0x7f7c640b21b0 2024-06-02T23:46:47.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7fbda24ae640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbd8006c230 0x7fbd8006e6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c06e6c0 tx=0x7fbd8c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7f0c29548640 1 -- 172.21.15.96:0/4198278289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c240683e0 con 0x7f0c240cef00 2024-06-02T23:46:47.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7f6b597fa640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6b4006bf00 0x7f6b4006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7f7c5affd640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7c4406be30 0x7f7c4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec0005290 con 0x7faed815e310 2024-06-02T23:46:47.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7f6b597fa640 1 -- 172.21.15.96:0/2704533491 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6b4808b5e0 con 0x7f6b5c14bd60 2024-06-02T23:46:47.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7f7c5affd640 1 -- 172.21.15.96:0/1611874516 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7c5402c020 con 0x7f7c640b21b0 2024-06-02T23:46:47.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7f7c61d9b640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7c4406be30 0x7f7c4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7f6b60bd4640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6b4006bf00 0x7f6b4006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7faeceffd640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faebc06bf30 0x7faebc06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7faeceffd640 1 -- 172.21.15.96:0/3144177931 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faed00abac0 con 0x7faed815e310 2024-06-02T23:46:47.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.663+0000 7faede1f9640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faebc06bf30 0x7faebc06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.664+0000 7f7c61d9b640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7c4406be30 0x7f7c4406e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c64157fa0 tx=0x7f7c5c012040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.664+0000 7f0c0b7fe640 1 -- 172.21.15.96:0/4198278289 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c1c004420 con 0x7f0c240cef00 2024-06-02T23:46:47.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.664+0000 7f6b60bd4640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6b4006bf00 0x7f6b4006e3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6b50034000 tx=0x7f6b5002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.664+0000 7faede1f9640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faebc06bf30 0x7faebc06e3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faec8006d40 tx=0x7faec8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.664+0000 7f0c0b7fe640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c1006be80 0x7f0c1006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.664+0000 7f0c0b7fe640 1 -- 172.21.15.96:0/4198278289 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0c1c0abc20 con 0x7f0c240cef00 2024-06-02T23:46:47.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.664+0000 7f0c22ffd640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c1006be80 0x7f0c1006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.665+0000 7f0c22ffd640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c1006be80 0x7f0c1006e340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c14000f60 tx=0x7f0c14009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.665+0000 7f37d0ff9640 1 -- 172.21.15.96:0/1788708131 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f37bc058ef0 con 0x7f37d40718c0 2024-06-02T23:46:47.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.667+0000 7f7c5affd640 1 -- 172.21.15.96:0/1611874516 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7c6415ccd0 con 0x7f7c640b21b0 2024-06-02T23:46:47.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.668+0000 7f7e227fc640 1 -- 172.21.15.96:0/1601407597 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7e1c058b90 con 0x7f7e2404fe90 2024-06-02T23:46:47.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.669+0000 7feb82ffd640 1 -- 172.21.15.96:0/3883930057 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb7c012b50 con 0x7feb8c15a0b0 2024-06-02T23:46:47.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.669+0000 7feb82ffd640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7feb6c06bf00 0x7feb6c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:47.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.670+0000 7feb82ffd640 1 -- 172.21.15.96:0/3883930057 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feb7c08bee0 con 0x7feb8c15a0b0 2024-06-02T23:46:47.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.670+0000 7feb8a59c640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7feb6c06bf00 0x7feb6c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:47.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.670+0000 7f6b597fa640 1 -- 172.21.15.96:0/2704533491 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6b480595e0 con 0x7f6b5c14bd60 2024-06-02T23:46:47.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.670+0000 7feb8a59c640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7feb6c06bf00 0x7feb6c06e3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb740049d0 tx=0x7feb74006030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:47.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.672+0000 7faeceffd640 1 -- 172.21.15.96:0/3144177931 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faed004b030 con 0x7faed815e310 2024-06-02T23:46:47.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.674+0000 7feb82ffd640 1 -- 172.21.15.96:0/3883930057 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7feb7c059ee0 con 0x7feb8c15a0b0 2024-06-02T23:46:47.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.677+0000 7f0c0b7fe640 1 -- 172.21.15.96:0/4198278289 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0c1c04d060 con 0x7f0c240cef00 2024-06-02T23:46:47.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:47.674+0000 7fbd92ffd640 1 -- 172.21.15.96:0/3279088839 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbd98079820 con 0x7fbd9c15a7e0 2024-06-02T23:46:48.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.082+0000 7f37d9d14640 1 -- 172.21.15.96:0/1788708131 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f37b8005580 con 0x7f37d40718c0 2024-06-02T23:46:48.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.082+0000 7f7e33f09640 1 -- 172.21.15.96:0/1601407597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7e2404aa70 con 0x7f7e2404fe90 2024-06-02T23:46:48.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.083+0000 7f7e227fc640 1 -- 172.21.15.96:0/1601407597 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7e1c058490 con 0x7f7e2404fe90 2024-06-02T23:46:48.083 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.083+0000 7f37d0ff9640 1 -- 172.21.15.96:0/1788708131 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37bc05d1f0 con 0x7f37d40718c0 2024-06-02T23:46:48.083 INFO:teuthology.orchestra.run.smithi096.stdout:55834574857 2024-06-02T23:46:48.084 INFO:teuthology.orchestra.run.smithi096.stdout:55834574857 2024-06-02T23:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.083+0000 7f7c6359e640 1 -- 172.21.15.96:0/1611874516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7c6404f760 con 0x7f7c640b21b0 2024-06-02T23:46:48.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.084+0000 7f7c5affd640 1 -- 172.21.15.96:0/1611874516 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7c540af030 con 0x7f7c640b21b0 2024-06-02T23:46:48.084 INFO:teuthology.orchestra.run.smithi096.stdout:55834574857 2024-06-02T23:46:48.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f37d9d14640 1 -- 172.21.15.96:0/1788708131 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37b406bf00 msgr2=0x7f37b406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f7e33f09640 1 -- 172.21.15.96:0/1601407597 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7e1006bf00 msgr2=0x7f7e1006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f7e33f09640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7e1006bf00 0x7f7e1006e3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7e2403b080 tx=0x7f7e2c06f000 comp rx=0 tx=0).stop 2024-06-02T23:46:48.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f37d9d14640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37b406bf00 0x7f37b406e3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f37c4033000 tx=0x7f37c4009000 comp rx=0 tx=0).stop 2024-06-02T23:46:48.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f37d9d14640 1 -- 172.21.15.96:0/1788708131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 msgr2=0x7f37d414c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f37d9d14640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d414c0a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37bc00e8a0 tx=0x7f37bc00ed60 comp rx=0 tx=0).stop 2024-06-02T23:46:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f37d9d14640 1 -- 172.21.15.96:0/1788708131 shutdown_connections 2024-06-02T23:46:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f37d9d14640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f37b406bf00 0x7f37b406e3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f37d9d14640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37d40d0720 0x7f37d414b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f7e33f09640 1 -- 172.21.15.96:0/1601407597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2404fe90 msgr2=0x7f7e2404e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f37d9d14640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37d40cad50 0x7f37d415e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f7e33f09640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2404fe90 0x7f7e2404e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c440 tx=0x7f7e1c00c900 comp rx=0 tx=0).stop 2024-06-02T23:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.086+0000 7f37d9d14640 1 --2- 172.21.15.96:0/1788708131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37d40718c0 0x7f37d414c0a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f37d9d14640 1 -- 172.21.15.96:0/1788708131 >> 172.21.15.96:0/1788708131 conn(0x7f37d40cfc30 msgr2=0x7f37d40b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:48.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f7e33f09640 1 -- 172.21.15.96:0/1601407597 shutdown_connections 2024-06-02T23:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f37d9d14640 1 -- 172.21.15.96:0/1788708131 shutdown_connections 2024-06-02T23:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f37d9d14640 1 -- 172.21.15.96:0/1788708131 wait complete. 2024-06-02T23:46:48.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7faec0005580 con 0x7faed815e310 2024-06-02T23:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f7e33f09640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7e1006bf00 0x7f7e1006e3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f7e33f09640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e2404fe90 0x7f7e2404e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f7e33f09640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e2404f4d0 0x7f7e24186120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f7e33f09640 1 --2- 172.21.15.96:0/1601407597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e2404b3c0 0x7f7e240df4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f7e33f09640 1 -- 172.21.15.96:0/1601407597 >> 172.21.15.96:0/1601407597 conn(0x7f7e2400a400 msgr2=0x7f7e24048a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f7e33f09640 1 -- 172.21.15.96:0/1601407597 shutdown_connections 2024-06-02T23:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f7e33f09640 1 -- 172.21.15.96:0/1601407597 wait complete. 2024-06-02T23:46:48.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7faeceffd640 1 -- 172.21.15.96:0/3144177931 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faed00abe20 con 0x7faed815e310 2024-06-02T23:46:48.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.087+0000 7f7c6359e640 1 -- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7c4406be30 msgr2=0x7f7c4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7c4406be30 0x7f7c4406e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c64157fa0 tx=0x7f7c5c012040 comp rx=0 tx=0).stop 2024-06-02T23:46:48.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 -- 172.21.15.96:0/1611874516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c640b21b0 msgr2=0x7f7c64153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c640b21b0 0x7f7c64153be0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400b4d0 tx=0x7f7c54004a40 comp rx=0 tx=0).stop 2024-06-02T23:46:48.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 -- 172.21.15.96:0/1611874516 shutdown_connections 2024-06-02T23:46:48.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7c4406be30 0x7f7c4406e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c6413d630 0x7f7c64154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6413cd90 0x7f7c641405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 --2- 172.21.15.96:0/1611874516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c640b21b0 0x7f7c64153be0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 -- 172.21.15.96:0/1611874516 >> 172.21.15.96:0/1611874516 conn(0x7f7c640b16c0 msgr2=0x7f7c6415bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:48.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 -- 172.21.15.96:0/1611874516 shutdown_connections 2024-06-02T23:46:48.094 INFO:teuthology.orchestra.run.smithi096.stdout:55834574857 2024-06-02T23:46:48.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.088+0000 7f7c6359e640 1 -- 172.21.15.96:0/1611874516 wait complete. 2024-06-02T23:46:48.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.092+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faebc06bf30 msgr2=0x7faebc06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.092+0000 7faee045d640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faebc06bf30 0x7faebc06e3f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faec8006d40 tx=0x7faec8008040 comp rx=0 tx=0).stop 2024-06-02T23:46:48.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.092+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed815e310 msgr2=0x7faed80b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.092+0000 7faee045d640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed815e310 0x7faed80b4db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faed0030000 tx=0x7faed0004a40 comp rx=0 tx=0).stop 2024-06-02T23:46:48.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.092+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 shutdown_connections 2024-06-02T23:46:48.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.092+0000 7faee045d640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faed815e310 0x7faed80b4db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.092+0000 7faee045d640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faebc06bf30 0x7faebc06e3f0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faec8006d40 tx=0x7faec8008040 comp rx=0 tx=0).stop 2024-06-02T23:46:48.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.093+0000 7faee045d640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faed80d4c60 0x7faed81fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.093+0000 7faee045d640 1 --2- 172.21.15.96:0/3144177931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faed80d2d40 0x7faed80ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.093+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 >> 172.21.15.96:0/3144177931 conn(0x7faed809d340 msgr2=0x7faed815e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:48.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.093+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 shutdown_connections 2024-06-02T23:46:48.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.093+0000 7faee045d640 1 -- 172.21.15.96:0/3144177931 wait complete. 2024-06-02T23:46:48.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.094+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2704533491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6b5c155330 con 0x7f6b5c14bd60 2024-06-02T23:46:48.099 INFO:teuthology.orchestra.run.smithi096.stdout:55834574856 2024-06-02T23:46:48.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.095+0000 7f6b597fa640 1 -- 172.21.15.96:0/2704533491 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6b4805d8e0 con 0x7f6b5c14bd60 2024-06-02T23:46:48.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.096+0000 7feb90b90640 1 -- 172.21.15.96:0/3883930057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7feb8c0683e0 con 0x7feb8c15a0b0 2024-06-02T23:46:48.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.096+0000 7fbda4712640 1 -- 172.21.15.96:0/3279088839 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbd84005580 con 0x7fbd9c15a7e0 2024-06-02T23:46:48.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.097+0000 7feb82ffd640 1 -- 172.21.15.96:0/3883930057 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb7c05e1e0 con 0x7feb8c15a0b0 2024-06-02T23:46:48.101 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-06-02T23:46:48.101 INFO:teuthology.orchestra.run.smithi096.stdout:55834574857 2024-06-02T23:46:48.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.097+0000 7fbd92ffd640 1 -- 172.21.15.96:0/3279088839 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbd98079820 con 0x7fbd9c15a7e0 2024-06-02T23:46:48.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f0c29548640 1 -- 172.21.15.96:0/4198278289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0c240ca540 con 0x7f0c240cef00 2024-06-02T23:46:48.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f0c0b7fe640 1 -- 172.21.15.96:0/4198278289 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c1c079d90 con 0x7f0c240cef00 2024-06-02T23:46:48.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2704533491 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6b4006bf00 msgr2=0x7f6b4006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6b4006bf00 0x7f6b4006e3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6b50034000 tx=0x7f6b5002e000 comp rx=0 tx=0).stop 2024-06-02T23:46:48.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2704533491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b5c14bd60 msgr2=0x7f6b5c144630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b5c14bd60 0x7f6b5c144630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800d550 tx=0x7f6b4800da10 comp rx=0 tx=0).stop 2024-06-02T23:46:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2704533491 shutdown_connections 2024-06-02T23:46:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6b4006bf00 0x7f6b4006e3c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c1629d0 0x7f6b5c144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b5c14bd60 0x7f6b5c144630 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 --2- 172.21.15.96:0/2704533491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5c072090 0x7f6b5c0ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2704533491 >> 172.21.15.96:0/2704533491 conn(0x7f6b5c0b16c0 msgr2=0x7f6b5c148b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2704533491 shutdown_connections 2024-06-02T23:46:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.099+0000 7f6b61bd6640 1 -- 172.21.15.96:0/2704533491 wait complete. 2024-06-02T23:46:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.100+0000 7feb90b90640 1 -- 172.21.15.96:0/3883930057 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7feb6c06bf00 msgr2=0x7feb6c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.100+0000 7feb90b90640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7feb6c06bf00 0x7feb6c06e3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb740049d0 tx=0x7feb74006030 comp rx=0 tx=0).stop 2024-06-02T23:46:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.100+0000 7feb90b90640 1 -- 172.21.15.96:0/3883930057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb8c15a0b0 msgr2=0x7feb8c153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.100+0000 7feb90b90640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb8c15a0b0 0x7feb8c153620 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00d530 tx=0x7feb7c00d9f0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7feb90b90640 1 -- 172.21.15.96:0/3883930057 shutdown_connections 2024-06-02T23:46:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7feb90b90640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7feb6c06bf00 0x7feb6c06e3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7feb90b90640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb8c15a0b0 0x7feb8c153620 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7feb90b90640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb8c0cef00 0x7feb8c1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7feb90b90640 1 --2- 172.21.15.96:0/3883930057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb8c071f90 0x7feb8c0c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7feb90b90640 1 -- 172.21.15.96:0/3883930057 >> 172.21.15.96:0/3883930057 conn(0x7feb8c0cfb90 msgr2=0x7feb8c1544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:48.105 INFO:teuthology.orchestra.run.smithi096.stdout:55834574855 2024-06-02T23:46:48.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7feb90b90640 1 -- 172.21.15.96:0/3883930057 shutdown_connections 2024-06-02T23:46:48.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7feb90b90640 1 -- 172.21.15.96:0/3883930057 wait complete. 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7fbda4712640 1 -- 172.21.15.96:0/3279088839 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbd8006c230 msgr2=0x7fbd8006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7fbda4712640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbd8006c230 0x7fbd8006e6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c06e6c0 tx=0x7fbd8c008040 comp rx=0 tx=0).stop 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7fbda4712640 1 -- 172.21.15.96:0/3279088839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c15a7e0 msgr2=0x7fbd9c14e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.101+0000 7fbda4712640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c15a7e0 0x7fbd9c14e040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0751e0 tx=0x7fbd980046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.102+0000 7fbda4712640 1 -- 172.21.15.96:0/3279088839 shutdown_connections 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.102+0000 7fbda4712640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd9c15a7e0 0x7fbd9c14e040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.102+0000 7fbda4712640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbd8006c230 0x7fbd8006e6f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.102+0000 7fbda4712640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd9c0ca8f0 0x7fbd9c1424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.102+0000 7fbda4712640 1 --2- 172.21.15.96:0/3279088839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd9c06efc0 0x7fbd9c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.102+0000 7fbda4712640 1 -- 172.21.15.96:0/3279088839 >> 172.21.15.96:0/3279088839 conn(0x7fbd9c0cfb90 msgr2=0x7fbd9c070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.102+0000 7fbda4712640 1 -- 172.21.15.96:0/3279088839 shutdown_connections 2024-06-02T23:46:48.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.102+0000 7fbda4712640 1 -- 172.21.15.96:0/3279088839 wait complete. 2024-06-02T23:46:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 -- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c1006be80 msgr2=0x7f0c1006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c1006be80 0x7f0c1006e340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c14000f60 tx=0x7f0c14009040 comp rx=0 tx=0).stop 2024-06-02T23:46:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 -- 172.21.15.96:0/4198278289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240cef00 msgr2=0x7f0c240c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:48.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240cef00 0x7f0c240c6c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c000f80 tx=0x7f0c1c004a40 comp rx=0 tx=0).stop 2024-06-02T23:46:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 -- 172.21.15.96:0/4198278289 shutdown_connections 2024-06-02T23:46:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c2415a0b0 0x7f0c240c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c240cef00 0x7f0c240c6c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c1006be80 0x7f0c1006e340 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 --2- 172.21.15.96:0/4198278289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c24071f90 0x7f0c241f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 -- 172.21.15.96:0/4198278289 >> 172.21.15.96:0/4198278289 conn(0x7f0c240cfb90 msgr2=0x7f0c2415dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 -- 172.21.15.96:0/4198278289 shutdown_connections 2024-06-02T23:46:48.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:48.106+0000 7f0c29548640 1 -- 172.21.15.96:0/4198278289 wait complete. 2024-06-02T23:46:48.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-06-02T23:46:48.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-06-02T23:46:48.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-06-02T23:46:48.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-06-02T23:46:48.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-06-02T23:46:48.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-06-02T23:46:48.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-06-02T23:46:48.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-06-02T23:46:49.112 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-06-02T23:46:49.113 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-06-02T23:46:49.113 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-06-02T23:46:49.116 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-06-02T23:46:49.119 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-06-02T23:46:49.123 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-06-02T23:46:49.124 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-06-02T23:46:49.124 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-06-02T23:46:49.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.269+0000 7f8b957fb640 1 Processor -- start 2024-06-02T23:46:49.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.270+0000 7f8b957fb640 1 -- start start 2024-06-02T23:46:49.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.270+0000 7ff3c1348640 1 Processor -- start 2024-06-02T23:46:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.270+0000 7ff3c1348640 1 -- start start 2024-06-02T23:46:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.270+0000 7f0d0bfff640 1 Processor -- start 2024-06-02T23:46:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.270+0000 7f0d0bfff640 1 -- start start 2024-06-02T23:46:49.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f8b957fb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b90162640 0x7f8b900c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f8b957fb640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b900ccaf0 0x7f8b900c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f8b957fb640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b900cd0f0 con 0x7f8b90162a20 2024-06-02T23:46:49.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f8b957fb640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8b900b36e0 con 0x7f8b900ccaf0 2024-06-02T23:46:49.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f8b957fb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b900cd3d0 con 0x7f8b90162640 2024-06-02T23:46:49.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f0d0bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0d0c14bd60 0x7f0d0c070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f8b87fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f8b90162a20 0x7f8b900cc3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39938/0 (socket says 172.21.15.96:39938) 2024-06-02T23:46:49.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f8b87fff640 1 -- 172.21.15.96:0/1722768313 learned_addr learned my addr 172.21.15.96:0/1722768313 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:49.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f0d0bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0d0c162ab0 0x7f0d0c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f0d0bfff640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0c06e390 con 0x7f0d0c06d660 2024-06-02T23:46:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f0d0bfff640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0d0c0b2b40 con 0x7f0d0c14bd60 2024-06-02T23:46:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f0d0bfff640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0d0c0b2e20 con 0x7f0d0c162ab0 2024-06-02T23:46:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7ff3c1348640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff3bc15a270 0x7ff3bc0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.271+0000 7f0d0affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0d0c14bd60 0x7f0d0c070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7f0d0affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0d0c14bd60 0x7f0d0c070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54920/0 (socket says 172.21.15.96:54920) 2024-06-02T23:46:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7f0d0affd640 1 -- 172.21.15.96:0/2769268382 learned_addr learned my addr 172.21.15.96:0/2769268382 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7f8b8f7fe640 1 --2- 172.21.15.96:0/1722768313 >> v2:172.21.15.162:3300/0 conn(0x7f8b900ccaf0 0x7f8b900c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7f8b8effd640 1 --2- 172.21.15.96:0/1722768313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b90162640 0x7f8b900c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7f0d03fff640 1 --2- 172.21.15.96:0/2769268382 >> v2:172.21.15.162:3300/0 conn(0x7f0d0c162ab0 0x7f0d0c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7ff3c1348640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff3bc070ef0 0x7ff3bc071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7ff3c1348640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3bc06cda0 con 0x7ff3bc0cd900 2024-06-02T23:46:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7ff3c1348640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff3bc06d040 con 0x7ff3bc15a270 2024-06-02T23:46:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7ff3c1348640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff3bc06d320 con 0x7ff3bc070ef0 2024-06-02T23:46:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7f0d0affd640 1 -- 172.21.15.96:0/2769268382 >> v2:172.21.15.162:3300/0 conn(0x7f0d0c162ab0 msgr2=0x7f0d0c0712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:49.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7f0d0affd640 1 --2- 172.21.15.96:0/2769268382 >> v2:172.21.15.162:3300/0 conn(0x7f0d0c162ab0 0x7f0d0c0712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7ff3baffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff3bc15a270 0x7ff3bc0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7f0d0affd640 1 -- 172.21.15.96:0/2769268382 >> v1:172.21.15.162:6789/0 conn(0x7f0d0c06d660 legacy=0x7f0d0c06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:49.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7ff3baffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff3bc15a270 0x7ff3bc0ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54928/0 (socket says 172.21.15.96:54928) 2024-06-02T23:46:49.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7ff3baffd640 1 -- 172.21.15.96:0/3019713806 learned_addr learned my addr 172.21.15.96:0/3019713806 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.272+0000 7f0d0affd640 1 -- 172.21.15.96:0/2769268382 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c0b3100 con 0x7f0d0c14bd60 2024-06-02T23:46:49.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.273+0000 7ff3baffd640 1 -- 172.21.15.96:0/3019713806 >> v2:172.21.15.162:3300/0 conn(0x7ff3bc070ef0 msgr2=0x7ff3bc071380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T23:46:49.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.273+0000 7ff3baffd640 1 --2- 172.21.15.96:0/3019713806 >> v2:172.21.15.162:3300/0 conn(0x7ff3bc070ef0 0x7ff3bc071380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.273+0000 7ff3baffd640 1 -- 172.21.15.96:0/3019713806 >> v1:172.21.15.96:6789/0 conn(0x7ff3bc0cd900 legacy=0x7ff3bc06de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.273+0000 7ff3baffd640 1 -- 172.21.15.96:0/3019713806 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3bc06d600 con 0x7ff3bc15a270 2024-06-02T23:46:49.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.273+0000 7f0d03fff640 1 --2- 172.21.15.96:0/2769268382 >> v2:172.21.15.162:3300/0 conn(0x7f0d0c162ab0 0x7f0d0c0712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:49.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.274+0000 7f0d0affd640 1 --2- 172.21.15.96:0/2769268382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c14bd60 0x7f0d0c070db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c073730 tx=0x7f0cf402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3c281ea5edf43a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.274+0000 7ff3baffd640 1 --2- 172.21.15.96:0/3019713806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc15a270 0x7ff3bc0ce7b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc15ef00 tx=0x7ff3b402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926e680353263d42 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.273+0000 7f8b8effd640 1 -- 172.21.15.96:0/1722768313 >> v2:172.21.15.162:3300/0 conn(0x7f8b900ccaf0 msgr2=0x7f8b900c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.273+0000 7f8b8effd640 1 --2- 172.21.15.96:0/1722768313 >> v2:172.21.15.162:3300/0 conn(0x7f8b900ccaf0 0x7f8b900c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.273+0000 7f8b8effd640 1 -- 172.21.15.96:0/1722768313 >> v1:172.21.15.96:6789/0 conn(0x7f8b90162a20 legacy=0x7f8b900cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.273+0000 7f8b8effd640 1 -- 172.21.15.96:0/1722768313 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b900cd6b0 con 0x7f8b90162640 2024-06-02T23:46:49.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.275+0000 7ff3b9ffb640 1 -- 172.21.15.96:0/3019713806 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4036070 con 0x7ff3bc15a270 2024-06-02T23:46:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.275+0000 7f8b8effd640 1 --2- 172.21.15.96:0/1722768313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b90162640 0x7f8b900c4d60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b800097a0 tx=0x7f8b8002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=204ec7d32707606e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.275+0000 7ff3b9ffb640 1 -- 172.21.15.96:0/3019713806 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b4031600 con 0x7ff3bc15a270 2024-06-02T23:46:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.275+0000 7ff3b9ffb640 1 -- 172.21.15.96:0/3019713806 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40319d0 con 0x7ff3bc15a270 2024-06-02T23:46:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.275+0000 7f0d0a7fc640 1 -- 172.21.15.96:0/2769268382 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4037070 con 0x7f0d0c14bd60 2024-06-02T23:46:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.275+0000 7f0d0a7fc640 1 -- 172.21.15.96:0/2769268382 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf4032440 con 0x7f0d0c14bd60 2024-06-02T23:46:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7ff3c1348640 1 -- 172.21.15.96:0/3019713806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc15a270 msgr2=0x7ff3bc0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7ff3c1348640 1 --2- 172.21.15.96:0/3019713806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc15a270 0x7ff3bc0ce7b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc15ef00 tx=0x7ff3b402a6f0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7f0d0a7fc640 1 -- 172.21.15.96:0/2769268382 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4032850 con 0x7f0d0c14bd60 2024-06-02T23:46:49.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7ff3c1348640 1 -- 172.21.15.96:0/3019713806 shutdown_connections 2024-06-02T23:46:49.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.275+0000 7f8b8e7fc640 1 -- 172.21.15.96:0/1722768313 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80037070 con 0x7f8b90162640 2024-06-02T23:46:49.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.275+0000 7f8b8e7fc640 1 -- 172.21.15.96:0/1722768313 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b80032440 con 0x7f8b90162640 2024-06-02T23:46:49.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.275+0000 7f8b8e7fc640 1 -- 172.21.15.96:0/1722768313 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80032810 con 0x7f8b90162640 2024-06-02T23:46:49.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7f8b957fb640 1 -- 172.21.15.96:0/1722768313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b90162640 msgr2=0x7f8b900c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7f8b957fb640 1 --2- 172.21.15.96:0/1722768313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b90162640 0x7f8b900c4d60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b800097a0 tx=0x7f8b8002a270 comp rx=0 tx=0).stop 2024-06-02T23:46:49.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7ff3c1348640 1 --2- 172.21.15.96:0/3019713806 >> v2:172.21.15.162:3300/0 conn(0x7ff3bc070ef0 0x7ff3bc071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7ff3c1348640 1 --2- 172.21.15.96:0/3019713806 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc15a270 0x7ff3bc0ce7b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7ff3c1348640 1 -- 172.21.15.96:0/3019713806 >> 172.21.15.96:0/3019713806 conn(0x7ff3bc0cfc30 msgr2=0x7ff3bc0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7ff3c1348640 1 -- 172.21.15.96:0/3019713806 shutdown_connections 2024-06-02T23:46:49.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7f8b957fb640 1 -- 172.21.15.96:0/1722768313 shutdown_connections 2024-06-02T23:46:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7f8b957fb640 1 --2- 172.21.15.96:0/1722768313 >> v2:172.21.15.162:3300/0 conn(0x7f8b900ccaf0 0x7f8b900c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7f8b957fb640 1 --2- 172.21.15.96:0/1722768313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b90162640 0x7f8b900c4d60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7f8b957fb640 1 -- 172.21.15.96:0/1722768313 >> 172.21.15.96:0/1722768313 conn(0x7f8b900d1d90 msgr2=0x7f8b900d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.276+0000 7ff3c1348640 1 -- 172.21.15.96:0/3019713806 wait complete. 2024-06-02T23:46:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.277+0000 7f0d0bfff640 1 -- 172.21.15.96:0/2769268382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c14bd60 msgr2=0x7f0d0c070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.277+0000 7f0d0bfff640 1 --2- 172.21.15.96:0/2769268382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c14bd60 0x7f0d0c070db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c073730 tx=0x7f0cf402a250 comp rx=0 tx=0).stop 2024-06-02T23:46:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.277+0000 7f8b957fb640 1 -- 172.21.15.96:0/1722768313 shutdown_connections 2024-06-02T23:46:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.277+0000 7f0d0bfff640 1 -- 172.21.15.96:0/2769268382 shutdown_connections 2024-06-02T23:46:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.277+0000 7f0d0bfff640 1 --2- 172.21.15.96:0/2769268382 >> v2:172.21.15.162:3300/0 conn(0x7f0d0c162ab0 0x7f0d0c0712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.277+0000 7f0d0bfff640 1 --2- 172.21.15.96:0/2769268382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c14bd60 0x7f0d0c070db0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c073730 tx=0x7f0cf402a250 comp rx=0 tx=0).stop 2024-06-02T23:46:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.277+0000 7f0d0bfff640 1 -- 172.21.15.96:0/2769268382 >> 172.21.15.96:0/2769268382 conn(0x7f0d0c0b16c0 msgr2=0x7f0d0c0b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.277+0000 7f0d0bfff640 1 -- 172.21.15.96:0/2769268382 shutdown_connections 2024-06-02T23:46:49.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.277+0000 7f8b957fb640 1 -- 172.21.15.96:0/1722768313 wait complete. 2024-06-02T23:46:49.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.278+0000 7ff3c1348640 1 Processor -- start 2024-06-02T23:46:49.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.278+0000 7f8b957fb640 1 Processor -- start 2024-06-02T23:46:49.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.277+0000 7f0d0bfff640 1 -- 172.21.15.96:0/2769268382 wait complete. 2024-06-02T23:46:49.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.279+0000 7ff3c1348640 1 -- start start 2024-06-02T23:46:49.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7ff3c1348640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc070ef0 0x7ff3bc0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7ff3c1348640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3bc0cd900 0x7ff3bc0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7ff3baffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc070ef0 0x7ff3bc0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7ff3baffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc070ef0 0x7ff3bc0c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54946/0 (socket says 172.21.15.96:54946) 2024-06-02T23:46:49.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7ff3baffd640 1 -- 172.21.15.96:0/2116002029 learned_addr learned my addr 172.21.15.96:0/2116002029 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.279+0000 7f0d0bfff640 1 Processor -- start 2024-06-02T23:46:49.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7ff3c1348640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc15a270 0x7ff3bc157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc06e510 con 0x7ff3bc070ef0 2024-06-02T23:46:49.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff3bc15a650 con 0x7ff3bc15a270 2024-06-02T23:46:49.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff3bc0ca280 con 0x7ff3bc0cd900 2024-06-02T23:46:49.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.279+0000 7f0d0bfff640 1 -- start start 2024-06-02T23:46:49.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7f0d0bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c06d660 0x7f0d0c1620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7f0d0bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d0c162ab0 0x7f0d0c162f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7f0d0bfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d0c166740 0x7f0d0c070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7f0d0bfff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0b37a0 con 0x7f0d0c06d660 2024-06-02T23:46:49.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7f0d0bfff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0c0b3620 con 0x7f0d0c162ab0 2024-06-02T23:46:49.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7f0d0bfff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c0b3920 con 0x7f0d0c166740 2024-06-02T23:46:49.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7f0d0affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c06d660 0x7f0d0c1620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7f0d0affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c06d660 0x7f0d0c1620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54956/0 (socket says 172.21.15.96:54956) 2024-06-02T23:46:49.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7f0d0affd640 1 -- 172.21.15.96:0/3728871500 learned_addr learned my addr 172.21.15.96:0/3728871500 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.279+0000 7f8b957fb640 1 -- start start 2024-06-02T23:46:49.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7f8b957fb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b900ccaf0 0x7f8b900c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7f8b957fb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b90162640 0x7f8b90161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7f8b957fb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b90162a20 0x7f8b90164490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7f8b957fb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8b900ce190 con 0x7f8b90162a20 2024-06-02T23:46:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7f8b957fb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b900cdc70 con 0x7f8b900ccaf0 2024-06-02T23:46:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7f8b957fb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9016c380 con 0x7f8b90162640 2024-06-02T23:46:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7f8b8f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b90162a20 0x7f8b90164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7f8b8f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b90162a20 0x7f8b90164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54940/0 (socket says 172.21.15.96:54940) 2024-06-02T23:46:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.280+0000 7f8b8f7fe640 1 -- 172.21.15.96:0/3603750127 learned_addr learned my addr 172.21.15.96:0/3603750127 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.281+0000 7f0d0b7fe640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d0c166740 0x7f0d0c070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7ff3bb7fe640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc15a270 0x7ff3bc157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7ff3ba7fc640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3bc0cd900 0x7ff3bc0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f0d03fff640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d0c162ab0 0x7f0d0c162f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f8b8effd640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b900ccaf0 0x7f8b900c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7ff3baffd640 1 -- 172.21.15.96:0/2116002029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3bc0cd900 msgr2=0x7ff3bc0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7ff3baffd640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3bc0cd900 0x7ff3bc0b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7ff3baffd640 1 -- 172.21.15.96:0/2116002029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc15a270 msgr2=0x7ff3bc157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7ff3baffd640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc15a270 0x7ff3bc157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7ff3baffd640 1 -- 172.21.15.96:0/2116002029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3bc0b4070 con 0x7ff3bc070ef0 2024-06-02T23:46:49.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f0d03fff640 1 -- 172.21.15.96:0/3728871500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d0c166740 msgr2=0x7f0d0c070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f0d03fff640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d0c166740 0x7f0d0c070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f8b8f7fe640 1 -- 172.21.15.96:0/3603750127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b90162640 msgr2=0x7f8b90161920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T23:46:49.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f8b8f7fe640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b90162640 0x7f8b90161920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f8b8f7fe640 1 -- 172.21.15.96:0/3603750127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b900ccaf0 msgr2=0x7f8b900c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f8b8f7fe640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b900ccaf0 0x7f8b900c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f8b8f7fe640 1 -- 172.21.15.96:0/3603750127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b900b63c0 con 0x7f8b90162a20 2024-06-02T23:46:49.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f8b8effd640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b900ccaf0 0x7f8b900c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f0d03fff640 1 -- 172.21.15.96:0/3728871500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c06d660 msgr2=0x7f0d0c1620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f0d03fff640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c06d660 0x7f0d0c1620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f0d03fff640 1 -- 172.21.15.96:0/3728871500 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c1648d0 con 0x7f0d0c162ab0 2024-06-02T23:46:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f0d0b7fe640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d0c166740 0x7f0d0c070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7ff3baffd640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc070ef0 0x7ff3bc0c8700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40093e0 tx=0x7ff3b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.282+0000 7f8b8f7fe640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b90162a20 0x7f8b90164490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009dd0 tx=0x7f8b8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7f0d0affd640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c06d660 0x7f0d0c1620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:49.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7ff3a37fe640 1 -- 172.21.15.96:0/2116002029 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4041020 con 0x7ff3bc070ef0 2024-06-02T23:46:49.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7f0d03fff640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d0c162ab0 0x7f0d0c162f10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00e840 tx=0x7f0cfc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3bc0c8ce0 con 0x7ff3bc070ef0 2024-06-02T23:46:49.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3bc0c92a0 con 0x7ff3bc070ef0 2024-06-02T23:46:49.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7ff3a37fe640 1 -- 172.21.15.96:0/2116002029 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b4031600 con 0x7ff3bc070ef0 2024-06-02T23:46:49.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7ff3a37fe640 1 -- 172.21.15.96:0/2116002029 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4036040 con 0x7ff3bc070ef0 2024-06-02T23:46:49.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7f0d037fe640 1 -- 172.21.15.96:0/3728871500 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc017070 con 0x7f0d0c162ab0 2024-06-02T23:46:49.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7f8b877fe640 1 -- 172.21.15.96:0/3603750127 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88018020 con 0x7f8b90162a20 2024-06-02T23:46:49.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7f8b957fb640 1 -- 172.21.15.96:0/3603750127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b90161e60 con 0x7f8b90162a20 2024-06-02T23:46:49.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7f8b957fb640 1 -- 172.21.15.96:0/3603750127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b90165ab0 con 0x7f8b90162a20 2024-06-02T23:46:49.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7f8b877fe640 1 -- 172.21.15.96:0/3603750127 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b88014480 con 0x7f8b90162a20 2024-06-02T23:46:49.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7f8b877fe640 1 -- 172.21.15.96:0/3603750127 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88014870 con 0x7f8b90162a20 2024-06-02T23:46:49.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.283+0000 7f0d037fe640 1 -- 172.21.15.96:0/3728871500 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cfc00c940 con 0x7f0d0c162ab0 2024-06-02T23:46:49.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.284+0000 7f0d0bfff640 1 -- 172.21.15.96:0/3728871500 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0c164bb0 con 0x7f0d0c162ab0 2024-06-02T23:46:49.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.284+0000 7f0d0bfff640 1 -- 172.21.15.96:0/3728871500 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0c166bd0 con 0x7f0d0c162ab0 2024-06-02T23:46:49.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.285+0000 7f0d037fe640 1 -- 172.21.15.96:0/3728871500 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc017070 con 0x7f0d0c162ab0 2024-06-02T23:46:49.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.286+0000 7ff3a37fe640 1 -- 172.21.15.96:0/2116002029 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3b4044020 con 0x7ff3bc070ef0 2024-06-02T23:46:49.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.287+0000 7ff3a37fe640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3a806be30 0x7ff3a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.287+0000 7ff3a37fe640 1 -- 172.21.15.96:0/2116002029 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff3b40ac030 con 0x7ff3bc070ef0 2024-06-02T23:46:49.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.287+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39c005290 con 0x7ff3bc070ef0 2024-06-02T23:46:49.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.288+0000 7f8b877fe640 1 -- 172.21.15.96:0/3603750127 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b88005d10 con 0x7f8b90162a20 2024-06-02T23:46:49.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.288+0000 7f0d0bfff640 1 -- 172.21.15.96:0/3728871500 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0c04f760 con 0x7f0d0c162ab0 2024-06-02T23:46:49.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.289+0000 7f8b957fb640 1 -- 172.21.15.96:0/3603750127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b74005290 con 0x7f8b90162a20 2024-06-02T23:46:49.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.289+0000 7f8b877fe640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8b7006bf00 0x7f8b7006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.288+0000 7f0d037fe640 1 -- 172.21.15.96:0/3728871500 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0cfc01a070 con 0x7f0d0c162ab0 2024-06-02T23:46:49.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.289+0000 7f0d037fe640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0cec06c260 0x7f0cec06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.289+0000 7f0d037fe640 1 -- 172.21.15.96:0/3728871500 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0cfc00f040 con 0x7f0d0c162ab0 2024-06-02T23:46:49.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.290+0000 7f8b877fe640 1 -- 172.21.15.96:0/3603750127 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8b8808bbd0 con 0x7f8b90162a20 2024-06-02T23:46:49.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.290+0000 7ff3ba7fc640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3a806be30 0x7ff3a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.290+0000 7f0d0affd640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0cec06c260 0x7f0cec06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.290+0000 7ff3ba7fc640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3a806be30 0x7ff3a806e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc0b4d20 tx=0x7ff3ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.290+0000 7f0d0affd640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0cec06c260 0x7f0cec06e720 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4000c00 tx=0x7f0cf402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.291+0000 7f8b8effd640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8b7006bf00 0x7f8b7006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.291+0000 7f8b8effd640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8b7006bf00 0x7f8b7006e3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8b80034000 tx=0x7f8b8002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.298+0000 7ff3a37fe640 1 -- 172.21.15.96:0/2116002029 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff3b404b030 con 0x7ff3bc070ef0 2024-06-02T23:46:49.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.296+0000 7f0d037fe640 1 -- 172.21.15.96:0/3728871500 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0cfc058b40 con 0x7f0d0c162ab0 2024-06-02T23:46:49.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.307+0000 7f8b877fe640 1 -- 172.21.15.96:0/3603750127 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8b88022070 con 0x7f8b90162a20 2024-06-02T23:46:49.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.328+0000 7f2c8f510640 1 Processor -- start 2024-06-02T23:46:49.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.329+0000 7f2c8f510640 1 -- start start 2024-06-02T23:46:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.330+0000 7f2c8f510640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2c8815a0b0 0x7f2c880cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.330+0000 7f2c8f510640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c880cef00 0x7f2c880cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.330+0000 7f2c8f510640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c880cde60 con 0x7f2c88071880 2024-06-02T23:46:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.330+0000 7f2c8f510640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2c880cea70 con 0x7f2c880cef00 2024-06-02T23:46:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.330+0000 7f2c8f510640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2c880ce140 con 0x7f2c8815a0b0 2024-06-02T23:46:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.330+0000 7f2c8caab640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c880cef00 0x7f2c880cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.330+0000 7f2c8caab640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c880cef00 0x7f2c880cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54966/0 (socket says 172.21.15.96:54966) 2024-06-02T23:46:49.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.330+0000 7f2c8caab640 1 -- 172.21.15.96:0/2511068576 learned_addr learned my addr 172.21.15.96:0/2511068576 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.331+0000 7f2c8caab640 1 -- 172.21.15.96:0/2511068576 >> v2:172.21.15.162:3300/0 conn(0x7f2c8815a0b0 msgr2=0x7f2c880cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:49.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.331+0000 7f2c8caab640 1 --2- 172.21.15.96:0/2511068576 >> v2:172.21.15.162:3300/0 conn(0x7f2c8815a0b0 0x7f2c880cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.331+0000 7f2c8caab640 1 -- 172.21.15.96:0/2511068576 >> v1:172.21.15.96:6789/0 conn(0x7f2c88071880 legacy=0x7f2c8815dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:49.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.331+0000 7f2c8caab640 1 -- 172.21.15.96:0/2511068576 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c880ce420 con 0x7f2c880cef00 2024-06-02T23:46:49.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.332+0000 7f2c8caab640 1 --2- 172.21.15.96:0/2511068576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c880cef00 0x7f2c880cbab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2c8806cb60 tx=0x7f2c8002bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7121ddb10bd8d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.334+0000 7fba4aabc640 1 Processor -- start 2024-06-02T23:46:49.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.334+0000 7fba4aabc640 1 -- start start 2024-06-02T23:46:49.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.333+0000 7f2c7ffff640 1 -- 172.21.15.96:0/2511068576 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8002c720 con 0x7f2c880cef00 2024-06-02T23:46:49.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.333+0000 7f2c7ffff640 1 -- 172.21.15.96:0/2511068576 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8002c8c0 con 0x7f2c880cef00 2024-06-02T23:46:49.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.333+0000 7f2c7ffff640 1 -- 172.21.15.96:0/2511068576 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8002ccd0 con 0x7f2c880cef00 2024-06-02T23:46:49.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.334+0000 7f2c8f510640 1 -- 172.21.15.96:0/2511068576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c880cef00 msgr2=0x7f2c880cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.334+0000 7f2c8f510640 1 --2- 172.21.15.96:0/2511068576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c880cef00 0x7f2c880cbab0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2c8806cb60 tx=0x7f2c8002bc20 comp rx=0 tx=0).stop 2024-06-02T23:46:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.335+0000 7f2c8f510640 1 -- 172.21.15.96:0/2511068576 shutdown_connections 2024-06-02T23:46:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.335+0000 7f2c8f510640 1 --2- 172.21.15.96:0/2511068576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c880cef00 0x7f2c880cbab0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.335+0000 7f2c8f510640 1 --2- 172.21.15.96:0/2511068576 >> v2:172.21.15.162:3300/0 conn(0x7f2c8815a0b0 0x7f2c880cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.335+0000 7f2c8f510640 1 -- 172.21.15.96:0/2511068576 >> 172.21.15.96:0/2511068576 conn(0x7f2c880cfb90 msgr2=0x7f2c880cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.335+0000 7fba4aabc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba4406d490 0x7fba440cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.335+0000 7fba4aabc640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba440ca320 con 0x7fba440ce0c0 2024-06-02T23:46:49.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.335+0000 7fba4aabc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba440ca5c0 con 0x7fba440cb380 2024-06-02T23:46:49.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.335+0000 7fba4aabc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fba440cbd20 con 0x7fba4406d490 2024-06-02T23:46:49.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.336+0000 7f7d09134640 1 Processor -- start 2024-06-02T23:46:49.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.336+0000 7fba48858640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fba440ce0c0 0x7fba44071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39956/0 (socket says 172.21.15.96:39956) 2024-06-02T23:46:49.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.336+0000 7fba48858640 1 -- 172.21.15.96:0/2363808306 learned_addr learned my addr 172.21.15.96:0/2363808306 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:49.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.336+0000 7f1d00cf8640 1 Processor -- start 2024-06-02T23:46:49.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.336+0000 7f1d00cf8640 1 -- start start 2024-06-02T23:46:49.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.336+0000 7f2c8f510640 1 -- 172.21.15.96:0/2511068576 shutdown_connections 2024-06-02T23:46:49.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.336+0000 7f2c8f510640 1 -- 172.21.15.96:0/2511068576 wait complete. 2024-06-02T23:46:49.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.336+0000 7fba437fe640 1 -- 172.21.15.96:0/2363808306 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497691864 0 0) 0x7fba440ca320 con 0x7fba440ce0c0 2024-06-02T23:46:49.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.336+0000 7fba437fe640 1 -- 172.21.15.96:0/2363808306 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba2c003520 con 0x7fba440ce0c0 2024-06-02T23:46:49.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.337+0000 7fba49059640 1 --2- 172.21.15.96:0/2363808306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba4406d490 0x7fba440cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.337+0000 7fba49059640 1 -- 172.21.15.96:0/2363808306 >> v1:172.21.15.162:6789/0 conn(0x7fba440cb380 legacy=0x7fba4406cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.337+0000 7fba49059640 1 -- 172.21.15.96:0/2363808306 >> v1:172.21.15.96:6789/0 conn(0x7fba440ce0c0 legacy=0x7fba44071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.337+0000 7f1d00cf8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15bd00 0x7f1cfc0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.337+0000 7f1d00cf8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1cfc15c0e0 0x7f1cfc0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.337+0000 7fba49059640 1 -- 172.21.15.96:0/2363808306 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba440ca8a0 con 0x7fba4406d490 2024-06-02T23:46:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.337+0000 7f1cfaffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1cfc15c0e0 0x7f1cfc0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.337+0000 7f1cfaffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1cfc15c0e0 0x7f1cfc0b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54972/0 (socket says 172.21.15.96:54972) 2024-06-02T23:46:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.337+0000 7f1cfaffd640 1 -- 172.21.15.96:0/1431108733 learned_addr learned my addr 172.21.15.96:0/1431108733 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.337+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/1431108733 >> v2:172.21.15.162:3300/0 conn(0x7f1cfc06b3c0 0x7f1cfc06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f1d00cf8640 1 -- 172.21.15.96:0/1431108733 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f1cfc06bd20 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f1d00cf8640 1 -- 172.21.15.96:0/1431108733 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1cfc0b2a30 con 0x7f1cfc06b3c0 2024-06-02T23:46:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f1d00cf8640 1 -- 172.21.15.96:0/1431108733 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1cfc160a70 con 0x7f1cfc15bd00 2024-06-02T23:46:49.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f2c8f510640 1 Processor -- start 2024-06-02T23:46:49.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f7d09134640 1 -- start start 2024-06-02T23:46:49.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f1cfaffd640 1 -- 172.21.15.96:0/1431108733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15bd00 msgr2=0x7f1cfc0cd520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T23:46:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f1cfaffd640 1 --2- 172.21.15.96:0/1431108733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15bd00 0x7f1cfc0cd520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f1cfaffd640 1 -- 172.21.15.96:0/1431108733 >> v2:172.21.15.162:3300/0 conn(0x7f1cfc06b3c0 msgr2=0x7f1cfc06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f1cfaffd640 1 --2- 172.21.15.96:0/1431108733 >> v2:172.21.15.162:3300/0 conn(0x7f1cfc06b3c0 0x7f1cfc06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f1cfaffd640 1 -- 172.21.15.96:0/1431108733 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc15fcb0 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7f2c8f510640 1 -- start start 2024-06-02T23:46:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.338+0000 7fba49059640 1 --2- 172.21.15.96:0/2363808306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba4406d490 0x7fba440cb7e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009dc0 tx=0x7fba3c02a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de5a843817d69667 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7fba437fe640 1 -- 172.21.15.96:0/2363808306 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c007740 con 0x7fba4406d490 2024-06-02T23:46:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7fba437fe640 1 -- 172.21.15.96:0/2363808306 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c0078e0 con 0x7fba4406d490 2024-06-02T23:46:49.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7fba437fe640 1 -- 172.21.15.96:0/2363808306 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c007cb0 con 0x7fba4406d490 2024-06-02T23:46:49.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7f1cfaffd640 1 --2- 172.21.15.96:0/1431108733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cfc15c0e0 0x7f1cfc0b24f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0724e0 tx=0x7f1cf402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fc730851d913dd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7f7d09134640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7d0415c130 0x7f7d040cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7f7d09134640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d040cfc70 0x7f7d040cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7f7d09134640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7d040cf630 0x7f7d040d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7f7d09134640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7d040cdfd0 con 0x7f7d040cf630 2024-06-02T23:46:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7f7d09134640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7d040c8d10 con 0x7f7d0415c130 2024-06-02T23:46:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7f7d09134640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7d040cdcf0 con 0x7f7d040cfc70 2024-06-02T23:46:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7f7d02d9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7d0415c130 0x7f7d040cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f1cfa7fc640 1 -- 172.21.15.96:0/1431108733 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4036070 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7f7d02d9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7d0415c130 0x7f7d040cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:55956/0 (socket says 172.21.15.96:55956) 2024-06-02T23:46:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f2c8f510640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c88071880 0x7f2c88151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f1cfa7fc640 1 -- 172.21.15.96:0/1431108733 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf4031600 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.339+0000 7f7d02d9d640 1 -- 172.21.15.96:0/1437360187 learned_addr learned my addr 172.21.15.96:0/1437360187 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f1cfa7fc640 1 -- 172.21.15.96:0/1431108733 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40319d0 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f2c8f510640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c880cef00 0x7f2c88152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f7d02d9d640 1 -- 172.21.15.96:0/1437360187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d040cfc70 msgr2=0x7f7d040cf0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T23:46:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f2c8f510640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c8815a0b0 0x7f2c880c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f7d02d9d640 1 --2- 172.21.15.96:0/1437360187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d040cfc70 0x7f7d040cf0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f2c8f510640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8815a610 con 0x7f2c880cef00 2024-06-02T23:46:49.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f2c8f510640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8815a490 con 0x7f2c8815a0b0 2024-06-02T23:46:49.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f7d02d9d640 1 -- 172.21.15.96:0/1437360187 >> v2:172.21.15.96:3300/0 conn(0x7f7d040cf630 msgr2=0x7f7d040d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f7d02d9d640 1 --2- 172.21.15.96:0/1437360187 >> v2:172.21.15.96:3300/0 conn(0x7f7d040cf630 0x7f7d040d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f7d02d9d640 1 -- 172.21.15.96:0/1437360187 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d040ce610 con 0x7f7d0415c130 2024-06-02T23:46:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f2c8daad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c8815a0b0 0x7f2c880c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f2c8daad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c8815a0b0 0x7f2c880c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:55960/0 (socket says 172.21.15.96:55960) 2024-06-02T23:46:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f2c8daad640 1 -- 172.21.15.96:0/1908407188 learned_addr learned my addr 172.21.15.96:0/1908407188 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7fba4aabc640 1 -- 172.21.15.96:0/2363808306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba4406d490 msgr2=0x7fba440cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7fba4aabc640 1 --2- 172.21.15.96:0/2363808306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba4406d490 0x7fba440cb7e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009dc0 tx=0x7fba3c02a760 comp rx=0 tx=0).stop 2024-06-02T23:46:49.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f2c8caab640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c880cef00 0x7f2c88152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c880d0680 con 0x7f2c88071880 2024-06-02T23:46:49.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7fba4aabc640 1 -- 172.21.15.96:0/2363808306 shutdown_connections 2024-06-02T23:46:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.340+0000 7fba4aabc640 1 --2- 172.21.15.96:0/2363808306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba4406d490 0x7fba440cb7e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7fba4aabc640 1 -- 172.21.15.96:0/2363808306 >> 172.21.15.96:0/2363808306 conn(0x7fba440cfc30 msgr2=0x7fba440d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7f2c8daad640 1 -- 172.21.15.96:0/1908407188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c88071880 msgr2=0x7f2c88151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7f2c8daad640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c88071880 0x7f2c88151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7f2c8daad640 1 -- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c880cef00 msgr2=0x7f2c88152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7f2c8daad640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c880cef00 0x7f2c88152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7f2c8daad640 1 -- 172.21.15.96:0/1908407188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c881531e0 con 0x7f2c8815a0b0 2024-06-02T23:46:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7f2c8caab640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c880cef00 0x7f2c88152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:49.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7fba4aabc640 1 -- 172.21.15.96:0/2363808306 shutdown_connections 2024-06-02T23:46:49.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7f1d00cf8640 1 -- 172.21.15.96:0/1431108733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cfc15c0e0 msgr2=0x7f1cfc0b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/1431108733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cfc15c0e0 0x7f1cfc0b24f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0724e0 tx=0x7f1cf402a6f0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7f2c8daad640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c8815a0b0 0x7f2c880c8c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800c440 tx=0x7f2c7800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f1d00cf8640 1 -- 172.21.15.96:0/1431108733 shutdown_connections 2024-06-02T23:46:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/1431108733 >> v2:172.21.15.162:3300/0 conn(0x7f1cfc06b3c0 0x7f1cfc06b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/1431108733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cfc15c0e0 0x7f1cfc0b24f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/1431108733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15bd00 0x7f1cfc0cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f1d00cf8640 1 -- 172.21.15.96:0/1431108733 >> 172.21.15.96:0/1431108733 conn(0x7f1cfc071c50 msgr2=0x7f1cfc0b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f7d02d9d640 1 --2- 172.21.15.96:0/1437360187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d0415c130 0x7f7d040cd630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d040729d0 tx=0x7f7cf402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f974003bf7aa975b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f2c7dffb640 1 -- 172.21.15.96:0/1908407188 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78011790 con 0x7f2c8815a0b0 2024-06-02T23:46:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f2c7dffb640 1 -- 172.21.15.96:0/1908407188 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c78017070 con 0x7f2c8815a0b0 2024-06-02T23:46:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f2c7dffb640 1 -- 172.21.15.96:0/1908407188 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78011b70 con 0x7f2c8815a0b0 2024-06-02T23:46:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c88153480 con 0x7f2c8815a0b0 2024-06-02T23:46:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f7d01d9b640 1 -- 172.21.15.96:0/1437360187 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4037070 con 0x7f7d0415c130 2024-06-02T23:46:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f7d01d9b640 1 -- 172.21.15.96:0/1437360187 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf402ae50 con 0x7f7d0415c130 2024-06-02T23:46:49.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f7d01d9b640 1 -- 172.21.15.96:0/1437360187 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4032660 con 0x7f7d0415c130 2024-06-02T23:46:49.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.342+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c88153a40 con 0x7f2c8815a0b0 2024-06-02T23:46:49.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.343+0000 7f7d09134640 1 -- 172.21.15.96:0/1437360187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d0415c130 msgr2=0x7f7d040cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.343+0000 7f7d09134640 1 --2- 172.21.15.96:0/1437360187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d0415c130 0x7f7d040cd630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7d040729d0 tx=0x7f7cf402a100 comp rx=0 tx=0).stop 2024-06-02T23:46:49.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.343+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c68005290 con 0x7f2c8815a0b0 2024-06-02T23:46:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.343+0000 7f7d09134640 1 -- 172.21.15.96:0/1437360187 shutdown_connections 2024-06-02T23:46:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.343+0000 7f7d09134640 1 --2- 172.21.15.96:0/1437360187 >> v2:172.21.15.96:3300/0 conn(0x7f7d040cf630 0x7f7d040d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.343+0000 7f7d09134640 1 --2- 172.21.15.96:0/1437360187 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d040cfc70 0x7f7d040cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.343+0000 7f7d09134640 1 --2- 172.21.15.96:0/1437360187 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d0415c130 0x7f7d040cd630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.343+0000 7f7d09134640 1 -- 172.21.15.96:0/1437360187 >> 172.21.15.96:0/1437360187 conn(0x7f7d040b39c0 msgr2=0x7f7d040b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.344+0000 7f1d00cf8640 1 -- 172.21.15.96:0/1431108733 shutdown_connections 2024-06-02T23:46:49.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.344+0000 7f3adffff640 1 Processor -- start 2024-06-02T23:46:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.344+0000 7f7d09134640 1 -- 172.21.15.96:0/1437360187 shutdown_connections 2024-06-02T23:46:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.344+0000 7f3adffff640 1 -- start start 2024-06-02T23:46:49.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.341+0000 7fba4aabc640 1 -- 172.21.15.96:0/2363808306 wait complete. 2024-06-02T23:46:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7f3adffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3ae0160830 0x7f3ae0072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7f3adffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b0f50 0x7f3ae009dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.344+0000 7f2c7dffb640 1 -- 172.21.15.96:0/1908407188 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c78011d10 con 0x7f2c8815a0b0 2024-06-02T23:46:49.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7f3adffff640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae00b6070 con 0x7f3ae00b4fb0 2024-06-02T23:46:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.343+0000 7fba4aabc640 1 Processor -- start 2024-06-02T23:46:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.343+0000 7fba4aabc640 1 -- start start 2024-06-02T23:46:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7fba4aabc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba4406d490 0x7fba440b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7fba4aabc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba440cb380 0x7fba44209640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7fba4aabc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba440ce0c0 0x7fba44159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7fba4aabc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fba440c34d0 con 0x7fba440ce0c0 2024-06-02T23:46:49.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7fba4aabc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba440cae60 con 0x7fba4406d490 2024-06-02T23:46:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7fba4aabc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fba44071f80 con 0x7fba440cb380 2024-06-02T23:46:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7fba43fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba440cb380 0x7fba44209640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7fba43fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba440cb380 0x7fba44209640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38928/0 (socket says 172.21.15.96:38928) 2024-06-02T23:46:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7fba43fff640 1 -- 172.21.15.96:0/2948899728 learned_addr learned my addr 172.21.15.96:0/2948899728 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7f3adffff640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae0067100 con 0x7f3ae0160830 2024-06-02T23:46:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7f3adf7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b0f50 0x7f3ae009dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7f3adf7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b0f50 0x7f3ae009dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38940/0 (socket says 172.21.15.96:38940) 2024-06-02T23:46:49.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7f3adf7fe640 1 -- 172.21.15.96:0/2307490631 learned_addr learned my addr 172.21.15.96:0/2307490631 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7f3adffff640 1 -- 172.21.15.96:0/2307490631 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae00cda30 con 0x7f3ae00b0f50 2024-06-02T23:46:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.344+0000 7f1d00cf8640 1 -- 172.21.15.96:0/1431108733 wait complete. 2024-06-02T23:46:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7f2c7dffb640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c6c06bf00 0x7f2c6c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.344+0000 7f7d09134640 1 -- 172.21.15.96:0/1437360187 wait complete. 2024-06-02T23:46:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7f2c7dffb640 1 -- 172.21.15.96:0/1908407188 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2c7808ae70 con 0x7f2c8815a0b0 2024-06-02T23:46:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7f7d09134640 1 Processor -- start 2024-06-02T23:46:49.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.345+0000 7f2c8d2ac640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c6c06bf00 0x7f2c6c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7f2c8d2ac640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c6c06bf00 0x7f2c6c06e3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2c88155110 tx=0x7f2c84006bf0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7f7d09134640 1 -- start start 2024-06-02T23:46:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7f3adf7fe640 1 -- 172.21.15.96:0/2307490631 >> v2:172.21.15.96:3300/0 conn(0x7f3ae0160830 msgr2=0x7f3ae0072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7f3adf7fe640 1 --2- 172.21.15.96:0/2307490631 >> v2:172.21.15.96:3300/0 conn(0x7f3ae0160830 0x7f3ae0072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7f3adf7fe640 1 -- 172.21.15.96:0/2307490631 >> v1:172.21.15.96:6789/0 conn(0x7f3ae00b4fb0 legacy=0x7f3ae006b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:49.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7f3adf7fe640 1 -- 172.21.15.96:0/2307490631 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae00b5ac0 con 0x7f3ae00b0f50 2024-06-02T23:46:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7fba48858640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba4406d490 0x7fba440b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7fba43fff640 1 -- 172.21.15.96:0/2948899728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba4406d490 msgr2=0x7fba440b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7fba43fff640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba4406d490 0x7fba440b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7fba43fff640 1 -- 172.21.15.96:0/2948899728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba440ce0c0 msgr2=0x7fba44159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7fba43fff640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba440ce0c0 0x7fba44159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7fba43fff640 1 -- 172.21.15.96:0/2948899728 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba44209b80 con 0x7fba440cb380 2024-06-02T23:46:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.347+0000 7fba43fff640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba440cb380 0x7fba44209640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba3400c450 tx=0x7fba3400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.346+0000 7f1d00cf8640 1 Processor -- start 2024-06-02T23:46:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.347+0000 7f1d00cf8640 1 -- start start 2024-06-02T23:46:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.347+0000 7f3adf7fe640 1 --2- 172.21.15.96:0/2307490631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b0f50 0x7f3ae009dde0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009e50 tx=0x7f3ad802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35ae890ad494f88b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.347+0000 7fba417fa640 1 -- 172.21.15.96:0/2948899728 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba340052d0 con 0x7fba440cb380 2024-06-02T23:46:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.347+0000 7fba417fa640 1 -- 172.21.15.96:0/2948899728 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba34005470 con 0x7fba440cb380 2024-06-02T23:46:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.347+0000 7f7d09134640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d040cf630 0x7f7d041e5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.347+0000 7f3addffb640 1 -- 172.21.15.96:0/2307490631 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8036070 con 0x7f3ae00b0f50 2024-06-02T23:46:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.347+0000 7f3addffb640 1 -- 172.21.15.96:0/2307490631 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad8031600 con 0x7f3ae00b0f50 2024-06-02T23:46:49.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.347+0000 7f3addffb640 1 -- 172.21.15.96:0/2307490631 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80319d0 con 0x7f3ae00b0f50 2024-06-02T23:46:49.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f7d09134640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d040cfc70 0x7f7d0406c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f7d09134640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0415c130 0x7f7d040d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7fba417fa640 1 -- 172.21.15.96:0/2948899728 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34012870 con 0x7fba440cb380 2024-06-02T23:46:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f7d09134640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0415c510 con 0x7f7d0415c130 2024-06-02T23:46:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f7d09134640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d040cebd0 con 0x7f7d040cfc70 2024-06-02T23:46:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f7d09134640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0415c690 con 0x7f7d040cf630 2024-06-02T23:46:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f7d0359e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0415c130 0x7f7d040d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f7d02d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d040cf630 0x7f7d041e5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f7d0359e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0415c130 0x7f7d040d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55028/0 (socket says 172.21.15.96:55028) 2024-06-02T23:46:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f7d0359e640 1 -- 172.21.15.96:0/3500341867 learned_addr learned my addr 172.21.15.96:0/3500341867 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f7d0259c640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d040cfc70 0x7f7d0406c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7fba4aabc640 1 -- 172.21.15.96:0/2948899728 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba44209e00 con 0x7fba440cb380 2024-06-02T23:46:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7fba4aabc640 1 -- 172.21.15.96:0/2948899728 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4420a3c0 con 0x7fba440cb380 2024-06-02T23:46:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1d00cf8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cfc06b3c0 0x7f1cfc0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1d00cf8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cfc15bd00 0x7f1cfc152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1d00cf8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15c0e0 0x7f1cfc152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1d00cf8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc160550 con 0x7f1cfc06b3c0 2024-06-02T23:46:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1d00cf8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc160270 con 0x7f1cfc15bd00 2024-06-02T23:46:49.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1d00cf8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1cfc072b00 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1cfbfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15c0e0 0x7f1cfc152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1cfbfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15c0e0 0x7f1cfc152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:38954/0 (socket says 172.21.15.96:38954) 2024-06-02T23:46:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1cfbfff640 1 -- 172.21.15.96:0/3781630344 learned_addr learned my addr 172.21.15.96:0/3781630344 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1cfb7fe640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cfc06b3c0 0x7f1cfc0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f1cfaffd640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cfc15bd00 0x7f1cfc152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f3adffff640 1 -- 172.21.15.96:0/2307490631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b0f50 msgr2=0x7f3ae009dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.348+0000 7f3adffff640 1 --2- 172.21.15.96:0/2307490631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b0f50 0x7f3ae009dde0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009e50 tx=0x7f3ad802a640 comp rx=0 tx=0).stop 2024-06-02T23:46:49.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f7d0259c640 1 -- 172.21.15.96:0/3500341867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d040cf630 msgr2=0x7f7d041e5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f7d0259c640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d040cf630 0x7f7d041e5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f7d0259c640 1 -- 172.21.15.96:0/3500341867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0415c130 msgr2=0x7f7d040d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f7d0259c640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0415c130 0x7f7d040d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f1cfbfff640 1 -- 172.21.15.96:0/3781630344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cfc15bd00 msgr2=0x7f1cfc152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f1cfbfff640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cfc15bd00 0x7f1cfc152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f1cfbfff640 1 -- 172.21.15.96:0/3781630344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cfc06b3c0 msgr2=0x7f1cfc0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f1cfbfff640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cfc06b3c0 0x7f1cfc0cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f1cfbfff640 1 -- 172.21.15.96:0/3781630344 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc155d30 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f7d0259c640 1 -- 172.21.15.96:0/3500341867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0406ca10 con 0x7f7d040cfc70 2024-06-02T23:46:49.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f1cfbfff640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15c0e0 0x7f1cfc152ff0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009fd0 tx=0x7f1cf000b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f7d0259c640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d040cfc70 0x7f7d0406c4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800b3e0 tx=0x7f7cf800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f3adffff640 1 -- 172.21.15.96:0/2307490631 shutdown_connections 2024-06-02T23:46:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f3adffff640 1 --2- 172.21.15.96:0/2307490631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b0f50 0x7f3ae009dde0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f3adffff640 1 --2- 172.21.15.96:0/2307490631 >> v2:172.21.15.96:3300/0 conn(0x7f3ae0160830 0x7f3ae0072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f3adffff640 1 -- 172.21.15.96:0/2307490631 >> 172.21.15.96:0/2307490631 conn(0x7f3ae00b3cd0 msgr2=0x7f3ae00728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f3adffff640 1 -- 172.21.15.96:0/2307490631 shutdown_connections 2024-06-02T23:46:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.349+0000 7f3adffff640 1 -- 172.21.15.96:0/2307490631 wait complete. 2024-06-02T23:46:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.350+0000 7f1ce3fff640 1 -- 172.21.15.96:0/3781630344 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0011830 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.350+0000 7f1d00cf8640 1 -- 172.21.15.96:0/3781630344 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cfc156010 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.350+0000 7f1d00cf8640 1 -- 172.21.15.96:0/3781630344 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cfc1565d0 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.350+0000 7f1ce3fff640 1 -- 172.21.15.96:0/3781630344 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf0016070 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.350+0000 7f1ce3fff640 1 -- 172.21.15.96:0/3781630344 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0011bd0 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.350+0000 7f2c7dffb640 1 -- 172.21.15.96:0/1908407188 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2c78059550 con 0x7f2c8815a0b0 2024-06-02T23:46:49.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.351+0000 7fba417fa640 1 -- 172.21.15.96:0/2948899728 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba34012a10 con 0x7fba440cb380 2024-06-02T23:46:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.351+0000 7f3adffff640 1 Processor -- start 2024-06-02T23:46:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.352+0000 7f3adffff640 1 -- start start 2024-06-02T23:46:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.351+0000 7fba417fa640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fba3006be30 0x7fba3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.352+0000 7fba48858640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fba3006be30 0x7fba3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.350+0000 7fba4aabc640 1 -- 172.21.15.96:0/2948899728 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba440b5750 con 0x7fba440cb380 2024-06-02T23:46:49.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.352+0000 7fba417fa640 1 -- 172.21.15.96:0/2948899728 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fba34056c50 con 0x7fba440cb380 2024-06-02T23:46:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.350+0000 7f7ceb7fe640 1 -- 172.21.15.96:0/3500341867 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8015020 con 0x7f7d040cfc70 2024-06-02T23:46:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.350+0000 7f7ceb7fe640 1 -- 172.21.15.96:0/3500341867 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf8011830 con 0x7f7d040cfc70 2024-06-02T23:46:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.351+0000 7f7ceb7fe640 1 -- 172.21.15.96:0/3500341867 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8015020 con 0x7f7d040cfc70 2024-06-02T23:46:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7fba48858640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fba3006be30 0x7fba3006e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba380011e0 tx=0x7fba38007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f1d00cf8640 1 -- 172.21.15.96:0/3781630344 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cdc005290 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f1ce3fff640 1 -- 172.21.15.96:0/3781630344 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1cf001b460 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f7d09134640 1 -- 172.21.15.96:0/3500341867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0406cce0 con 0x7f7d040cfc70 2024-06-02T23:46:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f7d09134640 1 -- 172.21.15.96:0/3500341867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d0406d580 con 0x7f7d040cfc70 2024-06-02T23:46:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae00b0f50 0x7f3ae01f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b4fb0 0x7f3ae009d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae0160830 0x7f3ae00c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adffff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0160d90 con 0x7f3ae0160830 2024-06-02T23:46:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adffff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0160c10 con 0x7f3ae00b0f50 2024-06-02T23:46:49.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adffff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae00cccf0 con 0x7f3ae00b4fb0 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adf7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae0160830 0x7f3ae00c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adf7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae0160830 0x7f3ae00c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55056/0 (socket says 172.21.15.96:55056) 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adf7fe640 1 -- 172.21.15.96:0/3075109741 learned_addr learned my addr 172.21.15.96:0/3075109741 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adeffd640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae00b0f50 0x7f3ae01f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3ade7fc640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b4fb0 0x7f3ae009d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adf7fe640 1 -- 172.21.15.96:0/3075109741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b4fb0 msgr2=0x7f3ae009d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adf7fe640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b4fb0 0x7f3ae009d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adf7fe640 1 -- 172.21.15.96:0/3075109741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae00b0f50 msgr2=0x7f3ae01f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adf7fe640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae00b0f50 0x7f3ae01f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.353+0000 7f3adf7fe640 1 -- 172.21.15.96:0/3075109741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae009ab90 con 0x7f3ae0160830 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.354+0000 7f3adeffd640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae00b0f50 0x7f3ae01f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:49.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.354+0000 7f3adf7fe640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae0160830 0x7f3ae00c5a90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80093e0 tx=0x7f3ad8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.354+0000 7f1ce3fff640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1ce806be60 0x7f1ce806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.354+0000 7f1ce3fff640 1 -- 172.21.15.96:0/3781630344 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1cf008ae60 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.354+0000 7f1cfb7fe640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1ce806be60 0x7f1ce806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.355+0000 7f1cfb7fe640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1ce806be60 0x7f1ce806e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1cec006fd0 tx=0x7f1cec0090e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.354+0000 7f3ac77fe640 1 -- 172.21.15.96:0/3075109741 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8041020 con 0x7f3ae0160830 2024-06-02T23:46:49.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.354+0000 7f3ac77fe640 1 -- 172.21.15.96:0/3075109741 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad8037040 con 0x7f3ae0160830 2024-06-02T23:46:49.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.354+0000 7f3ac77fe640 1 -- 172.21.15.96:0/3075109741 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8036070 con 0x7f3ae0160830 2024-06-02T23:46:49.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.355+0000 7f3adffff640 1 -- 172.21.15.96:0/3075109741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae009ae70 con 0x7f3ae0160830 2024-06-02T23:46:49.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.355+0000 7f3adffff640 1 -- 172.21.15.96:0/3075109741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae009b710 con 0x7f3ae0160830 2024-06-02T23:46:49.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.355+0000 7f7ceb7fe640 1 -- 172.21.15.96:0/3500341867 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cf8018020 con 0x7f7d040cfc70 2024-06-02T23:46:49.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.356+0000 7f7ceb7fe640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7cf006c230 0x7f7cf006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.356+0000 7f7ceb7fe640 1 -- 172.21.15.96:0/3500341867 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7cf8011630 con 0x7f7d040cfc70 2024-06-02T23:46:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.356+0000 7f7d02d9d640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7cf006c230 0x7f7cf006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.356+0000 7f7d02d9d640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7cf006c230 0x7f7cf006e6f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4034000 tx=0x7f7cf402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.357+0000 7f3adffff640 1 -- 172.21.15.96:0/3075109741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae009b910 con 0x7f3ae0160830 2024-06-02T23:46:49.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.357+0000 7f7d09134640 1 -- 172.21.15.96:0/3500341867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d04068af0 con 0x7f7d040cfc70 2024-06-02T23:46:49.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.357+0000 7f3ac77fe640 1 -- 172.21.15.96:0/3075109741 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ad8044020 con 0x7f3ae0160830 2024-06-02T23:46:49.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.358+0000 7f3ac77fe640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3acc06be80 0x7f3acc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.358+0000 7f3ac77fe640 1 -- 172.21.15.96:0/3075109741 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3ad80abb30 con 0x7f3ae0160830 2024-06-02T23:46:49.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.358+0000 7f3adeffd640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3acc06be80 0x7f3acc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.358+0000 7fba417fa640 1 -- 172.21.15.96:0/2948899728 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fba44209b80 con 0x7fba440cb380 2024-06-02T23:46:49.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.359+0000 7f3adeffd640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3acc06be80 0x7f3acc06e340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009880 tx=0x7f3ad0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.367+0000 7f3ac77fe640 1 -- 172.21.15.96:0/3075109741 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3ad804b030 con 0x7f3ae0160830 2024-06-02T23:46:49.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.368+0000 7f1ce3fff640 1 -- 172.21.15.96:0/3781630344 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1cf0059430 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.368+0000 7f7ceb7fe640 1 -- 172.21.15.96:0/3500341867 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7cf801f020 con 0x7f7d040cfc70 2024-06-02T23:46:49.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.703+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff39c005580 con 0x7ff3bc070ef0 2024-06-02T23:46:49.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.704+0000 7ff3a37fe640 1 -- 172.21.15.96:0/2116002029 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff3bc0b4070 con 0x7ff3bc070ef0 2024-06-02T23:46:49.707 INFO:teuthology.orchestra.run.smithi096.stdout:55834574858 2024-06-02T23:46:49.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.707+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3a806be30 msgr2=0x7ff3a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.707+0000 7ff3c1348640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3a806be30 0x7ff3a806e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc0b4d20 tx=0x7ff3ac009040 comp rx=0 tx=0).stop 2024-06-02T23:46:49.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.707+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc070ef0 msgr2=0x7ff3bc0c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.707+0000 7ff3c1348640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc070ef0 0x7ff3bc0c8700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40093e0 tx=0x7ff3b4004a40 comp rx=0 tx=0).stop 2024-06-02T23:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.711+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 shutdown_connections 2024-06-02T23:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.711+0000 7ff3c1348640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff3bc15a270 0x7ff3bc157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.711+0000 7ff3c1348640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3bc0cd900 0x7ff3bc0b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.711+0000 7ff3c1348640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff3a806be30 0x7ff3a806e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.711+0000 7ff3c1348640 1 --2- 172.21.15.96:0/2116002029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3bc070ef0 0x7ff3bc0c8700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.711+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 >> 172.21.15.96:0/2116002029 conn(0x7ff3bc0cfc30 msgr2=0x7ff3bc0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.711+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 shutdown_connections 2024-06-02T23:46:49.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.711+0000 7ff3c1348640 1 -- 172.21.15.96:0/2116002029 wait complete. 2024-06-02T23:46:49.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.712+0000 7f0d0bfff640 1 -- 172.21.15.96:0/3728871500 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0d0c068cb0 con 0x7f0d0c162ab0 2024-06-02T23:46:49.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.713+0000 7f0d037fe640 1 -- 172.21.15.96:0/3728871500 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0cfc05ce40 con 0x7f0d0c162ab0 2024-06-02T23:46:49.718 INFO:teuthology.orchestra.run.smithi096.stdout:55834574858 2024-06-02T23:46:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.719+0000 7f0d0bfff640 1 -- 172.21.15.96:0/3728871500 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0cec06c260 msgr2=0x7f0cec06e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.719+0000 7f0d0bfff640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0cec06c260 0x7f0cec06e720 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4000c00 tx=0x7f0cf402e000 comp rx=0 tx=0).stop 2024-06-02T23:46:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.719+0000 7f0d0bfff640 1 -- 172.21.15.96:0/3728871500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d0c162ab0 msgr2=0x7f0d0c162f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.719+0000 7f0d0bfff640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d0c162ab0 0x7f0d0c162f10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00e840 tx=0x7f0cfc00ed00 comp rx=0 tx=0).stop 2024-06-02T23:46:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.719+0000 7f0d0bfff640 1 -- 172.21.15.96:0/3728871500 shutdown_connections 2024-06-02T23:46:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.719+0000 7f0d0bfff640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d0c166740 0x7f0d0c070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.719+0000 7f0d0bfff640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d0c162ab0 0x7f0d0c162f10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.719+0000 7f0d0bfff640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0cec06c260 0x7f0cec06e720 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.719+0000 7f0d0bfff640 1 --2- 172.21.15.96:0/3728871500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d0c06d660 0x7f0d0c1620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.719+0000 7f0d0bfff640 1 -- 172.21.15.96:0/3728871500 >> 172.21.15.96:0/3728871500 conn(0x7f0d0c0b16c0 msgr2=0x7f0d0c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.720+0000 7f0d0bfff640 1 -- 172.21.15.96:0/3728871500 shutdown_connections 2024-06-02T23:46:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.720+0000 7f0d0bfff640 1 -- 172.21.15.96:0/3728871500 wait complete. 2024-06-02T23:46:49.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.724+0000 7f8b957fb640 1 -- 172.21.15.96:0/3603750127 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8b74005580 con 0x7f8b90162a20 2024-06-02T23:46:49.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.724+0000 7f8b877fe640 1 -- 172.21.15.96:0/3603750127 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b90161e60 con 0x7f8b90162a20 2024-06-02T23:46:49.725 INFO:teuthology.orchestra.run.smithi096.stdout:55834574858 2024-06-02T23:46:49.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-06-02T23:46:49.730 DEBUG:teuthology.parallel:result is None 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 -- 172.21.15.96:0/3603750127 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8b7006bf00 msgr2=0x7f8b7006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8b7006bf00 0x7f8b7006e3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8b80034000 tx=0x7f8b8002e000 comp rx=0 tx=0).stop 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 -- 172.21.15.96:0/3603750127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b90162a20 msgr2=0x7f8b90164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b90162a20 0x7f8b90164490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009dd0 tx=0x7f8b8800c490 comp rx=0 tx=0).stop 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 -- 172.21.15.96:0/3603750127 shutdown_connections 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8b7006bf00 0x7f8b7006e3c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b90162a20 0x7f8b90164490 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b90162640 0x7f8b90161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 --2- 172.21.15.96:0/3603750127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b900ccaf0 0x7f8b900c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 -- 172.21.15.96:0/3603750127 >> 172.21.15.96:0/3603750127 conn(0x7f8b900d1d90 msgr2=0x7f8b900709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 -- 172.21.15.96:0/3603750127 shutdown_connections 2024-06-02T23:46:49.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.730+0000 7f8b957fb640 1 -- 172.21.15.96:0/3603750127 wait complete. 2024-06-02T23:46:49.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-06-02T23:46:49.741 DEBUG:teuthology.parallel:result is None 2024-06-02T23:46:49.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-06-02T23:46:49.745 DEBUG:teuthology.parallel:result is None 2024-06-02T23:46:49.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.750+0000 7fba4aabc640 1 -- 172.21.15.96:0/2948899728 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fba440683e0 con 0x7fba440cb380 2024-06-02T23:46:49.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.750+0000 7fba417fa640 1 -- 172.21.15.96:0/2948899728 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba340592b0 con 0x7fba440cb380 2024-06-02T23:46:49.750 INFO:teuthology.orchestra.run.smithi096.stdout:55834574857 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.752+0000 7fba4aabc640 1 -- 172.21.15.96:0/2948899728 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fba3006be30 msgr2=0x7fba3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.752+0000 7fba4aabc640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fba3006be30 0x7fba3006e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba380011e0 tx=0x7fba38007d30 comp rx=0 tx=0).stop 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.752+0000 7fba4aabc640 1 -- 172.21.15.96:0/2948899728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba440cb380 msgr2=0x7fba44209640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.752+0000 7fba4aabc640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba440cb380 0x7fba44209640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba3400c450 tx=0x7fba3400c910 comp rx=0 tx=0).stop 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.753+0000 7fba4aabc640 1 -- 172.21.15.96:0/2948899728 shutdown_connections 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.753+0000 7fba4aabc640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fba3006be30 0x7fba3006e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.753+0000 7fba4aabc640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba440ce0c0 0x7fba44159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.753+0000 7fba4aabc640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba440cb380 0x7fba44209640 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.753+0000 7fba4aabc640 1 --2- 172.21.15.96:0/2948899728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba4406d490 0x7fba440b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.753+0000 7fba4aabc640 1 -- 172.21.15.96:0/2948899728 >> 172.21.15.96:0/2948899728 conn(0x7fba440cfc30 msgr2=0x7fba4406f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.753+0000 7fba4aabc640 1 -- 172.21.15.96:0/2948899728 shutdown_connections 2024-06-02T23:46:49.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.753+0000 7fba4aabc640 1 -- 172.21.15.96:0/2948899728 wait complete. 2024-06-02T23:46:49.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-06-02T23:46:49.764 DEBUG:teuthology.parallel:result is None 2024-06-02T23:46:49.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.770+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2c68005580 con 0x7f2c8815a0b0 2024-06-02T23:46:49.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.771+0000 7f2c7dffb640 1 -- 172.21.15.96:0/1908407188 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c78058e50 con 0x7f2c8815a0b0 2024-06-02T23:46:49.771 INFO:teuthology.orchestra.run.smithi096.stdout:55834574858 2024-06-02T23:46:49.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c6c06bf00 msgr2=0x7f2c6c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c6c06bf00 0x7f2c6c06e3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2c88155110 tx=0x7f2c84006bf0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c8815a0b0 msgr2=0x7f2c880c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c8815a0b0 0x7f2c880c8c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800c440 tx=0x7f2c7800c900 comp rx=0 tx=0).stop 2024-06-02T23:46:49.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 shutdown_connections 2024-06-02T23:46:49.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c8815a0b0 0x7f2c880c8c70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2c6c06bf00 0x7f2c6c06e3c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c880cef00 0x7f2c88152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 --2- 172.21.15.96:0/1908407188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c88071880 0x7f2c88151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 >> 172.21.15.96:0/1908407188 conn(0x7f2c880cfb90 msgr2=0x7f2c88158670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 shutdown_connections 2024-06-02T23:46:49.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.773+0000 7f2c8f510640 1 -- 172.21.15.96:0/1908407188 wait complete. 2024-06-02T23:46:49.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.780+0000 7f1d00cf8640 1 -- 172.21.15.96:0/3781630344 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1cdc005580 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.781+0000 7f1ce3fff640 1 -- 172.21.15.96:0/3781630344 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1cf0058d30 con 0x7f1cfc15c0e0 2024-06-02T23:46:49.781 INFO:teuthology.orchestra.run.smithi096.stdout:55834574856 2024-06-02T23:46:49.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 -- 172.21.15.96:0/3781630344 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1ce806be60 msgr2=0x7f1ce806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1ce806be60 0x7f1ce806e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1cec006fd0 tx=0x7f1cec0090e0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 -- 172.21.15.96:0/3781630344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15c0e0 msgr2=0x7f1cfc152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15c0e0 0x7f1cfc152ff0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009fd0 tx=0x7f1cf000b8e0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 -- 172.21.15.96:0/3781630344 shutdown_connections 2024-06-02T23:46:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cfc15c0e0 0x7f1cfc152ff0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cfc15bd00 0x7f1cfc152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1ce806be60 0x7f1ce806e320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 --2- 172.21.15.96:0/3781630344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cfc06b3c0 0x7f1cfc0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 -- 172.21.15.96:0/3781630344 >> 172.21.15.96:0/3781630344 conn(0x7f1cfc071c50 msgr2=0x7f1cfc0b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 -- 172.21.15.96:0/3781630344 shutdown_connections 2024-06-02T23:46:49.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.783+0000 7f1d00cf8640 1 -- 172.21.15.96:0/3781630344 wait complete. 2024-06-02T23:46:49.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-06-02T23:46:49.789 DEBUG:teuthology.parallel:result is None 2024-06-02T23:46:49.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-06-02T23:46:49.794 DEBUG:teuthology.parallel:result is None 2024-06-02T23:46:49.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.795+0000 7f3adffff640 1 -- 172.21.15.96:0/3075109741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3ae004f7d0 con 0x7f3ae0160830 2024-06-02T23:46:49.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.795+0000 7f7d09134640 1 -- 172.21.15.96:0/3500341867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7d04068440 con 0x7f7d040cfc70 2024-06-02T23:46:49.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.795+0000 7f3ac77fe640 1 -- 172.21.15.96:0/3075109741 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ad802ae20 con 0x7f3ae0160830 2024-06-02T23:46:49.795 INFO:teuthology.orchestra.run.smithi096.stdout:55834574858 2024-06-02T23:46:49.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.795+0000 7f7ceb7fe640 1 -- 172.21.15.96:0/3500341867 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7cf801f020 con 0x7f7d040cfc70 2024-06-02T23:46:49.796 INFO:teuthology.orchestra.run.smithi096.stdout:55834574856 2024-06-02T23:46:49.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 -- 172.21.15.96:0/3075109741 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3acc06be80 msgr2=0x7f3acc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3acc06be80 0x7f3acc06e340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009880 tx=0x7f3ad0008040 comp rx=0 tx=0).stop 2024-06-02T23:46:49.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 -- 172.21.15.96:0/3075109741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae0160830 msgr2=0x7f3ae00c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae0160830 0x7f3ae00c5a90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80093e0 tx=0x7f3ad8004a40 comp rx=0 tx=0).stop 2024-06-02T23:46:49.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 -- 172.21.15.96:0/3500341867 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7cf006c230 msgr2=0x7f7cf006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7cf006c230 0x7f7cf006e6f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4034000 tx=0x7f7cf402e000 comp rx=0 tx=0).stop 2024-06-02T23:46:49.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 -- 172.21.15.96:0/3500341867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d040cfc70 msgr2=0x7f7d0406c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d040cfc70 0x7f7d0406c4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800b3e0 tx=0x7f7cf800b8a0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 -- 172.21.15.96:0/3075109741 shutdown_connections 2024-06-02T23:46:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 -- 172.21.15.96:0/3500341867 shutdown_connections 2024-06-02T23:46:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7cf006c230 0x7f7cf006e6f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0415c130 0x7f7d040d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d040cfc70 0x7f7d0406c4d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 --2- 172.21.15.96:0/3500341867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d040cf630 0x7f7d041e5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3acc06be80 0x7f3acc06e340 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ae0160830 0x7f3ae00c5a90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ae00b4fb0 0x7f3ae009d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 --2- 172.21.15.96:0/3075109741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ae00b0f50 0x7f3ae01f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 -- 172.21.15.96:0/3500341867 >> 172.21.15.96:0/3500341867 conn(0x7f7d040b39c0 msgr2=0x7f7d040b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 -- 172.21.15.96:0/3075109741 >> 172.21.15.96:0/3075109741 conn(0x7f3ae00b3cd0 msgr2=0x7f3ae00ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 -- 172.21.15.96:0/3500341867 shutdown_connections 2024-06-02T23:46:49.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 -- 172.21.15.96:0/3075109741 shutdown_connections 2024-06-02T23:46:49.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f7d09134640 1 -- 172.21.15.96:0/3500341867 wait complete. 2024-06-02T23:46:49.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.798+0000 7f3adffff640 1 -- 172.21.15.96:0/3075109741 wait complete. 2024-06-02T23:46:49.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-06-02T23:46:49.811 DEBUG:teuthology.parallel:result is None 2024-06-02T23:46:49.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-06-02T23:46:49.812 DEBUG:teuthology.parallel:result is None 2024-06-02T23:46:49.812 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T23:46:49.812 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:46:49.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.948+0000 7f1fe368c640 1 Processor -- start 2024-06-02T23:46:49.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.949+0000 7f1fe368c640 1 -- start start 2024-06-02T23:46:49.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.949+0000 7f1fe368c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1fdc15a850 0x7f1fdc0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.949+0000 7f1fe368c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc0ca9d0 0x7f1fdc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.949+0000 7f1fe368c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fdc06ee70 con 0x7f1fdc06e650 2024-06-02T23:46:49.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe368c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1fdc0cae30 con 0x7f1fdc15a850 2024-06-02T23:46:49.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe368c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1fdc0711b0 con 0x7f1fdc0ca9d0 2024-06-02T23:46:49.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe1428640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1fdc15a850 0x7f1fdc0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe0c27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc0ca9d0 0x7f1fdc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe1c29640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1fdc06e650 0x7f1fdc0cdbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:42296/0 (socket says 172.21.15.96:42296) 2024-06-02T23:46:49.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe1428640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1fdc15a850 0x7f1fdc0ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:56006/0 (socket says 172.21.15.96:56006) 2024-06-02T23:46:49.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe1c29640 1 -- 172.21.15.96:0/1050081009 learned_addr learned my addr 172.21.15.96:0/1050081009 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:49.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe0c27640 1 -- 172.21.15.96:0/1050081009 >> v2:172.21.15.162:3300/0 conn(0x7f1fdc15a850 msgr2=0x7f1fdc0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:49.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe0c27640 1 --2- 172.21.15.96:0/1050081009 >> v2:172.21.15.162:3300/0 conn(0x7f1fdc15a850 0x7f1fdc0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe0c27640 1 -- 172.21.15.96:0/1050081009 >> v1:172.21.15.162:6789/0 conn(0x7f1fdc06e650 legacy=0x7f1fdc0cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe0c27640 1 -- 172.21.15.96:0/1050081009 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc071490 con 0x7f1fdc0ca9d0 2024-06-02T23:46:49.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.950+0000 7f1fe1428640 1 --2- 172.21.15.96:0/1050081009 >> v2:172.21.15.162:3300/0 conn(0x7f1fdc15a850 0x7f1fdc0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.951+0000 7f1fe0c27640 1 --2- 172.21.15.96:0/1050081009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc0ca9d0 0x7f1fdc06e110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0097a0 tx=0x7f1fcc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1d0cbeefeb9a7cb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.951+0000 7f1fd3fff640 1 -- 172.21.15.96:0/1050081009 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc037070 con 0x7f1fdc0ca9d0 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.951+0000 7f1fd3fff640 1 -- 172.21.15.96:0/1050081009 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc032440 con 0x7f1fdc0ca9d0 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.951+0000 7f1fd3fff640 1 -- 172.21.15.96:0/1050081009 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc032810 con 0x7f1fdc0ca9d0 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.952+0000 7f1fe368c640 1 -- 172.21.15.96:0/1050081009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc0ca9d0 msgr2=0x7f1fdc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.952+0000 7f1fe368c640 1 --2- 172.21.15.96:0/1050081009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc0ca9d0 0x7f1fdc06e110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0097a0 tx=0x7f1fcc02a210 comp rx=0 tx=0).stop 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.952+0000 7f1fe368c640 1 -- 172.21.15.96:0/1050081009 shutdown_connections 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.952+0000 7f1fe368c640 1 --2- 172.21.15.96:0/1050081009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc0ca9d0 0x7f1fdc06e110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.952+0000 7f1fe368c640 1 --2- 172.21.15.96:0/1050081009 >> v2:172.21.15.162:3300/0 conn(0x7f1fdc15a850 0x7f1fdc0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.952+0000 7f1fe368c640 1 -- 172.21.15.96:0/1050081009 >> 172.21.15.96:0/1050081009 conn(0x7f1fdc0cfc30 msgr2=0x7f1fdc0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.952+0000 7f1fe368c640 1 -- 172.21.15.96:0/1050081009 shutdown_connections 2024-06-02T23:46:49.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.952+0000 7f1fe368c640 1 -- 172.21.15.96:0/1050081009 wait complete. 2024-06-02T23:46:49.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.953+0000 7f1fe368c640 1 Processor -- start 2024-06-02T23:46:49.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.953+0000 7f1fe368c640 1 -- start start 2024-06-02T23:46:49.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.953+0000 7f1fe368c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc06e650 0x7f1fdc145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.953+0000 7f1fe368c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc0ca9d0 0x7f1fdc15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.953+0000 7f1fe368c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc15a850 0x7f1fdc06cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.953+0000 7f1fe368c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc06eae0 con 0x7f1fdc06e650 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.953+0000 7f1fe368c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1fdc071a50 con 0x7f1fdc0ca9d0 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe368c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1fdc072f80 con 0x7f1fdc15a850 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe1428640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc06e650 0x7f1fdc145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe1428640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc06e650 0x7f1fdc145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55068/0 (socket says 172.21.15.96:55068) 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe1428640 1 -- 172.21.15.96:0/3966602726 learned_addr learned my addr 172.21.15.96:0/3966602726 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe1c29640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc15a850 0x7f1fdc06cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe0c27640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc0ca9d0 0x7f1fdc15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe1428640 1 -- 172.21.15.96:0/3966602726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc15a850 msgr2=0x7f1fdc06cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe1428640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc15a850 0x7f1fdc06cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe1428640 1 -- 172.21.15.96:0/3966602726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc0ca9d0 msgr2=0x7f1fdc15bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe1428640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc0ca9d0 0x7f1fdc15bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe1428640 1 -- 172.21.15.96:0/3966602726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc146400 con 0x7f1fdc06e650 2024-06-02T23:46:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe1428640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc06e650 0x7f1fdc145d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800e960 tx=0x7f1fd800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fd1ffb640 1 -- 172.21.15.96:0/3966602726 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8017070 con 0x7f1fdc06e650 2024-06-02T23:46:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fd1ffb640 1 -- 172.21.15.96:0/3966602726 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd800ca00 con 0x7f1fdc06e650 2024-06-02T23:46:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fe368c640 1 -- 172.21.15.96:0/3966602726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fdc1466e0 con 0x7f1fdc06e650 2024-06-02T23:46:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.954+0000 7f1fd1ffb640 1 -- 172.21.15.96:0/3966602726 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800cdd0 con 0x7f1fdc06e650 2024-06-02T23:46:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.955+0000 7f1fe368c640 1 -- 172.21.15.96:0/3966602726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fdc146ca0 con 0x7f1fdc06e650 2024-06-02T23:46:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.955+0000 7f1fe368c640 1 -- 172.21.15.96:0/3966602726 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fdc0c3520 con 0x7f1fdc06e650 2024-06-02T23:46:49.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.956+0000 7f1fd1ffb640 1 -- 172.21.15.96:0/3966602726 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fd801a070 con 0x7f1fdc06e650 2024-06-02T23:46:49.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.956+0000 7f1fd1ffb640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1fc006be30 0x7f1fc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:49.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.956+0000 7f1fd1ffb640 1 -- 172.21.15.96:0/3966602726 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1fd808b370 con 0x7f1fdc06e650 2024-06-02T23:46:49.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.956+0000 7f1fe0c27640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1fc006be30 0x7f1fc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:49.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.957+0000 7f1fe0c27640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1fc006be30 0x7f1fc006e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc034000 tx=0x7f1fcc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:49.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:49.961+0000 7f1fd1ffb640 1 -- 172.21.15.96:0/3966602726 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1fdc0c3520 con 0x7f1fdc06e650 2024-06-02T23:46:50.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.131+0000 7f1fe368c640 1 -- 172.21.15.96:0/3966602726 --> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fdc0683e0 con 0x7f1fc006be30 2024-06-02T23:46:50.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.139+0000 7f1fd1ffb640 1 -- 172.21.15.96:0/3966602726 <== mgr.4113 v2:172.21.15.96:6832/1776728888 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f1fdc0683e0 con 0x7f1fc006be30 2024-06-02T23:46:50.142 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:50.144 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:46:50.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 -- 172.21.15.96:0/3966602726 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1fc006be30 msgr2=0x7f1fc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1fc006be30 0x7f1fc006e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc034000 tx=0x7f1fcc02e000 comp rx=0 tx=0).stop 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 -- 172.21.15.96:0/3966602726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc06e650 msgr2=0x7f1fdc145d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc06e650 0x7f1fdc145d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800e960 tx=0x7f1fd800ee20 comp rx=0 tx=0).stop 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 -- 172.21.15.96:0/3966602726 shutdown_connections 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fdc15a850 0x7f1fdc06cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc0ca9d0 0x7f1fdc15bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f1fc006be30 0x7f1fc006e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 --2- 172.21.15.96:0/3966602726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1fdc06e650 0x7f1fdc145d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 -- 172.21.15.96:0/3966602726 >> 172.21.15.96:0/3966602726 conn(0x7f1fdc0cfc30 msgr2=0x7f1fdc0b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 -- 172.21.15.96:0/3966602726 shutdown_connections 2024-06-02T23:46:50.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.142+0000 7f1fe368c640 1 -- 172.21.15.96:0/3966602726 wait complete. 2024-06-02T23:46:50.153 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-06-02T23:46:49.999299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002692"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519975+0000","last_change":"2024-06-02T23:46:24.723386+0000","last_active":"2024-06-02T23:46:32.519975+0000","last_peered":"2024-06-02T23:46:32.519975+0000","last_clean":"2024-06-02T23:46:32.519975+0000","last_became_active":"2024-06-02T23:46:24.723072+0000","last_became_peered":"2024-06-02T23:46:24.723072+0000","last_unstale":"2024-06-02T23:46:32.519975+0000","last_undegraded":"2024-06-02T23:46:32.519975+0000","last_fullsized":"2024-06-02T23:46:32.519975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:58.156345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519324+0000","last_change":"2024-06-02T23:46:25.728192+0000","last_active":"2024-06-02T23:46:32.519324+0000","last_peered":"2024-06-02T23:46:32.519324+0000","last_clean":"2024-06-02T23:46:32.519324+0000","last_became_active":"2024-06-02T23:46:25.727880+0000","last_became_peered":"2024-06-02T23:46:25.727880+0000","last_unstale":"2024-06-02T23:46:32.519324+0000","last_undegraded":"2024-06-02T23:46:32.519324+0000","last_fullsized":"2024-06-02T23:46:32.519324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519956+0000","last_change":"2024-06-02T23:46:30.061087+0000","last_active":"2024-06-02T23:46:32.519956+0000","last_peered":"2024-06-02T23:46:32.519956+0000","last_clean":"2024-06-02T23:46:32.519956+0000","last_became_active":"2024-06-02T23:46:30.060610+0000","last_became_peered":"2024-06-02T23:46:30.060610+0000","last_unstale":"2024-06-02T23:46:32.519956+0000","last_undegraded":"2024-06-02T23:46:32.519956+0000","last_fullsized":"2024-06-02T23:46:32.519956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:12:13.834338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519480+0000","last_change":"2024-06-02T23:46:24.719079+0000","last_active":"2024-06-02T23:46:32.519480+0000","last_peered":"2024-06-02T23:46:32.519480+0000","last_clean":"2024-06-02T23:46:32.519480+0000","last_became_active":"2024-06-02T23:46:24.718645+0000","last_became_peered":"2024-06-02T23:46:24.718645+0000","last_unstale":"2024-06-02T23:46:32.519480+0000","last_undegraded":"2024-06-02T23:46:32.519480+0000","last_fullsized":"2024-06-02T23:46:32.519480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:58.156345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519654+0000","last_change":"2024-06-02T23:46:25.726015+0000","last_active":"2024-06-02T23:46:32.519654+0000","last_peered":"2024-06-02T23:46:32.519654+0000","last_clean":"2024-06-02T23:46:32.519654+0000","last_became_active":"2024-06-02T23:46:25.725730+0000","last_became_peered":"2024-06-02T23:46:25.725730+0000","last_unstale":"2024-06-02T23:46:32.519654+0000","last_undegraded":"2024-06-02T23:46:32.519654+0000","last_fullsized":"2024-06-02T23:46:32.519654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:10.751775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761052+0000","last_change":"2024-06-02T23:46:29.747259+0000","last_active":"2024-06-02T23:46:30.761052+0000","last_peered":"2024-06-02T23:46:30.761052+0000","last_clean":"2024-06-02T23:46:30.761052+0000","last_became_active":"2024-06-02T23:46:29.746814+0000","last_became_peered":"2024-06-02T23:46:29.746814+0000","last_unstale":"2024-06-02T23:46:30.761052+0000","last_undegraded":"2024-06-02T23:46:30.761052+0000","last_fullsized":"2024-06-02T23:46:30.761052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:16.913415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520719+0000","last_change":"2024-06-02T23:46:24.728181+0000","last_active":"2024-06-02T23:46:32.520719+0000","last_peered":"2024-06-02T23:46:32.520719+0000","last_clean":"2024-06-02T23:46:32.520719+0000","last_became_active":"2024-06-02T23:46:24.727842+0000","last_became_peered":"2024-06-02T23:46:24.727842+0000","last_unstale":"2024-06-02T23:46:32.520719+0000","last_undegraded":"2024-06-02T23:46:32.520719+0000","last_fullsized":"2024-06-02T23:46:32.520719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020341+0000","last_change":"2024-06-02T23:46:25.725271+0000","last_active":"2024-06-02T23:46:32.020341+0000","last_peered":"2024-06-02T23:46:32.020341+0000","last_clean":"2024-06-02T23:46:32.020341+0000","last_became_active":"2024-06-02T23:46:25.725021+0000","last_became_peered":"2024-06-02T23:46:25.725021+0000","last_unstale":"2024-06-02T23:46:32.020341+0000","last_undegraded":"2024-06-02T23:46:32.020341+0000","last_fullsized":"2024-06-02T23:46:32.020341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:06.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760977+0000","last_change":"2024-06-02T23:46:29.747360+0000","last_active":"2024-06-02T23:46:30.760977+0000","last_peered":"2024-06-02T23:46:30.760977+0000","last_clean":"2024-06-02T23:46:30.760977+0000","last_became_active":"2024-06-02T23:46:29.746711+0000","last_became_peered":"2024-06-02T23:46:29.746711+0000","last_unstale":"2024-06-02T23:46:30.760977+0000","last_undegraded":"2024-06-02T23:46:30.760977+0000","last_fullsized":"2024-06-02T23:46:30.760977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:13.880688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519706+0000","last_change":"2024-06-02T23:46:24.728315+0000","last_active":"2024-06-02T23:46:32.519706+0000","last_peered":"2024-06-02T23:46:32.519706+0000","last_clean":"2024-06-02T23:46:32.519706+0000","last_became_active":"2024-06-02T23:46:24.728035+0000","last_became_peered":"2024-06-02T23:46:24.728035+0000","last_unstale":"2024-06-02T23:46:32.519706+0000","last_undegraded":"2024-06-02T23:46:32.519706+0000","last_fullsized":"2024-06-02T23:46:32.519706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020395+0000","last_change":"2024-06-02T23:46:25.725814+0000","last_active":"2024-06-02T23:46:32.020395+0000","last_peered":"2024-06-02T23:46:32.020395+0000","last_clean":"2024-06-02T23:46:32.020395+0000","last_became_active":"2024-06-02T23:46:25.725542+0000","last_became_peered":"2024-06-02T23:46:25.725542+0000","last_unstale":"2024-06-02T23:46:32.020395+0000","last_undegraded":"2024-06-02T23:46:32.020395+0000","last_fullsized":"2024-06-02T23:46:32.020395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:37.017923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760812+0000","last_change":"2024-06-02T23:46:29.748045+0000","last_active":"2024-06-02T23:46:30.760812+0000","last_peered":"2024-06-02T23:46:30.760812+0000","last_clean":"2024-06-02T23:46:30.760812+0000","last_became_active":"2024-06-02T23:46:29.747638+0000","last_became_peered":"2024-06-02T23:46:29.747638+0000","last_unstale":"2024-06-02T23:46:30.760812+0000","last_undegraded":"2024-06-02T23:46:30.760812+0000","last_fullsized":"2024-06-02T23:46:30.760812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:47.634910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520308+0000","last_change":"2024-06-02T23:46:25.724610+0000","last_active":"2024-06-02T23:46:32.520308+0000","last_peered":"2024-06-02T23:46:32.520308+0000","last_clean":"2024-06-02T23:46:32.520308+0000","last_became_active":"2024-06-02T23:46:25.724361+0000","last_became_peered":"2024-06-02T23:46:25.724361+0000","last_unstale":"2024-06-02T23:46:32.520308+0000","last_undegraded":"2024-06-02T23:46:32.520308+0000","last_fullsized":"2024-06-02T23:46:32.520308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520766+0000","last_change":"2024-06-02T23:46:24.725027+0000","last_active":"2024-06-02T23:46:32.520766+0000","last_peered":"2024-06-02T23:46:32.520766+0000","last_clean":"2024-06-02T23:46:32.520766+0000","last_became_active":"2024-06-02T23:46:24.724691+0000","last_became_peered":"2024-06-02T23:46:24.724691+0000","last_unstale":"2024-06-02T23:46:32.520766+0000","last_undegraded":"2024-06-02T23:46:32.520766+0000","last_fullsized":"2024-06-02T23:46:32.520766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:07.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761401+0000","last_change":"2024-06-02T23:46:29.750805+0000","last_active":"2024-06-02T23:46:30.761401+0000","last_peered":"2024-06-02T23:46:30.761401+0000","last_clean":"2024-06-02T23:46:30.761401+0000","last_became_active":"2024-06-02T23:46:29.750392+0000","last_became_peered":"2024-06-02T23:46:29.750392+0000","last_unstale":"2024-06-02T23:46:30.761401+0000","last_undegraded":"2024-06-02T23:46:30.761401+0000","last_fullsized":"2024-06-02T23:46:30.761401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519491+0000","last_change":"2024-06-02T23:46:25.730928+0000","last_active":"2024-06-02T23:46:32.519491+0000","last_peered":"2024-06-02T23:46:32.519491+0000","last_clean":"2024-06-02T23:46:32.519491+0000","last_became_active":"2024-06-02T23:46:25.730035+0000","last_became_peered":"2024-06-02T23:46:25.730035+0000","last_unstale":"2024-06-02T23:46:32.519491+0000","last_undegraded":"2024-06-02T23:46:32.519491+0000","last_fullsized":"2024-06-02T23:46:32.519491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519486+0000","last_change":"2024-06-02T23:46:24.726529+0000","last_active":"2024-06-02T23:46:32.519486+0000","last_peered":"2024-06-02T23:46:32.519486+0000","last_clean":"2024-06-02T23:46:32.519486+0000","last_became_active":"2024-06-02T23:46:24.726263+0000","last_became_peered":"2024-06-02T23:46:24.726263+0000","last_unstale":"2024-06-02T23:46:32.519486+0000","last_undegraded":"2024-06-02T23:46:32.519486+0000","last_fullsized":"2024-06-02T23:46:32.519486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:22.253427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760795+0000","last_change":"2024-06-02T23:46:29.747195+0000","last_active":"2024-06-02T23:46:30.760795+0000","last_peered":"2024-06-02T23:46:30.760795+0000","last_clean":"2024-06-02T23:46:30.760795+0000","last_became_active":"2024-06-02T23:46:29.746715+0000","last_became_peered":"2024-06-02T23:46:29.746715+0000","last_unstale":"2024-06-02T23:46:30.760795+0000","last_undegraded":"2024-06-02T23:46:30.760795+0000","last_fullsized":"2024-06-02T23:46:30.760795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:48.919181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520156+0000","last_change":"2024-06-02T23:46:25.730204+0000","last_active":"2024-06-02T23:46:32.520156+0000","last_peered":"2024-06-02T23:46:32.520156+0000","last_clean":"2024-06-02T23:46:32.520156+0000","last_became_active":"2024-06-02T23:46:25.728660+0000","last_became_peered":"2024-06-02T23:46:25.728660+0000","last_unstale":"2024-06-02T23:46:32.520156+0000","last_undegraded":"2024-06-02T23:46:32.520156+0000","last_fullsized":"2024-06-02T23:46:32.520156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518837+0000","last_change":"2024-06-02T23:46:24.725743+0000","last_active":"2024-06-02T23:46:32.518837+0000","last_peered":"2024-06-02T23:46:32.518837+0000","last_clean":"2024-06-02T23:46:32.518837+0000","last_became_active":"2024-06-02T23:46:24.725418+0000","last_became_peered":"2024-06-02T23:46:24.725418+0000","last_unstale":"2024-06-02T23:46:32.518837+0000","last_undegraded":"2024-06-02T23:46:32.518837+0000","last_fullsized":"2024-06-02T23:46:32.518837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:07.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520044+0000","last_change":"2024-06-02T23:46:30.062502+0000","last_active":"2024-06-02T23:46:32.520044+0000","last_peered":"2024-06-02T23:46:32.520044+0000","last_clean":"2024-06-02T23:46:32.520044+0000","last_became_active":"2024-06-02T23:46:30.062168+0000","last_became_peered":"2024-06-02T23:46:30.062168+0000","last_unstale":"2024-06-02T23:46:32.520044+0000","last_undegraded":"2024-06-02T23:46:32.520044+0000","last_fullsized":"2024-06-02T23:46:32.520044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:15.508248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761606+0000","last_change":"2024-06-02T23:46:25.729672+0000","last_active":"2024-06-02T23:46:30.761606+0000","last_peered":"2024-06-02T23:46:30.761606+0000","last_clean":"2024-06-02T23:46:30.761606+0000","last_became_active":"2024-06-02T23:46:25.729405+0000","last_became_peered":"2024-06-02T23:46:25.729405+0000","last_unstale":"2024-06-02T23:46:30.761606+0000","last_undegraded":"2024-06-02T23:46:30.761606+0000","last_fullsized":"2024-06-02T23:46:30.761606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:21.812182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519444+0000","last_change":"2024-06-02T23:46:24.725037+0000","last_active":"2024-06-02T23:46:32.519444+0000","last_peered":"2024-06-02T23:46:32.519444+0000","last_clean":"2024-06-02T23:46:32.519444+0000","last_became_active":"2024-06-02T23:46:24.724705+0000","last_became_peered":"2024-06-02T23:46:24.724705+0000","last_unstale":"2024-06-02T23:46:32.519444+0000","last_undegraded":"2024-06-02T23:46:32.519444+0000","last_fullsized":"2024-06-02T23:46:32.519444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760969+0000","last_change":"2024-06-02T23:46:29.745875+0000","last_active":"2024-06-02T23:46:30.760969+0000","last_peered":"2024-06-02T23:46:30.760969+0000","last_clean":"2024-06-02T23:46:30.760969+0000","last_became_active":"2024-06-02T23:46:29.745417+0000","last_became_peered":"2024-06-02T23:46:29.745417+0000","last_unstale":"2024-06-02T23:46:30.760969+0000","last_undegraded":"2024-06-02T23:46:30.760969+0000","last_fullsized":"2024-06-02T23:46:30.760969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:52.536406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520531+0000","last_change":"2024-06-02T23:46:25.726449+0000","last_active":"2024-06-02T23:46:32.520531+0000","last_peered":"2024-06-02T23:46:32.520531+0000","last_clean":"2024-06-02T23:46:32.520531+0000","last_became_active":"2024-06-02T23:46:25.725878+0000","last_became_peered":"2024-06-02T23:46:25.725878+0000","last_unstale":"2024-06-02T23:46:32.520531+0000","last_undegraded":"2024-06-02T23:46:32.520531+0000","last_fullsized":"2024-06-02T23:46:32.520531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520174+0000","last_change":"2024-06-02T23:46:24.723537+0000","last_active":"2024-06-02T23:46:32.520174+0000","last_peered":"2024-06-02T23:46:32.520174+0000","last_clean":"2024-06-02T23:46:32.520174+0000","last_became_active":"2024-06-02T23:46:24.723258+0000","last_became_peered":"2024-06-02T23:46:24.723258+0000","last_unstale":"2024-06-02T23:46:32.520174+0000","last_undegraded":"2024-06-02T23:46:32.520174+0000","last_fullsized":"2024-06-02T23:46:32.520174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760721+0000","last_change":"2024-06-02T23:46:30.059389+0000","last_active":"2024-06-02T23:46:30.760721+0000","last_peered":"2024-06-02T23:46:30.760721+0000","last_clean":"2024-06-02T23:46:30.760721+0000","last_became_active":"2024-06-02T23:46:30.058909+0000","last_became_peered":"2024-06-02T23:46:30.058909+0000","last_unstale":"2024-06-02T23:46:30.760721+0000","last_undegraded":"2024-06-02T23:46:30.760721+0000","last_fullsized":"2024-06-02T23:46:30.760721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:24.838590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519819+0000","last_change":"2024-06-02T23:46:25.738807+0000","last_active":"2024-06-02T23:46:32.519819+0000","last_peered":"2024-06-02T23:46:32.519819+0000","last_clean":"2024-06-02T23:46:32.519819+0000","last_became_active":"2024-06-02T23:46:25.738552+0000","last_became_peered":"2024-06-02T23:46:25.738552+0000","last_unstale":"2024-06-02T23:46:32.519819+0000","last_undegraded":"2024-06-02T23:46:32.519819+0000","last_fullsized":"2024-06-02T23:46:32.519819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519426+0000","last_change":"2024-06-02T23:46:24.717509+0000","last_active":"2024-06-02T23:46:32.519426+0000","last_peered":"2024-06-02T23:46:32.519426+0000","last_clean":"2024-06-02T23:46:32.519426+0000","last_became_active":"2024-06-02T23:46:24.716726+0000","last_became_peered":"2024-06-02T23:46:24.716726+0000","last_unstale":"2024-06-02T23:46:32.519426+0000","last_undegraded":"2024-06-02T23:46:32.519426+0000","last_fullsized":"2024-06-02T23:46:32.519426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520004+0000","last_change":"2024-06-02T23:46:30.060386+0000","last_active":"2024-06-02T23:46:32.520004+0000","last_peered":"2024-06-02T23:46:32.520004+0000","last_clean":"2024-06-02T23:46:32.520004+0000","last_became_active":"2024-06-02T23:46:30.058822+0000","last_became_peered":"2024-06-02T23:46:30.058822+0000","last_unstale":"2024-06-02T23:46:32.520004+0000","last_undegraded":"2024-06-02T23:46:32.520004+0000","last_fullsized":"2024-06-02T23:46:32.520004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:33.045570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521240+0000","last_change":"2024-06-02T23:46:25.735259+0000","last_active":"2024-06-02T23:46:32.521240+0000","last_peered":"2024-06-02T23:46:32.521240+0000","last_clean":"2024-06-02T23:46:32.521240+0000","last_became_active":"2024-06-02T23:46:25.734998+0000","last_became_peered":"2024-06-02T23:46:25.734998+0000","last_unstale":"2024-06-02T23:46:32.521240+0000","last_undegraded":"2024-06-02T23:46:32.521240+0000","last_fullsized":"2024-06-02T23:46:32.521240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520831+0000","last_change":"2024-06-02T23:46:24.725043+0000","last_active":"2024-06-02T23:46:32.520831+0000","last_peered":"2024-06-02T23:46:32.520831+0000","last_clean":"2024-06-02T23:46:32.520831+0000","last_became_active":"2024-06-02T23:46:24.724672+0000","last_became_peered":"2024-06-02T23:46:24.724672+0000","last_unstale":"2024-06-02T23:46:32.520831+0000","last_undegraded":"2024-06-02T23:46:32.520831+0000","last_fullsized":"2024-06-02T23:46:32.520831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:22.253427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519079+0000","last_change":"2024-06-02T23:46:30.061769+0000","last_active":"2024-06-02T23:46:32.519079+0000","last_peered":"2024-06-02T23:46:32.519079+0000","last_clean":"2024-06-02T23:46:32.519079+0000","last_became_active":"2024-06-02T23:46:30.061381+0000","last_became_peered":"2024-06-02T23:46:30.061381+0000","last_unstale":"2024-06-02T23:46:32.519079+0000","last_undegraded":"2024-06-02T23:46:32.519079+0000","last_fullsized":"2024-06-02T23:46:32.519079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020522+0000","last_change":"2024-06-02T23:46:25.733026+0000","last_active":"2024-06-02T23:46:32.020522+0000","last_peered":"2024-06-02T23:46:32.020522+0000","last_clean":"2024-06-02T23:46:32.020522+0000","last_became_active":"2024-06-02T23:46:25.732637+0000","last_became_peered":"2024-06-02T23:46:25.732637+0000","last_unstale":"2024-06-02T23:46:32.020522+0000","last_undegraded":"2024-06-02T23:46:32.020522+0000","last_fullsized":"2024-06-02T23:46:32.020522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:20.812410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521321+0000","last_change":"2024-06-02T23:46:24.725276+0000","last_active":"2024-06-02T23:46:32.521321+0000","last_peered":"2024-06-02T23:46:32.521321+0000","last_clean":"2024-06-02T23:46:32.521321+0000","last_became_active":"2024-06-02T23:46:24.725003+0000","last_became_peered":"2024-06-02T23:46:24.725003+0000","last_unstale":"2024-06-02T23:46:32.521321+0000","last_undegraded":"2024-06-02T23:46:32.521321+0000","last_fullsized":"2024-06-02T23:46:32.521321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519089+0000","last_change":"2024-06-02T23:46:29.748270+0000","last_active":"2024-06-02T23:46:32.519089+0000","last_peered":"2024-06-02T23:46:32.519089+0000","last_clean":"2024-06-02T23:46:32.519089+0000","last_became_active":"2024-06-02T23:46:29.746100+0000","last_became_peered":"2024-06-02T23:46:29.746100+0000","last_unstale":"2024-06-02T23:46:32.519089+0000","last_undegraded":"2024-06-02T23:46:32.519089+0000","last_fullsized":"2024-06-02T23:46:32.519089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761799+0000","last_change":"2024-06-02T23:46:25.721864+0000","last_active":"2024-06-02T23:46:30.761799+0000","last_peered":"2024-06-02T23:46:30.761799+0000","last_clean":"2024-06-02T23:46:30.761799+0000","last_became_active":"2024-06-02T23:46:25.721542+0000","last_became_peered":"2024-06-02T23:46:25.721542+0000","last_unstale":"2024-06-02T23:46:30.761799+0000","last_undegraded":"2024-06-02T23:46:30.761799+0000","last_fullsized":"2024-06-02T23:46:30.761799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:43.831493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020299+0000","last_change":"2024-06-02T23:46:24.721734+0000","last_active":"2024-06-02T23:46:32.020299+0000","last_peered":"2024-06-02T23:46:32.020299+0000","last_clean":"2024-06-02T23:46:32.020299+0000","last_became_active":"2024-06-02T23:46:24.721054+0000","last_became_peered":"2024-06-02T23:46:24.721054+0000","last_unstale":"2024-06-02T23:46:32.020299+0000","last_undegraded":"2024-06-02T23:46:32.020299+0000","last_fullsized":"2024-06-02T23:46:32.020299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521266+0000","last_change":"2024-06-02T23:46:29.747631+0000","last_active":"2024-06-02T23:46:32.521266+0000","last_peered":"2024-06-02T23:46:32.521266+0000","last_clean":"2024-06-02T23:46:32.521266+0000","last_became_active":"2024-06-02T23:46:29.747131+0000","last_became_peered":"2024-06-02T23:46:29.747131+0000","last_unstale":"2024-06-02T23:46:32.521266+0000","last_undegraded":"2024-06-02T23:46:32.521266+0000","last_fullsized":"2024-06-02T23:46:32.521266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:25:42.527465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521158+0000","last_change":"2024-06-02T23:46:25.730642+0000","last_active":"2024-06-02T23:46:32.521158+0000","last_peered":"2024-06-02T23:46:32.521158+0000","last_clean":"2024-06-02T23:46:32.521158+0000","last_became_active":"2024-06-02T23:46:25.730361+0000","last_became_peered":"2024-06-02T23:46:25.730361+0000","last_unstale":"2024-06-02T23:46:32.521158+0000","last_undegraded":"2024-06-02T23:46:32.521158+0000","last_fullsized":"2024-06-02T23:46:32.521158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760281+0000","last_change":"2024-06-02T23:46:24.723907+0000","last_active":"2024-06-02T23:46:30.760281+0000","last_peered":"2024-06-02T23:46:30.760281+0000","last_clean":"2024-06-02T23:46:30.760281+0000","last_became_active":"2024-06-02T23:46:24.723625+0000","last_became_peered":"2024-06-02T23:46:24.723625+0000","last_unstale":"2024-06-02T23:46:30.760281+0000","last_undegraded":"2024-06-02T23:46:30.760281+0000","last_fullsized":"2024-06-02T23:46:30.760281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520188+0000","last_change":"2024-06-02T23:46:29.750215+0000","last_active":"2024-06-02T23:46:32.520188+0000","last_peered":"2024-06-02T23:46:32.520188+0000","last_clean":"2024-06-02T23:46:32.520188+0000","last_became_active":"2024-06-02T23:46:29.749639+0000","last_became_peered":"2024-06-02T23:46:29.749639+0000","last_unstale":"2024-06-02T23:46:32.520188+0000","last_undegraded":"2024-06-02T23:46:32.520188+0000","last_fullsized":"2024-06-02T23:46:32.520188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:29.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518955+0000","last_change":"2024-06-02T23:46:25.715090+0000","last_active":"2024-06-02T23:46:32.518955+0000","last_peered":"2024-06-02T23:46:32.518955+0000","last_clean":"2024-06-02T23:46:32.518955+0000","last_became_active":"2024-06-02T23:46:25.714367+0000","last_became_peered":"2024-06-02T23:46:25.714367+0000","last_unstale":"2024-06-02T23:46:32.518955+0000","last_undegraded":"2024-06-02T23:46:32.518955+0000","last_fullsized":"2024-06-02T23:46:32.518955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519559+0000","last_change":"2024-06-02T23:46:24.727655+0000","last_active":"2024-06-02T23:46:32.519559+0000","last_peered":"2024-06-02T23:46:32.519559+0000","last_clean":"2024-06-02T23:46:32.519559+0000","last_became_active":"2024-06-02T23:46:24.727332+0000","last_became_peered":"2024-06-02T23:46:24.727332+0000","last_unstale":"2024-06-02T23:46:32.519559+0000","last_undegraded":"2024-06-02T23:46:32.519559+0000","last_fullsized":"2024-06-02T23:46:32.519559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520433+0000","last_change":"2024-06-02T23:46:30.058954+0000","last_active":"2024-06-02T23:46:32.520433+0000","last_peered":"2024-06-02T23:46:32.520433+0000","last_clean":"2024-06-02T23:46:32.520433+0000","last_became_active":"2024-06-02T23:46:30.058572+0000","last_became_peered":"2024-06-02T23:46:30.058572+0000","last_unstale":"2024-06-02T23:46:32.520433+0000","last_undegraded":"2024-06-02T23:46:32.520433+0000","last_fullsized":"2024-06-02T23:46:32.520433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:29.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519081+0000","last_change":"2024-06-02T23:46:25.733213+0000","last_active":"2024-06-02T23:46:32.519081+0000","last_peered":"2024-06-02T23:46:32.519081+0000","last_clean":"2024-06-02T23:46:32.519081+0000","last_became_active":"2024-06-02T23:46:25.732930+0000","last_became_peered":"2024-06-02T23:46:25.732930+0000","last_unstale":"2024-06-02T23:46:32.519081+0000","last_undegraded":"2024-06-02T23:46:32.519081+0000","last_fullsized":"2024-06-02T23:46:32.519081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020160+0000","last_change":"2024-06-02T23:46:24.721901+0000","last_active":"2024-06-02T23:46:32.020160+0000","last_peered":"2024-06-02T23:46:32.020160+0000","last_clean":"2024-06-02T23:46:32.020160+0000","last_became_active":"2024-06-02T23:46:24.721566+0000","last_became_peered":"2024-06-02T23:46:24.721566+0000","last_unstale":"2024-06-02T23:46:32.020160+0000","last_undegraded":"2024-06-02T23:46:32.020160+0000","last_fullsized":"2024-06-02T23:46:32.020160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519663+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:46:32.519663+0000","last_peered":"2024-06-02T23:46:32.519663+0000","last_clean":"2024-06-02T23:46:32.519663+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:46:32.519663+0000","last_undegraded":"2024-06-02T23:46:32.519663+0000","last_fullsized":"2024-06-02T23:46:32.519663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520077+0000","last_change":"2024-06-02T23:46:30.062637+0000","last_active":"2024-06-02T23:46:32.520077+0000","last_peered":"2024-06-02T23:46:32.520077+0000","last_clean":"2024-06-02T23:46:32.520077+0000","last_became_active":"2024-06-02T23:46:30.061399+0000","last_became_peered":"2024-06-02T23:46:30.061399+0000","last_unstale":"2024-06-02T23:46:32.520077+0000","last_undegraded":"2024-06-02T23:46:32.520077+0000","last_fullsized":"2024-06-02T23:46:32.520077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:13.880688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520556+0000","last_change":"2024-06-02T23:46:25.735716+0000","last_active":"2024-06-02T23:46:32.520556+0000","last_peered":"2024-06-02T23:46:32.520556+0000","last_clean":"2024-06-02T23:46:32.520556+0000","last_became_active":"2024-06-02T23:46:25.735260+0000","last_became_peered":"2024-06-02T23:46:25.735260+0000","last_unstale":"2024-06-02T23:46:32.520556+0000","last_undegraded":"2024-06-02T23:46:32.520556+0000","last_fullsized":"2024-06-02T23:46:32.520556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760537+0000","last_change":"2024-06-02T23:46:24.723946+0000","last_active":"2024-06-02T23:46:30.760537+0000","last_peered":"2024-06-02T23:46:30.760537+0000","last_clean":"2024-06-02T23:46:30.760537+0000","last_became_active":"2024-06-02T23:46:24.723650+0000","last_became_peered":"2024-06-02T23:46:24.723650+0000","last_unstale":"2024-06-02T23:46:30.760537+0000","last_undegraded":"2024-06-02T23:46:30.760537+0000","last_fullsized":"2024-06-02T23:46:30.760537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520181+0000","last_change":"2024-06-02T23:46:30.059124+0000","last_active":"2024-06-02T23:46:32.520181+0000","last_peered":"2024-06-02T23:46:32.520181+0000","last_clean":"2024-06-02T23:46:32.520181+0000","last_became_active":"2024-06-02T23:46:30.058661+0000","last_became_peered":"2024-06-02T23:46:30.058661+0000","last_unstale":"2024-06-02T23:46:32.520181+0000","last_undegraded":"2024-06-02T23:46:32.520181+0000","last_fullsized":"2024-06-02T23:46:32.520181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020428+0000","last_change":"2024-06-02T23:46:25.732804+0000","last_active":"2024-06-02T23:46:32.020428+0000","last_peered":"2024-06-02T23:46:32.020428+0000","last_clean":"2024-06-02T23:46:32.020428+0000","last_became_active":"2024-06-02T23:46:25.732456+0000","last_became_peered":"2024-06-02T23:46:25.732456+0000","last_unstale":"2024-06-02T23:46:32.020428+0000","last_undegraded":"2024-06-02T23:46:32.020428+0000","last_fullsized":"2024-06-02T23:46:32.020428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:12.887235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520544+0000","last_change":"2024-06-02T23:46:24.719921+0000","last_active":"2024-06-02T23:46:32.520544+0000","last_peered":"2024-06-02T23:46:32.520544+0000","last_clean":"2024-06-02T23:46:32.520544+0000","last_became_active":"2024-06-02T23:46:24.719648+0000","last_became_peered":"2024-06-02T23:46:24.719648+0000","last_unstale":"2024-06-02T23:46:32.520544+0000","last_undegraded":"2024-06-02T23:46:32.520544+0000","last_fullsized":"2024-06-02T23:46:32.520544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519336+0000","last_change":"2024-06-02T23:46:29.750616+0000","last_active":"2024-06-02T23:46:32.519336+0000","last_peered":"2024-06-02T23:46:32.519336+0000","last_clean":"2024-06-02T23:46:32.519336+0000","last_became_active":"2024-06-02T23:46:29.750269+0000","last_became_peered":"2024-06-02T23:46:29.750269+0000","last_unstale":"2024-06-02T23:46:32.519336+0000","last_undegraded":"2024-06-02T23:46:32.519336+0000","last_fullsized":"2024-06-02T23:46:32.519336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520532+0000","last_change":"2024-06-02T23:46:25.735799+0000","last_active":"2024-06-02T23:46:32.520532+0000","last_peered":"2024-06-02T23:46:32.520532+0000","last_clean":"2024-06-02T23:46:32.520532+0000","last_became_active":"2024-06-02T23:46:25.735543+0000","last_became_peered":"2024-06-02T23:46:25.735543+0000","last_unstale":"2024-06-02T23:46:32.520532+0000","last_undegraded":"2024-06-02T23:46:32.520532+0000","last_fullsized":"2024-06-02T23:46:32.520532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:37.017923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760515+0000","last_change":"2024-06-02T23:46:24.725885+0000","last_active":"2024-06-02T23:46:30.760515+0000","last_peered":"2024-06-02T23:46:30.760515+0000","last_clean":"2024-06-02T23:46:30.760515+0000","last_became_active":"2024-06-02T23:46:24.725536+0000","last_became_peered":"2024-06-02T23:46:24.725536+0000","last_unstale":"2024-06-02T23:46:30.760515+0000","last_undegraded":"2024-06-02T23:46:30.760515+0000","last_fullsized":"2024-06-02T23:46:30.760515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019834+0000","last_change":"2024-06-02T23:46:30.061677+0000","last_active":"2024-06-02T23:46:32.019834+0000","last_peered":"2024-06-02T23:46:32.019834+0000","last_clean":"2024-06-02T23:46:32.019834+0000","last_became_active":"2024-06-02T23:46:30.060775+0000","last_became_peered":"2024-06-02T23:46:30.060775+0000","last_unstale":"2024-06-02T23:46:32.019834+0000","last_undegraded":"2024-06-02T23:46:32.019834+0000","last_fullsized":"2024-06-02T23:46:32.019834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:33.045570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520258+0000","last_change":"2024-06-02T23:46:25.730305+0000","last_active":"2024-06-02T23:46:32.520258+0000","last_peered":"2024-06-02T23:46:32.520258+0000","last_clean":"2024-06-02T23:46:32.520258+0000","last_became_active":"2024-06-02T23:46:25.730021+0000","last_became_peered":"2024-06-02T23:46:25.730021+0000","last_unstale":"2024-06-02T23:46:32.520258+0000","last_undegraded":"2024-06-02T23:46:32.520258+0000","last_fullsized":"2024-06-02T23:46:32.520258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:55.355993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761363+0000","last_change":"2024-06-02T23:46:24.715701+0000","last_active":"2024-06-02T23:46:30.761363+0000","last_peered":"2024-06-02T23:46:30.761363+0000","last_clean":"2024-06-02T23:46:30.761363+0000","last_became_active":"2024-06-02T23:46:24.715390+0000","last_became_peered":"2024-06-02T23:46:24.715390+0000","last_unstale":"2024-06-02T23:46:30.761363+0000","last_undegraded":"2024-06-02T23:46:30.761363+0000","last_fullsized":"2024-06-02T23:46:30.761363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:58.235763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760636+0000","last_change":"2024-06-02T23:46:29.746332+0000","last_active":"2024-06-02T23:46:30.760636+0000","last_peered":"2024-06-02T23:46:30.760636+0000","last_clean":"2024-06-02T23:46:30.760636+0000","last_became_active":"2024-06-02T23:46:29.745413+0000","last_became_peered":"2024-06-02T23:46:29.745413+0000","last_unstale":"2024-06-02T23:46:30.760636+0000","last_undegraded":"2024-06-02T23:46:30.760636+0000","last_fullsized":"2024-06-02T23:46:30.760636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:19.371522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519802+0000","last_change":"2024-06-02T23:46:25.725887+0000","last_active":"2024-06-02T23:46:32.519802+0000","last_peered":"2024-06-02T23:46:32.519802+0000","last_clean":"2024-06-02T23:46:32.519802+0000","last_became_active":"2024-06-02T23:46:25.725612+0000","last_became_peered":"2024-06-02T23:46:25.725612+0000","last_unstale":"2024-06-02T23:46:32.519802+0000","last_undegraded":"2024-06-02T23:46:32.519802+0000","last_fullsized":"2024-06-02T23:46:32.519802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760127+0000","last_change":"2024-06-02T23:46:24.724594+0000","last_active":"2024-06-02T23:46:30.760127+0000","last_peered":"2024-06-02T23:46:30.760127+0000","last_clean":"2024-06-02T23:46:30.760127+0000","last_became_active":"2024-06-02T23:46:24.723922+0000","last_became_peered":"2024-06-02T23:46:24.723922+0000","last_unstale":"2024-06-02T23:46:30.760127+0000","last_undegraded":"2024-06-02T23:46:30.760127+0000","last_fullsized":"2024-06-02T23:46:30.760127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520293+0000","last_change":"2024-06-02T23:46:29.747557+0000","last_active":"2024-06-02T23:46:32.520293+0000","last_peered":"2024-06-02T23:46:32.520293+0000","last_clean":"2024-06-02T23:46:32.520293+0000","last_became_active":"2024-06-02T23:46:29.747197+0000","last_became_peered":"2024-06-02T23:46:29.747197+0000","last_unstale":"2024-06-02T23:46:32.520293+0000","last_undegraded":"2024-06-02T23:46:32.520293+0000","last_fullsized":"2024-06-02T23:46:32.520293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:15.508248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519514+0000","last_change":"2024-06-02T23:46:25.724028+0000","last_active":"2024-06-02T23:46:32.519514+0000","last_peered":"2024-06-02T23:46:32.519514+0000","last_clean":"2024-06-02T23:46:32.519514+0000","last_became_active":"2024-06-02T23:46:25.723772+0000","last_became_peered":"2024-06-02T23:46:25.723772+0000","last_unstale":"2024-06-02T23:46:32.519514+0000","last_undegraded":"2024-06-02T23:46:32.519514+0000","last_fullsized":"2024-06-02T23:46:32.519514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519626+0000","last_change":"2024-06-02T23:46:24.719789+0000","last_active":"2024-06-02T23:46:32.519626+0000","last_peered":"2024-06-02T23:46:32.519626+0000","last_clean":"2024-06-02T23:46:32.519626+0000","last_became_active":"2024-06-02T23:46:24.719492+0000","last_became_peered":"2024-06-02T23:46:24.719492+0000","last_unstale":"2024-06-02T23:46:32.519626+0000","last_undegraded":"2024-06-02T23:46:32.519626+0000","last_fullsized":"2024-06-02T23:46:32.519626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519714+0000","last_change":"2024-06-02T23:46:30.060001+0000","last_active":"2024-06-02T23:46:32.519714+0000","last_peered":"2024-06-02T23:46:32.519714+0000","last_clean":"2024-06-02T23:46:32.519714+0000","last_became_active":"2024-06-02T23:46:30.059636+0000","last_became_peered":"2024-06-02T23:46:30.059636+0000","last_unstale":"2024-06-02T23:46:32.519714+0000","last_undegraded":"2024-06-02T23:46:32.519714+0000","last_fullsized":"2024-06-02T23:46:32.519714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:25:42.527465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520625+0000","last_change":"2024-06-02T23:46:25.731503+0000","last_active":"2024-06-02T23:46:32.520625+0000","last_peered":"2024-06-02T23:46:32.520625+0000","last_clean":"2024-06-02T23:46:32.520625+0000","last_became_active":"2024-06-02T23:46:25.726384+0000","last_became_peered":"2024-06-02T23:46:25.726384+0000","last_unstale":"2024-06-02T23:46:32.520625+0000","last_undegraded":"2024-06-02T23:46:32.520625+0000","last_fullsized":"2024-06-02T23:46:32.520625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:11.482068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020231+0000","last_change":"2024-06-02T23:46:24.717644+0000","last_active":"2024-06-02T23:46:32.020231+0000","last_peered":"2024-06-02T23:46:32.020231+0000","last_clean":"2024-06-02T23:46:32.020231+0000","last_became_active":"2024-06-02T23:46:24.717376+0000","last_became_peered":"2024-06-02T23:46:24.717376+0000","last_unstale":"2024-06-02T23:46:32.020231+0000","last_undegraded":"2024-06-02T23:46:32.020231+0000","last_fullsized":"2024-06-02T23:46:32.020231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520673+0000","last_change":"2024-06-02T23:46:30.059757+0000","last_active":"2024-06-02T23:46:32.520673+0000","last_peered":"2024-06-02T23:46:32.520673+0000","last_clean":"2024-06-02T23:46:32.520673+0000","last_became_active":"2024-06-02T23:46:30.059322+0000","last_became_peered":"2024-06-02T23:46:30.059322+0000","last_unstale":"2024-06-02T23:46:32.520673+0000","last_undegraded":"2024-06-02T23:46:32.520673+0000","last_fullsized":"2024-06-02T23:46:32.520673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:23.721847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519530+0000","last_change":"2024-06-02T23:46:25.728180+0000","last_active":"2024-06-02T23:46:32.519530+0000","last_peered":"2024-06-02T23:46:32.519530+0000","last_clean":"2024-06-02T23:46:32.519530+0000","last_became_active":"2024-06-02T23:46:25.727929+0000","last_became_peered":"2024-06-02T23:46:25.727929+0000","last_unstale":"2024-06-02T23:46:32.519530+0000","last_undegraded":"2024-06-02T23:46:32.519530+0000","last_fullsized":"2024-06-02T23:46:32.519530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:13:41.243193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520755+0000","last_change":"2024-06-02T23:46:24.720640+0000","last_active":"2024-06-02T23:46:32.520755+0000","last_peered":"2024-06-02T23:46:32.520755+0000","last_clean":"2024-06-02T23:46:32.520755+0000","last_became_active":"2024-06-02T23:46:24.718963+0000","last_became_peered":"2024-06-02T23:46:24.718963+0000","last_unstale":"2024-06-02T23:46:32.520755+0000","last_undegraded":"2024-06-02T23:46:32.520755+0000","last_fullsized":"2024-06-02T23:46:32.520755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:48:20.465639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020392+0000","last_change":"2024-06-02T23:46:30.061979+0000","last_active":"2024-06-02T23:46:32.020392+0000","last_peered":"2024-06-02T23:46:32.020392+0000","last_clean":"2024-06-02T23:46:32.020392+0000","last_became_active":"2024-06-02T23:46:30.060895+0000","last_became_peered":"2024-06-02T23:46:30.060895+0000","last_unstale":"2024-06-02T23:46:32.020392+0000","last_undegraded":"2024-06-02T23:46:32.020392+0000","last_fullsized":"2024-06-02T23:46:32.020392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:45:39.641287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520442+0000","last_change":"2024-06-02T23:46:25.735883+0000","last_active":"2024-06-02T23:46:32.520442+0000","last_peered":"2024-06-02T23:46:32.520442+0000","last_clean":"2024-06-02T23:46:32.520442+0000","last_became_active":"2024-06-02T23:46:25.735603+0000","last_became_peered":"2024-06-02T23:46:25.735603+0000","last_unstale":"2024-06-02T23:46:32.520442+0000","last_undegraded":"2024-06-02T23:46:32.520442+0000","last_fullsized":"2024-06-02T23:46:32.520442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:35.130935+0000","last_change":"2024-06-02T23:46:24.721360+0000","last_active":"2024-06-02T23:46:35.130935+0000","last_peered":"2024-06-02T23:46:35.130935+0000","last_clean":"2024-06-02T23:46:35.130935+0000","last_became_active":"2024-06-02T23:46:24.721084+0000","last_became_peered":"2024-06-02T23:46:24.721084+0000","last_unstale":"2024-06-02T23:46:35.130935+0000","last_undegraded":"2024-06-02T23:46:35.130935+0000","last_fullsized":"2024-06-02T23:46:35.130935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519296+0000","last_change":"2024-06-02T23:46:29.746644+0000","last_active":"2024-06-02T23:46:32.519296+0000","last_peered":"2024-06-02T23:46:32.519296+0000","last_clean":"2024-06-02T23:46:32.519296+0000","last_became_active":"2024-06-02T23:46:29.746228+0000","last_became_peered":"2024-06-02T23:46:29.746228+0000","last_unstale":"2024-06-02T23:46:32.519296+0000","last_undegraded":"2024-06-02T23:46:32.519296+0000","last_fullsized":"2024-06-02T23:46:32.519296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:10.654147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761249+0000","last_change":"2024-06-02T23:46:25.728089+0000","last_active":"2024-06-02T23:46:30.761249+0000","last_peered":"2024-06-02T23:46:30.761249+0000","last_clean":"2024-06-02T23:46:30.761249+0000","last_became_active":"2024-06-02T23:46:25.726955+0000","last_became_peered":"2024-06-02T23:46:25.726955+0000","last_unstale":"2024-06-02T23:46:30.761249+0000","last_undegraded":"2024-06-02T23:46:30.761249+0000","last_fullsized":"2024-06-02T23:46:30.761249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:35.672297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520452+0000","last_change":"2024-06-02T23:46:24.725891+0000","last_active":"2024-06-02T23:46:32.520452+0000","last_peered":"2024-06-02T23:46:32.520452+0000","last_clean":"2024-06-02T23:46:32.520452+0000","last_became_active":"2024-06-02T23:46:24.725584+0000","last_became_peered":"2024-06-02T23:46:24.725584+0000","last_unstale":"2024-06-02T23:46:32.520452+0000","last_undegraded":"2024-06-02T23:46:32.520452+0000","last_fullsized":"2024-06-02T23:46:32.520452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761588+0000","last_change":"2024-06-02T23:46:29.745572+0000","last_active":"2024-06-02T23:46:30.761588+0000","last_peered":"2024-06-02T23:46:30.761588+0000","last_clean":"2024-06-02T23:46:30.761588+0000","last_became_active":"2024-06-02T23:46:29.744992+0000","last_became_peered":"2024-06-02T23:46:29.744992+0000","last_unstale":"2024-06-02T23:46:30.761588+0000","last_undegraded":"2024-06-02T23:46:30.761588+0000","last_fullsized":"2024-06-02T23:46:30.761588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519822+0000","last_change":"2024-06-02T23:46:25.725605+0000","last_active":"2024-06-02T23:46:32.519822+0000","last_peered":"2024-06-02T23:46:32.519822+0000","last_clean":"2024-06-02T23:46:32.519822+0000","last_became_active":"2024-06-02T23:46:25.725274+0000","last_became_peered":"2024-06-02T23:46:25.725274+0000","last_unstale":"2024-06-02T23:46:32.519822+0000","last_undegraded":"2024-06-02T23:46:32.519822+0000","last_fullsized":"2024-06-02T23:46:32.519822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020509+0000","last_change":"2024-06-02T23:46:24.715879+0000","last_active":"2024-06-02T23:46:32.020509+0000","last_peered":"2024-06-02T23:46:32.020509+0000","last_clean":"2024-06-02T23:46:32.020509+0000","last_became_active":"2024-06-02T23:46:24.715573+0000","last_became_peered":"2024-06-02T23:46:24.715573+0000","last_unstale":"2024-06-02T23:46:32.020509+0000","last_undegraded":"2024-06-02T23:46:32.020509+0000","last_fullsized":"2024-06-02T23:46:32.020509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520072+0000","last_change":"2024-06-02T23:46:29.747846+0000","last_active":"2024-06-02T23:46:32.520072+0000","last_peered":"2024-06-02T23:46:32.520072+0000","last_clean":"2024-06-02T23:46:32.520072+0000","last_became_active":"2024-06-02T23:46:29.747447+0000","last_became_peered":"2024-06-02T23:46:29.747447+0000","last_unstale":"2024-06-02T23:46:32.520072+0000","last_undegraded":"2024-06-02T23:46:32.520072+0000","last_fullsized":"2024-06-02T23:46:32.520072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:45:39.641287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020419+0000","last_change":"2024-06-02T23:46:25.724680+0000","last_active":"2024-06-02T23:46:32.020419+0000","last_peered":"2024-06-02T23:46:32.020419+0000","last_clean":"2024-06-02T23:46:32.020419+0000","last_became_active":"2024-06-02T23:46:25.724407+0000","last_became_peered":"2024-06-02T23:46:25.724407+0000","last_unstale":"2024-06-02T23:46:32.020419+0000","last_undegraded":"2024-06-02T23:46:32.020419+0000","last_fullsized":"2024-06-02T23:46:32.020419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:09.854508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520034+0000","last_change":"2024-06-02T23:46:24.722854+0000","last_active":"2024-06-02T23:46:32.520034+0000","last_peered":"2024-06-02T23:46:32.520034+0000","last_clean":"2024-06-02T23:46:32.520034+0000","last_became_active":"2024-06-02T23:46:24.722517+0000","last_became_peered":"2024-06-02T23:46:24.722517+0000","last_unstale":"2024-06-02T23:46:32.520034+0000","last_undegraded":"2024-06-02T23:46:32.520034+0000","last_fullsized":"2024-06-02T23:46:32.520034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520095+0000","last_change":"2024-06-02T23:46:30.059124+0000","last_active":"2024-06-02T23:46:32.520095+0000","last_peered":"2024-06-02T23:46:32.520095+0000","last_clean":"2024-06-02T23:46:32.520095+0000","last_became_active":"2024-06-02T23:46:30.058701+0000","last_became_peered":"2024-06-02T23:46:30.058701+0000","last_unstale":"2024-06-02T23:46:32.520095+0000","last_undegraded":"2024-06-02T23:46:32.520095+0000","last_fullsized":"2024-06-02T23:46:32.520095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:03:32.967430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520137+0000","last_change":"2024-06-02T23:46:30.060519+0000","last_active":"2024-06-02T23:46:32.520137+0000","last_peered":"2024-06-02T23:46:32.520137+0000","last_clean":"2024-06-02T23:46:32.520137+0000","last_became_active":"2024-06-02T23:46:30.060121+0000","last_became_peered":"2024-06-02T23:46:30.060121+0000","last_unstale":"2024-06-02T23:46:32.520137+0000","last_undegraded":"2024-06-02T23:46:32.520137+0000","last_fullsized":"2024-06-02T23:46:32.520137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:10.654147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518734+0000","last_change":"2024-06-02T23:46:25.732314+0000","last_active":"2024-06-02T23:46:32.518734+0000","last_peered":"2024-06-02T23:46:32.518734+0000","last_clean":"2024-06-02T23:46:32.518734+0000","last_became_active":"2024-06-02T23:46:25.732022+0000","last_became_peered":"2024-06-02T23:46:25.732022+0000","last_unstale":"2024-06-02T23:46:32.518734+0000","last_undegraded":"2024-06-02T23:46:32.518734+0000","last_fullsized":"2024-06-02T23:46:32.518734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019991+0000","last_change":"2024-06-02T23:46:24.716182+0000","last_active":"2024-06-02T23:46:32.019991+0000","last_peered":"2024-06-02T23:46:32.019991+0000","last_clean":"2024-06-02T23:46:32.019991+0000","last_became_active":"2024-06-02T23:46:24.715906+0000","last_became_peered":"2024-06-02T23:46:24.715906+0000","last_unstale":"2024-06-02T23:46:32.019991+0000","last_undegraded":"2024-06-02T23:46:32.019991+0000","last_fullsized":"2024-06-02T23:46:32.019991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519713+0000","last_change":"2024-06-02T23:46:29.750554+0000","last_active":"2024-06-02T23:46:32.519713+0000","last_peered":"2024-06-02T23:46:32.519713+0000","last_clean":"2024-06-02T23:46:32.519713+0000","last_became_active":"2024-06-02T23:46:29.750212+0000","last_became_peered":"2024-06-02T23:46:29.750212+0000","last_unstale":"2024-06-02T23:46:32.519713+0000","last_undegraded":"2024-06-02T23:46:32.519713+0000","last_fullsized":"2024-06-02T23:46:32.519713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:24.838590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520102+0000","last_change":"2024-06-02T23:46:25.730716+0000","last_active":"2024-06-02T23:46:32.520102+0000","last_peered":"2024-06-02T23:46:32.520102+0000","last_clean":"2024-06-02T23:46:32.520102+0000","last_became_active":"2024-06-02T23:46:25.730447+0000","last_became_peered":"2024-06-02T23:46:25.730447+0000","last_unstale":"2024-06-02T23:46:32.520102+0000","last_undegraded":"2024-06-02T23:46:32.520102+0000","last_fullsized":"2024-06-02T23:46:32.520102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520355+0000","last_change":"2024-06-02T23:46:24.718681+0000","last_active":"2024-06-02T23:46:32.520355+0000","last_peered":"2024-06-02T23:46:32.520355+0000","last_clean":"2024-06-02T23:46:32.520355+0000","last_became_active":"2024-06-02T23:46:24.717312+0000","last_became_peered":"2024-06-02T23:46:24.717312+0000","last_unstale":"2024-06-02T23:46:32.520355+0000","last_undegraded":"2024-06-02T23:46:32.520355+0000","last_fullsized":"2024-06-02T23:46:32.520355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:53.696691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520419+0000","last_change":"2024-06-02T23:46:24.719033+0000","last_active":"2024-06-02T23:46:32.520419+0000","last_peered":"2024-06-02T23:46:32.520419+0000","last_clean":"2024-06-02T23:46:32.520419+0000","last_became_active":"2024-06-02T23:46:24.718726+0000","last_became_peered":"2024-06-02T23:46:24.718726+0000","last_unstale":"2024-06-02T23:46:32.520419+0000","last_undegraded":"2024-06-02T23:46:32.520419+0000","last_fullsized":"2024-06-02T23:46:32.520419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520671+0000","last_change":"2024-06-02T23:46:25.714066+0000","last_active":"2024-06-02T23:46:32.520671+0000","last_peered":"2024-06-02T23:46:32.520671+0000","last_clean":"2024-06-02T23:46:32.520671+0000","last_became_active":"2024-06-02T23:46:25.713761+0000","last_became_peered":"2024-06-02T23:46:25.713761+0000","last_unstale":"2024-06-02T23:46:32.520671+0000","last_undegraded":"2024-06-02T23:46:32.520671+0000","last_fullsized":"2024-06-02T23:46:32.520671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760380+0000","last_change":"2024-06-02T23:46:29.745968+0000","last_active":"2024-06-02T23:46:30.760380+0000","last_peered":"2024-06-02T23:46:30.760380+0000","last_clean":"2024-06-02T23:46:30.760380+0000","last_became_active":"2024-06-02T23:46:29.745547+0000","last_became_peered":"2024-06-02T23:46:29.745547+0000","last_unstale":"2024-06-02T23:46:30.760380+0000","last_undegraded":"2024-06-02T23:46:30.760380+0000","last_fullsized":"2024-06-02T23:46:30.760380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:14.777955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519569+0000","last_change":"2024-06-02T23:46:24.724513+0000","last_active":"2024-06-02T23:46:32.519569+0000","last_peered":"2024-06-02T23:46:32.519569+0000","last_clean":"2024-06-02T23:46:32.519569+0000","last_became_active":"2024-06-02T23:46:24.723129+0000","last_became_peered":"2024-06-02T23:46:24.723129+0000","last_unstale":"2024-06-02T23:46:32.519569+0000","last_undegraded":"2024-06-02T23:46:32.519569+0000","last_fullsized":"2024-06-02T23:46:32.519569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761185+0000","last_change":"2024-06-02T23:46:25.728059+0000","last_active":"2024-06-02T23:46:30.761185+0000","last_peered":"2024-06-02T23:46:30.761185+0000","last_clean":"2024-06-02T23:46:30.761185+0000","last_became_active":"2024-06-02T23:46:25.726707+0000","last_became_peered":"2024-06-02T23:46:25.726707+0000","last_unstale":"2024-06-02T23:46:30.761185+0000","last_undegraded":"2024-06-02T23:46:30.761185+0000","last_fullsized":"2024-06-02T23:46:30.761185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:28.357265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520439+0000","last_change":"2024-06-02T23:46:29.751586+0000","last_active":"2024-06-02T23:46:32.520439+0000","last_peered":"2024-06-02T23:46:32.520439+0000","last_clean":"2024-06-02T23:46:32.520439+0000","last_became_active":"2024-06-02T23:46:29.751242+0000","last_became_peered":"2024-06-02T23:46:29.751242+0000","last_unstale":"2024-06-02T23:46:32.520439+0000","last_undegraded":"2024-06-02T23:46:32.520439+0000","last_fullsized":"2024-06-02T23:46:32.520439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:44.019486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519290+0000","last_change":"2024-06-02T23:46:25.724423+0000","last_active":"2024-06-02T23:46:32.519290+0000","last_peered":"2024-06-02T23:46:32.519290+0000","last_clean":"2024-06-02T23:46:32.519290+0000","last_became_active":"2024-06-02T23:46:25.723880+0000","last_became_peered":"2024-06-02T23:46:25.723880+0000","last_unstale":"2024-06-02T23:46:32.519290+0000","last_undegraded":"2024-06-02T23:46:32.519290+0000","last_fullsized":"2024-06-02T23:46:32.519290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760154+0000","last_change":"2024-06-02T23:46:25.733710+0000","last_active":"2024-06-02T23:46:30.760154+0000","last_peered":"2024-06-02T23:46:30.760154+0000","last_clean":"2024-06-02T23:46:30.760154+0000","last_became_active":"2024-06-02T23:46:25.733419+0000","last_became_peered":"2024-06-02T23:46:25.733419+0000","last_unstale":"2024-06-02T23:46:30.760154+0000","last_undegraded":"2024-06-02T23:46:30.760154+0000","last_fullsized":"2024-06-02T23:46:30.760154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:23.259628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020177+0000","last_change":"2024-06-02T23:46:25.732210+0000","last_active":"2024-06-02T23:46:32.020177+0000","last_peered":"2024-06-02T23:46:32.020177+0000","last_clean":"2024-06-02T23:46:32.020177+0000","last_became_active":"2024-06-02T23:46:25.731930+0000","last_became_peered":"2024-06-02T23:46:25.731930+0000","last_unstale":"2024-06-02T23:46:32.020177+0000","last_undegraded":"2024-06-02T23:46:32.020177+0000","last_fullsized":"2024-06-02T23:46:32.020177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520584+0000","last_change":"2024-06-02T23:46:25.733626+0000","last_active":"2024-06-02T23:46:32.520584+0000","last_peered":"2024-06-02T23:46:32.520584+0000","last_clean":"2024-06-02T23:46:32.520584+0000","last_became_active":"2024-06-02T23:46:25.733343+0000","last_became_peered":"2024-06-02T23:46:25.733343+0000","last_unstale":"2024-06-02T23:46:32.520584+0000","last_undegraded":"2024-06-02T23:46:32.520584+0000","last_fullsized":"2024-06-02T23:46:32.520584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520773+0000","last_change":"2024-06-02T23:46:25.730607+0000","last_active":"2024-06-02T23:46:32.520773+0000","last_peered":"2024-06-02T23:46:32.520773+0000","last_clean":"2024-06-02T23:46:32.520773+0000","last_became_active":"2024-06-02T23:46:25.728526+0000","last_became_peered":"2024-06-02T23:46:25.728526+0000","last_unstale":"2024-06-02T23:46:32.520773+0000","last_undegraded":"2024-06-02T23:46:32.520773+0000","last_fullsized":"2024-06-02T23:46:32.520773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520287+0000","last_change":"2024-06-02T23:46:25.732586+0000","last_active":"2024-06-02T23:46:32.520287+0000","last_peered":"2024-06-02T23:46:32.520287+0000","last_clean":"2024-06-02T23:46:32.520287+0000","last_became_active":"2024-06-02T23:46:25.732332+0000","last_became_peered":"2024-06-02T23:46:25.732332+0000","last_unstale":"2024-06-02T23:46:32.520287+0000","last_undegraded":"2024-06-02T23:46:32.520287+0000","last_fullsized":"2024-06-02T23:46:32.520287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520449+0000","last_change":"2024-06-02T23:46:25.726741+0000","last_active":"2024-06-02T23:46:32.520449+0000","last_peered":"2024-06-02T23:46:32.520449+0000","last_clean":"2024-06-02T23:46:32.520449+0000","last_became_active":"2024-06-02T23:46:25.726480+0000","last_became_peered":"2024-06-02T23:46:25.726480+0000","last_unstale":"2024-06-02T23:46:32.520449+0000","last_undegraded":"2024-06-02T23:46:32.520449+0000","last_fullsized":"2024-06-02T23:46:32.520449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519721+0000","last_change":"2024-06-02T23:46:25.732734+0000","last_active":"2024-06-02T23:46:32.519721+0000","last_peered":"2024-06-02T23:46:32.519721+0000","last_clean":"2024-06-02T23:46:32.519721+0000","last_became_active":"2024-06-02T23:46:25.732444+0000","last_became_peered":"2024-06-02T23:46:25.732444+0000","last_unstale":"2024-06-02T23:46:32.519721+0000","last_undegraded":"2024-06-02T23:46:32.519721+0000","last_fullsized":"2024-06-02T23:46:32.519721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019988+0000","last_change":"2024-06-02T23:46:25.733224+0000","last_active":"2024-06-02T23:46:32.019988+0000","last_peered":"2024-06-02T23:46:32.019988+0000","last_clean":"2024-06-02T23:46:32.019988+0000","last_became_active":"2024-06-02T23:46:25.732945+0000","last_became_peered":"2024-06-02T23:46:25.732945+0000","last_unstale":"2024-06-02T23:46:32.019988+0000","last_undegraded":"2024-06-02T23:46:32.019988+0000","last_fullsized":"2024-06-02T23:46:32.019988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520271+0000","last_change":"2024-06-02T23:46:25.727647+0000","last_active":"2024-06-02T23:46:32.520271+0000","last_peered":"2024-06-02T23:46:32.520271+0000","last_clean":"2024-06-02T23:46:32.520271+0000","last_became_active":"2024-06-02T23:46:25.727364+0000","last_became_peered":"2024-06-02T23:46:25.727364+0000","last_unstale":"2024-06-02T23:46:32.520271+0000","last_undegraded":"2024-06-02T23:46:32.520271+0000","last_fullsized":"2024-06-02T23:46:32.520271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020096+0000","last_change":"2024-06-02T23:46:25.727678+0000","last_active":"2024-06-02T23:46:32.020096+0000","last_peered":"2024-06-02T23:46:32.020096+0000","last_clean":"2024-06-02T23:46:32.020096+0000","last_became_active":"2024-06-02T23:46:25.727392+0000","last_became_peered":"2024-06-02T23:46:25.727392+0000","last_unstale":"2024-06-02T23:46:32.020096+0000","last_undegraded":"2024-06-02T23:46:32.020096+0000","last_fullsized":"2024-06-02T23:46:32.020096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519179+0000","last_change":"2024-06-02T23:46:25.722139+0000","last_active":"2024-06-02T23:46:32.519179+0000","last_peered":"2024-06-02T23:46:32.519179+0000","last_clean":"2024-06-02T23:46:32.519179+0000","last_became_active":"2024-06-02T23:46:25.721804+0000","last_became_peered":"2024-06-02T23:46:25.721804+0000","last_unstale":"2024-06-02T23:46:32.519179+0000","last_undegraded":"2024-06-02T23:46:32.519179+0000","last_fullsized":"2024-06-02T23:46:32.519179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519769+0000","last_change":"2024-06-02T23:46:25.728123+0000","last_active":"2024-06-02T23:46:32.519769+0000","last_peered":"2024-06-02T23:46:32.519769+0000","last_clean":"2024-06-02T23:46:32.519769+0000","last_became_active":"2024-06-02T23:46:25.727805+0000","last_became_peered":"2024-06-02T23:46:25.727805+0000","last_unstale":"2024-06-02T23:46:32.519769+0000","last_undegraded":"2024-06-02T23:46:32.519769+0000","last_fullsized":"2024-06-02T23:46:32.519769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520780+0000","last_change":"2024-06-02T23:46:25.735497+0000","last_active":"2024-06-02T23:46:32.520780+0000","last_peered":"2024-06-02T23:46:32.520780+0000","last_clean":"2024-06-02T23:46:32.520780+0000","last_became_active":"2024-06-02T23:46:25.734887+0000","last_became_peered":"2024-06-02T23:46:25.734887+0000","last_unstale":"2024-06-02T23:46:32.520780+0000","last_undegraded":"2024-06-02T23:46:32.520780+0000","last_fullsized":"2024-06-02T23:46:32.520780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:20.812410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760496+0000","last_change":"2024-06-02T23:46:25.734490+0000","last_active":"2024-06-02T23:46:30.760496+0000","last_peered":"2024-06-02T23:46:30.760496+0000","last_clean":"2024-06-02T23:46:30.760496+0000","last_became_active":"2024-06-02T23:46:25.734206+0000","last_became_peered":"2024-06-02T23:46:25.734206+0000","last_unstale":"2024-06-02T23:46:30.760496+0000","last_undegraded":"2024-06-02T23:46:30.760496+0000","last_fullsized":"2024-06-02T23:46:30.760496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:08.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020711+0000","last_change":"2024-06-02T23:46:25.736811+0000","last_active":"2024-06-02T23:46:32.020711+0000","last_peered":"2024-06-02T23:46:32.020711+0000","last_clean":"2024-06-02T23:46:32.020711+0000","last_became_active":"2024-06-02T23:46:25.736568+0000","last_became_peered":"2024-06-02T23:46:25.736568+0000","last_unstale":"2024-06-02T23:46:32.020711+0000","last_undegraded":"2024-06-02T23:46:32.020711+0000","last_fullsized":"2024-06-02T23:46:32.020711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:55.355993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019835+0000","last_change":"2024-06-02T23:46:25.722197+0000","last_active":"2024-06-02T23:46:32.019835+0000","last_peered":"2024-06-02T23:46:32.019835+0000","last_clean":"2024-06-02T23:46:32.019835+0000","last_became_active":"2024-06-02T23:46:25.721911+0000","last_became_peered":"2024-06-02T23:46:25.721911+0000","last_unstale":"2024-06-02T23:46:32.019835+0000","last_undegraded":"2024-06-02T23:46:32.019835+0000","last_fullsized":"2024-06-02T23:46:32.019835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518775+0000","last_change":"2024-06-02T23:46:25.727178+0000","last_active":"2024-06-02T23:46:32.518775+0000","last_peered":"2024-06-02T23:46:32.518775+0000","last_clean":"2024-06-02T23:46:32.518775+0000","last_became_active":"2024-06-02T23:46:25.726888+0000","last_became_peered":"2024-06-02T23:46:25.726888+0000","last_unstale":"2024-06-02T23:46:32.518775+0000","last_undegraded":"2024-06-02T23:46:32.518775+0000","last_fullsized":"2024-06-02T23:46:32.518775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519434+0000","last_change":"2024-06-02T23:46:25.725940+0000","last_active":"2024-06-02T23:46:32.519434+0000","last_peered":"2024-06-02T23:46:32.519434+0000","last_clean":"2024-06-02T23:46:32.519434+0000","last_became_active":"2024-06-02T23:46:25.725534+0000","last_became_peered":"2024-06-02T23:46:25.725534+0000","last_unstale":"2024-06-02T23:46:32.519434+0000","last_undegraded":"2024-06-02T23:46:32.519434+0000","last_fullsized":"2024-06-02T23:46:32.519434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:32.885581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519416+0000","last_change":"2024-06-02T23:46:25.730569+0000","last_active":"2024-06-02T23:46:32.519416+0000","last_peered":"2024-06-02T23:46:32.519416+0000","last_clean":"2024-06-02T23:46:32.519416+0000","last_became_active":"2024-06-02T23:46:25.728481+0000","last_became_peered":"2024-06-02T23:46:25.728481+0000","last_unstale":"2024-06-02T23:46:32.519416+0000","last_undegraded":"2024-06-02T23:46:32.519416+0000","last_fullsized":"2024-06-02T23:46:32.519416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761074+0000","last_change":"2024-06-02T23:46:25.730619+0000","last_active":"2024-06-02T23:46:30.761074+0000","last_peered":"2024-06-02T23:46:30.761074+0000","last_clean":"2024-06-02T23:46:30.761074+0000","last_became_active":"2024-06-02T23:46:25.730319+0000","last_became_peered":"2024-06-02T23:46:25.730319+0000","last_unstale":"2024-06-02T23:46:30.761074+0000","last_undegraded":"2024-06-02T23:46:30.761074+0000","last_fullsized":"2024-06-02T23:46:30.761074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:08.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520090+0000","last_change":"2024-06-02T23:46:25.733651+0000","last_active":"2024-06-02T23:46:32.520090+0000","last_peered":"2024-06-02T23:46:32.520090+0000","last_clean":"2024-06-02T23:46:32.520090+0000","last_became_active":"2024-06-02T23:46:25.733349+0000","last_became_peered":"2024-06-02T23:46:25.733349+0000","last_unstale":"2024-06-02T23:46:32.520090+0000","last_undegraded":"2024-06-02T23:46:32.520090+0000","last_fullsized":"2024-06-02T23:46:32.520090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520283+0000","last_change":"2024-06-02T23:46:25.727878+0000","last_active":"2024-06-02T23:46:32.520283+0000","last_peered":"2024-06-02T23:46:32.520283+0000","last_clean":"2024-06-02T23:46:32.520283+0000","last_became_active":"2024-06-02T23:46:25.727594+0000","last_became_peered":"2024-06-02T23:46:25.727594+0000","last_unstale":"2024-06-02T23:46:32.520283+0000","last_undegraded":"2024-06-02T23:46:32.520283+0000","last_fullsized":"2024-06-02T23:46:32.520283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520435+0000","last_change":"2024-06-02T23:46:25.734791+0000","last_active":"2024-06-02T23:46:32.520435+0000","last_peered":"2024-06-02T23:46:32.520435+0000","last_clean":"2024-06-02T23:46:32.520435+0000","last_became_active":"2024-06-02T23:46:25.734514+0000","last_became_peered":"2024-06-02T23:46:25.734514+0000","last_unstale":"2024-06-02T23:46:32.520435+0000","last_undegraded":"2024-06-02T23:46:32.520435+0000","last_fullsized":"2024-06-02T23:46:32.520435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:09.854508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519886+0000","last_change":"2024-06-02T23:46:25.736896+0000","last_active":"2024-06-02T23:46:32.519886+0000","last_peered":"2024-06-02T23:46:32.519886+0000","last_clean":"2024-06-02T23:46:32.519886+0000","last_became_active":"2024-06-02T23:46:25.736216+0000","last_became_peered":"2024-06-02T23:46:25.736216+0000","last_unstale":"2024-06-02T23:46:32.519886+0000","last_undegraded":"2024-06-02T23:46:32.519886+0000","last_fullsized":"2024-06-02T23:46:32.519886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:10.751775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519694+0000","last_change":"2024-06-02T23:46:25.723384+0000","last_active":"2024-06-02T23:46:32.519694+0000","last_peered":"2024-06-02T23:46:32.519694+0000","last_clean":"2024-06-02T23:46:32.519694+0000","last_became_active":"2024-06-02T23:46:25.722938+0000","last_became_peered":"2024-06-02T23:46:25.722938+0000","last_unstale":"2024-06-02T23:46:32.519694+0000","last_undegraded":"2024-06-02T23:46:32.519694+0000","last_fullsized":"2024-06-02T23:46:32.519694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020020+0000","last_change":"2024-06-02T23:46:25.729629+0000","last_active":"2024-06-02T23:46:32.020020+0000","last_peered":"2024-06-02T23:46:32.020020+0000","last_clean":"2024-06-02T23:46:32.020020+0000","last_became_active":"2024-06-02T23:46:25.729363+0000","last_became_peered":"2024-06-02T23:46:25.729363+0000","last_unstale":"2024-06-02T23:46:32.020020+0000","last_undegraded":"2024-06-02T23:46:32.020020+0000","last_fullsized":"2024-06-02T23:46:32.020020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520515+0000","last_change":"2024-06-02T23:46:25.734931+0000","last_active":"2024-06-02T23:46:32.520515+0000","last_peered":"2024-06-02T23:46:32.520515+0000","last_clean":"2024-06-02T23:46:32.520515+0000","last_became_active":"2024-06-02T23:46:25.734577+0000","last_became_peered":"2024-06-02T23:46:25.734577+0000","last_unstale":"2024-06-02T23:46:32.520515+0000","last_undegraded":"2024-06-02T23:46:32.520515+0000","last_fullsized":"2024-06-02T23:46:32.520515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:06.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020302+0000","last_change":"2024-06-02T23:46:25.732610+0000","last_active":"2024-06-02T23:46:32.020302+0000","last_peered":"2024-06-02T23:46:32.020302+0000","last_clean":"2024-06-02T23:46:32.020302+0000","last_became_active":"2024-06-02T23:46:25.731714+0000","last_became_peered":"2024-06-02T23:46:25.731714+0000","last_unstale":"2024-06-02T23:46:32.020302+0000","last_undegraded":"2024-06-02T23:46:32.020302+0000","last_fullsized":"2024-06-02T23:46:32.020302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519731+0000","last_change":"2024-06-02T23:46:25.729533+0000","last_active":"2024-06-02T23:46:32.519731+0000","last_peered":"2024-06-02T23:46:32.519731+0000","last_clean":"2024-06-02T23:46:32.519731+0000","last_became_active":"2024-06-02T23:46:25.729234+0000","last_became_peered":"2024-06-02T23:46:25.729234+0000","last_unstale":"2024-06-02T23:46:32.519731+0000","last_undegraded":"2024-06-02T23:46:32.519731+0000","last_fullsized":"2024-06-02T23:46:32.519731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519199+0000","last_change":"2024-06-02T23:46:25.727031+0000","last_active":"2024-06-02T23:46:32.519199+0000","last_peered":"2024-06-02T23:46:32.519199+0000","last_clean":"2024-06-02T23:46:32.519199+0000","last_became_active":"2024-06-02T23:46:25.726700+0000","last_became_peered":"2024-06-02T23:46:25.726700+0000","last_unstale":"2024-06-02T23:46:32.519199+0000","last_undegraded":"2024-06-02T23:46:32.519199+0000","last_fullsized":"2024-06-02T23:46:32.519199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520212+0000","last_change":"2024-06-02T23:46:25.731930+0000","last_active":"2024-06-02T23:46:32.520212+0000","last_peered":"2024-06-02T23:46:32.520212+0000","last_clean":"2024-06-02T23:46:32.520212+0000","last_became_active":"2024-06-02T23:46:25.730679+0000","last_became_peered":"2024-06-02T23:46:25.730679+0000","last_unstale":"2024-06-02T23:46:32.520212+0000","last_undegraded":"2024-06-02T23:46:32.520212+0000","last_fullsized":"2024-06-02T23:46:32.520212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:12.887235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:46:50.158 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:46:50.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.292+0000 7f4cc88dd640 1 Processor -- start 2024-06-02T23:46:50.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.292+0000 7f4cc88dd640 1 -- start start 2024-06-02T23:46:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.293+0000 7f4cc88dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4cc40d1120 0x7f4cc40c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.293+0000 7f4cc88dd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4cc40b5510 0x7f4cc40c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.293+0000 7f4cc88dd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc40d4a90 con 0x7f4cc4161900 2024-06-02T23:46:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.293+0000 7f4cc88dd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc40cf5c0 con 0x7f4cc40b5510 2024-06-02T23:46:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.293+0000 7f4cc88dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc40caf70 con 0x7f4cc40d1120 2024-06-02T23:46:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.293+0000 7f4cc2d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4cc40b5510 0x7f4cc40c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.293+0000 7f4cc2d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4cc40b5510 0x7f4cc40c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55070/0 (socket says 172.21.15.96:55070) 2024-06-02T23:46:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.294+0000 7f4cc2d9d640 1 -- 172.21.15.96:0/3317522529 learned_addr learned my addr 172.21.15.96:0/3317522529 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.294+0000 7f4cc1d9b640 1 --2- 172.21.15.96:0/3317522529 >> v2:172.21.15.162:3300/0 conn(0x7f4cc40d1120 0x7f4cc40c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.294+0000 7f4cc2d9d640 1 -- 172.21.15.96:0/3317522529 >> v2:172.21.15.162:3300/0 conn(0x7f4cc40d1120 msgr2=0x7f4cc40c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.294+0000 7f4cc2d9d640 1 --2- 172.21.15.96:0/3317522529 >> v2:172.21.15.162:3300/0 conn(0x7f4cc40d1120 0x7f4cc40c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.294+0000 7f4cc2d9d640 1 -- 172.21.15.96:0/3317522529 >> v1:172.21.15.162:6789/0 conn(0x7f4cc4161900 legacy=0x7f4cc40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.294+0000 7f4cc2d9d640 1 -- 172.21.15.96:0/3317522529 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc40d4d70 con 0x7f4cc40b5510 2024-06-02T23:46:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.294+0000 7f4cc2d9d640 1 --2- 172.21.15.96:0/3317522529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc40b5510 0x7f4cc40c8100 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4cc408cc80 tx=0x7f4cbc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985cccc3879da2d7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc159a640 1 -- 172.21.15.96:0/3317522529 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc037070 con 0x7f4cc40b5510 2024-06-02T23:46:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc159a640 1 -- 172.21.15.96:0/3317522529 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc032440 con 0x7f4cc40b5510 2024-06-02T23:46:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc159a640 1 -- 172.21.15.96:0/3317522529 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc032810 con 0x7f4cc40b5510 2024-06-02T23:46:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc88dd640 1 -- 172.21.15.96:0/3317522529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc40b5510 msgr2=0x7f4cc40c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc88dd640 1 --2- 172.21.15.96:0/3317522529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc40b5510 0x7f4cc40c8100 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4cc408cc80 tx=0x7f4cbc02a1e0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc88dd640 1 -- 172.21.15.96:0/3317522529 shutdown_connections 2024-06-02T23:46:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc88dd640 1 --2- 172.21.15.96:0/3317522529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc40b5510 0x7f4cc40c8100 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc88dd640 1 --2- 172.21.15.96:0/3317522529 >> v2:172.21.15.162:3300/0 conn(0x7f4cc40d1120 0x7f4cc40c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc88dd640 1 -- 172.21.15.96:0/3317522529 >> 172.21.15.96:0/3317522529 conn(0x7f4cc409d3b0 msgr2=0x7f4cc40d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc88dd640 1 -- 172.21.15.96:0/3317522529 shutdown_connections 2024-06-02T23:46:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.295+0000 7f4cc88dd640 1 -- 172.21.15.96:0/3317522529 wait complete. 2024-06-02T23:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.297+0000 7f4cc88dd640 1 Processor -- start 2024-06-02T23:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.297+0000 7f4cc88dd640 1 -- start start 2024-06-02T23:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.297+0000 7f4cc88dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc40b5510 0x7f4cc40cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.297+0000 7f4cc88dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cc40d1120 0x7f4cc4159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.297+0000 7f4cc88dd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc4161900 0x7f4cc406d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.297+0000 7f4cc88dd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc40d4780 con 0x7f4cc4161900 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.297+0000 7f4cc88dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc40cfae0 con 0x7f4cc40b5510 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.297+0000 7f4cc88dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc4161ce0 con 0x7f4cc40d1120 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc2d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc4161900 0x7f4cc406d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc2d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc4161900 0x7f4cc406d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55082/0 (socket says 172.21.15.96:55082) 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc2d9d640 1 -- 172.21.15.96:0/792897629 learned_addr learned my addr 172.21.15.96:0/792897629 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc1d9b640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cc40d1120 0x7f4cc4159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc259c640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc40b5510 0x7f4cc40cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc2d9d640 1 -- 172.21.15.96:0/792897629 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cc40d1120 msgr2=0x7f4cc4159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc2d9d640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cc40d1120 0x7f4cc4159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc2d9d640 1 -- 172.21.15.96:0/792897629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc40b5510 msgr2=0x7f4cc40cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc2d9d640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc40b5510 0x7f4cc40cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc2d9d640 1 -- 172.21.15.96:0/792897629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc4159f70 con 0x7f4cc4161900 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc2d9d640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc4161900 0x7f4cc406d4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0090b0 tx=0x7f4cbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cbaffd640 1 -- 172.21.15.96:0/792897629 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc041020 con 0x7f4cc4161900 2024-06-02T23:46:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cbaffd640 1 -- 172.21.15.96:0/792897629 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc03d620 con 0x7f4cc4161900 2024-06-02T23:46:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc88dd640 1 -- 172.21.15.96:0/792897629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc415a2a0 con 0x7f4cc4161900 2024-06-02T23:46:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cbaffd640 1 -- 172.21.15.96:0/792897629 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc037040 con 0x7f4cc4161900 2024-06-02T23:46:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.298+0000 7f4cc88dd640 1 -- 172.21.15.96:0/792897629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc415aae0 con 0x7f4cc4161900 2024-06-02T23:46:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.299+0000 7f4cc88dd640 1 -- 172.21.15.96:0/792897629 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc415a630 con 0x7f4cc4161900 2024-06-02T23:46:50.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.300+0000 7f4cbaffd640 1 -- 172.21.15.96:0/792897629 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cbc044020 con 0x7f4cc4161900 2024-06-02T23:46:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.300+0000 7f4cbaffd640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4ca406be30 0x7f4ca406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.300+0000 7f4cc259c640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4ca406be30 0x7f4ca406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.300+0000 7f4cbaffd640 1 -- 172.21.15.96:0/792897629 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4cbc0aba20 con 0x7f4cc4161900 2024-06-02T23:46:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.301+0000 7f4cc259c640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4ca406be30 0x7f4ca406e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4001ca0 tx=0x7f4cb4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.305+0000 7f4cbaffd640 1 -- 172.21.15.96:0/792897629 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4cbc04b030 con 0x7f4cc4161900 2024-06-02T23:46:50.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.478+0000 7f4cc88dd640 1 -- 172.21.15.96:0/792897629 --> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4cc40683e0 con 0x7f4ca406be30 2024-06-02T23:46:50.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.485+0000 7f4cbaffd640 1 -- 172.21.15.96:0/792897629 <== mgr.4113 v2:172.21.15.96:6832/1776728888 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f4cc40683e0 con 0x7f4ca406be30 2024-06-02T23:46:50.489 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:50.490 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 -- 172.21.15.96:0/792897629 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4ca406be30 msgr2=0x7f4ca406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4ca406be30 0x7f4ca406e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4001ca0 tx=0x7f4cb4009040 comp rx=0 tx=0).stop 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 -- 172.21.15.96:0/792897629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc4161900 msgr2=0x7f4cc406d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc4161900 0x7f4cc406d4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc0090b0 tx=0x7f4cbc0046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 -- 172.21.15.96:0/792897629 shutdown_connections 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4ca406be30 0x7f4ca406e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4cc4161900 0x7f4cc406d4c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cc40d1120 0x7f4cc4159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 --2- 172.21.15.96:0/792897629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cc40b5510 0x7f4cc40cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 -- 172.21.15.96:0/792897629 >> 172.21.15.96:0/792897629 conn(0x7f4cc409d3b0 msgr2=0x7f4cc40d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 -- 172.21.15.96:0/792897629 shutdown_connections 2024-06-02T23:46:50.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.489+0000 7f4cc88dd640 1 -- 172.21.15.96:0/792897629 wait complete. 2024-06-02T23:46:50.500 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-06-02T23:46:49.999299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002692"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519975+0000","last_change":"2024-06-02T23:46:24.723386+0000","last_active":"2024-06-02T23:46:32.519975+0000","last_peered":"2024-06-02T23:46:32.519975+0000","last_clean":"2024-06-02T23:46:32.519975+0000","last_became_active":"2024-06-02T23:46:24.723072+0000","last_became_peered":"2024-06-02T23:46:24.723072+0000","last_unstale":"2024-06-02T23:46:32.519975+0000","last_undegraded":"2024-06-02T23:46:32.519975+0000","last_fullsized":"2024-06-02T23:46:32.519975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:58.156345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519324+0000","last_change":"2024-06-02T23:46:25.728192+0000","last_active":"2024-06-02T23:46:32.519324+0000","last_peered":"2024-06-02T23:46:32.519324+0000","last_clean":"2024-06-02T23:46:32.519324+0000","last_became_active":"2024-06-02T23:46:25.727880+0000","last_became_peered":"2024-06-02T23:46:25.727880+0000","last_unstale":"2024-06-02T23:46:32.519324+0000","last_undegraded":"2024-06-02T23:46:32.519324+0000","last_fullsized":"2024-06-02T23:46:32.519324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519956+0000","last_change":"2024-06-02T23:46:30.061087+0000","last_active":"2024-06-02T23:46:32.519956+0000","last_peered":"2024-06-02T23:46:32.519956+0000","last_clean":"2024-06-02T23:46:32.519956+0000","last_became_active":"2024-06-02T23:46:30.060610+0000","last_became_peered":"2024-06-02T23:46:30.060610+0000","last_unstale":"2024-06-02T23:46:32.519956+0000","last_undegraded":"2024-06-02T23:46:32.519956+0000","last_fullsized":"2024-06-02T23:46:32.519956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:12:13.834338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519480+0000","last_change":"2024-06-02T23:46:24.719079+0000","last_active":"2024-06-02T23:46:32.519480+0000","last_peered":"2024-06-02T23:46:32.519480+0000","last_clean":"2024-06-02T23:46:32.519480+0000","last_became_active":"2024-06-02T23:46:24.718645+0000","last_became_peered":"2024-06-02T23:46:24.718645+0000","last_unstale":"2024-06-02T23:46:32.519480+0000","last_undegraded":"2024-06-02T23:46:32.519480+0000","last_fullsized":"2024-06-02T23:46:32.519480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:17:58.156345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519654+0000","last_change":"2024-06-02T23:46:25.726015+0000","last_active":"2024-06-02T23:46:32.519654+0000","last_peered":"2024-06-02T23:46:32.519654+0000","last_clean":"2024-06-02T23:46:32.519654+0000","last_became_active":"2024-06-02T23:46:25.725730+0000","last_became_peered":"2024-06-02T23:46:25.725730+0000","last_unstale":"2024-06-02T23:46:32.519654+0000","last_undegraded":"2024-06-02T23:46:32.519654+0000","last_fullsized":"2024-06-02T23:46:32.519654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:10.751775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761052+0000","last_change":"2024-06-02T23:46:29.747259+0000","last_active":"2024-06-02T23:46:30.761052+0000","last_peered":"2024-06-02T23:46:30.761052+0000","last_clean":"2024-06-02T23:46:30.761052+0000","last_became_active":"2024-06-02T23:46:29.746814+0000","last_became_peered":"2024-06-02T23:46:29.746814+0000","last_unstale":"2024-06-02T23:46:30.761052+0000","last_undegraded":"2024-06-02T23:46:30.761052+0000","last_fullsized":"2024-06-02T23:46:30.761052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:16.913415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520719+0000","last_change":"2024-06-02T23:46:24.728181+0000","last_active":"2024-06-02T23:46:32.520719+0000","last_peered":"2024-06-02T23:46:32.520719+0000","last_clean":"2024-06-02T23:46:32.520719+0000","last_became_active":"2024-06-02T23:46:24.727842+0000","last_became_peered":"2024-06-02T23:46:24.727842+0000","last_unstale":"2024-06-02T23:46:32.520719+0000","last_undegraded":"2024-06-02T23:46:32.520719+0000","last_fullsized":"2024-06-02T23:46:32.520719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020341+0000","last_change":"2024-06-02T23:46:25.725271+0000","last_active":"2024-06-02T23:46:32.020341+0000","last_peered":"2024-06-02T23:46:32.020341+0000","last_clean":"2024-06-02T23:46:32.020341+0000","last_became_active":"2024-06-02T23:46:25.725021+0000","last_became_peered":"2024-06-02T23:46:25.725021+0000","last_unstale":"2024-06-02T23:46:32.020341+0000","last_undegraded":"2024-06-02T23:46:32.020341+0000","last_fullsized":"2024-06-02T23:46:32.020341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:06.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760977+0000","last_change":"2024-06-02T23:46:29.747360+0000","last_active":"2024-06-02T23:46:30.760977+0000","last_peered":"2024-06-02T23:46:30.760977+0000","last_clean":"2024-06-02T23:46:30.760977+0000","last_became_active":"2024-06-02T23:46:29.746711+0000","last_became_peered":"2024-06-02T23:46:29.746711+0000","last_unstale":"2024-06-02T23:46:30.760977+0000","last_undegraded":"2024-06-02T23:46:30.760977+0000","last_fullsized":"2024-06-02T23:46:30.760977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:13.880688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519706+0000","last_change":"2024-06-02T23:46:24.728315+0000","last_active":"2024-06-02T23:46:32.519706+0000","last_peered":"2024-06-02T23:46:32.519706+0000","last_clean":"2024-06-02T23:46:32.519706+0000","last_became_active":"2024-06-02T23:46:24.728035+0000","last_became_peered":"2024-06-02T23:46:24.728035+0000","last_unstale":"2024-06-02T23:46:32.519706+0000","last_undegraded":"2024-06-02T23:46:32.519706+0000","last_fullsized":"2024-06-02T23:46:32.519706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020395+0000","last_change":"2024-06-02T23:46:25.725814+0000","last_active":"2024-06-02T23:46:32.020395+0000","last_peered":"2024-06-02T23:46:32.020395+0000","last_clean":"2024-06-02T23:46:32.020395+0000","last_became_active":"2024-06-02T23:46:25.725542+0000","last_became_peered":"2024-06-02T23:46:25.725542+0000","last_unstale":"2024-06-02T23:46:32.020395+0000","last_undegraded":"2024-06-02T23:46:32.020395+0000","last_fullsized":"2024-06-02T23:46:32.020395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:37.017923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760812+0000","last_change":"2024-06-02T23:46:29.748045+0000","last_active":"2024-06-02T23:46:30.760812+0000","last_peered":"2024-06-02T23:46:30.760812+0000","last_clean":"2024-06-02T23:46:30.760812+0000","last_became_active":"2024-06-02T23:46:29.747638+0000","last_became_peered":"2024-06-02T23:46:29.747638+0000","last_unstale":"2024-06-02T23:46:30.760812+0000","last_undegraded":"2024-06-02T23:46:30.760812+0000","last_fullsized":"2024-06-02T23:46:30.760812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:47.634910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520308+0000","last_change":"2024-06-02T23:46:25.724610+0000","last_active":"2024-06-02T23:46:32.520308+0000","last_peered":"2024-06-02T23:46:32.520308+0000","last_clean":"2024-06-02T23:46:32.520308+0000","last_became_active":"2024-06-02T23:46:25.724361+0000","last_became_peered":"2024-06-02T23:46:25.724361+0000","last_unstale":"2024-06-02T23:46:32.520308+0000","last_undegraded":"2024-06-02T23:46:32.520308+0000","last_fullsized":"2024-06-02T23:46:32.520308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520766+0000","last_change":"2024-06-02T23:46:24.725027+0000","last_active":"2024-06-02T23:46:32.520766+0000","last_peered":"2024-06-02T23:46:32.520766+0000","last_clean":"2024-06-02T23:46:32.520766+0000","last_became_active":"2024-06-02T23:46:24.724691+0000","last_became_peered":"2024-06-02T23:46:24.724691+0000","last_unstale":"2024-06-02T23:46:32.520766+0000","last_undegraded":"2024-06-02T23:46:32.520766+0000","last_fullsized":"2024-06-02T23:46:32.520766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:07.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761401+0000","last_change":"2024-06-02T23:46:29.750805+0000","last_active":"2024-06-02T23:46:30.761401+0000","last_peered":"2024-06-02T23:46:30.761401+0000","last_clean":"2024-06-02T23:46:30.761401+0000","last_became_active":"2024-06-02T23:46:29.750392+0000","last_became_peered":"2024-06-02T23:46:29.750392+0000","last_unstale":"2024-06-02T23:46:30.761401+0000","last_undegraded":"2024-06-02T23:46:30.761401+0000","last_fullsized":"2024-06-02T23:46:30.761401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519491+0000","last_change":"2024-06-02T23:46:25.730928+0000","last_active":"2024-06-02T23:46:32.519491+0000","last_peered":"2024-06-02T23:46:32.519491+0000","last_clean":"2024-06-02T23:46:32.519491+0000","last_became_active":"2024-06-02T23:46:25.730035+0000","last_became_peered":"2024-06-02T23:46:25.730035+0000","last_unstale":"2024-06-02T23:46:32.519491+0000","last_undegraded":"2024-06-02T23:46:32.519491+0000","last_fullsized":"2024-06-02T23:46:32.519491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519486+0000","last_change":"2024-06-02T23:46:24.726529+0000","last_active":"2024-06-02T23:46:32.519486+0000","last_peered":"2024-06-02T23:46:32.519486+0000","last_clean":"2024-06-02T23:46:32.519486+0000","last_became_active":"2024-06-02T23:46:24.726263+0000","last_became_peered":"2024-06-02T23:46:24.726263+0000","last_unstale":"2024-06-02T23:46:32.519486+0000","last_undegraded":"2024-06-02T23:46:32.519486+0000","last_fullsized":"2024-06-02T23:46:32.519486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:22.253427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760795+0000","last_change":"2024-06-02T23:46:29.747195+0000","last_active":"2024-06-02T23:46:30.760795+0000","last_peered":"2024-06-02T23:46:30.760795+0000","last_clean":"2024-06-02T23:46:30.760795+0000","last_became_active":"2024-06-02T23:46:29.746715+0000","last_became_peered":"2024-06-02T23:46:29.746715+0000","last_unstale":"2024-06-02T23:46:30.760795+0000","last_undegraded":"2024-06-02T23:46:30.760795+0000","last_fullsized":"2024-06-02T23:46:30.760795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:48.919181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520156+0000","last_change":"2024-06-02T23:46:25.730204+0000","last_active":"2024-06-02T23:46:32.520156+0000","last_peered":"2024-06-02T23:46:32.520156+0000","last_clean":"2024-06-02T23:46:32.520156+0000","last_became_active":"2024-06-02T23:46:25.728660+0000","last_became_peered":"2024-06-02T23:46:25.728660+0000","last_unstale":"2024-06-02T23:46:32.520156+0000","last_undegraded":"2024-06-02T23:46:32.520156+0000","last_fullsized":"2024-06-02T23:46:32.520156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518837+0000","last_change":"2024-06-02T23:46:24.725743+0000","last_active":"2024-06-02T23:46:32.518837+0000","last_peered":"2024-06-02T23:46:32.518837+0000","last_clean":"2024-06-02T23:46:32.518837+0000","last_became_active":"2024-06-02T23:46:24.725418+0000","last_became_peered":"2024-06-02T23:46:24.725418+0000","last_unstale":"2024-06-02T23:46:32.518837+0000","last_undegraded":"2024-06-02T23:46:32.518837+0000","last_fullsized":"2024-06-02T23:46:32.518837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:07.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520044+0000","last_change":"2024-06-02T23:46:30.062502+0000","last_active":"2024-06-02T23:46:32.520044+0000","last_peered":"2024-06-02T23:46:32.520044+0000","last_clean":"2024-06-02T23:46:32.520044+0000","last_became_active":"2024-06-02T23:46:30.062168+0000","last_became_peered":"2024-06-02T23:46:30.062168+0000","last_unstale":"2024-06-02T23:46:32.520044+0000","last_undegraded":"2024-06-02T23:46:32.520044+0000","last_fullsized":"2024-06-02T23:46:32.520044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:15.508248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761606+0000","last_change":"2024-06-02T23:46:25.729672+0000","last_active":"2024-06-02T23:46:30.761606+0000","last_peered":"2024-06-02T23:46:30.761606+0000","last_clean":"2024-06-02T23:46:30.761606+0000","last_became_active":"2024-06-02T23:46:25.729405+0000","last_became_peered":"2024-06-02T23:46:25.729405+0000","last_unstale":"2024-06-02T23:46:30.761606+0000","last_undegraded":"2024-06-02T23:46:30.761606+0000","last_fullsized":"2024-06-02T23:46:30.761606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:21.812182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519444+0000","last_change":"2024-06-02T23:46:24.725037+0000","last_active":"2024-06-02T23:46:32.519444+0000","last_peered":"2024-06-02T23:46:32.519444+0000","last_clean":"2024-06-02T23:46:32.519444+0000","last_became_active":"2024-06-02T23:46:24.724705+0000","last_became_peered":"2024-06-02T23:46:24.724705+0000","last_unstale":"2024-06-02T23:46:32.519444+0000","last_undegraded":"2024-06-02T23:46:32.519444+0000","last_fullsized":"2024-06-02T23:46:32.519444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760969+0000","last_change":"2024-06-02T23:46:29.745875+0000","last_active":"2024-06-02T23:46:30.760969+0000","last_peered":"2024-06-02T23:46:30.760969+0000","last_clean":"2024-06-02T23:46:30.760969+0000","last_became_active":"2024-06-02T23:46:29.745417+0000","last_became_peered":"2024-06-02T23:46:29.745417+0000","last_unstale":"2024-06-02T23:46:30.760969+0000","last_undegraded":"2024-06-02T23:46:30.760969+0000","last_fullsized":"2024-06-02T23:46:30.760969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:52.536406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520531+0000","last_change":"2024-06-02T23:46:25.726449+0000","last_active":"2024-06-02T23:46:32.520531+0000","last_peered":"2024-06-02T23:46:32.520531+0000","last_clean":"2024-06-02T23:46:32.520531+0000","last_became_active":"2024-06-02T23:46:25.725878+0000","last_became_peered":"2024-06-02T23:46:25.725878+0000","last_unstale":"2024-06-02T23:46:32.520531+0000","last_undegraded":"2024-06-02T23:46:32.520531+0000","last_fullsized":"2024-06-02T23:46:32.520531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520174+0000","last_change":"2024-06-02T23:46:24.723537+0000","last_active":"2024-06-02T23:46:32.520174+0000","last_peered":"2024-06-02T23:46:32.520174+0000","last_clean":"2024-06-02T23:46:32.520174+0000","last_became_active":"2024-06-02T23:46:24.723258+0000","last_became_peered":"2024-06-02T23:46:24.723258+0000","last_unstale":"2024-06-02T23:46:32.520174+0000","last_undegraded":"2024-06-02T23:46:32.520174+0000","last_fullsized":"2024-06-02T23:46:32.520174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760721+0000","last_change":"2024-06-02T23:46:30.059389+0000","last_active":"2024-06-02T23:46:30.760721+0000","last_peered":"2024-06-02T23:46:30.760721+0000","last_clean":"2024-06-02T23:46:30.760721+0000","last_became_active":"2024-06-02T23:46:30.058909+0000","last_became_peered":"2024-06-02T23:46:30.058909+0000","last_unstale":"2024-06-02T23:46:30.760721+0000","last_undegraded":"2024-06-02T23:46:30.760721+0000","last_fullsized":"2024-06-02T23:46:30.760721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:24.838590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519819+0000","last_change":"2024-06-02T23:46:25.738807+0000","last_active":"2024-06-02T23:46:32.519819+0000","last_peered":"2024-06-02T23:46:32.519819+0000","last_clean":"2024-06-02T23:46:32.519819+0000","last_became_active":"2024-06-02T23:46:25.738552+0000","last_became_peered":"2024-06-02T23:46:25.738552+0000","last_unstale":"2024-06-02T23:46:32.519819+0000","last_undegraded":"2024-06-02T23:46:32.519819+0000","last_fullsized":"2024-06-02T23:46:32.519819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519426+0000","last_change":"2024-06-02T23:46:24.717509+0000","last_active":"2024-06-02T23:46:32.519426+0000","last_peered":"2024-06-02T23:46:32.519426+0000","last_clean":"2024-06-02T23:46:32.519426+0000","last_became_active":"2024-06-02T23:46:24.716726+0000","last_became_peered":"2024-06-02T23:46:24.716726+0000","last_unstale":"2024-06-02T23:46:32.519426+0000","last_undegraded":"2024-06-02T23:46:32.519426+0000","last_fullsized":"2024-06-02T23:46:32.519426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520004+0000","last_change":"2024-06-02T23:46:30.060386+0000","last_active":"2024-06-02T23:46:32.520004+0000","last_peered":"2024-06-02T23:46:32.520004+0000","last_clean":"2024-06-02T23:46:32.520004+0000","last_became_active":"2024-06-02T23:46:30.058822+0000","last_became_peered":"2024-06-02T23:46:30.058822+0000","last_unstale":"2024-06-02T23:46:32.520004+0000","last_undegraded":"2024-06-02T23:46:32.520004+0000","last_fullsized":"2024-06-02T23:46:32.520004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:33.045570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521240+0000","last_change":"2024-06-02T23:46:25.735259+0000","last_active":"2024-06-02T23:46:32.521240+0000","last_peered":"2024-06-02T23:46:32.521240+0000","last_clean":"2024-06-02T23:46:32.521240+0000","last_became_active":"2024-06-02T23:46:25.734998+0000","last_became_peered":"2024-06-02T23:46:25.734998+0000","last_unstale":"2024-06-02T23:46:32.521240+0000","last_undegraded":"2024-06-02T23:46:32.521240+0000","last_fullsized":"2024-06-02T23:46:32.521240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520831+0000","last_change":"2024-06-02T23:46:24.725043+0000","last_active":"2024-06-02T23:46:32.520831+0000","last_peered":"2024-06-02T23:46:32.520831+0000","last_clean":"2024-06-02T23:46:32.520831+0000","last_became_active":"2024-06-02T23:46:24.724672+0000","last_became_peered":"2024-06-02T23:46:24.724672+0000","last_unstale":"2024-06-02T23:46:32.520831+0000","last_undegraded":"2024-06-02T23:46:32.520831+0000","last_fullsized":"2024-06-02T23:46:32.520831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:22.253427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519079+0000","last_change":"2024-06-02T23:46:30.061769+0000","last_active":"2024-06-02T23:46:32.519079+0000","last_peered":"2024-06-02T23:46:32.519079+0000","last_clean":"2024-06-02T23:46:32.519079+0000","last_became_active":"2024-06-02T23:46:30.061381+0000","last_became_peered":"2024-06-02T23:46:30.061381+0000","last_unstale":"2024-06-02T23:46:32.519079+0000","last_undegraded":"2024-06-02T23:46:32.519079+0000","last_fullsized":"2024-06-02T23:46:32.519079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020522+0000","last_change":"2024-06-02T23:46:25.733026+0000","last_active":"2024-06-02T23:46:32.020522+0000","last_peered":"2024-06-02T23:46:32.020522+0000","last_clean":"2024-06-02T23:46:32.020522+0000","last_became_active":"2024-06-02T23:46:25.732637+0000","last_became_peered":"2024-06-02T23:46:25.732637+0000","last_unstale":"2024-06-02T23:46:32.020522+0000","last_undegraded":"2024-06-02T23:46:32.020522+0000","last_fullsized":"2024-06-02T23:46:32.020522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:20.812410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521321+0000","last_change":"2024-06-02T23:46:24.725276+0000","last_active":"2024-06-02T23:46:32.521321+0000","last_peered":"2024-06-02T23:46:32.521321+0000","last_clean":"2024-06-02T23:46:32.521321+0000","last_became_active":"2024-06-02T23:46:24.725003+0000","last_became_peered":"2024-06-02T23:46:24.725003+0000","last_unstale":"2024-06-02T23:46:32.521321+0000","last_undegraded":"2024-06-02T23:46:32.521321+0000","last_fullsized":"2024-06-02T23:46:32.521321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519089+0000","last_change":"2024-06-02T23:46:29.748270+0000","last_active":"2024-06-02T23:46:32.519089+0000","last_peered":"2024-06-02T23:46:32.519089+0000","last_clean":"2024-06-02T23:46:32.519089+0000","last_became_active":"2024-06-02T23:46:29.746100+0000","last_became_peered":"2024-06-02T23:46:29.746100+0000","last_unstale":"2024-06-02T23:46:32.519089+0000","last_undegraded":"2024-06-02T23:46:32.519089+0000","last_fullsized":"2024-06-02T23:46:32.519089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761799+0000","last_change":"2024-06-02T23:46:25.721864+0000","last_active":"2024-06-02T23:46:30.761799+0000","last_peered":"2024-06-02T23:46:30.761799+0000","last_clean":"2024-06-02T23:46:30.761799+0000","last_became_active":"2024-06-02T23:46:25.721542+0000","last_became_peered":"2024-06-02T23:46:25.721542+0000","last_unstale":"2024-06-02T23:46:30.761799+0000","last_undegraded":"2024-06-02T23:46:30.761799+0000","last_fullsized":"2024-06-02T23:46:30.761799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:43.831493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020299+0000","last_change":"2024-06-02T23:46:24.721734+0000","last_active":"2024-06-02T23:46:32.020299+0000","last_peered":"2024-06-02T23:46:32.020299+0000","last_clean":"2024-06-02T23:46:32.020299+0000","last_became_active":"2024-06-02T23:46:24.721054+0000","last_became_peered":"2024-06-02T23:46:24.721054+0000","last_unstale":"2024-06-02T23:46:32.020299+0000","last_undegraded":"2024-06-02T23:46:32.020299+0000","last_fullsized":"2024-06-02T23:46:32.020299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521266+0000","last_change":"2024-06-02T23:46:29.747631+0000","last_active":"2024-06-02T23:46:32.521266+0000","last_peered":"2024-06-02T23:46:32.521266+0000","last_clean":"2024-06-02T23:46:32.521266+0000","last_became_active":"2024-06-02T23:46:29.747131+0000","last_became_peered":"2024-06-02T23:46:29.747131+0000","last_unstale":"2024-06-02T23:46:32.521266+0000","last_undegraded":"2024-06-02T23:46:32.521266+0000","last_fullsized":"2024-06-02T23:46:32.521266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:25:42.527465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.521158+0000","last_change":"2024-06-02T23:46:25.730642+0000","last_active":"2024-06-02T23:46:32.521158+0000","last_peered":"2024-06-02T23:46:32.521158+0000","last_clean":"2024-06-02T23:46:32.521158+0000","last_became_active":"2024-06-02T23:46:25.730361+0000","last_became_peered":"2024-06-02T23:46:25.730361+0000","last_unstale":"2024-06-02T23:46:32.521158+0000","last_undegraded":"2024-06-02T23:46:32.521158+0000","last_fullsized":"2024-06-02T23:46:32.521158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760281+0000","last_change":"2024-06-02T23:46:24.723907+0000","last_active":"2024-06-02T23:46:30.760281+0000","last_peered":"2024-06-02T23:46:30.760281+0000","last_clean":"2024-06-02T23:46:30.760281+0000","last_became_active":"2024-06-02T23:46:24.723625+0000","last_became_peered":"2024-06-02T23:46:24.723625+0000","last_unstale":"2024-06-02T23:46:30.760281+0000","last_undegraded":"2024-06-02T23:46:30.760281+0000","last_fullsized":"2024-06-02T23:46:30.760281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520188+0000","last_change":"2024-06-02T23:46:29.750215+0000","last_active":"2024-06-02T23:46:32.520188+0000","last_peered":"2024-06-02T23:46:32.520188+0000","last_clean":"2024-06-02T23:46:32.520188+0000","last_became_active":"2024-06-02T23:46:29.749639+0000","last_became_peered":"2024-06-02T23:46:29.749639+0000","last_unstale":"2024-06-02T23:46:32.520188+0000","last_undegraded":"2024-06-02T23:46:32.520188+0000","last_fullsized":"2024-06-02T23:46:32.520188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:29.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518955+0000","last_change":"2024-06-02T23:46:25.715090+0000","last_active":"2024-06-02T23:46:32.518955+0000","last_peered":"2024-06-02T23:46:32.518955+0000","last_clean":"2024-06-02T23:46:32.518955+0000","last_became_active":"2024-06-02T23:46:25.714367+0000","last_became_peered":"2024-06-02T23:46:25.714367+0000","last_unstale":"2024-06-02T23:46:32.518955+0000","last_undegraded":"2024-06-02T23:46:32.518955+0000","last_fullsized":"2024-06-02T23:46:32.518955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519559+0000","last_change":"2024-06-02T23:46:24.727655+0000","last_active":"2024-06-02T23:46:32.519559+0000","last_peered":"2024-06-02T23:46:32.519559+0000","last_clean":"2024-06-02T23:46:32.519559+0000","last_became_active":"2024-06-02T23:46:24.727332+0000","last_became_peered":"2024-06-02T23:46:24.727332+0000","last_unstale":"2024-06-02T23:46:32.519559+0000","last_undegraded":"2024-06-02T23:46:32.519559+0000","last_fullsized":"2024-06-02T23:46:32.519559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520433+0000","last_change":"2024-06-02T23:46:30.058954+0000","last_active":"2024-06-02T23:46:32.520433+0000","last_peered":"2024-06-02T23:46:32.520433+0000","last_clean":"2024-06-02T23:46:32.520433+0000","last_became_active":"2024-06-02T23:46:30.058572+0000","last_became_peered":"2024-06-02T23:46:30.058572+0000","last_unstale":"2024-06-02T23:46:32.520433+0000","last_undegraded":"2024-06-02T23:46:32.520433+0000","last_fullsized":"2024-06-02T23:46:32.520433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:29.386705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519081+0000","last_change":"2024-06-02T23:46:25.733213+0000","last_active":"2024-06-02T23:46:32.519081+0000","last_peered":"2024-06-02T23:46:32.519081+0000","last_clean":"2024-06-02T23:46:32.519081+0000","last_became_active":"2024-06-02T23:46:25.732930+0000","last_became_peered":"2024-06-02T23:46:25.732930+0000","last_unstale":"2024-06-02T23:46:32.519081+0000","last_undegraded":"2024-06-02T23:46:32.519081+0000","last_fullsized":"2024-06-02T23:46:32.519081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020160+0000","last_change":"2024-06-02T23:46:24.721901+0000","last_active":"2024-06-02T23:46:32.020160+0000","last_peered":"2024-06-02T23:46:32.020160+0000","last_clean":"2024-06-02T23:46:32.020160+0000","last_became_active":"2024-06-02T23:46:24.721566+0000","last_became_peered":"2024-06-02T23:46:24.721566+0000","last_unstale":"2024-06-02T23:46:32.020160+0000","last_undegraded":"2024-06-02T23:46:32.020160+0000","last_fullsized":"2024-06-02T23:46:32.020160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519663+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:46:32.519663+0000","last_peered":"2024-06-02T23:46:32.519663+0000","last_clean":"2024-06-02T23:46:32.519663+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:46:32.519663+0000","last_undegraded":"2024-06-02T23:46:32.519663+0000","last_fullsized":"2024-06-02T23:46:32.519663+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520077+0000","last_change":"2024-06-02T23:46:30.062637+0000","last_active":"2024-06-02T23:46:32.520077+0000","last_peered":"2024-06-02T23:46:32.520077+0000","last_clean":"2024-06-02T23:46:32.520077+0000","last_became_active":"2024-06-02T23:46:30.061399+0000","last_became_peered":"2024-06-02T23:46:30.061399+0000","last_unstale":"2024-06-02T23:46:32.520077+0000","last_undegraded":"2024-06-02T23:46:32.520077+0000","last_fullsized":"2024-06-02T23:46:32.520077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:13.880688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520556+0000","last_change":"2024-06-02T23:46:25.735716+0000","last_active":"2024-06-02T23:46:32.520556+0000","last_peered":"2024-06-02T23:46:32.520556+0000","last_clean":"2024-06-02T23:46:32.520556+0000","last_became_active":"2024-06-02T23:46:25.735260+0000","last_became_peered":"2024-06-02T23:46:25.735260+0000","last_unstale":"2024-06-02T23:46:32.520556+0000","last_undegraded":"2024-06-02T23:46:32.520556+0000","last_fullsized":"2024-06-02T23:46:32.520556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760537+0000","last_change":"2024-06-02T23:46:24.723946+0000","last_active":"2024-06-02T23:46:30.760537+0000","last_peered":"2024-06-02T23:46:30.760537+0000","last_clean":"2024-06-02T23:46:30.760537+0000","last_became_active":"2024-06-02T23:46:24.723650+0000","last_became_peered":"2024-06-02T23:46:24.723650+0000","last_unstale":"2024-06-02T23:46:30.760537+0000","last_undegraded":"2024-06-02T23:46:30.760537+0000","last_fullsized":"2024-06-02T23:46:30.760537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520181+0000","last_change":"2024-06-02T23:46:30.059124+0000","last_active":"2024-06-02T23:46:32.520181+0000","last_peered":"2024-06-02T23:46:32.520181+0000","last_clean":"2024-06-02T23:46:32.520181+0000","last_became_active":"2024-06-02T23:46:30.058661+0000","last_became_peered":"2024-06-02T23:46:30.058661+0000","last_unstale":"2024-06-02T23:46:32.520181+0000","last_undegraded":"2024-06-02T23:46:32.520181+0000","last_fullsized":"2024-06-02T23:46:32.520181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:41.044103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020428+0000","last_change":"2024-06-02T23:46:25.732804+0000","last_active":"2024-06-02T23:46:32.020428+0000","last_peered":"2024-06-02T23:46:32.020428+0000","last_clean":"2024-06-02T23:46:32.020428+0000","last_became_active":"2024-06-02T23:46:25.732456+0000","last_became_peered":"2024-06-02T23:46:25.732456+0000","last_unstale":"2024-06-02T23:46:32.020428+0000","last_undegraded":"2024-06-02T23:46:32.020428+0000","last_fullsized":"2024-06-02T23:46:32.020428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:12.887235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520544+0000","last_change":"2024-06-02T23:46:24.719921+0000","last_active":"2024-06-02T23:46:32.520544+0000","last_peered":"2024-06-02T23:46:32.520544+0000","last_clean":"2024-06-02T23:46:32.520544+0000","last_became_active":"2024-06-02T23:46:24.719648+0000","last_became_peered":"2024-06-02T23:46:24.719648+0000","last_unstale":"2024-06-02T23:46:32.520544+0000","last_undegraded":"2024-06-02T23:46:32.520544+0000","last_fullsized":"2024-06-02T23:46:32.520544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519336+0000","last_change":"2024-06-02T23:46:29.750616+0000","last_active":"2024-06-02T23:46:32.519336+0000","last_peered":"2024-06-02T23:46:32.519336+0000","last_clean":"2024-06-02T23:46:32.519336+0000","last_became_active":"2024-06-02T23:46:29.750269+0000","last_became_peered":"2024-06-02T23:46:29.750269+0000","last_unstale":"2024-06-02T23:46:32.519336+0000","last_undegraded":"2024-06-02T23:46:32.519336+0000","last_fullsized":"2024-06-02T23:46:32.519336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520532+0000","last_change":"2024-06-02T23:46:25.735799+0000","last_active":"2024-06-02T23:46:32.520532+0000","last_peered":"2024-06-02T23:46:32.520532+0000","last_clean":"2024-06-02T23:46:32.520532+0000","last_became_active":"2024-06-02T23:46:25.735543+0000","last_became_peered":"2024-06-02T23:46:25.735543+0000","last_unstale":"2024-06-02T23:46:32.520532+0000","last_undegraded":"2024-06-02T23:46:32.520532+0000","last_fullsized":"2024-06-02T23:46:32.520532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:37.017923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760515+0000","last_change":"2024-06-02T23:46:24.725885+0000","last_active":"2024-06-02T23:46:30.760515+0000","last_peered":"2024-06-02T23:46:30.760515+0000","last_clean":"2024-06-02T23:46:30.760515+0000","last_became_active":"2024-06-02T23:46:24.725536+0000","last_became_peered":"2024-06-02T23:46:24.725536+0000","last_unstale":"2024-06-02T23:46:30.760515+0000","last_undegraded":"2024-06-02T23:46:30.760515+0000","last_fullsized":"2024-06-02T23:46:30.760515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019834+0000","last_change":"2024-06-02T23:46:30.061677+0000","last_active":"2024-06-02T23:46:32.019834+0000","last_peered":"2024-06-02T23:46:32.019834+0000","last_clean":"2024-06-02T23:46:32.019834+0000","last_became_active":"2024-06-02T23:46:30.060775+0000","last_became_peered":"2024-06-02T23:46:30.060775+0000","last_unstale":"2024-06-02T23:46:32.019834+0000","last_undegraded":"2024-06-02T23:46:32.019834+0000","last_fullsized":"2024-06-02T23:46:32.019834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:33.045570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520258+0000","last_change":"2024-06-02T23:46:25.730305+0000","last_active":"2024-06-02T23:46:32.520258+0000","last_peered":"2024-06-02T23:46:32.520258+0000","last_clean":"2024-06-02T23:46:32.520258+0000","last_became_active":"2024-06-02T23:46:25.730021+0000","last_became_peered":"2024-06-02T23:46:25.730021+0000","last_unstale":"2024-06-02T23:46:32.520258+0000","last_undegraded":"2024-06-02T23:46:32.520258+0000","last_fullsized":"2024-06-02T23:46:32.520258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:55.355993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761363+0000","last_change":"2024-06-02T23:46:24.715701+0000","last_active":"2024-06-02T23:46:30.761363+0000","last_peered":"2024-06-02T23:46:30.761363+0000","last_clean":"2024-06-02T23:46:30.761363+0000","last_became_active":"2024-06-02T23:46:24.715390+0000","last_became_peered":"2024-06-02T23:46:24.715390+0000","last_unstale":"2024-06-02T23:46:30.761363+0000","last_undegraded":"2024-06-02T23:46:30.761363+0000","last_fullsized":"2024-06-02T23:46:30.761363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:28:58.235763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760636+0000","last_change":"2024-06-02T23:46:29.746332+0000","last_active":"2024-06-02T23:46:30.760636+0000","last_peered":"2024-06-02T23:46:30.760636+0000","last_clean":"2024-06-02T23:46:30.760636+0000","last_became_active":"2024-06-02T23:46:29.745413+0000","last_became_peered":"2024-06-02T23:46:29.745413+0000","last_unstale":"2024-06-02T23:46:30.760636+0000","last_undegraded":"2024-06-02T23:46:30.760636+0000","last_fullsized":"2024-06-02T23:46:30.760636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:19.371522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519802+0000","last_change":"2024-06-02T23:46:25.725887+0000","last_active":"2024-06-02T23:46:32.519802+0000","last_peered":"2024-06-02T23:46:32.519802+0000","last_clean":"2024-06-02T23:46:32.519802+0000","last_became_active":"2024-06-02T23:46:25.725612+0000","last_became_peered":"2024-06-02T23:46:25.725612+0000","last_unstale":"2024-06-02T23:46:32.519802+0000","last_undegraded":"2024-06-02T23:46:32.519802+0000","last_fullsized":"2024-06-02T23:46:32.519802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760127+0000","last_change":"2024-06-02T23:46:24.724594+0000","last_active":"2024-06-02T23:46:30.760127+0000","last_peered":"2024-06-02T23:46:30.760127+0000","last_clean":"2024-06-02T23:46:30.760127+0000","last_became_active":"2024-06-02T23:46:24.723922+0000","last_became_peered":"2024-06-02T23:46:24.723922+0000","last_unstale":"2024-06-02T23:46:30.760127+0000","last_undegraded":"2024-06-02T23:46:30.760127+0000","last_fullsized":"2024-06-02T23:46:30.760127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520293+0000","last_change":"2024-06-02T23:46:29.747557+0000","last_active":"2024-06-02T23:46:32.520293+0000","last_peered":"2024-06-02T23:46:32.520293+0000","last_clean":"2024-06-02T23:46:32.520293+0000","last_became_active":"2024-06-02T23:46:29.747197+0000","last_became_peered":"2024-06-02T23:46:29.747197+0000","last_unstale":"2024-06-02T23:46:32.520293+0000","last_undegraded":"2024-06-02T23:46:32.520293+0000","last_fullsized":"2024-06-02T23:46:32.520293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:15.508248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519514+0000","last_change":"2024-06-02T23:46:25.724028+0000","last_active":"2024-06-02T23:46:32.519514+0000","last_peered":"2024-06-02T23:46:32.519514+0000","last_clean":"2024-06-02T23:46:32.519514+0000","last_became_active":"2024-06-02T23:46:25.723772+0000","last_became_peered":"2024-06-02T23:46:25.723772+0000","last_unstale":"2024-06-02T23:46:32.519514+0000","last_undegraded":"2024-06-02T23:46:32.519514+0000","last_fullsized":"2024-06-02T23:46:32.519514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519626+0000","last_change":"2024-06-02T23:46:24.719789+0000","last_active":"2024-06-02T23:46:32.519626+0000","last_peered":"2024-06-02T23:46:32.519626+0000","last_clean":"2024-06-02T23:46:32.519626+0000","last_became_active":"2024-06-02T23:46:24.719492+0000","last_became_peered":"2024-06-02T23:46:24.719492+0000","last_unstale":"2024-06-02T23:46:32.519626+0000","last_undegraded":"2024-06-02T23:46:32.519626+0000","last_fullsized":"2024-06-02T23:46:32.519626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519714+0000","last_change":"2024-06-02T23:46:30.060001+0000","last_active":"2024-06-02T23:46:32.519714+0000","last_peered":"2024-06-02T23:46:32.519714+0000","last_clean":"2024-06-02T23:46:32.519714+0000","last_became_active":"2024-06-02T23:46:30.059636+0000","last_became_peered":"2024-06-02T23:46:30.059636+0000","last_unstale":"2024-06-02T23:46:32.519714+0000","last_undegraded":"2024-06-02T23:46:32.519714+0000","last_fullsized":"2024-06-02T23:46:32.519714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:25:42.527465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520625+0000","last_change":"2024-06-02T23:46:25.731503+0000","last_active":"2024-06-02T23:46:32.520625+0000","last_peered":"2024-06-02T23:46:32.520625+0000","last_clean":"2024-06-02T23:46:32.520625+0000","last_became_active":"2024-06-02T23:46:25.726384+0000","last_became_peered":"2024-06-02T23:46:25.726384+0000","last_unstale":"2024-06-02T23:46:32.520625+0000","last_undegraded":"2024-06-02T23:46:32.520625+0000","last_fullsized":"2024-06-02T23:46:32.520625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:17:11.482068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020231+0000","last_change":"2024-06-02T23:46:24.717644+0000","last_active":"2024-06-02T23:46:32.020231+0000","last_peered":"2024-06-02T23:46:32.020231+0000","last_clean":"2024-06-02T23:46:32.020231+0000","last_became_active":"2024-06-02T23:46:24.717376+0000","last_became_peered":"2024-06-02T23:46:24.717376+0000","last_unstale":"2024-06-02T23:46:32.020231+0000","last_undegraded":"2024-06-02T23:46:32.020231+0000","last_fullsized":"2024-06-02T23:46:32.020231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:06:20.805981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520673+0000","last_change":"2024-06-02T23:46:30.059757+0000","last_active":"2024-06-02T23:46:32.520673+0000","last_peered":"2024-06-02T23:46:32.520673+0000","last_clean":"2024-06-02T23:46:32.520673+0000","last_became_active":"2024-06-02T23:46:30.059322+0000","last_became_peered":"2024-06-02T23:46:30.059322+0000","last_unstale":"2024-06-02T23:46:32.520673+0000","last_undegraded":"2024-06-02T23:46:32.520673+0000","last_fullsized":"2024-06-02T23:46:32.520673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:29:23.721847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519530+0000","last_change":"2024-06-02T23:46:25.728180+0000","last_active":"2024-06-02T23:46:32.519530+0000","last_peered":"2024-06-02T23:46:32.519530+0000","last_clean":"2024-06-02T23:46:32.519530+0000","last_became_active":"2024-06-02T23:46:25.727929+0000","last_became_peered":"2024-06-02T23:46:25.727929+0000","last_unstale":"2024-06-02T23:46:32.519530+0000","last_undegraded":"2024-06-02T23:46:32.519530+0000","last_fullsized":"2024-06-02T23:46:32.519530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:13:41.243193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520755+0000","last_change":"2024-06-02T23:46:24.720640+0000","last_active":"2024-06-02T23:46:32.520755+0000","last_peered":"2024-06-02T23:46:32.520755+0000","last_clean":"2024-06-02T23:46:32.520755+0000","last_became_active":"2024-06-02T23:46:24.718963+0000","last_became_peered":"2024-06-02T23:46:24.718963+0000","last_unstale":"2024-06-02T23:46:32.520755+0000","last_undegraded":"2024-06-02T23:46:32.520755+0000","last_fullsized":"2024-06-02T23:46:32.520755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:48:20.465639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020392+0000","last_change":"2024-06-02T23:46:30.061979+0000","last_active":"2024-06-02T23:46:32.020392+0000","last_peered":"2024-06-02T23:46:32.020392+0000","last_clean":"2024-06-02T23:46:32.020392+0000","last_became_active":"2024-06-02T23:46:30.060895+0000","last_became_peered":"2024-06-02T23:46:30.060895+0000","last_unstale":"2024-06-02T23:46:32.020392+0000","last_undegraded":"2024-06-02T23:46:32.020392+0000","last_fullsized":"2024-06-02T23:46:32.020392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:45:39.641287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520442+0000","last_change":"2024-06-02T23:46:25.735883+0000","last_active":"2024-06-02T23:46:32.520442+0000","last_peered":"2024-06-02T23:46:32.520442+0000","last_clean":"2024-06-02T23:46:32.520442+0000","last_became_active":"2024-06-02T23:46:25.735603+0000","last_became_peered":"2024-06-02T23:46:25.735603+0000","last_unstale":"2024-06-02T23:46:32.520442+0000","last_undegraded":"2024-06-02T23:46:32.520442+0000","last_fullsized":"2024-06-02T23:46:32.520442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:35.130935+0000","last_change":"2024-06-02T23:46:24.721360+0000","last_active":"2024-06-02T23:46:35.130935+0000","last_peered":"2024-06-02T23:46:35.130935+0000","last_clean":"2024-06-02T23:46:35.130935+0000","last_became_active":"2024-06-02T23:46:24.721084+0000","last_became_peered":"2024-06-02T23:46:24.721084+0000","last_unstale":"2024-06-02T23:46:35.130935+0000","last_undegraded":"2024-06-02T23:46:35.130935+0000","last_fullsized":"2024-06-02T23:46:35.130935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519296+0000","last_change":"2024-06-02T23:46:29.746644+0000","last_active":"2024-06-02T23:46:32.519296+0000","last_peered":"2024-06-02T23:46:32.519296+0000","last_clean":"2024-06-02T23:46:32.519296+0000","last_became_active":"2024-06-02T23:46:29.746228+0000","last_became_peered":"2024-06-02T23:46:29.746228+0000","last_unstale":"2024-06-02T23:46:32.519296+0000","last_undegraded":"2024-06-02T23:46:32.519296+0000","last_fullsized":"2024-06-02T23:46:32.519296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:10.654147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761249+0000","last_change":"2024-06-02T23:46:25.728089+0000","last_active":"2024-06-02T23:46:30.761249+0000","last_peered":"2024-06-02T23:46:30.761249+0000","last_clean":"2024-06-02T23:46:30.761249+0000","last_became_active":"2024-06-02T23:46:25.726955+0000","last_became_peered":"2024-06-02T23:46:25.726955+0000","last_unstale":"2024-06-02T23:46:30.761249+0000","last_undegraded":"2024-06-02T23:46:30.761249+0000","last_fullsized":"2024-06-02T23:46:30.761249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:35.672297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520452+0000","last_change":"2024-06-02T23:46:24.725891+0000","last_active":"2024-06-02T23:46:32.520452+0000","last_peered":"2024-06-02T23:46:32.520452+0000","last_clean":"2024-06-02T23:46:32.520452+0000","last_became_active":"2024-06-02T23:46:24.725584+0000","last_became_peered":"2024-06-02T23:46:24.725584+0000","last_unstale":"2024-06-02T23:46:32.520452+0000","last_undegraded":"2024-06-02T23:46:32.520452+0000","last_fullsized":"2024-06-02T23:46:32.520452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:37:42.825292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761588+0000","last_change":"2024-06-02T23:46:29.745572+0000","last_active":"2024-06-02T23:46:30.761588+0000","last_peered":"2024-06-02T23:46:30.761588+0000","last_clean":"2024-06-02T23:46:30.761588+0000","last_became_active":"2024-06-02T23:46:29.744992+0000","last_became_peered":"2024-06-02T23:46:29.744992+0000","last_unstale":"2024-06-02T23:46:30.761588+0000","last_undegraded":"2024-06-02T23:46:30.761588+0000","last_fullsized":"2024-06-02T23:46:30.761588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:59.382173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519822+0000","last_change":"2024-06-02T23:46:25.725605+0000","last_active":"2024-06-02T23:46:32.519822+0000","last_peered":"2024-06-02T23:46:32.519822+0000","last_clean":"2024-06-02T23:46:32.519822+0000","last_became_active":"2024-06-02T23:46:25.725274+0000","last_became_peered":"2024-06-02T23:46:25.725274+0000","last_unstale":"2024-06-02T23:46:32.519822+0000","last_undegraded":"2024-06-02T23:46:32.519822+0000","last_fullsized":"2024-06-02T23:46:32.519822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020509+0000","last_change":"2024-06-02T23:46:24.715879+0000","last_active":"2024-06-02T23:46:32.020509+0000","last_peered":"2024-06-02T23:46:32.020509+0000","last_clean":"2024-06-02T23:46:32.020509+0000","last_became_active":"2024-06-02T23:46:24.715573+0000","last_became_peered":"2024-06-02T23:46:24.715573+0000","last_unstale":"2024-06-02T23:46:32.020509+0000","last_undegraded":"2024-06-02T23:46:32.020509+0000","last_fullsized":"2024-06-02T23:46:32.020509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:27.351064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520072+0000","last_change":"2024-06-02T23:46:29.747846+0000","last_active":"2024-06-02T23:46:32.520072+0000","last_peered":"2024-06-02T23:46:32.520072+0000","last_clean":"2024-06-02T23:46:32.520072+0000","last_became_active":"2024-06-02T23:46:29.747447+0000","last_became_peered":"2024-06-02T23:46:29.747447+0000","last_unstale":"2024-06-02T23:46:32.520072+0000","last_undegraded":"2024-06-02T23:46:32.520072+0000","last_fullsized":"2024-06-02T23:46:32.520072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:45:39.641287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020419+0000","last_change":"2024-06-02T23:46:25.724680+0000","last_active":"2024-06-02T23:46:32.020419+0000","last_peered":"2024-06-02T23:46:32.020419+0000","last_clean":"2024-06-02T23:46:32.020419+0000","last_became_active":"2024-06-02T23:46:25.724407+0000","last_became_peered":"2024-06-02T23:46:25.724407+0000","last_unstale":"2024-06-02T23:46:32.020419+0000","last_undegraded":"2024-06-02T23:46:32.020419+0000","last_fullsized":"2024-06-02T23:46:32.020419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:09.854508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520034+0000","last_change":"2024-06-02T23:46:24.722854+0000","last_active":"2024-06-02T23:46:32.520034+0000","last_peered":"2024-06-02T23:46:32.520034+0000","last_clean":"2024-06-02T23:46:32.520034+0000","last_became_active":"2024-06-02T23:46:24.722517+0000","last_became_peered":"2024-06-02T23:46:24.722517+0000","last_unstale":"2024-06-02T23:46:32.520034+0000","last_undegraded":"2024-06-02T23:46:32.520034+0000","last_fullsized":"2024-06-02T23:46:32.520034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:22.018269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520095+0000","last_change":"2024-06-02T23:46:30.059124+0000","last_active":"2024-06-02T23:46:32.520095+0000","last_peered":"2024-06-02T23:46:32.520095+0000","last_clean":"2024-06-02T23:46:32.520095+0000","last_became_active":"2024-06-02T23:46:30.058701+0000","last_became_peered":"2024-06-02T23:46:30.058701+0000","last_unstale":"2024-06-02T23:46:32.520095+0000","last_undegraded":"2024-06-02T23:46:32.520095+0000","last_fullsized":"2024-06-02T23:46:32.520095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:03:32.967430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520137+0000","last_change":"2024-06-02T23:46:30.060519+0000","last_active":"2024-06-02T23:46:32.520137+0000","last_peered":"2024-06-02T23:46:32.520137+0000","last_clean":"2024-06-02T23:46:32.520137+0000","last_became_active":"2024-06-02T23:46:30.060121+0000","last_became_peered":"2024-06-02T23:46:30.060121+0000","last_unstale":"2024-06-02T23:46:32.520137+0000","last_undegraded":"2024-06-02T23:46:32.520137+0000","last_fullsized":"2024-06-02T23:46:32.520137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:10.654147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518734+0000","last_change":"2024-06-02T23:46:25.732314+0000","last_active":"2024-06-02T23:46:32.518734+0000","last_peered":"2024-06-02T23:46:32.518734+0000","last_clean":"2024-06-02T23:46:32.518734+0000","last_became_active":"2024-06-02T23:46:25.732022+0000","last_became_peered":"2024-06-02T23:46:25.732022+0000","last_unstale":"2024-06-02T23:46:32.518734+0000","last_undegraded":"2024-06-02T23:46:32.518734+0000","last_fullsized":"2024-06-02T23:46:32.518734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019991+0000","last_change":"2024-06-02T23:46:24.716182+0000","last_active":"2024-06-02T23:46:32.019991+0000","last_peered":"2024-06-02T23:46:32.019991+0000","last_clean":"2024-06-02T23:46:32.019991+0000","last_became_active":"2024-06-02T23:46:24.715906+0000","last_became_peered":"2024-06-02T23:46:24.715906+0000","last_unstale":"2024-06-02T23:46:32.019991+0000","last_undegraded":"2024-06-02T23:46:32.019991+0000","last_fullsized":"2024-06-02T23:46:32.019991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519713+0000","last_change":"2024-06-02T23:46:29.750554+0000","last_active":"2024-06-02T23:46:32.519713+0000","last_peered":"2024-06-02T23:46:32.519713+0000","last_clean":"2024-06-02T23:46:32.519713+0000","last_became_active":"2024-06-02T23:46:29.750212+0000","last_became_peered":"2024-06-02T23:46:29.750212+0000","last_unstale":"2024-06-02T23:46:32.519713+0000","last_undegraded":"2024-06-02T23:46:32.519713+0000","last_fullsized":"2024-06-02T23:46:32.519713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:24.838590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520102+0000","last_change":"2024-06-02T23:46:25.730716+0000","last_active":"2024-06-02T23:46:32.520102+0000","last_peered":"2024-06-02T23:46:32.520102+0000","last_clean":"2024-06-02T23:46:32.520102+0000","last_became_active":"2024-06-02T23:46:25.730447+0000","last_became_peered":"2024-06-02T23:46:25.730447+0000","last_unstale":"2024-06-02T23:46:32.520102+0000","last_undegraded":"2024-06-02T23:46:32.520102+0000","last_fullsized":"2024-06-02T23:46:32.520102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520355+0000","last_change":"2024-06-02T23:46:24.718681+0000","last_active":"2024-06-02T23:46:32.520355+0000","last_peered":"2024-06-02T23:46:32.520355+0000","last_clean":"2024-06-02T23:46:32.520355+0000","last_became_active":"2024-06-02T23:46:24.717312+0000","last_became_peered":"2024-06-02T23:46:24.717312+0000","last_unstale":"2024-06-02T23:46:32.520355+0000","last_undegraded":"2024-06-02T23:46:32.520355+0000","last_fullsized":"2024-06-02T23:46:32.520355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:08:53.696691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520419+0000","last_change":"2024-06-02T23:46:24.719033+0000","last_active":"2024-06-02T23:46:32.520419+0000","last_peered":"2024-06-02T23:46:32.520419+0000","last_clean":"2024-06-02T23:46:32.520419+0000","last_became_active":"2024-06-02T23:46:24.718726+0000","last_became_peered":"2024-06-02T23:46:24.718726+0000","last_unstale":"2024-06-02T23:46:32.520419+0000","last_undegraded":"2024-06-02T23:46:32.520419+0000","last_fullsized":"2024-06-02T23:46:32.520419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:05:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520671+0000","last_change":"2024-06-02T23:46:25.714066+0000","last_active":"2024-06-02T23:46:32.520671+0000","last_peered":"2024-06-02T23:46:32.520671+0000","last_clean":"2024-06-02T23:46:32.520671+0000","last_became_active":"2024-06-02T23:46:25.713761+0000","last_became_peered":"2024-06-02T23:46:25.713761+0000","last_unstale":"2024-06-02T23:46:32.520671+0000","last_undegraded":"2024-06-02T23:46:32.520671+0000","last_fullsized":"2024-06-02T23:46:32.520671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760380+0000","last_change":"2024-06-02T23:46:29.745968+0000","last_active":"2024-06-02T23:46:30.760380+0000","last_peered":"2024-06-02T23:46:30.760380+0000","last_clean":"2024-06-02T23:46:30.760380+0000","last_became_active":"2024-06-02T23:46:29.745547+0000","last_became_peered":"2024-06-02T23:46:29.745547+0000","last_unstale":"2024-06-02T23:46:30.760380+0000","last_undegraded":"2024-06-02T23:46:30.760380+0000","last_fullsized":"2024-06-02T23:46:30.760380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:14.777955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519569+0000","last_change":"2024-06-02T23:46:24.724513+0000","last_active":"2024-06-02T23:46:32.519569+0000","last_peered":"2024-06-02T23:46:32.519569+0000","last_clean":"2024-06-02T23:46:32.519569+0000","last_became_active":"2024-06-02T23:46:24.723129+0000","last_became_peered":"2024-06-02T23:46:24.723129+0000","last_unstale":"2024-06-02T23:46:32.519569+0000","last_undegraded":"2024-06-02T23:46:32.519569+0000","last_fullsized":"2024-06-02T23:46:32.519569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:23.692179+0000","last_clean_scrub_stamp":"2024-06-02T23:46:23.692179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:39:55.565517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761185+0000","last_change":"2024-06-02T23:46:25.728059+0000","last_active":"2024-06-02T23:46:30.761185+0000","last_peered":"2024-06-02T23:46:30.761185+0000","last_clean":"2024-06-02T23:46:30.761185+0000","last_became_active":"2024-06-02T23:46:25.726707+0000","last_became_peered":"2024-06-02T23:46:25.726707+0000","last_unstale":"2024-06-02T23:46:30.761185+0000","last_undegraded":"2024-06-02T23:46:30.761185+0000","last_fullsized":"2024-06-02T23:46:30.761185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:14:28.357265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520439+0000","last_change":"2024-06-02T23:46:29.751586+0000","last_active":"2024-06-02T23:46:32.520439+0000","last_peered":"2024-06-02T23:46:32.520439+0000","last_clean":"2024-06-02T23:46:32.520439+0000","last_became_active":"2024-06-02T23:46:29.751242+0000","last_became_peered":"2024-06-02T23:46:29.751242+0000","last_unstale":"2024-06-02T23:46:32.520439+0000","last_undegraded":"2024-06-02T23:46:32.520439+0000","last_fullsized":"2024-06-02T23:46:32.520439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:28.724561+0000","last_clean_scrub_stamp":"2024-06-02T23:46:28.724561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:44.019486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519290+0000","last_change":"2024-06-02T23:46:25.724423+0000","last_active":"2024-06-02T23:46:32.519290+0000","last_peered":"2024-06-02T23:46:32.519290+0000","last_clean":"2024-06-02T23:46:32.519290+0000","last_became_active":"2024-06-02T23:46:25.723880+0000","last_became_peered":"2024-06-02T23:46:25.723880+0000","last_unstale":"2024-06-02T23:46:32.519290+0000","last_undegraded":"2024-06-02T23:46:32.519290+0000","last_fullsized":"2024-06-02T23:46:32.519290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760154+0000","last_change":"2024-06-02T23:46:25.733710+0000","last_active":"2024-06-02T23:46:30.760154+0000","last_peered":"2024-06-02T23:46:30.760154+0000","last_clean":"2024-06-02T23:46:30.760154+0000","last_became_active":"2024-06-02T23:46:25.733419+0000","last_became_peered":"2024-06-02T23:46:25.733419+0000","last_unstale":"2024-06-02T23:46:30.760154+0000","last_undegraded":"2024-06-02T23:46:30.760154+0000","last_fullsized":"2024-06-02T23:46:30.760154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:15:23.259628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020177+0000","last_change":"2024-06-02T23:46:25.732210+0000","last_active":"2024-06-02T23:46:32.020177+0000","last_peered":"2024-06-02T23:46:32.020177+0000","last_clean":"2024-06-02T23:46:32.020177+0000","last_became_active":"2024-06-02T23:46:25.731930+0000","last_became_peered":"2024-06-02T23:46:25.731930+0000","last_unstale":"2024-06-02T23:46:32.020177+0000","last_undegraded":"2024-06-02T23:46:32.020177+0000","last_fullsized":"2024-06-02T23:46:32.020177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:21:43.608730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520584+0000","last_change":"2024-06-02T23:46:25.733626+0000","last_active":"2024-06-02T23:46:32.520584+0000","last_peered":"2024-06-02T23:46:32.520584+0000","last_clean":"2024-06-02T23:46:32.520584+0000","last_became_active":"2024-06-02T23:46:25.733343+0000","last_became_peered":"2024-06-02T23:46:25.733343+0000","last_unstale":"2024-06-02T23:46:32.520584+0000","last_undegraded":"2024-06-02T23:46:32.520584+0000","last_fullsized":"2024-06-02T23:46:32.520584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:02.211736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520773+0000","last_change":"2024-06-02T23:46:25.730607+0000","last_active":"2024-06-02T23:46:32.520773+0000","last_peered":"2024-06-02T23:46:32.520773+0000","last_clean":"2024-06-02T23:46:32.520773+0000","last_became_active":"2024-06-02T23:46:25.728526+0000","last_became_peered":"2024-06-02T23:46:25.728526+0000","last_unstale":"2024-06-02T23:46:32.520773+0000","last_undegraded":"2024-06-02T23:46:32.520773+0000","last_fullsized":"2024-06-02T23:46:32.520773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520287+0000","last_change":"2024-06-02T23:46:25.732586+0000","last_active":"2024-06-02T23:46:32.520287+0000","last_peered":"2024-06-02T23:46:32.520287+0000","last_clean":"2024-06-02T23:46:32.520287+0000","last_became_active":"2024-06-02T23:46:25.732332+0000","last_became_peered":"2024-06-02T23:46:25.732332+0000","last_unstale":"2024-06-02T23:46:32.520287+0000","last_undegraded":"2024-06-02T23:46:32.520287+0000","last_fullsized":"2024-06-02T23:46:32.520287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520449+0000","last_change":"2024-06-02T23:46:25.726741+0000","last_active":"2024-06-02T23:46:32.520449+0000","last_peered":"2024-06-02T23:46:32.520449+0000","last_clean":"2024-06-02T23:46:32.520449+0000","last_became_active":"2024-06-02T23:46:25.726480+0000","last_became_peered":"2024-06-02T23:46:25.726480+0000","last_unstale":"2024-06-02T23:46:32.520449+0000","last_undegraded":"2024-06-02T23:46:32.520449+0000","last_fullsized":"2024-06-02T23:46:32.520449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519721+0000","last_change":"2024-06-02T23:46:25.732734+0000","last_active":"2024-06-02T23:46:32.519721+0000","last_peered":"2024-06-02T23:46:32.519721+0000","last_clean":"2024-06-02T23:46:32.519721+0000","last_became_active":"2024-06-02T23:46:25.732444+0000","last_became_peered":"2024-06-02T23:46:25.732444+0000","last_unstale":"2024-06-02T23:46:32.519721+0000","last_undegraded":"2024-06-02T23:46:32.519721+0000","last_fullsized":"2024-06-02T23:46:32.519721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019988+0000","last_change":"2024-06-02T23:46:25.733224+0000","last_active":"2024-06-02T23:46:32.019988+0000","last_peered":"2024-06-02T23:46:32.019988+0000","last_clean":"2024-06-02T23:46:32.019988+0000","last_became_active":"2024-06-02T23:46:25.732945+0000","last_became_peered":"2024-06-02T23:46:25.732945+0000","last_unstale":"2024-06-02T23:46:32.019988+0000","last_undegraded":"2024-06-02T23:46:32.019988+0000","last_fullsized":"2024-06-02T23:46:32.019988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520271+0000","last_change":"2024-06-02T23:46:25.727647+0000","last_active":"2024-06-02T23:46:32.520271+0000","last_peered":"2024-06-02T23:46:32.520271+0000","last_clean":"2024-06-02T23:46:32.520271+0000","last_became_active":"2024-06-02T23:46:25.727364+0000","last_became_peered":"2024-06-02T23:46:25.727364+0000","last_unstale":"2024-06-02T23:46:32.520271+0000","last_undegraded":"2024-06-02T23:46:32.520271+0000","last_fullsized":"2024-06-02T23:46:32.520271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020096+0000","last_change":"2024-06-02T23:46:25.727678+0000","last_active":"2024-06-02T23:46:32.020096+0000","last_peered":"2024-06-02T23:46:32.020096+0000","last_clean":"2024-06-02T23:46:32.020096+0000","last_became_active":"2024-06-02T23:46:25.727392+0000","last_became_peered":"2024-06-02T23:46:25.727392+0000","last_unstale":"2024-06-02T23:46:32.020096+0000","last_undegraded":"2024-06-02T23:46:32.020096+0000","last_fullsized":"2024-06-02T23:46:32.020096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519179+0000","last_change":"2024-06-02T23:46:25.722139+0000","last_active":"2024-06-02T23:46:32.519179+0000","last_peered":"2024-06-02T23:46:32.519179+0000","last_clean":"2024-06-02T23:46:32.519179+0000","last_became_active":"2024-06-02T23:46:25.721804+0000","last_became_peered":"2024-06-02T23:46:25.721804+0000","last_unstale":"2024-06-02T23:46:32.519179+0000","last_undegraded":"2024-06-02T23:46:32.519179+0000","last_fullsized":"2024-06-02T23:46:32.519179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:35:52.857442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519769+0000","last_change":"2024-06-02T23:46:25.728123+0000","last_active":"2024-06-02T23:46:32.519769+0000","last_peered":"2024-06-02T23:46:32.519769+0000","last_clean":"2024-06-02T23:46:32.519769+0000","last_became_active":"2024-06-02T23:46:25.727805+0000","last_became_peered":"2024-06-02T23:46:25.727805+0000","last_unstale":"2024-06-02T23:46:32.519769+0000","last_undegraded":"2024-06-02T23:46:32.519769+0000","last_fullsized":"2024-06-02T23:46:32.519769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520780+0000","last_change":"2024-06-02T23:46:25.735497+0000","last_active":"2024-06-02T23:46:32.520780+0000","last_peered":"2024-06-02T23:46:32.520780+0000","last_clean":"2024-06-02T23:46:32.520780+0000","last_became_active":"2024-06-02T23:46:25.734887+0000","last_became_peered":"2024-06-02T23:46:25.734887+0000","last_unstale":"2024-06-02T23:46:32.520780+0000","last_undegraded":"2024-06-02T23:46:32.520780+0000","last_fullsized":"2024-06-02T23:46:32.520780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:18:20.812410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.760496+0000","last_change":"2024-06-02T23:46:25.734490+0000","last_active":"2024-06-02T23:46:30.760496+0000","last_peered":"2024-06-02T23:46:30.760496+0000","last_clean":"2024-06-02T23:46:30.760496+0000","last_became_active":"2024-06-02T23:46:25.734206+0000","last_became_peered":"2024-06-02T23:46:25.734206+0000","last_unstale":"2024-06-02T23:46:30.760496+0000","last_undegraded":"2024-06-02T23:46:30.760496+0000","last_fullsized":"2024-06-02T23:46:30.760496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:08.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020711+0000","last_change":"2024-06-02T23:46:25.736811+0000","last_active":"2024-06-02T23:46:32.020711+0000","last_peered":"2024-06-02T23:46:32.020711+0000","last_clean":"2024-06-02T23:46:32.020711+0000","last_became_active":"2024-06-02T23:46:25.736568+0000","last_became_peered":"2024-06-02T23:46:25.736568+0000","last_unstale":"2024-06-02T23:46:32.020711+0000","last_undegraded":"2024-06-02T23:46:32.020711+0000","last_fullsized":"2024-06-02T23:46:32.020711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:55.355993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.019835+0000","last_change":"2024-06-02T23:46:25.722197+0000","last_active":"2024-06-02T23:46:32.019835+0000","last_peered":"2024-06-02T23:46:32.019835+0000","last_clean":"2024-06-02T23:46:32.019835+0000","last_became_active":"2024-06-02T23:46:25.721911+0000","last_became_peered":"2024-06-02T23:46:25.721911+0000","last_unstale":"2024-06-02T23:46:32.019835+0000","last_undegraded":"2024-06-02T23:46:32.019835+0000","last_fullsized":"2024-06-02T23:46:32.019835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:39:34.863056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.518775+0000","last_change":"2024-06-02T23:46:25.727178+0000","last_active":"2024-06-02T23:46:32.518775+0000","last_peered":"2024-06-02T23:46:32.518775+0000","last_clean":"2024-06-02T23:46:32.518775+0000","last_became_active":"2024-06-02T23:46:25.726888+0000","last_became_peered":"2024-06-02T23:46:25.726888+0000","last_unstale":"2024-06-02T23:46:32.518775+0000","last_undegraded":"2024-06-02T23:46:32.518775+0000","last_fullsized":"2024-06-02T23:46:32.518775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.409211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519434+0000","last_change":"2024-06-02T23:46:25.725940+0000","last_active":"2024-06-02T23:46:32.519434+0000","last_peered":"2024-06-02T23:46:32.519434+0000","last_clean":"2024-06-02T23:46:32.519434+0000","last_became_active":"2024-06-02T23:46:25.725534+0000","last_became_peered":"2024-06-02T23:46:25.725534+0000","last_unstale":"2024-06-02T23:46:32.519434+0000","last_undegraded":"2024-06-02T23:46:32.519434+0000","last_fullsized":"2024-06-02T23:46:32.519434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:32.885581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519416+0000","last_change":"2024-06-02T23:46:25.730569+0000","last_active":"2024-06-02T23:46:32.519416+0000","last_peered":"2024-06-02T23:46:32.519416+0000","last_clean":"2024-06-02T23:46:32.519416+0000","last_became_active":"2024-06-02T23:46:25.728481+0000","last_became_peered":"2024-06-02T23:46:25.728481+0000","last_unstale":"2024-06-02T23:46:32.519416+0000","last_undegraded":"2024-06-02T23:46:32.519416+0000","last_fullsized":"2024-06-02T23:46:32.519416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:30.761074+0000","last_change":"2024-06-02T23:46:25.730619+0000","last_active":"2024-06-02T23:46:30.761074+0000","last_peered":"2024-06-02T23:46:30.761074+0000","last_clean":"2024-06-02T23:46:30.761074+0000","last_became_active":"2024-06-02T23:46:25.730319+0000","last_became_peered":"2024-06-02T23:46:25.730319+0000","last_unstale":"2024-06-02T23:46:30.761074+0000","last_undegraded":"2024-06-02T23:46:30.761074+0000","last_fullsized":"2024-06-02T23:46:30.761074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:30:08.778940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520090+0000","last_change":"2024-06-02T23:46:25.733651+0000","last_active":"2024-06-02T23:46:32.520090+0000","last_peered":"2024-06-02T23:46:32.520090+0000","last_clean":"2024-06-02T23:46:32.520090+0000","last_became_active":"2024-06-02T23:46:25.733349+0000","last_became_peered":"2024-06-02T23:46:25.733349+0000","last_unstale":"2024-06-02T23:46:32.520090+0000","last_undegraded":"2024-06-02T23:46:32.520090+0000","last_fullsized":"2024-06-02T23:46:32.520090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520283+0000","last_change":"2024-06-02T23:46:25.727878+0000","last_active":"2024-06-02T23:46:32.520283+0000","last_peered":"2024-06-02T23:46:32.520283+0000","last_clean":"2024-06-02T23:46:32.520283+0000","last_became_active":"2024-06-02T23:46:25.727594+0000","last_became_peered":"2024-06-02T23:46:25.727594+0000","last_unstale":"2024-06-02T23:46:32.520283+0000","last_undegraded":"2024-06-02T23:46:32.520283+0000","last_fullsized":"2024-06-02T23:46:32.520283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520435+0000","last_change":"2024-06-02T23:46:25.734791+0000","last_active":"2024-06-02T23:46:32.520435+0000","last_peered":"2024-06-02T23:46:32.520435+0000","last_clean":"2024-06-02T23:46:32.520435+0000","last_became_active":"2024-06-02T23:46:25.734514+0000","last_became_peered":"2024-06-02T23:46:25.734514+0000","last_unstale":"2024-06-02T23:46:32.520435+0000","last_undegraded":"2024-06-02T23:46:32.520435+0000","last_fullsized":"2024-06-02T23:46:32.520435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:30:09.854508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519886+0000","last_change":"2024-06-02T23:46:25.736896+0000","last_active":"2024-06-02T23:46:32.519886+0000","last_peered":"2024-06-02T23:46:32.519886+0000","last_clean":"2024-06-02T23:46:32.519886+0000","last_became_active":"2024-06-02T23:46:25.736216+0000","last_became_peered":"2024-06-02T23:46:25.736216+0000","last_unstale":"2024-06-02T23:46:32.519886+0000","last_undegraded":"2024-06-02T23:46:32.519886+0000","last_fullsized":"2024-06-02T23:46:32.519886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:23:10.751775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519694+0000","last_change":"2024-06-02T23:46:25.723384+0000","last_active":"2024-06-02T23:46:32.519694+0000","last_peered":"2024-06-02T23:46:32.519694+0000","last_clean":"2024-06-02T23:46:32.519694+0000","last_became_active":"2024-06-02T23:46:25.722938+0000","last_became_peered":"2024-06-02T23:46:25.722938+0000","last_unstale":"2024-06-02T23:46:32.519694+0000","last_undegraded":"2024-06-02T23:46:32.519694+0000","last_fullsized":"2024-06-02T23:46:32.519694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:11:44.893001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020020+0000","last_change":"2024-06-02T23:46:25.729629+0000","last_active":"2024-06-02T23:46:32.020020+0000","last_peered":"2024-06-02T23:46:32.020020+0000","last_clean":"2024-06-02T23:46:32.020020+0000","last_became_active":"2024-06-02T23:46:25.729363+0000","last_became_peered":"2024-06-02T23:46:25.729363+0000","last_unstale":"2024-06-02T23:46:32.020020+0000","last_undegraded":"2024-06-02T23:46:32.020020+0000","last_fullsized":"2024-06-02T23:46:32.020020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:51:15.345342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520515+0000","last_change":"2024-06-02T23:46:25.734931+0000","last_active":"2024-06-02T23:46:32.520515+0000","last_peered":"2024-06-02T23:46:32.520515+0000","last_clean":"2024-06-02T23:46:32.520515+0000","last_became_active":"2024-06-02T23:46:25.734577+0000","last_became_peered":"2024-06-02T23:46:25.734577+0000","last_unstale":"2024-06-02T23:46:32.520515+0000","last_undegraded":"2024-06-02T23:46:32.520515+0000","last_fullsized":"2024-06-02T23:46:32.520515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:32:06.627967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.020302+0000","last_change":"2024-06-02T23:46:25.732610+0000","last_active":"2024-06-02T23:46:32.020302+0000","last_peered":"2024-06-02T23:46:32.020302+0000","last_clean":"2024-06-02T23:46:32.020302+0000","last_became_active":"2024-06-02T23:46:25.731714+0000","last_became_peered":"2024-06-02T23:46:25.731714+0000","last_unstale":"2024-06-02T23:46:32.020302+0000","last_undegraded":"2024-06-02T23:46:32.020302+0000","last_fullsized":"2024-06-02T23:46:32.020302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:37:48.510226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519731+0000","last_change":"2024-06-02T23:46:25.729533+0000","last_active":"2024-06-02T23:46:32.519731+0000","last_peered":"2024-06-02T23:46:32.519731+0000","last_clean":"2024-06-02T23:46:32.519731+0000","last_became_active":"2024-06-02T23:46:25.729234+0000","last_became_peered":"2024-06-02T23:46:25.729234+0000","last_unstale":"2024-06-02T23:46:32.519731+0000","last_undegraded":"2024-06-02T23:46:32.519731+0000","last_fullsized":"2024-06-02T23:46:32.519731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:53.206061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.519199+0000","last_change":"2024-06-02T23:46:25.727031+0000","last_active":"2024-06-02T23:46:32.519199+0000","last_peered":"2024-06-02T23:46:32.519199+0000","last_clean":"2024-06-02T23:46:32.519199+0000","last_became_active":"2024-06-02T23:46:25.726700+0000","last_became_peered":"2024-06-02T23:46:25.726700+0000","last_unstale":"2024-06-02T23:46:32.519199+0000","last_undegraded":"2024-06-02T23:46:32.519199+0000","last_fullsized":"2024-06-02T23:46:32.519199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T23:59:01.671423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-06-02T23:46:32.520212+0000","last_change":"2024-06-02T23:46:25.731930+0000","last_active":"2024-06-02T23:46:32.520212+0000","last_peered":"2024-06-02T23:46:32.520212+0000","last_clean":"2024-06-02T23:46:32.520212+0000","last_became_active":"2024-06-02T23:46:25.730679+0000","last_became_peered":"2024-06-02T23:46:25.730679+0000","last_unstale":"2024-06-02T23:46:32.520212+0000","last_undegraded":"2024-06-02T23:46:32.520212+0000","last_fullsized":"2024-06-02T23:46:32.520212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:24.698381+0000","last_clean_scrub_stamp":"2024-06-02T23:46:24.698381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:12.887235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:46:50.505 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T23:46:50.505 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-02T23:46:50.505 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-06-02T23:46:50.505 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-06-02T23:46:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.640+0000 7fd6e55c8640 1 Processor -- start 2024-06-02T23:46:50.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.640+0000 7fd6e55c8640 1 -- start start 2024-06-02T23:46:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.640+0000 7fd6e55c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00d2d10 0x7fd6e00d4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.640+0000 7fd6e55c8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd6e00d1e00 0x7fd6e00b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.640+0000 7fd6e55c8640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e00d05d0 con 0x7fd6e015e4f0 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.640+0000 7fd6e55c8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e00d2240 con 0x7fd6e00d1e00 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.640+0000 7fd6e55c8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e00cf9c0 con 0x7fd6e00d2d10 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6deffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd6e015e4f0 0x7fd6e00d2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39974/0 (socket says 172.21.15.96:39974) 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6deffd640 1 -- 172.21.15.96:0/2015506033 learned_addr learned my addr 172.21.15.96:0/2015506033 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200096758 0 0) 0x7fd6e00d05d0 con 0x7fd6e015e4f0 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6de7fc640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00d2d10 0x7fd6e00d4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6c8003520 con 0x7fd6e015e4f0 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6df7fe640 1 --2- 172.21.15.96:0/2015506033 >> v2:172.21.15.162:3300/0 conn(0x7fd6e00d1e00 0x7fd6e00b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2773703867 0 0) 0x7fd6c8003520 con 0x7fd6e015e4f0 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00d2d10 msgr2=0x7fd6e00d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00d2d10 0x7fd6e00d4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 >> v2:172.21.15.162:3300/0 conn(0x7fd6e00d1e00 msgr2=0x7fd6e00b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 --2- 172.21.15.96:0/2015506033 >> v2:172.21.15.162:3300/0 conn(0x7fd6e00d1e00 0x7fd6e00b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e00cfca0 con 0x7fd6e015e4f0 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fd6d0001670 con 0x7fd6e015e4f0 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 >> v1:172.21.15.96:6789/0 conn(0x7fd6e015e4f0 legacy=0x7fd6e00d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6c80039b0 0x7fd6c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 0x7fd6c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00d2d10 0x7fd6c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e00d2240 con 0x7fd6c8004800 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e00cf9c0 con 0x7fd6c80039b0 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c800b9c0 con 0x7fd6e00d2d10 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6de7fc640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 0x7fd6c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6deffd640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6c80039b0 0x7fd6c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.641+0000 7fd6df7fe640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00d2d10 0x7fd6c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.642+0000 7fd6de7fc640 1 -- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00d2d10 msgr2=0x7fd6c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:50.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.642+0000 7fd6de7fc640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00d2d10 0x7fd6c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.642+0000 7fd6de7fc640 1 -- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6c80039b0 msgr2=0x7fd6c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.642+0000 7fd6de7fc640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6c80039b0 0x7fd6c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.642+0000 7fd6de7fc640 1 -- 172.21.15.96:0/2015506033 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c8003520 con 0x7fd6c8004800 2024-06-02T23:46:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.642+0000 7fd6df7fe640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00d2d10 0x7fd6c80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.642+0000 7fd6de7fc640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 0x7fd6c8004c80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009ac0 tx=0x7fd6c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4c4f43e6a07b59 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.642+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4036070 con 0x7fd6c8004800 2024-06-02T23:46:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.642+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d4031400 con 0x7fd6c8004800 2024-06-02T23:46:50.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.642+0000 7fd6ddffb640 1 -- 172.21.15.96:0/2015506033 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4009690 con 0x7fd6c8004800 2024-06-02T23:46:50.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.643+0000 7fd6e55c8640 1 -- 172.21.15.96:0/2015506033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 msgr2=0x7fd6c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.643+0000 7fd6e55c8640 1 --2- 172.21.15.96:0/2015506033 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 0x7fd6c8004c80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009ac0 tx=0x7fd6c8005830 comp rx=0 tx=0).stop 2024-06-02T23:46:50.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.643+0000 7fd6df7fe640 1 -- 172.21.15.96:0/2015506033 reap_dead start 2024-06-02T23:46:50.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.643+0000 7fd6e55c8640 1 -- 172.21.15.96:0/2015506033 shutdown_connections 2024-06-02T23:46:50.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.643+0000 7fd6e55c8640 1 -- 172.21.15.96:0/2015506033 >> 172.21.15.96:0/2015506033 conn(0x7fd6e00d4020 msgr2=0x7fd6e00d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:50.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.643+0000 7fd6e55c8640 1 -- 172.21.15.96:0/2015506033 shutdown_connections 2024-06-02T23:46:50.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.643+0000 7fd6e55c8640 1 -- 172.21.15.96:0/2015506033 wait complete. 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.644+0000 7fd6e55c8640 1 Processor -- start 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.644+0000 7fd6e55c8640 1 -- start start 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6e55c8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 0x7fd6e00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6e55c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e01f83a0 0x7fd6e00ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6e55c8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00cd430 0x7fd6e01f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6e55c8640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e00d4b40 con 0x7fd6c8004800 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6e55c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e00d0260 con 0x7fd6e01f83a0 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6e55c8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e00d4cc0 con 0x7fd6e00cd430 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6deffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 0x7fd6e00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6deffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 0x7fd6e00cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55110/0 (socket says 172.21.15.96:55110) 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6deffd640 1 -- 172.21.15.96:0/1873730510 learned_addr learned my addr 172.21.15.96:0/1873730510 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6deffd640 1 -- 172.21.15.96:0/1873730510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00cd430 msgr2=0x7fd6e01f7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6deffd640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00cd430 0x7fd6e01f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6deffd640 1 -- 172.21.15.96:0/1873730510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e01f83a0 msgr2=0x7fd6e00ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6de7fc640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e01f83a0 0x7fd6e00ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6deffd640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e01f83a0 0x7fd6e00ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.645+0000 7fd6deffd640 1 -- 172.21.15.96:0/1873730510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e00cd8f0 con 0x7fd6c8004800 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.646+0000 7fd6deffd640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 0x7fd6e00cb390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0007290 tx=0x7fd6d0007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.646+0000 7fd6c77fe640 1 -- 172.21.15.96:0/1873730510 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000f9c0 con 0x7fd6c8004800 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.646+0000 7fd6c77fe640 1 -- 172.21.15.96:0/1873730510 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d0018070 con 0x7fd6c8004800 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.646+0000 7fd6e55c8640 1 -- 172.21.15.96:0/1873730510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e00cdbd0 con 0x7fd6c8004800 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.646+0000 7fd6c77fe640 1 -- 172.21.15.96:0/1873730510 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d000fdc0 con 0x7fd6c8004800 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.646+0000 7fd6e55c8640 1 -- 172.21.15.96:0/1873730510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e00ce190 con 0x7fd6c8004800 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.647+0000 7fd6e55c8640 1 -- 172.21.15.96:0/1873730510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e00683e0 con 0x7fd6c8004800 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.647+0000 7fd6c77fe640 1 -- 172.21.15.96:0/1873730510 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6d001d460 con 0x7fd6c8004800 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.648+0000 7fd6c77fe640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd6cc06be30 0x7fd6cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.648+0000 7fd6de7fc640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd6cc06be30 0x7fd6cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.648+0000 7fd6c77fe640 1 -- 172.21.15.96:0/1873730510 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd6d008b150 con 0x7fd6c8004800 2024-06-02T23:46:50.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.648+0000 7fd6de7fc640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd6cc06be30 0x7fd6cc06e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4033000 tx=0x7fd6d4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:50.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.652+0000 7fd6c77fe640 1 -- 172.21.15.96:0/1873730510 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd6d0059850 con 0x7fd6c8004800 2024-06-02T23:46:50.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.866+0000 7fd6e55c8640 1 -- 172.21.15.96:0/1873730510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd6e00c7900 con 0x7fd6c8004800 2024-06-02T23:46:50.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.866+0000 7fd6c77fe640 1 -- 172.21.15.96:0/1873730510 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd6d0059150 con 0x7fd6c8004800 2024-06-02T23:46:50.867 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:50.867 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-02T23:46:50.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 -- 172.21.15.96:0/1873730510 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd6cc06be30 msgr2=0x7fd6cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd6cc06be30 0x7fd6cc06e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4033000 tx=0x7fd6d4008030 comp rx=0 tx=0).stop 2024-06-02T23:46:50.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 -- 172.21.15.96:0/1873730510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 msgr2=0x7fd6e00cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 0x7fd6e00cb390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0007290 tx=0x7fd6d0007750 comp rx=0 tx=0).stop 2024-06-02T23:46:50.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 -- 172.21.15.96:0/1873730510 shutdown_connections 2024-06-02T23:46:50.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6e00cd430 0x7fd6e01f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6e01f83a0 0x7fd6e00ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd6cc06be30 0x7fd6cc06e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 --2- 172.21.15.96:0/1873730510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd6c8004800 0x7fd6e00cb390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 -- 172.21.15.96:0/1873730510 >> 172.21.15.96:0/1873730510 conn(0x7fd6e00d4020 msgr2=0x7fd6e006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:50.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 -- 172.21.15.96:0/1873730510 shutdown_connections 2024-06-02T23:46:50.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.868+0000 7fd6e55c8640 1 -- 172.21.15.96:0/1873730510 wait complete. 2024-06-02T23:46:50.879 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-06-02T23:46:50.879 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:46:50.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.978+0000 7f9af8b09640 1 Processor -- start 2024-06-02T23:46:50.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.978+0000 7f9af8b09640 1 -- start start 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af8b09640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af415f290 0x7f9af40b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af8b09640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af41627e0 con 0x7f9af4067100 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af8b09640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af4162ac0 con 0x7f9af406b3c0 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af8b09640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9af415ee00 con 0x7f9af415f290 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9aebfff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9af4067100 0x7f9af4161f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39982/0 (socket says 172.21.15.96:39982) 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9aebfff640 1 -- 172.21.15.96:0/827101812 learned_addr learned my addr 172.21.15.96:0/827101812 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af2d9d640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af415f290 0x7f9af40b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3416756178 0 0) 0x7f9af41627e0 con 0x7f9af4067100 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae0003520 con 0x7f9af4067100 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1314099171 0 0) 0x7f9ae0003520 con 0x7f9af4067100 2024-06-02T23:46:50.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af415f290 msgr2=0x7f9af40b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af1d9b640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af415f290 0x7f9af40b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 >> v1:172.21.15.162:6789/0 conn(0x7f9af406b3c0 legacy=0x7f9af406b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.979+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af4162da0 con 0x7f9af4067100 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f9adc001670 con 0x7f9af4067100 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 >> v1:172.21.15.96:6789/0 conn(0x7f9af4067100 legacy=0x7f9af4161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af1d9b640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 0x7f9ae0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af1d9b640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af415f290 0x7f9ae0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af1d9b640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ae0004d40 0x7f9ae00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9af415ee00 con 0x7f9ae00039e0 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae000b9f0 con 0x7f9ae0004d40 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae000bbf0 con 0x7f9af415f290 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af259c640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 0x7f9ae0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9aebfff640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af415f290 0x7f9ae0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af2d9d640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ae0004d40 0x7f9ae00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af259c640 1 -- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af415f290 msgr2=0x7f9ae0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af259c640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af415f290 0x7f9ae0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af259c640 1 -- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ae0004d40 msgr2=0x7f9ae00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af259c640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ae0004d40 0x7f9ae00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.980+0000 7f9af259c640 1 -- 172.21.15.96:0/827101812 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae0003520 con 0x7f9ae00039e0 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af259c640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 0x7f9ae0003dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4001860 tx=0x7f9ae0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964557e86c09c864 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4037070 con 0x7f9ae00039e0 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae402ab60 con 0x7f9ae00039e0 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af1d9b640 1 -- 172.21.15.96:0/827101812 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4001430 con 0x7f9ae00039e0 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af8b09640 1 -- 172.21.15.96:0/827101812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 msgr2=0x7f9ae0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af8b09640 1 --2- 172.21.15.96:0/827101812 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 0x7f9ae0003dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4001860 tx=0x7f9ae0005830 comp rx=0 tx=0).stop 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af2d9d640 1 -- 172.21.15.96:0/827101812 reap_dead start 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af8b09640 1 -- 172.21.15.96:0/827101812 shutdown_connections 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af8b09640 1 -- 172.21.15.96:0/827101812 >> 172.21.15.96:0/827101812 conn(0x7f9af40b1f80 msgr2=0x7f9af40b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:50.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af8b09640 1 -- 172.21.15.96:0/827101812 shutdown_connections 2024-06-02T23:46:50.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.981+0000 7f9af8b09640 1 -- 172.21.15.96:0/827101812 wait complete. 2024-06-02T23:46:50.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.983+0000 7f9af8b09640 1 Processor -- start 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.983+0000 7f9af8b09640 1 -- start start 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.983+0000 7f9af8b09640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 0x7f9af40cf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.983+0000 7f9af8b09640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9af4153f80 0x7f9af40990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.983+0000 7f9af8b09640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af4099600 0x7f9af41610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.983+0000 7f9af8b09640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9af415f720 con 0x7f9ae00039e0 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.983+0000 7f9af8b09640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9af40afe90 con 0x7f9af4153f80 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.983+0000 7f9af8b09640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9af415f8a0 con 0x7f9af4099600 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 0x7f9af40cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 0x7f9af40cf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55132/0 (socket says 172.21.15.96:55132) 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af259c640 1 -- 172.21.15.96:0/786685949 learned_addr learned my addr 172.21.15.96:0/786685949 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9aebfff640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9af4153f80 0x7f9af40990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af2d9d640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af4099600 0x7f9af41610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af259c640 1 -- 172.21.15.96:0/786685949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af4099600 msgr2=0x7f9af41610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af259c640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af4099600 0x7f9af41610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af259c640 1 -- 172.21.15.96:0/786685949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9af4153f80 msgr2=0x7f9af40990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af259c640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9af4153f80 0x7f9af40990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af259c640 1 -- 172.21.15.96:0/786685949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af40cdf80 con 0x7f9ae00039e0 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9aebfff640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9af4153f80 0x7f9af40990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af259c640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 0x7f9af40cf960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4001780 tx=0x7f9ae4001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9aeaffd640 1 -- 172.21.15.96:0/786685949 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae403f020 con 0x7f9ae00039e0 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9aeaffd640 1 -- 172.21.15.96:0/786685949 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae4005270 con 0x7f9ae00039e0 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af8b09640 1 -- 172.21.15.96:0/786685949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af40ce260 con 0x7f9ae00039e0 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9aeaffd640 1 -- 172.21.15.96:0/786685949 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4037040 con 0x7f9ae00039e0 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.984+0000 7f9af8b09640 1 -- 172.21.15.96:0/786685949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af4099ad0 con 0x7f9ae00039e0 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.985+0000 7f9af8b09640 1 -- 172.21.15.96:0/786685949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af4073da0 con 0x7f9ae00039e0 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.986+0000 7f9aeaffd640 1 -- 172.21.15.96:0/786685949 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ae4042020 con 0x7f9ae00039e0 2024-06-02T23:46:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.986+0000 7f9aeaffd640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9ad406be30 0x7f9ad406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:50.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.986+0000 7f9aeaffd640 1 -- 172.21.15.96:0/786685949 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9ae40ab1b0 con 0x7f9ae00039e0 2024-06-02T23:46:50.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.986+0000 7f9aebfff640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9ad406be30 0x7f9ad406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:50.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.987+0000 7f9aebfff640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9ad406be30 0x7f9ad406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9af40b3190 tx=0x7f9adc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:50.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:50.991+0000 7f9aeaffd640 1 -- 172.21.15.96:0/786685949 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9af4073da0 con 0x7f9ae00039e0 2024-06-02T23:46:51.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.201+0000 7f9af8b09640 1 -- 172.21.15.96:0/786685949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9af40683e0 con 0x7f9ae00039e0 2024-06-02T23:46:51.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.201+0000 7f9aeaffd640 1 -- 172.21.15.96:0/786685949 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f9ae4049030 con 0x7f9ae00039e0 2024-06-02T23:46:51.201 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:51.202 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:46:25.060503+0000","modified":"2024-06-02T23:46:44.137908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-02T23:46:51.202 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 8 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 -- 172.21.15.96:0/786685949 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9ad406be30 msgr2=0x7f9ad406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9ad406be30 0x7f9ad406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9af40b3190 tx=0x7f9adc009040 comp rx=0 tx=0).stop 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 -- 172.21.15.96:0/786685949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 msgr2=0x7f9af40cf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 0x7f9af40cf960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4001780 tx=0x7f9ae4001230 comp rx=0 tx=0).stop 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 -- 172.21.15.96:0/786685949 shutdown_connections 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9af4099600 0x7f9af41610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9af4153f80 0x7f9af40990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9ad406be30 0x7f9ad406e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 --2- 172.21.15.96:0/786685949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ae00039e0 0x7f9af40cf960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 -- 172.21.15.96:0/786685949 >> 172.21.15.96:0/786685949 conn(0x7f9af40b1f80 msgr2=0x7f9af406ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 -- 172.21.15.96:0/786685949 shutdown_connections 2024-06-02T23:46:51.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.203+0000 7f9af8b09640 1 -- 172.21.15.96:0/786685949 wait complete. 2024-06-02T23:46:51.215 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:46:51.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.314+0000 7fb073d77640 1 Processor -- start 2024-06-02T23:46:51.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.314+0000 7fb073d77640 1 -- start start 2024-06-02T23:46:51.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.315+0000 7fb073d77640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb06c161900 0x7fb06c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.315+0000 7fb073d77640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb06c0b5510 0x7fb06c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.315+0000 7fb073d77640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb06c0d4a90 con 0x7fb06c0b4fa0 2024-06-02T23:46:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.315+0000 7fb073d77640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb06c0cf5c0 con 0x7fb06c161900 2024-06-02T23:46:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.315+0000 7fb073d77640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb06c0caf70 con 0x7fb06c0b5510 2024-06-02T23:46:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.315+0000 7fb071b13640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb06c161900 0x7fb06c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.315+0000 7fb072314640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb06c0b4fa0 0x7fb06c0d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39994/0 (socket says 172.21.15.96:39994) 2024-06-02T23:46:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.315+0000 7fb072314640 1 -- 172.21.15.96:0/701501386 learned_addr learned my addr 172.21.15.96:0/701501386 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.316+0000 7fb071312640 1 --2- 172.21.15.96:0/701501386 >> v2:172.21.15.162:3300/0 conn(0x7fb06c0b5510 0x7fb06c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.316+0000 7fb071b13640 1 -- 172.21.15.96:0/701501386 >> v2:172.21.15.162:3300/0 conn(0x7fb06c0b5510 msgr2=0x7fb06c0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:51.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.316+0000 7fb071b13640 1 --2- 172.21.15.96:0/701501386 >> v2:172.21.15.162:3300/0 conn(0x7fb06c0b5510 0x7fb06c0d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.316+0000 7fb071b13640 1 -- 172.21.15.96:0/701501386 >> v1:172.21.15.96:6789/0 conn(0x7fb06c0b4fa0 legacy=0x7fb06c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.316+0000 7fb071b13640 1 -- 172.21.15.96:0/701501386 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c0d4d70 con 0x7fb06c161900 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.316+0000 7fb071b13640 1 --2- 172.21.15.96:0/701501386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 0x7fb06c0d0a10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb06c08cc50 tx=0x7fb05c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e048a09801852c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb070b11640 1 -- 172.21.15.96:0/701501386 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c037070 con 0x7fb06c161900 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb070b11640 1 -- 172.21.15.96:0/701501386 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c032440 con 0x7fb06c161900 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb070b11640 1 -- 172.21.15.96:0/701501386 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c02ae60 con 0x7fb06c161900 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb073d77640 1 -- 172.21.15.96:0/701501386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 msgr2=0x7fb06c0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb073d77640 1 --2- 172.21.15.96:0/701501386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 0x7fb06c0d0a10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb06c08cc50 tx=0x7fb05c02a110 comp rx=0 tx=0).stop 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb073d77640 1 -- 172.21.15.96:0/701501386 shutdown_connections 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb073d77640 1 --2- 172.21.15.96:0/701501386 >> v2:172.21.15.162:3300/0 conn(0x7fb06c0b5510 0x7fb06c0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb073d77640 1 --2- 172.21.15.96:0/701501386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 0x7fb06c0d0a10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb073d77640 1 -- 172.21.15.96:0/701501386 >> 172.21.15.96:0/701501386 conn(0x7fb06c09d3b0 msgr2=0x7fb06c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb073d77640 1 -- 172.21.15.96:0/701501386 shutdown_connections 2024-06-02T23:46:51.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.317+0000 7fb073d77640 1 -- 172.21.15.96:0/701501386 wait complete. 2024-06-02T23:46:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.318+0000 7fb073d77640 1 Processor -- start 2024-06-02T23:46:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.318+0000 7fb073d77640 1 -- start start 2024-06-02T23:46:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb073d77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c0b4fa0 0x7fb06c0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb073d77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb06c0b5510 0x7fb06c1f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb073d77640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 0x7fb06c15f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb073d77640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c0d4780 con 0x7fb06c161900 2024-06-02T23:46:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb073d77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb06c0cfae0 con 0x7fb06c0b4fa0 2024-06-02T23:46:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb073d77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb06c161ce0 con 0x7fb06c0b5510 2024-06-02T23:46:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb072314640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 0x7fb06c15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb072314640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 0x7fb06c15f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55156/0 (socket says 172.21.15.96:55156) 2024-06-02T23:46:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb072314640 1 -- 172.21.15.96:0/451654167 learned_addr learned my addr 172.21.15.96:0/451654167 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb071312640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb06c0b5510 0x7fb06c1f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb072314640 1 -- 172.21.15.96:0/451654167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb06c0b5510 msgr2=0x7fb06c1f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb072314640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb06c0b5510 0x7fb06c1f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb071b13640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c0b4fa0 0x7fb06c0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.319+0000 7fb072314640 1 -- 172.21.15.96:0/451654167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c0b4fa0 msgr2=0x7fb06c0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.320+0000 7fb072314640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c0b4fa0 0x7fb06c0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.320+0000 7fb072314640 1 -- 172.21.15.96:0/451654167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb06c1595f0 con 0x7fb06c161900 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.320+0000 7fb071b13640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c0b4fa0 0x7fb06c0cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.320+0000 7fb072314640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 0x7fb06c15f020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb06400cbc0 tx=0x7fb06400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.320+0000 7fb06a7fc640 1 -- 172.21.15.96:0/451654167 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064017070 con 0x7fb06c161900 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.320+0000 7fb06a7fc640 1 -- 172.21.15.96:0/451654167 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06400ad40 con 0x7fb06c161900 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.320+0000 7fb073d77640 1 -- 172.21.15.96:0/451654167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06c1598d0 con 0x7fb06c161900 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.320+0000 7fb06a7fc640 1 -- 172.21.15.96:0/451654167 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064012600 con 0x7fb06c161900 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.320+0000 7fb073d77640 1 -- 172.21.15.96:0/451654167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb06c159e90 con 0x7fb06c161900 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.321+0000 7fb073d77640 1 -- 172.21.15.96:0/451654167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb06c0683e0 con 0x7fb06c161900 2024-06-02T23:46:51.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.321+0000 7fb06a7fc640 1 -- 172.21.15.96:0/451654167 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb06401a070 con 0x7fb06c161900 2024-06-02T23:46:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.322+0000 7fb06a7fc640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb05806be30 0x7fb05806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.322+0000 7fb071b13640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb05806be30 0x7fb05806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.322+0000 7fb06a7fc640 1 -- 172.21.15.96:0/451654167 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb06408ae00 con 0x7fb06c161900 2024-06-02T23:46:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.322+0000 7fb071b13640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb05806be30 0x7fb05806e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb05c034000 tx=0x7fb05c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:51.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.326+0000 7fb06a7fc640 1 -- 172.21.15.96:0/451654167 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb064058eb0 con 0x7fb06c161900 2024-06-02T23:46:51.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.536+0000 7fb073d77640 1 -- 172.21.15.96:0/451654167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb06c160570 con 0x7fb06c161900 2024-06-02T23:46:51.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.536+0000 7fb06a7fc640 1 -- 172.21.15.96:0/451654167 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7fb06405d1b0 con 0x7fb06c161900 2024-06-02T23:46:51.536 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:51.537 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:46:25.060503+0000","modified":"2024-06-02T23:46:44.137908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-02T23:46:51.537 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 8 2024-06-02T23:46:51.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 -- 172.21.15.96:0/451654167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb05806be30 msgr2=0x7fb05806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb05806be30 0x7fb05806e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb05c034000 tx=0x7fb05c02e000 comp rx=0 tx=0).stop 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 -- 172.21.15.96:0/451654167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 msgr2=0x7fb06c15f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 0x7fb06c15f020 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb06400cbc0 tx=0x7fb06400a430 comp rx=0 tx=0).stop 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 -- 172.21.15.96:0/451654167 shutdown_connections 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb05806be30 0x7fb05806e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb06c161900 0x7fb06c15f020 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb06c0b5510 0x7fb06c1f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 --2- 172.21.15.96:0/451654167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb06c0b4fa0 0x7fb06c0cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 -- 172.21.15.96:0/451654167 >> 172.21.15.96:0/451654167 conn(0x7fb06c09d3b0 msgr2=0x7fb06c0ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 -- 172.21.15.96:0/451654167 shutdown_connections 2024-06-02T23:46:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.538+0000 7fb073d77640 1 -- 172.21.15.96:0/451654167 wait complete. 2024-06-02T23:46:51.549 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:46:51.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.647+0000 7f0f97589640 1 Processor -- start 2024-06-02T23:46:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.647+0000 7f0f97589640 1 -- start start 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.648+0000 7f0f97589640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f9006ea70 0x7f0f90071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.648+0000 7f0f97589640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0f900cae00 0x7f0f900cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.648+0000 7f0f97589640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f9006f210 con 0x7f0f9015f5e0 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.648+0000 7f0f97589640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0f9006ef30 con 0x7f0f9006ea70 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.648+0000 7f0f97589640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0f900ca320 con 0x7f0f900cae00 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.648+0000 7f0f94b24640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f9006ea70 0x7f0f90071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.648+0000 7f0f95325640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f0f9015f5e0 0x7f0f90071100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40000/0 (socket says 172.21.15.96:40000) 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.648+0000 7f0f94b24640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f9006ea70 0x7f0f90071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55168/0 (socket says 172.21.15.96:55168) 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.648+0000 7f0f94b24640 1 -- 172.21.15.96:0/2313926229 learned_addr learned my addr 172.21.15.96:0/2313926229 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.649+0000 7f0f94b24640 1 -- 172.21.15.96:0/2313926229 >> v2:172.21.15.162:3300/0 conn(0x7f0f900cae00 msgr2=0x7f0f900cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.649+0000 7f0f95b26640 1 --2- 172.21.15.96:0/2313926229 >> v2:172.21.15.162:3300/0 conn(0x7f0f900cae00 0x7f0f900cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.649+0000 7f0f94b24640 1 --2- 172.21.15.96:0/2313926229 >> v2:172.21.15.162:3300/0 conn(0x7f0f900cae00 0x7f0f900cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.649+0000 7f0f94b24640 1 -- 172.21.15.96:0/2313926229 >> v1:172.21.15.96:6789/0 conn(0x7f0f9015f5e0 legacy=0x7f0f90071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.649+0000 7f0f87fff640 1 -- 172.21.15.96:0/2313926229 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175826594 0 0) 0x7f0f9006f210 con 0x7f0f9015f5e0 2024-06-02T23:46:51.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.649+0000 7f0f94b24640 1 -- 172.21.15.96:0/2313926229 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f900ca600 con 0x7f0f9006ea70 2024-06-02T23:46:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.649+0000 7f0f94b24640 1 --2- 172.21.15.96:0/2313926229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 0x7f0f90071810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0f90070e80 tx=0x7f0f8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d64a0019d2ccc1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.649+0000 7f0f87fff640 1 -- 172.21.15.96:0/2313926229 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80037070 con 0x7f0f9006ea70 2024-06-02T23:46:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.649+0000 7f0f87fff640 1 -- 172.21.15.96:0/2313926229 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f80032440 con 0x7f0f9006ea70 2024-06-02T23:46:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.649+0000 7f0f87fff640 1 -- 172.21.15.96:0/2313926229 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80032810 con 0x7f0f9006ea70 2024-06-02T23:46:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.650+0000 7f0f97589640 1 -- 172.21.15.96:0/2313926229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 msgr2=0x7f0f90071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.650+0000 7f0f97589640 1 --2- 172.21.15.96:0/2313926229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 0x7f0f90071810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0f90070e80 tx=0x7f0f8002a270 comp rx=0 tx=0).stop 2024-06-02T23:46:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.650+0000 7f0f97589640 1 -- 172.21.15.96:0/2313926229 shutdown_connections 2024-06-02T23:46:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.650+0000 7f0f97589640 1 --2- 172.21.15.96:0/2313926229 >> v2:172.21.15.162:3300/0 conn(0x7f0f900cae00 0x7f0f900cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.650+0000 7f0f97589640 1 --2- 172.21.15.96:0/2313926229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 0x7f0f90071810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.650+0000 7f0f97589640 1 -- 172.21.15.96:0/2313926229 >> 172.21.15.96:0/2313926229 conn(0x7f0f900cfc30 msgr2=0x7f0f900d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.650+0000 7f0f97589640 1 -- 172.21.15.96:0/2313926229 shutdown_connections 2024-06-02T23:46:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.650+0000 7f0f97589640 1 -- 172.21.15.96:0/2313926229 wait complete. 2024-06-02T23:46:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.651+0000 7f0f97589640 1 Processor -- start 2024-06-02T23:46:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.651+0000 7f0f97589640 1 -- start start 2024-06-02T23:46:51.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f97589640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 0x7f0f900c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f97589640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f900cae00 0x7f0f900c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f97589640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f9015f5e0 0x7f0f900c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f97589640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0f900731b0 con 0x7f0f9006ea70 2024-06-02T23:46:51.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f97589640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90073030 con 0x7f0f9015f5e0 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f97589640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0f900b2ac0 con 0x7f0f900cae00 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f95325640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 0x7f0f900c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f95325640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 0x7f0f900c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55174/0 (socket says 172.21.15.96:55174) 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f95325640 1 -- 172.21.15.96:0/3146070870 learned_addr learned my addr 172.21.15.96:0/3146070870 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f94b24640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f900cae00 0x7f0f900c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f95325640 1 -- 172.21.15.96:0/3146070870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f900cae00 msgr2=0x7f0f900c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f95325640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f900cae00 0x7f0f900c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f95325640 1 -- 172.21.15.96:0/3146070870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f9015f5e0 msgr2=0x7f0f900c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f95b26640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f9015f5e0 0x7f0f900c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f95325640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f9015f5e0 0x7f0f900c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f95325640 1 -- 172.21.15.96:0/3146070870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f900c57f0 con 0x7f0f9006ea70 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f94b24640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f900cae00 0x7f0f900c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.652+0000 7f0f95b26640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f9015f5e0 0x7f0f900c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:51.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.653+0000 7f0f95325640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 0x7f0f900c5fa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00c430 tx=0x7f0f8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.653+0000 7f0f85ffb640 1 -- 172.21.15.96:0/3146070870 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0074e0 con 0x7f0f9006ea70 2024-06-02T23:46:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.653+0000 7f0f85ffb640 1 -- 172.21.15.96:0/3146070870 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8c0047e0 con 0x7f0f9006ea70 2024-06-02T23:46:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.653+0000 7f0f97589640 1 -- 172.21.15.96:0/3146070870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f900c3570 con 0x7f0f9006ea70 2024-06-02T23:46:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.653+0000 7f0f85ffb640 1 -- 172.21.15.96:0/3146070870 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c004bd0 con 0x7f0f9006ea70 2024-06-02T23:46:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.653+0000 7f0f97589640 1 -- 172.21.15.96:0/3146070870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f900c3b30 con 0x7f0f9006ea70 2024-06-02T23:46:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.654+0000 7f0f97589640 1 -- 172.21.15.96:0/3146070870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f9006da60 con 0x7f0f9006ea70 2024-06-02T23:46:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.654+0000 7f0f85ffb640 1 -- 172.21.15.96:0/3146070870 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f8c011070 con 0x7f0f9006ea70 2024-06-02T23:46:51.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.655+0000 7f0f85ffb640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0f7406be30 0x7f0f7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.655+0000 7f0f85ffb640 1 -- 172.21.15.96:0/3146070870 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0f8c08ad80 con 0x7f0f9006ea70 2024-06-02T23:46:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.655+0000 7f0f94b24640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0f7406be30 0x7f0f7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.655+0000 7f0f94b24640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0f7406be30 0x7f0f7406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f80034000 tx=0x7f0f8002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:51.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.659+0000 7f0f85ffb640 1 -- 172.21.15.96:0/3146070870 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0f9006da60 con 0x7f0f9006ea70 2024-06-02T23:46:51.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.833+0000 7f0f97589640 1 -- 172.21.15.96:0/3146070870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f900cbf70 con 0x7f0f9006ea70 2024-06-02T23:46:51.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.834+0000 7f0f85ffb640 1 -- 172.21.15.96:0/3146070870 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7f0f8c059480 con 0x7f0f9006ea70 2024-06-02T23:46:51.834 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:51.834 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":24,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:30.096314+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 -- 172.21.15.96:0/3146070870 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0f7406be30 msgr2=0x7f0f7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0f7406be30 0x7f0f7406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f80034000 tx=0x7f0f8002e000 comp rx=0 tx=0).stop 2024-06-02T23:46:51.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 -- 172.21.15.96:0/3146070870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 msgr2=0x7f0f900c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 0x7f0f900c5fa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00c430 tx=0x7f0f8c00c8f0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 -- 172.21.15.96:0/3146070870 shutdown_connections 2024-06-02T23:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f9015f5e0 0x7f0f900c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f900cae00 0x7f0f900c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0f7406be30 0x7f0f7406e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 --2- 172.21.15.96:0/3146070870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f9006ea70 0x7f0f900c5fa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 -- 172.21.15.96:0/3146070870 >> 172.21.15.96:0/3146070870 conn(0x7f0f900cfc30 msgr2=0x7f0f9006cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 -- 172.21.15.96:0/3146070870 shutdown_connections 2024-06-02T23:46:51.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.836+0000 7f0f97589640 1 -- 172.21.15.96:0/3146070870 wait complete. 2024-06-02T23:46:51.848 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:46:51.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.947+0000 7fadf55a9640 1 Processor -- start 2024-06-02T23:46:51.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.947+0000 7fadf55a9640 1 -- start start 2024-06-02T23:46:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.947+0000 7fadf55a9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fadf0161900 0x7fadf00d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadf55a9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf00d2a60 con 0x7fadf00b5510 2024-06-02T23:46:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadf55a9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf00d4a90 con 0x7fadf00b4fa0 2024-06-02T23:46:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadf55a9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fadf00cf5c0 con 0x7fadf0161900 2024-06-02T23:46:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fade67fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fadf00b5510 0x7fadf00d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40012/0 (socket says 172.21.15.96:40012) 2024-06-02T23:46:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fade67fc640 1 -- 172.21.15.96:0/3736581524 learned_addr learned my addr 172.21.15.96:0/3736581524 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadeeffd640 1 --2- 172.21.15.96:0/3736581524 >> v2:172.21.15.162:3300/0 conn(0x7fadf0161900 0x7fadf00d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3046239065 0 0) 0x7fadf00d2a60 con 0x7fadf00b5510 2024-06-02T23:46:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faddc003520 con 0x7fadf00b5510 2024-06-02T23:46:51.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678704249 0 0) 0x7fadf00d4a90 con 0x7fadf00b4fa0 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadf00d2a60 con 0x7fadf00b4fa0 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1562644340 0 0) 0x7faddc003520 con 0x7fadf00b5510 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 >> v2:172.21.15.162:3300/0 conn(0x7fadf0161900 msgr2=0x7fadf00d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 --2- 172.21.15.96:0/3736581524 >> v2:172.21.15.162:3300/0 conn(0x7fadf0161900 0x7fadf00d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 >> v1:172.21.15.162:6789/0 conn(0x7fadf00b4fa0 legacy=0x7fadf00d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf00d4d70 con 0x7fadf00b5510 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fadd8001670 con 0x7fadf00b5510 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 >> v1:172.21.15.96:6789/0 conn(0x7fadf00b5510 legacy=0x7fadf00d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faddc003b40 0x7faddc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faddc004800 0x7faddc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faddc0051c0 0x7faddc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fadf00cf5c0 con 0x7faddc004800 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faddc00c0f0 con 0x7faddc003b40 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faddc00c2f0 con 0x7faddc0051c0 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fade67fc640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faddc004800 0x7faddc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.948+0000 7fadeeffd640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faddc003b40 0x7faddc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.949+0000 7fadef7fe640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faddc0051c0 0x7faddc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.949+0000 7fade67fc640 1 -- 172.21.15.96:0/3736581524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faddc0051c0 msgr2=0x7faddc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.949+0000 7fade67fc640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faddc0051c0 0x7faddc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.949+0000 7fade67fc640 1 -- 172.21.15.96:0/3736581524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faddc003b40 msgr2=0x7faddc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.949+0000 7fade67fc640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faddc003b40 0x7faddc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.949+0000 7fade67fc640 1 -- 172.21.15.96:0/3736581524 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faddc003520 con 0x7faddc004800 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.949+0000 7fadef7fe640 1 -- 172.21.15.96:0/3736581524 reap_dead start 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.949+0000 7fade67fc640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faddc004800 0x7faddc004c80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fadd800c160 tx=0x7faddc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177a1962444917b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.950+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8007ca0 con 0x7faddc004800 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.950+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd8005ad0 con 0x7faddc004800 2024-06-02T23:46:51.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.950+0000 7fadee7fc640 1 -- 172.21.15.96:0/3736581524 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8007070 con 0x7faddc004800 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.950+0000 7fadf55a9640 1 -- 172.21.15.96:0/3736581524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faddc004800 msgr2=0x7faddc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.950+0000 7fadf55a9640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faddc004800 0x7faddc004c80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fadd800c160 tx=0x7faddc005830 comp rx=0 tx=0).stop 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.950+0000 7fadf55a9640 1 -- 172.21.15.96:0/3736581524 shutdown_connections 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.950+0000 7fadf55a9640 1 --2- 172.21.15.96:0/3736581524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faddc004800 0x7faddc004c80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.950+0000 7fadf55a9640 1 -- 172.21.15.96:0/3736581524 >> 172.21.15.96:0/3736581524 conn(0x7fadf009d3b0 msgr2=0x7fadf00d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.950+0000 7fadf55a9640 1 -- 172.21.15.96:0/3736581524 shutdown_connections 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.950+0000 7fadf55a9640 1 -- 172.21.15.96:0/3736581524 wait complete. 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.951+0000 7fadf55a9640 1 Processor -- start 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadf55a9640 1 -- start start 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadf55a9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faddc004800 0x7fadf0153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadf55a9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf0153e40 0x7fadf01f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadf55a9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf0154390 0x7fadf00c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadf55a9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fadf00cfae0 con 0x7fadf0154390 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadf55a9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fadf00caf70 con 0x7fadf0153e40 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadf55a9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fadf00d4780 con 0x7faddc004800 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadef7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf0154390 0x7fadf00c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadef7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf0154390 0x7fadf00c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55196/0 (socket says 172.21.15.96:55196) 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadef7fe640 1 -- 172.21.15.96:0/500855257 learned_addr learned my addr 172.21.15.96:0/500855257 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fade67fc640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf0153e40 0x7fadf01f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.952+0000 7fadeeffd640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faddc004800 0x7fadf0153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fadef7fe640 1 -- 172.21.15.96:0/500855257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faddc004800 msgr2=0x7fadf0153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fadef7fe640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faddc004800 0x7fadf0153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fadef7fe640 1 -- 172.21.15.96:0/500855257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf0153e40 msgr2=0x7fadf01f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fadef7fe640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf0153e40 0x7fadf01f41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fadef7fe640 1 -- 172.21.15.96:0/500855257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf00cbb20 con 0x7fadf0154390 2024-06-02T23:46:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fadef7fe640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf0154390 0x7fadf00c9a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fadf00b5470 tx=0x7fade800feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fade7fff640 1 -- 172.21.15.96:0/500855257 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8019070 con 0x7fadf0154390 2024-06-02T23:46:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fade7fff640 1 -- 172.21.15.96:0/500855257 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade8006e20 con 0x7fadf0154390 2024-06-02T23:46:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fadf55a9640 1 -- 172.21.15.96:0/500855257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf00b9000 con 0x7fadf0154390 2024-06-02T23:46:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fade7fff640 1 -- 172.21.15.96:0/500855257 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8003b70 con 0x7fadf0154390 2024-06-02T23:46:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.953+0000 7fadf55a9640 1 -- 172.21.15.96:0/500855257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf015d4d0 con 0x7fadf0154390 2024-06-02T23:46:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.954+0000 7fadf55a9640 1 -- 172.21.15.96:0/500855257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf00683e0 con 0x7fadf0154390 2024-06-02T23:46:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.955+0000 7fade7fff640 1 -- 172.21.15.96:0/500855257 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fade801c070 con 0x7fadf0154390 2024-06-02T23:46:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.955+0000 7fade7fff640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fadd006be30 0x7fadd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:51.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.955+0000 7fade7fff640 1 -- 172.21.15.96:0/500855257 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fade808a260 con 0x7fadf0154390 2024-06-02T23:46:51.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.955+0000 7fadeeffd640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fadd006be30 0x7fadd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:51.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.955+0000 7fadeeffd640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fadd006be30 0x7fadd006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fadf006a3a0 tx=0x7fade0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:51.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:51.959+0000 7fade7fff640 1 -- 172.21.15.96:0/500855257 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fadf00cbb20 con 0x7fadf0154390 2024-06-02T23:46:52.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.171+0000 7fadf55a9640 1 -- 172.21.15.96:0/500855257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadf00d05e0 con 0x7fadf0154390 2024-06-02T23:46:52.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.171+0000 7fade7fff640 1 -- 172.21.15.96:0/500855257 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7fade8058280 con 0x7fadf0154390 2024-06-02T23:46:52.171 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:46:52.172 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:46:25.060503+0000","modified":"2024-06-02T23:46:44.137908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-02T23:46:52.172 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 8 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 -- 172.21.15.96:0/500855257 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fadd006be30 msgr2=0x7fadd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fadd006be30 0x7fadd006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fadf006a3a0 tx=0x7fade0009190 comp rx=0 tx=0).stop 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 -- 172.21.15.96:0/500855257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf0154390 msgr2=0x7fadf00c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf0154390 0x7fadf00c9a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fadf00b5470 tx=0x7fade800feb0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 -- 172.21.15.96:0/500855257 shutdown_connections 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fadd006be30 0x7fadd006e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fadf0154390 0x7fadf00c9a50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadf0153e40 0x7fadf01f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 --2- 172.21.15.96:0/500855257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faddc004800 0x7fadf0153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 -- 172.21.15.96:0/500855257 >> 172.21.15.96:0/500855257 conn(0x7fadf009d3b0 msgr2=0x7fadf00d1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 -- 172.21.15.96:0/500855257 shutdown_connections 2024-06-02T23:46:52.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.173+0000 7fadf55a9640 1 -- 172.21.15.96:0/500855257 wait complete. 2024-06-02T23:46:52.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T23:46:25.060503+0000', 'modified': '2024-06-02T23:46:44.137908+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.96:6837/1720821828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6835', 'nonce': 1720821828}, {'type': 'v1', 'addr': '172.21.15.96:6837', 'nonce': 1720821828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-06-02T23:46:52.587 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T23:46:52.587 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-06-02T23:46:52.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.689+0000 7f8c83789640 1 Processor -- start 2024-06-02T23:46:52.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.689+0000 7f8c83789640 1 -- start start 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c83789640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8c7c164f10 0x7f8c7c167300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c83789640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7c071f20 con 0x7f8c7c15f5e0 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c83789640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7c06f210 con 0x7f8c7c06ea70 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c83789640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8c7c06ef30 con 0x7f8c7c164f10 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c81525640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f8c7c15f5e0 0x7f8c7c071100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40026/0 (socket says 172.21.15.96:40026) 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c81525640 1 -- 172.21.15.96:0/1055732677 learned_addr learned my addr 172.21.15.96:0/1055732677 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233586218 0 0) 0x7f8c7c071f20 con 0x7f8c7c15f5e0 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c68003520 con 0x7f8c7c15f5e0 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c81d26640 1 --2- 172.21.15.96:0/1055732677 >> v2:172.21.15.162:3300/0 conn(0x7f8c7c164f10 0x7f8c7c167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1259488506 0 0) 0x7f8c68003520 con 0x7f8c7c15f5e0 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 >> v2:172.21.15.162:3300/0 conn(0x7f8c7c164f10 msgr2=0x7f8c7c167300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c73fff640 1 --2- 172.21.15.96:0/1055732677 >> v2:172.21.15.162:3300/0 conn(0x7f8c7c164f10 0x7f8c7c167300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 >> v1:172.21.15.162:6789/0 conn(0x7f8c7c06ea70 legacy=0x7f8c7c071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c0ca320 con 0x7f8c7c15f5e0 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f8c78001670 con 0x7f8c7c15f5e0 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.690+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 >> v1:172.21.15.96:6789/0 conn(0x7f8c7c15f5e0 legacy=0x7f8c7c071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c73fff640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c73fff640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c68004800 0x7f8c68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c73fff640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c680051c0 0x7f8c6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c06ef30 con 0x7f8c680039b0 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6800c110 con 0x7f8c68004800 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6800c310 con 0x7f8c680051c0 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c81525640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c80d24640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c68004800 0x7f8c68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c81d26640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c680051c0 0x7f8c6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c81525640 1 -- 172.21.15.96:0/1055732677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c680051c0 msgr2=0x7f8c6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c81525640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c680051c0 0x7f8c6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c81525640 1 -- 172.21.15.96:0/1055732677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c68004800 msgr2=0x7f8c68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c81525640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c68004800 0x7f8c68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c81525640 1 -- 172.21.15.96:0/1055732677 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c68003520 con 0x7f8c680039b0 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.691+0000 7f8c81d26640 1 -- 172.21.15.96:0/1055732677 reap_dead start 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c81525640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c68003dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c240 tx=0x7f8c68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ab4ee144e28576 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78007d10 con 0x7f8c680039b0 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c78005ad0 con 0x7f8c680039b0 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c73fff640 1 -- 172.21.15.96:0/1055732677 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78007070 con 0x7f8c680039b0 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c83789640 1 -- 172.21.15.96:0/1055732677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 msgr2=0x7f8c68003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c83789640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c68003dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c240 tx=0x7f8c68005830 comp rx=0 tx=0).stop 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c83789640 1 -- 172.21.15.96:0/1055732677 shutdown_connections 2024-06-02T23:46:52.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c83789640 1 --2- 172.21.15.96:0/1055732677 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c68003dd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c83789640 1 -- 172.21.15.96:0/1055732677 >> 172.21.15.96:0/1055732677 conn(0x7f8c7c0cfc30 msgr2=0x7f8c7c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c83789640 1 -- 172.21.15.96:0/1055732677 shutdown_connections 2024-06-02T23:46:52.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.692+0000 7f8c83789640 1 -- 172.21.15.96:0/1055732677 wait complete. 2024-06-02T23:46:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.693+0000 7f8c83789640 1 Processor -- start 2024-06-02T23:46:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.694+0000 7f8c83789640 1 -- start start 2024-06-02T23:46:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.694+0000 7f8c83789640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c7c14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.694+0000 7f8c83789640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c7c14c0d0 0x7f8c7c14e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.694+0000 7f8c83789640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c7c0cd800 0x7f8c7c163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.694+0000 7f8c83789640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c073030 con 0x7f8c680039b0 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.694+0000 7f8c83789640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c0ca8e0 con 0x7f8c7c14c0d0 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.694+0000 7f8c83789640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7c0731b0 con 0x7f8c7c0cd800 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.694+0000 7f8c81525640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c7c14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.694+0000 7f8c81525640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c7c14ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55212/0 (socket says 172.21.15.96:55212) 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.694+0000 7f8c81525640 1 -- 172.21.15.96:0/4243725830 learned_addr learned my addr 172.21.15.96:0/4243725830 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c81d26640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c7c0cd800 0x7f8c7c163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c80d24640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c7c14c0d0 0x7f8c7c14e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c81525640 1 -- 172.21.15.96:0/4243725830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c7c0cd800 msgr2=0x7f8c7c163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c81525640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c7c0cd800 0x7f8c7c163dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c81525640 1 -- 172.21.15.96:0/4243725830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c7c14c0d0 msgr2=0x7f8c7c14e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c81525640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c7c14c0d0 0x7f8c7c14e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c81525640 1 -- 172.21.15.96:0/4243725830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c0c9b10 con 0x7f8c680039b0 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c81525640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c7c14ba10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c240 tx=0x7f8c7c0ca4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c71ffb640 1 -- 172.21.15.96:0/4243725830 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7803f020 con 0x7f8c680039b0 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c71ffb640 1 -- 172.21.15.96:0/4243725830 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c78001470 con 0x7f8c680039b0 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c71ffb640 1 -- 172.21.15.96:0/4243725830 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c780049e0 con 0x7f8c680039b0 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c83789640 1 -- 172.21.15.96:0/4243725830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7c14f110 con 0x7f8c680039b0 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.695+0000 7f8c83789640 1 -- 172.21.15.96:0/4243725830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7c0c81d0 con 0x7f8c680039b0 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.697+0000 7f8c71ffb640 1 -- 172.21.15.96:0/4243725830 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c78042020 con 0x7f8c680039b0 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.697+0000 7f8c71ffb640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8c6006be60 0x7f8c6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.697+0000 7f8c80d24640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8c6006be60 0x7f8c6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.697+0000 7f8c71ffb640 1 -- 172.21.15.96:0/4243725830 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8c780aacc0 con 0x7f8c680039b0 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.698+0000 7f8c80d24640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8c6006be60 0x7f8c6006e320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c000c00 tx=0x7f8c6c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.698+0000 7f8c86575740 1 Processor -- start 2024-06-02T23:46:52.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.698+0000 7f8c86575740 1 -- start start 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c86575740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d9dd00 0x556301da0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c86575740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9e0e0 0x556301da0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c86575740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d70960 0x556301d74170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c86575740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x556301cd9740 con 0x556301d70960 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c86575740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556301c77a80 con 0x556301d9e0e0 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c86575740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556301cd5700 con 0x556301d9dd00 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c81d26640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d70960 0x556301d74170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c81d26640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d70960 0x556301d74170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55218/0 (socket says 172.21.15.96:55218) 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c81d26640 1 -- 172.21.15.96:0/1218724873 learned_addr learned my addr 172.21.15.96:0/1218724873 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c81525640 1 --2- 172.21.15.96:0/1218724873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d9dd00 0x556301da0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c80d24640 1 --2- 172.21.15.96:0/1218724873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9e0e0 0x556301da0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c81d26640 1 -- 172.21.15.96:0/1218724873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d9dd00 msgr2=0x556301da0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c81d26640 1 --2- 172.21.15.96:0/1218724873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d9dd00 0x556301da0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c81d26640 1 -- 172.21.15.96:0/1218724873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9e0e0 msgr2=0x556301da0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c81d26640 1 --2- 172.21.15.96:0/1218724873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9e0e0 0x556301da0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c81d26640 1 -- 172.21.15.96:0/1218724873 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556301ca2fb0 con 0x556301d70960 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.699+0000 7f8c81d26640 1 --2- 172.21.15.96:0/1218724873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d70960 0x556301d74170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0733a0 tx=0x7f8c74004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f374e8bd32e80b24 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c5effd640 1 -- 172.21.15.96:0/1218724873 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74004860 con 0x556301d70960 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c5effd640 1 -- 172.21.15.96:0/1218724873 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7401b070 con 0x556301d70960 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c5effd640 1 -- 172.21.15.96:0/1218724873 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c740153f0 con 0x556301d70960 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c86575740 1 -- 172.21.15.96:0/1218724873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d70960 msgr2=0x556301d74170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c86575740 1 --2- 172.21.15.96:0/1218724873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d70960 0x556301d74170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0733a0 tx=0x7f8c74004610 comp rx=0 tx=0).stop 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c86575740 1 -- 172.21.15.96:0/1218724873 shutdown_connections 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c86575740 1 --2- 172.21.15.96:0/1218724873 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d70960 0x556301d74170 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c86575740 1 --2- 172.21.15.96:0/1218724873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9e0e0 0x556301da0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c86575740 1 --2- 172.21.15.96:0/1218724873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d9dd00 0x556301da0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c86575740 1 -- 172.21.15.96:0/1218724873 >> 172.21.15.96:0/1218724873 conn(0x556301d72bd0 msgr2=0x556301dbb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c86575740 1 -- 172.21.15.96:0/1218724873 shutdown_connections 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.700+0000 7f8c86575740 1 -- 172.21.15.96:0/1218724873 wait complete. 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.701+0000 7f8c86575740 1 -- start start 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.701+0000 7f8c86575740 1 Processor -- start 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c86575740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9dd00 0x556301d9ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c86575740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301dbebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c86575740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d97210 0x556301d9c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c86575740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x556301d75d80 con 0x556301d9e0e0 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c86575740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556301c62c30 con 0x556301d9dd00 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c86575740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556301d76060 con 0x556301d97210 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c86575740 10 client.0 _ll_register_callbacks cb 0x556301c947f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:46:52.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c80d24640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301dbebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c80d24640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301dbebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55222/0 (socket says 172.21.15.96:55222) 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c80d24640 1 -- 172.21.15.96:0/4286777056 learned_addr learned my addr 172.21.15.96:0/4286777056 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c81d26640 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d97210 0x556301d9c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c81525640 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9dd00 0x556301d9ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c80d24640 1 -- 172.21.15.96:0/4286777056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d97210 msgr2=0x556301d9c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c80d24640 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d97210 0x556301d9c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c80d24640 1 -- 172.21.15.96:0/4286777056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9dd00 msgr2=0x556301d9ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c80d24640 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9dd00 0x556301d9ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c80d24640 1 -- 172.21.15.96:0/4286777056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563019ed2d0 con 0x556301d9e0e0 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c80d24640 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301dbebd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0154d0 tx=0x7f8c6c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36fd05295f03b30 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.702+0000 7f8c57fff640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c57fff640 1 -- 172.21.15.96:0/4286777056 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0145e0 con 0x556301d9e0e0 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c57fff640 1 -- 172.21.15.96:0/4286777056 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8c6c014780 con 0x556301d9e0e0 2024-06-02T23:46:52.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c86575740 1 -- 172.21.15.96:0/4286777056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c7401b070 con 0x556301d9e0e0 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c57fff640 1 -- 172.21.15.96:0/4286777056 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f8c6c030050 con 0x556301d9e0e0 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c86575740 10 client.4689 fetch_fsmap learned FSMap version 8 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c86575740 1 -- 172.21.15.96:0/4286777056 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x556301ab76b0 con 0x556301d9e0e0 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c57fff640 1 -- 172.21.15.96:0/4286777056 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7401b070 con 0x556301d9e0e0 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c57fff640 1 -- 172.21.15.96:0/4286777056 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f8c6c033020 con 0x556301d9e0e0 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c86575740 10 client.4689 fetch_fsmap finished waiting for FSMap version 8 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c86575740 10 client.4689 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c86575740 20 client.4689 populate_metadata read hostname 'smithi096' 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c86575740 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x556301dbcca0 0x556301dbd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c86575740 4 client.4689 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c86575740 1 -- 172.21.15.96:0/4286777056 --> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556301ce6e70 con 0x556301dbcca0 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.703+0000 7f8c81525640 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x556301dbcca0 0x556301dbd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c57fff640 10 client.4689 ms_handle_connect on v2:172.21.15.96:6835/1720821828 2024-06-02T23:46:52.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c81525640 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x556301dbcca0 0x556301dbd080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=703a3fe63f8ebea server_cookie=cdece49abf7887e0 in_seq=0 out_seq=0 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c57fff640 1 -- 172.21.15.96:0/4286777056 <== mds.0 v2:172.21.15.96:6835/1720821828 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556301ce6e70 con 0x556301dbcca0 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c57fff640 10 client.4689 handle_command_reply: tid=0 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 client.4689 shutdown 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 -- 172.21.15.96:0/4286777056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 msgr2=0x556301dbebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301dbebd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0154d0 tx=0x7f8c6c001120 comp rx=0 tx=0).stop 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 -- 172.21.15.96:0/4286777056 shutdown_connections 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x556301dbcca0 0x556301dbd080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d97210 0x556301d9c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c57fff640 0 client.4689 ms_handle_reset on v2:172.21.15.96:6835/1720821828 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301dbebd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 --2- 172.21.15.96:0/4286777056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9dd00 0x556301d9ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 -- 172.21.15.96:0/4286777056 >> 172.21.15.96:0/4286777056 conn(0x556301d70960 msgr2=0x556301d9d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 -- 172.21.15.96:0/4286777056 shutdown_connections 2024-06-02T23:46:52.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.704+0000 7f8c86575740 1 -- 172.21.15.96:0/4286777056 wait complete. 2024-06-02T23:46:52.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.705+0000 7f8c86575740 20 client.4689 trim_cache size 0 max 16384 2024-06-02T23:46:52.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.723+0000 7f8c86575740 1 Processor -- start 2024-06-02T23:46:52.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.723+0000 7f8c86575740 1 -- start start 2024-06-02T23:46:52.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c86575740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d97210 0x556301d9cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c86575740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9dd00 0x556301d9d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c86575740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301d97670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c86575740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c201620 con 0x556301d9e0e0 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c86575740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c2009b0 con 0x556301d9dd00 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c86575740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7c201000 con 0x556301d97210 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c81d26640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301d97670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c81d26640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301d97670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55224/0 (socket says 172.21.15.96:55224) 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c81d26640 1 -- 172.21.15.96:0/2717635094 learned_addr learned my addr 172.21.15.96:0/2717635094 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c81d26640 1 -- 172.21.15.96:0/2717635094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d97210 msgr2=0x556301d9cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c81d26640 1 --2- 172.21.15.96:0/2717635094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d97210 0x556301d9cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c81d26640 1 -- 172.21.15.96:0/2717635094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9dd00 msgr2=0x556301d9d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c81d26640 1 --2- 172.21.15.96:0/2717635094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9dd00 0x556301d9d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c81d26640 1 -- 172.21.15.96:0/2717635094 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556301d77730 con 0x556301d9e0e0 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c81d26640 1 --2- 172.21.15.96:0/2717635094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301d97670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x556301d78260 tx=0x7f8c7400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cece434b543100 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:52.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c5e7fc640 1 -- 172.21.15.96:0/2717635094 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74029070 con 0x556301d9e0e0 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c5e7fc640 1 -- 172.21.15.96:0/2717635094 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7401b040 con 0x556301d9e0e0 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.724+0000 7f8c5e7fc640 1 -- 172.21.15.96:0/2717635094 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74020860 con 0x556301d9e0e0 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.725+0000 7f8c86575740 1 -- 172.21.15.96:0/2717635094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 msgr2=0x556301d97670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.725+0000 7f8c86575740 1 --2- 172.21.15.96:0/2717635094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301d97670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x556301d78260 tx=0x7f8c7400f000 comp rx=0 tx=0).stop 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.725+0000 7f8c86575740 1 -- 172.21.15.96:0/2717635094 shutdown_connections 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.725+0000 7f8c86575740 1 --2- 172.21.15.96:0/2717635094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9e0e0 0x556301d97670 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.725+0000 7f8c86575740 1 --2- 172.21.15.96:0/2717635094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d9dd00 0x556301d9d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.725+0000 7f8c86575740 1 --2- 172.21.15.96:0/2717635094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d97210 0x556301d9cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.725+0000 7f8c86575740 1 -- 172.21.15.96:0/2717635094 >> 172.21.15.96:0/2717635094 conn(0x556301d70960 msgr2=0x556301dbde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.725+0000 7f8c86575740 1 -- 172.21.15.96:0/2717635094 shutdown_connections 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.725+0000 7f8c86575740 1 -- 172.21.15.96:0/2717635094 wait complete. 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.725+0000 7f8c86575740 1 -- start start 2024-06-02T23:46:52.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.726+0000 7f8c86575740 1 Processor -- start 2024-06-02T23:46:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.726+0000 7f8c86575740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d97210 0x556301e39df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.726+0000 7f8c86575740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9dd00 0x556301d98b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.726+0000 7f8c86575740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d9e0e0 0x556301d70f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.726+0000 7f8c86575740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x556301dcfda0 con 0x556301d9dd00 2024-06-02T23:46:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.726+0000 7f8c86575740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556301d9a750 con 0x556301d97210 2024-06-02T23:46:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.726+0000 7f8c86575740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556301dcc440 con 0x556301d9e0e0 2024-06-02T23:46:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.726+0000 7f8c86575740 10 client.0 _ll_register_callbacks cb 0x7f8c6c001ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:46:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c80d24640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9dd00 0x556301d98b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c80d24640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9dd00 0x556301d98b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55232/0 (socket says 172.21.15.96:55232) 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c80d24640 1 -- 172.21.15.96:0/1595871435 learned_addr learned my addr 172.21.15.96:0/1595871435 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c81525640 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d97210 0x556301e39df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c81d26640 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d9e0e0 0x556301d70f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c80d24640 1 -- 172.21.15.96:0/1595871435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d9e0e0 msgr2=0x556301d70f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c80d24640 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d9e0e0 0x556301d70f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c80d24640 1 -- 172.21.15.96:0/1595871435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d97210 msgr2=0x556301e39df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c80d24640 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d97210 0x556301e39df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c80d24640 1 -- 172.21.15.96:0/1595871435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556301d99050 con 0x556301d9dd00 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c80d24640 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9dd00 0x556301d98b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c015fd0 tx=0x7f8c6c007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2333a5399c0580 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c57fff640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c57fff640 1 -- 172.21.15.96:0/1595871435 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0147e0 con 0x556301d9dd00 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c57fff640 1 -- 172.21.15.96:0/1595871435 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8c6c0067d0 con 0x556301d9dd00 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c86575740 1 -- 172.21.15.96:0/1595871435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c7401b040 con 0x556301d9dd00 2024-06-02T23:46:52.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c57fff640 1 -- 172.21.15.96:0/1595871435 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f8c6c042050 con 0x556301d9dd00 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c86575740 10 client.4695 fetch_fsmap learned FSMap version 8 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c86575740 1 -- 172.21.15.96:0/1595871435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x556301dbdfe0 con 0x556301d9dd00 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.727+0000 7f8c57fff640 1 -- 172.21.15.96:0/1595871435 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7401b040 con 0x556301d9dd00 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c57fff640 1 -- 172.21.15.96:0/1595871435 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f8c6c045020 con 0x556301d9dd00 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 10 client.4695 fetch_fsmap finished waiting for FSMap version 8 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 10 client.4695 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 20 client.4695 populate_metadata read hostname 'smithi096' 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x556301ddfdc0 0x556301da3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 4 client.4695 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 -- 172.21.15.96:0/1595871435 --> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] -- command(tid 0: {"prefix": "status"}) -- 0x556301ce11c0 con 0x556301ddfdc0 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c81525640 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x556301ddfdc0 0x556301da3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c57fff640 10 client.4695 ms_handle_connect on v2:172.21.15.96:6835/1720821828 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c81525640 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x556301ddfdc0 0x556301da3590 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b83ead3b54c64fe1 server_cookie=37f772dc4d4ec5f2 in_seq=0 out_seq=0 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c57fff640 1 -- 172.21.15.96:0/1595871435 <== mds.0 v2:172.21.15.96:6835/1720821828 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x556301ce11c0 con 0x556301ddfdc0 2024-06-02T23:46:52.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c57fff640 10 client.4695 handle_command_reply: tid=0 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 client.4695 shutdown 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 -- 172.21.15.96:0/1595871435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9dd00 msgr2=0x556301d98b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9dd00 0x556301d98b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c015fd0 tx=0x7f8c6c007c80 comp rx=0 tx=0).stop 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 -- 172.21.15.96:0/1595871435 shutdown_connections 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.96:6835/1720821828,v1:172.21.15.96:6837/1720821828] conn(0x556301ddfdc0 0x556301da3590 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556301d9e0e0 0x556301d70f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556301d9dd00 0x556301d98b10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c57fff640 0 client.4695 ms_handle_reset on v2:172.21.15.96:6835/1720821828 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 --2- 172.21.15.96:0/1595871435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556301d97210 0x556301e39df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 -- 172.21.15.96:0/1595871435 >> 172.21.15.96:0/1595871435 conn(0x556301d70960 msgr2=0x556301d6c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 -- 172.21.15.96:0/1595871435 shutdown_connections 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.728+0000 7f8c86575740 1 -- 172.21.15.96:0/1595871435 wait complete. 2024-06-02T23:46:52.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c86575740 20 client.4695 trim_cache size 0 max 16384 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "83723afd-2657-4b93-818a-1e4b19cab42f", 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4287, 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 27.024181628000001, 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 8, 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 24, 2024-06-02T23:46:52.735 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 24, 2024-06-02T23:46:52.736 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 33.108033198999998 2024-06-02T23:46:52.736 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:46:52.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 -- 172.21.15.96:0/4243725830 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8c6006be60 msgr2=0x7f8c6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8c6006be60 0x7f8c6006e320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c000c00 tx=0x7f8c6c009040 comp rx=0 tx=0).stop 2024-06-02T23:46:52.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 -- 172.21.15.96:0/4243725830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 msgr2=0x7f8c7c14ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:52.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c7c14ba10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800c240 tx=0x7f8c7c0ca4f0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 -- 172.21.15.96:0/4243725830 shutdown_connections 2024-06-02T23:46:52.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c7c0cd800 0x7f8c7c163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c7c14c0d0 0x7f8c7c14e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8c6006be60 0x7f8c6006e320 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 --2- 172.21.15.96:0/4243725830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c680039b0 0x7f8c7c14ba10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:52.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 -- 172.21.15.96:0/4243725830 >> 172.21.15.96:0/4243725830 conn(0x7f8c7c0cfc30 msgr2=0x7f8c7c15e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:52.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 -- 172.21.15.96:0/4243725830 shutdown_connections 2024-06-02T23:46:52.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:52.729+0000 7f8c83789640 1 -- 172.21.15.96:0/4243725830 wait complete. 2024-06-02T23:46:52.740 INFO:teuthology.run_tasks:Running task sequential... 2024-06-02T23:46:52.748 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-02T23:46:52.749 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-02T23:46:52.749 INFO:teuthology.task.print:Enabling mgr modules 2024-06-02T23:46:52.749 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-06-02T23:46:52.758 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-06-02T23:46:52.758 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-06-02T23:46:52.758 INFO:tasks.ceph_fuse:client.0 config is {} 2024-06-02T23:46:52.759 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T23:46:52.759 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T23:46:52.759 INFO:tasks.ceph_fuse:client.2 config is {} 2024-06-02T23:46:52.759 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T23:46:52.759 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-06-02T23:46:52.759 INFO:tasks.ceph_fuse:client.1 config is {} 2024-06-02T23:46:52.759 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T23:46:52.759 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-02T23:46:52.759 INFO:tasks.ceph_fuse:client.3 config is {} 2024-06-02T23:46:52.759 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T23:46:52.759 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-06-02T23:46:52.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:52.760 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-06-02T23:46:52.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:52.779 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-06-02T23:46:52.850 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-06-02T23:46:52.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:46:52.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:52.851 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-06-02T23:46:52.867 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-06-02T23:46:52.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:52.867 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-02T23:46:52.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:52.932 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-06-02T23:46:53.031 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-06-02T23:46:53.032 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T23:46:53.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.132+0000 7febe09c1640 1 Processor -- start 2024-06-02T23:46:53.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.132+0000 7febe09c1640 1 -- start start 2024-06-02T23:46:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.133+0000 7febe09c1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7febdc06ea70 0x7febdc071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.133+0000 7febe09c1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febdc06f210 con 0x7febdc0cae00 2024-06-02T23:46:53.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.133+0000 7febe09c1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febdc06ef30 con 0x7febdc15f5e0 2024-06-02T23:46:53.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.133+0000 7febe09c1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7febdc0ca320 con 0x7febdc06ea70 2024-06-02T23:46:53.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.133+0000 7febdad9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7febdc0cae00 0x7febdc0cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55094/0 (socket says 172.21.15.96:55094) 2024-06-02T23:46:53.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.133+0000 7febdad9d640 1 -- 172.21.15.96:0/129810876 learned_addr learned my addr 172.21.15.96:0/129810876 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:53.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd9d9b640 1 --2- 172.21.15.96:0/129810876 >> v2:172.21.15.162:3300/0 conn(0x7febdc06ea70 0x7febdc071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:53.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3800672320 0 0) 0x7febdc06f210 con 0x7febdc0cae00 2024-06-02T23:46:53.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febc4003520 con 0x7febdc0cae00 2024-06-02T23:46:53.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4277523649 0 0) 0x7febc4003520 con 0x7febdc0cae00 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 >> v2:172.21.15.162:3300/0 conn(0x7febdc06ea70 msgr2=0x7febdc071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 --2- 172.21.15.96:0/129810876 >> v2:172.21.15.162:3300/0 conn(0x7febdc06ea70 0x7febdc071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 >> v1:172.21.15.162:6789/0 conn(0x7febdc15f5e0 legacy=0x7febdc071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febdc0ca600 con 0x7febdc0cae00 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7febd40019f0 con 0x7febdc0cae00 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 >> v1:172.21.15.96:6789/0 conn(0x7febdc0cae00 legacy=0x7febdc0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febc40039b0 0x7febc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febc40043b0 0x7febc4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4005080 0x7febc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7febdc0ca320 con 0x7febc40043b0 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febc400bfe0 con 0x7febc4005080 2024-06-02T23:46:53.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7febc400c1e0 con 0x7febc40039b0 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd9d9b640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febc40043b0 0x7febc4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febda59c640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febc40039b0 0x7febc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febdad9d640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4005080 0x7febc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd9d9b640 1 -- 172.21.15.96:0/129810876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febc40039b0 msgr2=0x7febc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd9d9b640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febc40039b0 0x7febc4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd9d9b640 1 -- 172.21.15.96:0/129810876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4005080 msgr2=0x7febc400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd9d9b640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4005080 0x7febc400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febd9d9b640 1 -- 172.21.15.96:0/129810876 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc4003520 con 0x7febc40043b0 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febda59c640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febc40039b0 0x7febc4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febdad9d640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc4005080 0x7febc400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.134+0000 7febdad9d640 1 -- 172.21.15.96:0/129810876 reap_dead start 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.135+0000 7febd9d9b640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febc40043b0 0x7febc4004880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7febd0009ac0 tx=0x7febc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd0aaccc5b95b07 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.135+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0036070 con 0x7febc40043b0 2024-06-02T23:46:53.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.135+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd0031400 con 0x7febc40043b0 2024-06-02T23:46:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.135+0000 7febd959a640 1 -- 172.21.15.96:0/129810876 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0009690 con 0x7febc40043b0 2024-06-02T23:46:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.136+0000 7febe09c1640 1 -- 172.21.15.96:0/129810876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febc40043b0 msgr2=0x7febc4004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.136+0000 7febe09c1640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febc40043b0 0x7febc4004880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7febd0009ac0 tx=0x7febc4005830 comp rx=0 tx=0).stop 2024-06-02T23:46:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.136+0000 7febe09c1640 1 -- 172.21.15.96:0/129810876 shutdown_connections 2024-06-02T23:46:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.136+0000 7febe09c1640 1 --2- 172.21.15.96:0/129810876 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febc40043b0 0x7febc4004880 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.136+0000 7febe09c1640 1 -- 172.21.15.96:0/129810876 >> 172.21.15.96:0/129810876 conn(0x7febdc0cfc30 msgr2=0x7febdc0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.136+0000 7febe09c1640 1 -- 172.21.15.96:0/129810876 shutdown_connections 2024-06-02T23:46:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.136+0000 7febe09c1640 1 -- 172.21.15.96:0/129810876 wait complete. 2024-06-02T23:46:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febe09c1640 1 Processor -- start 2024-06-02T23:46:53.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febe09c1640 1 -- start start 2024-06-02T23:46:53.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febe09c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc40043b0 0x7febdc0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febe09c1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febdc14b530 0x7febdc0c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febe09c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febdc0c6d00 0x7febdc0b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febe09c1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7febdc0731b0 con 0x7febdc14b530 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febe09c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febdc073030 con 0x7febc40043b0 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febe09c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7febdc0b2ac0 con 0x7febdc0c6d00 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febd9d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febdc14b530 0x7febdc0c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febd9d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febdc14b530 0x7febdc0c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38550/0 (socket says 172.21.15.96:38550) 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febd9d9b640 1 -- 172.21.15.96:0/1279836345 learned_addr learned my addr 172.21.15.96:0/1279836345 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febda59c640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc40043b0 0x7febdc0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febdad9d640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febdc0c6d00 0x7febdc0b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febd9d9b640 1 -- 172.21.15.96:0/1279836345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febdc0c6d00 msgr2=0x7febdc0b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febd9d9b640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febdc0c6d00 0x7febdc0b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febd9d9b640 1 -- 172.21.15.96:0/1279836345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc40043b0 msgr2=0x7febdc0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:53.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febd9d9b640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc40043b0 0x7febdc0c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.137+0000 7febd9d9b640 1 -- 172.21.15.96:0/1279836345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febdc0c6720 con 0x7febdc14b530 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.138+0000 7febd9d9b640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febdc14b530 0x7febdc0c97b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7febd0034040 tx=0x7febd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.138+0000 7febcaffd640 1 -- 172.21.15.96:0/1279836345 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd003f020 con 0x7febdc14b530 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.138+0000 7febcaffd640 1 -- 172.21.15.96:0/1279836345 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febd0037040 con 0x7febdc14b530 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.138+0000 7febe09c1640 1 -- 172.21.15.96:0/1279836345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febdc0c7270 con 0x7febdc14b530 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.138+0000 7febcaffd640 1 -- 172.21.15.96:0/1279836345 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0036070 con 0x7febdc14b530 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.138+0000 7febe09c1640 1 -- 172.21.15.96:0/1279836345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febdc14ad30 con 0x7febdc14b530 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.139+0000 7febe09c1640 1 -- 172.21.15.96:0/1279836345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febdc0709d0 con 0x7febdc14b530 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.139+0000 7febcaffd640 1 -- 172.21.15.96:0/1279836345 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febd0042020 con 0x7febdc14b530 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.140+0000 7febcaffd640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7febbc06be60 0x7febbc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.140+0000 7febcaffd640 1 -- 172.21.15.96:0/1279836345 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7febd00ab1f0 con 0x7febdc14b530 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.140+0000 7febda59c640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7febbc06be60 0x7febbc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:53.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.140+0000 7febda59c640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7febbc06be60 0x7febbc06e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7febcc007fd0 tx=0x7febcc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:53.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.144+0000 7febcaffd640 1 -- 172.21.15.96:0/1279836345 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7febdc0709d0 con 0x7febdc14b530 2024-06-02T23:46:53.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.354+0000 7febe09c1640 1 -- 172.21.15.96:0/1279836345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7febdc14a860 con 0x7febdc14b530 2024-06-02T23:46:53.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.355+0000 7febcaffd640 1 -- 172.21.15.96:0/1279836345 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7febd0049030 con 0x7febdc14b530 2024-06-02T23:46:53.356 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T23:46:53.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 -- 172.21.15.96:0/1279836345 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7febbc06be60 msgr2=0x7febbc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:53.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7febbc06be60 0x7febbc06e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7febcc007fd0 tx=0x7febcc009040 comp rx=0 tx=0).stop 2024-06-02T23:46:53.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 -- 172.21.15.96:0/1279836345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febdc14b530 msgr2=0x7febdc0c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:53.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febdc14b530 0x7febdc0c97b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7febd0034040 tx=0x7febd0004730 comp rx=0 tx=0).stop 2024-06-02T23:46:53.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 -- 172.21.15.96:0/1279836345 shutdown_connections 2024-06-02T23:46:53.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febdc0c6d00 0x7febdc0b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:53.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7febbc06be60 0x7febbc06e320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:53.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7febdc14b530 0x7febdc0c97b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:53.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 --2- 172.21.15.96:0/1279836345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febc40043b0 0x7febdc0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:53.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 -- 172.21.15.96:0/1279836345 >> 172.21.15.96:0/1279836345 conn(0x7febdc0cfc30 msgr2=0x7febdc15c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:53.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 -- 172.21.15.96:0/1279836345 shutdown_connections 2024-06-02T23:46:53.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53.357+0000 7febe09c1640 1 -- 172.21.15.96:0/1279836345 wait complete. 2024-06-02T23:46:53.369 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T23:46:53.369 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T23:46:53.369 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-06-02T23:46:53.369 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T23:46:53.369 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T23:46:53.369 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T23:46:53.369 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T23:46:53.369 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T23:46:53.370 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T23:46:53.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:53.370 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-06-02T23:46:53.385 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:46:53.385 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:46:53.385 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:46:53.385 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:53.385 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-06-02T23:46:53.385 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:53.385 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-06-02T23:46:53.386 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:53.387 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T23:46:53.387 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:53.387 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:53.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2024-06-02T23:46:53.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2024-06-02T23:46:53.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2024-06-02T23:46:53.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T23:46:53.387 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:53.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:53.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:53.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:53.525 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T23:46:53.548 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-06-02T23:46:53.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:53.550 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-06-02T23:46:53.607 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-06-02T23:46:53.607 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T23:46:53.607 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T23:46:53.607 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T23:46:53.607 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T23:46:53.607 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:53.607 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:53.608 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T23:46:53.608 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T23:46:53.608 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T23:46:53.608 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:53.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:53.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:53.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:53.734 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-06-02T23:46:53.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:53.751 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2024-06-02T23:46:53.806 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:53.806 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:53.806 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:46:53.806 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-02T23:46:53.806 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:53.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:53.924 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-02T23:46:53.924 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:53.924 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:53.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-02T23:46:53.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T23:46:53.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-02T23:46:53.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-02T23:46:53.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-02T23:46:53.924 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:53.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:54.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:54.037 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:54.037 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:54.037 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2024-06-02T23:46:54.037 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T23:46:54.037 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:54.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:54.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:54.114 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T23:46:54.114 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:46:54.115 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T23:46:54.129 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T23:46:54.129 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:46:54.129 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T23:46:54.184 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-06-02T23:46:54.250 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:46:54.306 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-06-02T23:46:54.306 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-06-02T23:46:54.306 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-06-02T23:46:54.306 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-06-02T23:46:54.307 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T23:46:54.308 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T23:46:54.309 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-06-02T23:46:54.309 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:46:54.309 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:46:54.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:54.310 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-06-02T23:46:54.362 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T23:46:54.362 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T23:46:54.404 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-06-02T23:46:54.428 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:46:54.485 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-06-02T23:46:54.485 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-06-02T23:46:54.485 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-06-02T23:46:54.485 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-06-02T23:46:54.485 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-06-02T23:46:54.485 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-06-02T23:46:54.485 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-06-02T23:46:54.485 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:46:54.486 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:46:54.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:54.487 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-06-02T23:46:54.488 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:2024-06-02T23:46:54.486+0000 7f0440478480 -1 init, newargv = 0x559e3d115620 newargc=15 2024-06-02T23:46:54.488 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[47751]: starting ceph client 2024-06-02T23:46:54.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[47751]: starting fuse 2024-06-02T23:46:54.506 INFO:teuthology.orchestra.run.smithi096.stdout:40 2024-06-02T23:46:54.506 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T23:46:54.506 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2024-06-02T23:46:54.506 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2024-06-02T23:46:54.506 DEBUG:teuthology.orchestra.run.smithi096:> import re 2024-06-02T23:46:54.506 DEBUG:teuthology.orchestra.run.smithi096:> import os 2024-06-02T23:46:54.506 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T23:46:54.507 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T23:46:54.508 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2024-06-02T23:46:54.508 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2024-06-02T23:46:54.508 DEBUG:teuthology.orchestra.run.smithi096:> return f 2024-06-02T23:46:54.508 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T23:46:54.508 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:54.508 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.0")) 2024-06-02T23:46:54.508 DEBUG:teuthology.orchestra.run.smithi096:> ' 2024-06-02T23:46:54.620 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.0.47751.asok 2024-06-02T23:46:54.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:54.631 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47751.asok 2024-06-02T23:46:54.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:54.631 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47751.asok status 2024-06-02T23:46:54.765 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:46:54.766 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2024-06-02T23:46:54.766 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T23:46:54.766 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T23:46:54.766 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "0", 2024-06-02T23:46:54.766 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2024-06-02T23:46:54.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T23:46:54.766 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "47751", 2024-06-02T23:46:54.766 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2024-06-02T23:46:54.766 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:54.766 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4710, 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4710 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 3847279630 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-06-02T23:46:54.767 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:46:54.768 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 3847279630 2024-06-02T23:46:54.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:54.768 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4710 192.168.0.1:0/3847279630", 2024-06-02T23:46:54.768 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.1:0/3847279630", 2024-06-02T23:46:54.768 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2024-06-02T23:46:54.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 8, 2024-06-02T23:46:54.768 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 24, 2024-06-02T23:46:54.768 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2024-06-02T23:46:54.768 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2024-06-02T23:46:54.769 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2024-06-02T23:46:54.769 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:46:54.773 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T23:46:54.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.873+0000 7fd4a1190640 1 Processor -- start 2024-06-02T23:46:54.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.874+0000 7fd4a1190640 1 -- start start 2024-06-02T23:46:54.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.874+0000 7fd4a1190640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd49c155570 0x7fd49c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:54.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.874+0000 7fd4a1190640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c155950 con 0x7fd49c06eb50 2024-06-02T23:46:54.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.874+0000 7fd4a1190640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c0cb2e0 con 0x7fd49c0cad30 2024-06-02T23:46:54.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.874+0000 7fd4a1190640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd49c0cb5c0 con 0x7fd49c155570 2024-06-02T23:46:54.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.874+0000 7fd49ad9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd49c155570 0x7fd49c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:54.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.874+0000 7fd49a59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd49c06eb50 0x7fd49c0ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55100/0 (socket says 172.21.15.96:55100) 2024-06-02T23:46:54.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.874+0000 7fd49a59c640 1 -- 172.21.15.96:0/3970179220 learned_addr learned my addr 172.21.15.96:0/3970179220 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:54.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.875+0000 7fd49ad9d640 1 -- 172.21.15.96:0/3970179220 >> v1:172.21.15.162:6789/0 conn(0x7fd49c0cad30 legacy=0x7fd49c072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:54.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.875+0000 7fd499d9b640 1 -- 172.21.15.96:0/3970179220 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3817997918 0 0) 0x7fd49c155950 con 0x7fd49c06eb50 2024-06-02T23:46:54.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.875+0000 7fd49ad9d640 1 -- 172.21.15.96:0/3970179220 >> v1:172.21.15.96:6789/0 conn(0x7fd49c06eb50 legacy=0x7fd49c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:54.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.875+0000 7fd49ad9d640 1 -- 172.21.15.96:0/3970179220 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c0cb8a0 con 0x7fd49c155570 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.875+0000 7fd49ad9d640 1 --2- 172.21.15.96:0/3970179220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c155570 0x7fd49c06e610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0097a0 tx=0x7fd48c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a5cf935b273577 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.876+0000 7fd499d9b640 1 -- 172.21.15.96:0/3970179220 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c037070 con 0x7fd49c155570 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.876+0000 7fd499d9b640 1 -- 172.21.15.96:0/3970179220 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48c032440 con 0x7fd49c155570 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.876+0000 7fd499d9b640 1 -- 172.21.15.96:0/3970179220 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c032810 con 0x7fd49c155570 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.876+0000 7fd4a1190640 1 -- 172.21.15.96:0/3970179220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c155570 msgr2=0x7fd49c06e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.876+0000 7fd4a1190640 1 --2- 172.21.15.96:0/3970179220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c155570 0x7fd49c06e610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0097a0 tx=0x7fd48c02a1e0 comp rx=0 tx=0).stop 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.876+0000 7fd4a1190640 1 -- 172.21.15.96:0/3970179220 shutdown_connections 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.876+0000 7fd4a1190640 1 --2- 172.21.15.96:0/3970179220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c155570 0x7fd49c06e610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.876+0000 7fd4a1190640 1 -- 172.21.15.96:0/3970179220 >> 172.21.15.96:0/3970179220 conn(0x7fd49c0cfc30 msgr2=0x7fd49c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.876+0000 7fd4a1190640 1 -- 172.21.15.96:0/3970179220 shutdown_connections 2024-06-02T23:46:54.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.876+0000 7fd4a1190640 1 -- 172.21.15.96:0/3970179220 wait complete. 2024-06-02T23:46:54.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.878+0000 7fd4a1190640 1 Processor -- start 2024-06-02T23:46:54.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.878+0000 7fd4a1190640 1 -- start start 2024-06-02T23:46:54.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.878+0000 7fd4a1190640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c06eb50 0x7fd49c1e48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:54.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.878+0000 7fd4a1190640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd49c0cad30 0x7fd49c0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:54.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.878+0000 7fd4a1190640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd49c155570 0x7fd49c0ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:54.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.878+0000 7fd4a1190640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c072730 con 0x7fd49c06eb50 2024-06-02T23:46:54.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.878+0000 7fd4a1190640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c0717d0 con 0x7fd49c155570 2024-06-02T23:46:54.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.878+0000 7fd4a1190640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd49c0728b0 con 0x7fd49c0cad30 2024-06-02T23:46:54.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.878+0000 7fd49ad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c06eb50 0x7fd49c1e48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:54.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd49ad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c06eb50 0x7fd49c1e48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38556/0 (socket says 172.21.15.96:38556) 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd49ad9d640 1 -- 172.21.15.96:0/1455359167 learned_addr learned my addr 172.21.15.96:0/1455359167 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd49a59c640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd49c0cad30 0x7fd49c0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd49b59e640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd49c155570 0x7fd49c0ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd49ad9d640 1 -- 172.21.15.96:0/1455359167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd49c0cad30 msgr2=0x7fd49c0cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd49ad9d640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd49c0cad30 0x7fd49c0cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd49ad9d640 1 -- 172.21.15.96:0/1455359167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd49c155570 msgr2=0x7fd49c0ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd49ad9d640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd49c155570 0x7fd49c0ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd49ad9d640 1 -- 172.21.15.96:0/1455359167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c1e5320 con 0x7fd49c06eb50 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd49ad9d640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c06eb50 0x7fd49c1e48d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0098c0 tx=0x7fd48c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd4937fe640 1 -- 172.21.15.96:0/1455359167 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c041070 con 0x7fd49c06eb50 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd4937fe640 1 -- 172.21.15.96:0/1455359167 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48c03c870 con 0x7fd49c06eb50 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd4a1190640 1 -- 172.21.15.96:0/1455359167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd49c1e5600 con 0x7fd49c06eb50 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd4937fe640 1 -- 172.21.15.96:0/1455359167 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c037040 con 0x7fd49c06eb50 2024-06-02T23:46:54.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.879+0000 7fd4a1190640 1 -- 172.21.15.96:0/1455359167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd49c1e5bc0 con 0x7fd49c06eb50 2024-06-02T23:46:54.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.880+0000 7fd4a1190640 1 -- 172.21.15.96:0/1455359167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd49c0683e0 con 0x7fd49c06eb50 2024-06-02T23:46:54.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.881+0000 7fd4937fe640 1 -- 172.21.15.96:0/1455359167 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd48c044070 con 0x7fd49c06eb50 2024-06-02T23:46:54.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.881+0000 7fd4937fe640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd47c06be30 0x7fd47c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:54.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.881+0000 7fd4937fe640 1 -- 172.21.15.96:0/1455359167 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd48c0abc50 con 0x7fd49c06eb50 2024-06-02T23:46:54.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.881+0000 7fd49a59c640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd47c06be30 0x7fd47c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:54.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.882+0000 7fd49a59c640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd47c06be30 0x7fd47c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0ca490 tx=0x7fd484001700 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:54.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:54.886+0000 7fd4937fe640 1 -- 172.21.15.96:0/1455359167 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd48c0b1020 con 0x7fd49c06eb50 2024-06-02T23:46:55.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.096+0000 7fd4a1190640 1 -- 172.21.15.96:0/1455359167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd49c15afd0 con 0x7fd49c06eb50 2024-06-02T23:46:55.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.096+0000 7fd4937fe640 1 -- 172.21.15.96:0/1455359167 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fd48c079da0 con 0x7fd49c06eb50 2024-06-02T23:46:55.097 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T23:46:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 -- 172.21.15.96:0/1455359167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd47c06be30 msgr2=0x7fd47c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd47c06be30 0x7fd47c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0ca490 tx=0x7fd484001700 comp rx=0 tx=0).stop 2024-06-02T23:46:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 -- 172.21.15.96:0/1455359167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c06eb50 msgr2=0x7fd49c1e48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c06eb50 0x7fd49c1e48d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0098c0 tx=0x7fd48c0046c0 comp rx=0 tx=0).stop 2024-06-02T23:46:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 -- 172.21.15.96:0/1455359167 shutdown_connections 2024-06-02T23:46:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd49c155570 0x7fd49c0ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd49c0cad30 0x7fd49c0cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd47c06be30 0x7fd47c06e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 --2- 172.21.15.96:0/1455359167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd49c06eb50 0x7fd49c1e48d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:55.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 -- 172.21.15.96:0/1455359167 >> 172.21.15.96:0/1455359167 conn(0x7fd49c0cfc30 msgr2=0x7fd49c159050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:55.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 -- 172.21.15.96:0/1455359167 shutdown_connections 2024-06-02T23:46:55.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55.098+0000 7fd4a1190640 1 -- 172.21.15.96:0/1455359167 wait complete. 2024-06-02T23:46:55.109 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T23:46:55.109 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T23:46:55.109 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-06-02T23:46:55.109 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-06-02T23:46:55.109 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-06-02T23:46:55.109 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T23:46:55.109 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T23:46:55.109 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T23:46:55.109 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-06-02T23:46:55.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:55.110 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-06-02T23:46:55.125 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-06-02T23:46:55.126 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42745sec preferred_lft 42745sec 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether da:61:41:8f:5f:36 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::fc2d:2aff:fe99:fd88/64 scope link tentative 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.127 INFO:teuthology.orchestra.run.smithi096.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T23:46:55.128 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether da:61:41:8f:5f:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:46:55.128 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::d861:41ff:fe8f:5f36/64 scope link tentative 2024-06-02T23:46:55.128 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:55.128 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T23:46:55.189 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-06-02T23:46:55.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:55.191 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-06-02T23:46:55.246 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-06-02T23:46:55.246 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T23:46:55.247 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T23:46:55.247 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T23:46:55.247 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T23:46:55.247 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:55.247 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:55.247 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T23:46:55.247 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T23:46:55.247 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T23:46:55.247 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:55.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:55.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:55.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:55.374 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-06-02T23:46:55.389 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T23:46:55.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:55.389 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2024-06-02T23:46:55.444 INFO:teuthology.orchestra.run.smithi096.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-06-02T23:46:55.444 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:55.445 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:55.445 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:46:55.445 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-06-02T23:46:55.445 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:55.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:55.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:55.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:55.562 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-06-02T23:46:55.586 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:46:55.586 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:46:55.586 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:46:55.586 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.586 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-06-02T23:46:55.586 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.586 INFO:teuthology.orchestra.run.smithi096.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T23:46:55.586 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 66:1c:4d:9e:52:2d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T23:46:55.586 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T23:46:55.587 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.587 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::641c:4dff:fe9e:522d/64 scope link tentative 2024-06-02T23:46:55.587 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:55.588 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-06-02T23:46:55.652 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:46:55.652 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:46:55.652 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:46:55.652 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.653 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-06-02T23:46:55.653 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.653 INFO:teuthology.orchestra.run.smithi096.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T23:46:55.653 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 66:1c:4d:9e:52:2d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T23:46:55.653 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T23:46:55.653 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.653 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::641c:4dff:fe9e:522d/64 scope link tentative 2024-06-02T23:46:55.653 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:55.654 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-06-02T23:46:55.655 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:55.655 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:55.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-06-02T23:46:55.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-06-02T23:46:55.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-06-02T23:46:55.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-06-02T23:46:55.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-06-02T23:46:55.655 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:55.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:55.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:55.818 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:55.819 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:46:55.819 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.1 up 2024-06-02T23:46:55.819 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.1 master ceph-brx 2024-06-02T23:46:55.819 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:46:55.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:55.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:55.896 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-06-02T23:46:55.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:46:55.896 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-06-02T23:46:55.922 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-06-02T23:46:55.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:46:55.923 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-06-02T23:46:55.978 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-06-02T23:46:56.043 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:46:56.099 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-06-02T23:46:56.100 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-06-02T23:46:56.100 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-06-02T23:46:56.100 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-06-02T23:46:56.100 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-06-02T23:46:56.100 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-06-02T23:46:56.100 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-06-02T23:46:56.100 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-06-02T23:46:56.101 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-06-02T23:46:56.101 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-06-02T23:46:56.101 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-06-02T23:46:56.101 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2024-06-02T23:46:56.101 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:46:56.101 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-06-02T23:46:56.101 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-06-02T23:46:56.101 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-06-02T23:46:56.102 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-06-02T23:46:56.102 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-06-02T23:46:56.102 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-06-02T23:46:56.102 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:46:56.102 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:46:56.102 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:46:56.102 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:46:56.102 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-06-02T23:46:56.102 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run.smithi096.stdout:/home/ubuntu/cephtest/mnt.0 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:46:56.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:56.103 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-06-02T23:46:56.155 INFO:teuthology.orchestra.run.smithi096.stdout:40 2024-06-02T23:46:56.155 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2024-06-02T23:46:56.155 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-06-02T23:46:56.157 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:46:56.197 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-06-02T23:46:56.198 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:46:56.222 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:46:56.283 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi096.stderr:2024-06-02T23:46:56.283+0000 7f6253e71480 -1 init, newargv = 0x55d6f3677500 newargc=15 2024-06-02T23:46:56.283 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi096.stderr:ceph-fuse[48267]: starting ceph client 2024-06-02T23:46:56.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi096.stderr:ceph-fuse[48267]: starting fuse 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-06-02T23:46:56.300 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-06-02T23:46:56.301 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/home/ubuntu/cephtest/mnt.0 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run.smithi096.stdout:/home/ubuntu/cephtest/mnt.2 2024-06-02T23:46:56.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:56.303 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-06-02T23:46:56.355 INFO:teuthology.orchestra.run.smithi096.stdout:40 2024-06-02T23:46:56.355 INFO:teuthology.orchestra.run.smithi096.stdout:43 2024-06-02T23:46:56.355 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 43] 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> import re 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> import os 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2024-06-02T23:46:56.356 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> return f 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.2")) 2024-06-02T23:46:56.357 DEBUG:teuthology.orchestra.run.smithi096:> ' 2024-06-02T23:46:56.474 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.2.48267.asok 2024-06-02T23:46:56.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:56.485 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.48267.asok 2024-06-02T23:46:56.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:56.485 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.48267.asok status 2024-06-02T23:46:56.619 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:46:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2024-06-02T23:46:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T23:46:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T23:46:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "2", 2024-06-02T23:46:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "48267", 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4722, 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4722 2024-06-02T23:46:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.2:0", 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2035755910 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.2:0", 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2035755910 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4722 192.168.0.2:0/2035755910", 2024-06-02T23:46:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.2:0/2035755910", 2024-06-02T23:46:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2024-06-02T23:46:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 8, 2024-06-02T23:46:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 24, 2024-06-02T23:46:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2024-06-02T23:46:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2024-06-02T23:46:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2024-06-02T23:46:56.622 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:46:56.628 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T23:46:56.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.727+0000 7fed4a916640 1 Processor -- start 2024-06-02T23:46:56.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.727+0000 7fed4a916640 1 -- start start 2024-06-02T23:46:56.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed4a916640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fed44161900 0x7fed440d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:56.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed4a916640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fed440b4fa0 0x7fed440d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:56.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed4a916640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed440d4a90 con 0x7fed440b5510 2024-06-02T23:46:56.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed4a916640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fed440cf5c0 con 0x7fed44161900 2024-06-02T23:46:56.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed4a916640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fed440caf70 con 0x7fed440b4fa0 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed43fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fed44161900 0x7fed440d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed437fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fed440b5510 0x7fed440d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55116/0 (socket says 172.21.15.96:55116) 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed437fe640 1 -- 172.21.15.96:0/1241724452 learned_addr learned my addr 172.21.15.96:0/1241724452 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed48eb3640 1 --2- 172.21.15.96:0/1241724452 >> v2:172.21.15.162:3300/0 conn(0x7fed440b4fa0 0x7fed440d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed43fff640 1 -- 172.21.15.96:0/1241724452 >> v2:172.21.15.162:3300/0 conn(0x7fed440b4fa0 msgr2=0x7fed440d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed43fff640 1 --2- 172.21.15.96:0/1241724452 >> v2:172.21.15.162:3300/0 conn(0x7fed440b4fa0 0x7fed440d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed43fff640 1 -- 172.21.15.96:0/1241724452 >> v1:172.21.15.96:6789/0 conn(0x7fed440b5510 legacy=0x7fed440d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed42ffd640 1 -- 172.21.15.96:0/1241724452 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2133417805 0 0) 0x7fed440d4a90 con 0x7fed440b5510 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.728+0000 7fed43fff640 1 -- 172.21.15.96:0/1241724452 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed440d4d70 con 0x7fed44161900 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.729+0000 7fed43fff640 1 --2- 172.21.15.96:0/1241724452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 0x7fed440d0a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fed440d39c0 tx=0x7fed3402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eaafd649d19b85f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.729+0000 7fed42ffd640 1 -- 172.21.15.96:0/1241724452 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34037070 con 0x7fed44161900 2024-06-02T23:46:56.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.729+0000 7fed42ffd640 1 -- 172.21.15.96:0/1241724452 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed34032440 con 0x7fed44161900 2024-06-02T23:46:56.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.729+0000 7fed42ffd640 1 -- 172.21.15.96:0/1241724452 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3402ae60 con 0x7fed44161900 2024-06-02T23:46:56.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.730+0000 7fed4a916640 1 -- 172.21.15.96:0/1241724452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 msgr2=0x7fed440d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:56.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.730+0000 7fed4a916640 1 --2- 172.21.15.96:0/1241724452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 0x7fed440d0a10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fed440d39c0 tx=0x7fed3402a110 comp rx=0 tx=0).stop 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.730+0000 7fed4a916640 1 -- 172.21.15.96:0/1241724452 shutdown_connections 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.730+0000 7fed4a916640 1 --2- 172.21.15.96:0/1241724452 >> v2:172.21.15.162:3300/0 conn(0x7fed440b4fa0 0x7fed440d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.730+0000 7fed4a916640 1 --2- 172.21.15.96:0/1241724452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 0x7fed440d0a10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.730+0000 7fed4a916640 1 -- 172.21.15.96:0/1241724452 >> 172.21.15.96:0/1241724452 conn(0x7fed4409d3b0 msgr2=0x7fed440d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.730+0000 7fed4a916640 1 -- 172.21.15.96:0/1241724452 shutdown_connections 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.730+0000 7fed4a916640 1 -- 172.21.15.96:0/1241724452 wait complete. 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.731+0000 7fed4a916640 1 Processor -- start 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.731+0000 7fed4a916640 1 -- start start 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed4a916640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed440b4fa0 0x7fed4415f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed4a916640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed440b5510 0x7fed441597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed4a916640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 0x7fed44159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:56.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed4a916640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fed440d4780 con 0x7fed44161900 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed4a916640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed440cfae0 con 0x7fed440b4fa0 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed4a916640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fed44161ce0 con 0x7fed440b5510 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed48eb3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 0x7fed44159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed48eb3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 0x7fed44159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38560/0 (socket says 172.21.15.96:38560) 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed48eb3640 1 -- 172.21.15.96:0/3699204436 learned_addr learned my addr 172.21.15.96:0/3699204436 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed43fff640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed440b4fa0 0x7fed4415f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed437fe640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed440b5510 0x7fed441597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed48eb3640 1 -- 172.21.15.96:0/3699204436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed440b5510 msgr2=0x7fed441597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed48eb3640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed440b5510 0x7fed441597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed48eb3640 1 -- 172.21.15.96:0/3699204436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed440b4fa0 msgr2=0x7fed4415f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed48eb3640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed440b4fa0 0x7fed4415f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed48eb3640 1 -- 172.21.15.96:0/3699204436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4415a340 con 0x7fed44161900 2024-06-02T23:46:56.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed43fff640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed440b4fa0 0x7fed4415f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:56.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.732+0000 7fed48eb3640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 0x7fed44159ce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00efc0 tx=0x7fed3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:56.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.733+0000 7fed40ff9640 1 -- 172.21.15.96:0/3699204436 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c018020 con 0x7fed44161900 2024-06-02T23:46:56.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.733+0000 7fed40ff9640 1 -- 172.21.15.96:0/3699204436 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3c014480 con 0x7fed44161900 2024-06-02T23:46:56.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.733+0000 7fed4a916640 1 -- 172.21.15.96:0/3699204436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4415a620 con 0x7fed44161900 2024-06-02T23:46:56.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.733+0000 7fed40ff9640 1 -- 172.21.15.96:0/3699204436 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c014870 con 0x7fed44161900 2024-06-02T23:46:56.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.733+0000 7fed4a916640 1 -- 172.21.15.96:0/3699204436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4415abe0 con 0x7fed44161900 2024-06-02T23:46:56.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.734+0000 7fed4a916640 1 -- 172.21.15.96:0/3699204436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed440683e0 con 0x7fed44161900 2024-06-02T23:46:56.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.734+0000 7fed40ff9640 1 -- 172.21.15.96:0/3699204436 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed3c005d10 con 0x7fed44161900 2024-06-02T23:46:56.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.735+0000 7fed40ff9640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fed3006be30 0x7fed3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:56.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.735+0000 7fed43fff640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fed3006be30 0x7fed3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:56.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.735+0000 7fed40ff9640 1 -- 172.21.15.96:0/3699204436 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fed3c08bca0 con 0x7fed44161900 2024-06-02T23:46:56.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.735+0000 7fed43fff640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fed3006be30 0x7fed3006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed34034000 tx=0x7fed3402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:56.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.739+0000 7fed40ff9640 1 -- 172.21.15.96:0/3699204436 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fed3c022070 con 0x7fed44161900 2024-06-02T23:46:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.947+0000 7fed4a916640 1 -- 172.21.15.96:0/3699204436 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fed440d05e0 con 0x7fed44161900 2024-06-02T23:46:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.948+0000 7fed40ff9640 1 -- 172.21.15.96:0/3699204436 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fed3c010040 con 0x7fed44161900 2024-06-02T23:46:56.949 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T23:46:56.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 -- 172.21.15.96:0/3699204436 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fed3006be30 msgr2=0x7fed3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:56.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fed3006be30 0x7fed3006e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed34034000 tx=0x7fed3402e000 comp rx=0 tx=0).stop 2024-06-02T23:46:56.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 -- 172.21.15.96:0/3699204436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 msgr2=0x7fed44159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:56.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 0x7fed44159ce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00efc0 tx=0x7fed3c00c490 comp rx=0 tx=0).stop 2024-06-02T23:46:56.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 -- 172.21.15.96:0/3699204436 shutdown_connections 2024-06-02T23:46:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fed3006be30 0x7fed3006e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed44161900 0x7fed44159ce0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed440b5510 0x7fed441597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 --2- 172.21.15.96:0/3699204436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed440b4fa0 0x7fed4415f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 -- 172.21.15.96:0/3699204436 >> 172.21.15.96:0/3699204436 conn(0x7fed4409d3b0 msgr2=0x7fed440d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 -- 172.21.15.96:0/3699204436 shutdown_connections 2024-06-02T23:46:56.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:56.950+0000 7fed4a916640 1 -- 172.21.15.96:0/3699204436 wait complete. 2024-06-02T23:46:56.961 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T23:46:56.961 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T23:46:56.961 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-06-02T23:46:56.961 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-06-02T23:46:56.961 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-06-02T23:46:56.961 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T23:46:56.961 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T23:46:56.961 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T23:46:56.961 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-06-02T23:46:56.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:56.962 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-06-02T23:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T23:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T23:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-06-02T23:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2024-06-02T23:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:56.983 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T23:46:56.984 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:56.984 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-06-02T23:46:56.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add name ceph-brx type bridge 2024-06-02T23:46:56.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr flush dev ceph-brx 2024-06-02T23:46:56.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set ceph-brx up 2024-06-02T23:46:56.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T23:46:56.984 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-06-02T23:46:57.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:57.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:57.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:57.206 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T23:46:57.231 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-06-02T23:46:57.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:57.233 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-06-02T23:46:57.385 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-06-02T23:46:57.385 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T23:46:57.385 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T23:46:57.385 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T23:46:57.385 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T23:46:57.386 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:57.386 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-06-02T23:46:57.386 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T23:46:57.386 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T23:46:57.386 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T23:46:57.386 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-06-02T23:46:57.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:57.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:57.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:57.656 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-06-02T23:46:57.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:57.672 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-06-02T23:46:57.727 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:57.727 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-06-02T23:46:57.727 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:46:57.727 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-06-02T23:46:57.728 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-06-02T23:46:57.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:57.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:57.846 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-06-02T23:46:57.847 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:57.847 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-06-02T23:46:57.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-06-02T23:46:57.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T23:46:57.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-06-02T23:46:57.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-06-02T23:46:57.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-06-02T23:46:57.847 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-06-02T23:46:57.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:57.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:57.971 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:57.971 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-06-02T23:46:57.971 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-06-02T23:46:57.971 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T23:46:57.971 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-06-02T23:46:58.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:58.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:58.048 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-06-02T23:46:58.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:46:58.049 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-06-02T23:46:58.073 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-06-02T23:46:58.073 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:46:58.073 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-06-02T23:46:58.128 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-06-02T23:46:58.194 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:46:58.250 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-06-02T23:46:58.250 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-06-02T23:46:58.250 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-06-02T23:46:58.250 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-06-02T23:46:58.250 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-06-02T23:46:58.250 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-06-02T23:46:58.250 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/selinux 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:46:58.251 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-4 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-5 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-6 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-7 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:46:58.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:58.253 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-06-02T23:46:58.306 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T23:46:58.306 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-06-02T23:46:58.348 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-06-02T23:46:58.372 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:46:58.429 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-06-02T23:46:58.429 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-06-02T23:46:58.429 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-06-02T23:46:58.429 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-06-02T23:46:58.429 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-06-02T23:46:58.429 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/selinux 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-06-02T23:46:58.430 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-4 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-5 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-6 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-7 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-06-02T23:46:58.431 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:46:58.432 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:46:58.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:58.432 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-06-02T23:46:58.440 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi162.stderr:2024-06-02T23:46:58.440+0000 7f39f1b1f480 -1 init, newargv = 0x5621b6c944b0 newargc=15 2024-06-02T23:46:58.440 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi162.stderr:ceph-fuse[44282]: starting ceph client 2024-06-02T23:46:58.445 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi162.stderr:ceph-fuse[44282]: starting fuse 2024-06-02T23:46:58.455 INFO:teuthology.orchestra.run.smithi162.stdout:40 2024-06-02T23:46:58.456 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T23:46:58.456 DEBUG:teuthology.orchestra.run.smithi162:> sudo stdin-killer -- python3 -c ' 2024-06-02T23:46:58.456 DEBUG:teuthology.orchestra.run.smithi162:> import glob 2024-06-02T23:46:58.456 DEBUG:teuthology.orchestra.run.smithi162:> import re 2024-06-02T23:46:58.456 DEBUG:teuthology.orchestra.run.smithi162:> import os 2024-06-02T23:46:58.456 DEBUG:teuthology.orchestra.run.smithi162:> import subprocess 2024-06-02T23:46:58.456 DEBUG:teuthology.orchestra.run.smithi162:> 2024-06-02T23:46:58.456 DEBUG:teuthology.orchestra.run.smithi162:> def _find_admin_socket(client_name): 2024-06-02T23:46:58.456 DEBUG:teuthology.orchestra.run.smithi162:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-06-02T23:46:58.456 DEBUG:teuthology.orchestra.run.smithi162:> files = glob.glob(asok_path) 2024-06-02T23:46:58.456 DEBUG:teuthology.orchestra.run.smithi162:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> # Given a non-glob path, it better be there 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> if "*" not in asok_path: 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> assert(len(files) == 1) 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> return files[0] 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> for f in files: 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> contents = proc_f.read() 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> if mountpoint in contents: 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> return f 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> 2024-06-02T23:46:58.457 DEBUG:teuthology.orchestra.run.smithi162:> print(_find_admin_socket("client.1")) 2024-06-02T23:46:58.458 DEBUG:teuthology.orchestra.run.smithi162:> ' 2024-06-02T23:46:58.573 INFO:teuthology.orchestra.run.smithi162.stdout:/var/run/ceph/ceph-client.1.44282.asok 2024-06-02T23:46:58.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:58.583 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44282.asok 2024-06-02T23:46:58.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:58.584 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44282.asok status 2024-06-02T23:46:58.718 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-06-02T23:46:58.718 INFO:teuthology.orchestra.run.smithi162.stdout: "metadata": { 2024-06-02T23:46:58.718 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T23:46:58.718 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T23:46:58.719 INFO:teuthology.orchestra.run.smithi162.stdout: "entity_id": "1", 2024-06-02T23:46:58.719 INFO:teuthology.orchestra.run.smithi162.stdout: "hostname": "smithi162", 2024-06-02T23:46:58.719 INFO:teuthology.orchestra.run.smithi162.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-06-02T23:46:58.719 INFO:teuthology.orchestra.run.smithi162.stdout: "pid": "44282", 2024-06-02T23:46:58.719 INFO:teuthology.orchestra.run.smithi162.stdout: "root": "/" 2024-06-02T23:46:58.719 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T23:46:58.719 INFO:teuthology.orchestra.run.smithi162.stdout: "dentry_count": 0, 2024-06-02T23:46:58.719 INFO:teuthology.orchestra.run.smithi162.stdout: "dentry_pinned_count": 0, 2024-06-02T23:46:58.719 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4624, 2024-06-02T23:46:58.719 INFO:teuthology.orchestra.run.smithi162.stdout: "inst": { 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: "name": { 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "client", 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: "num": 4624 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": { 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "v1", 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: "nonce": 2427716660 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": { 2024-06-02T23:46:58.720 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "v1", 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: "nonce": 2427716660 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: "inst_str": "client.4624 192.168.0.1:0/2427716660", 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: "addr_str": "192.168.0.1:0/2427716660", 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: "inode_count": 1, 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_epoch": 8, 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_epoch": 24, 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_epoch_barrier": 0, 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: "blocklisted": false, 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs" 2024-06-02T23:46:58.721 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-06-02T23:46:58.727 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T23:46:58.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.839+0000 7f7fcdc6d640 1 Processor -- start 2024-06-02T23:46:58.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.839+0000 7f7fcdc6d640 1 -- start start 2024-06-02T23:46:58.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fcdc6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc8155570 0x7f7fc806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fcdc6d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7fc806eb50 0x7f7fc80ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fcdc6d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7fc80cab60 0x7f7fc815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fcdc6d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc806efb0 con 0x7f7fc80cab60 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fcdc6d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc8155950 con 0x7f7fc806eb50 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fcdc6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc80cb2e0 con 0x7f7fc8155570 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc7fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7fc80cab60 0x7f7fc815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc7fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7fc80cab60 0x7f7fc815eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38566/0 (socket says 172.21.15.96:38566) 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc7fff640 1 -- 172.21.15.96:0/1966631824 learned_addr learned my addr 172.21.15.96:0/1966631824 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc6ffd640 1 --2- 172.21.15.96:0/1966631824 >> v2:172.21.15.162:3300/0 conn(0x7f7fc806eb50 0x7f7fc80ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc77fe640 1 --2- 172.21.15.96:0/1966631824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc8155570 0x7f7fc806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:58.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc7fff640 1 -- 172.21.15.96:0/1966631824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc8155570 msgr2=0x7f7fc806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc7fff640 1 --2- 172.21.15.96:0/1966631824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc8155570 0x7f7fc806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc7fff640 1 -- 172.21.15.96:0/1966631824 >> v2:172.21.15.162:3300/0 conn(0x7f7fc806eb50 msgr2=0x7f7fc80ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:46:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc7fff640 1 --2- 172.21.15.96:0/1966631824 >> v2:172.21.15.162:3300/0 conn(0x7f7fc806eb50 0x7f7fc80ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc7fff640 1 -- 172.21.15.96:0/1966631824 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc80cb5c0 con 0x7f7fc80cab60 2024-06-02T23:46:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.840+0000 7f7fc6ffd640 1 --2- 172.21.15.96:0/1966631824 >> v2:172.21.15.162:3300/0 conn(0x7f7fc806eb50 0x7f7fc80ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:46:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.841+0000 7f7fc7fff640 1 --2- 172.21.15.96:0/1966631824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc80cab60 0x7f7fc815eab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7fc806ca30 tx=0x7f7fc002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a0c6169dd98965 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.841+0000 7f7fc67fc640 1 -- 172.21.15.96:0/1966631824 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0036070 con 0x7f7fc80cab60 2024-06-02T23:46:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.841+0000 7f7fc67fc640 1 -- 172.21.15.96:0/1966631824 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc0031600 con 0x7f7fc80cab60 2024-06-02T23:46:58.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.841+0000 7f7fc67fc640 1 -- 172.21.15.96:0/1966631824 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00319d0 con 0x7f7fc80cab60 2024-06-02T23:46:58.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.842+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/1966631824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc80cab60 msgr2=0x7f7fc815eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:58.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.842+0000 7f7fcdc6d640 1 --2- 172.21.15.96:0/1966631824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc80cab60 0x7f7fc815eab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7fc806ca30 tx=0x7f7fc002a6a0 comp rx=0 tx=0).stop 2024-06-02T23:46:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.842+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/1966631824 shutdown_connections 2024-06-02T23:46:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.842+0000 7f7fcdc6d640 1 --2- 172.21.15.96:0/1966631824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc80cab60 0x7f7fc815eab0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.842+0000 7f7fcdc6d640 1 --2- 172.21.15.96:0/1966631824 >> v2:172.21.15.162:3300/0 conn(0x7f7fc806eb50 0x7f7fc80ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.842+0000 7f7fcdc6d640 1 --2- 172.21.15.96:0/1966631824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc8155570 0x7f7fc806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.842+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/1966631824 >> 172.21.15.96:0/1966631824 conn(0x7f7fc80cfc30 msgr2=0x7f7fc80d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.842+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/1966631824 shutdown_connections 2024-06-02T23:46:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.842+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/1966631824 wait complete. 2024-06-02T23:46:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.843+0000 7f7fcdc6d640 1 Processor -- start 2024-06-02T23:46:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.843+0000 7f7fcdc6d640 1 -- start start 2024-06-02T23:46:58.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.844+0000 7f7fcdc6d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc806eb50 0x7f7fc81563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.844+0000 7f7fcdc6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc80cab60 0x7f7fc81520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.844+0000 7f7fcdc6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8155570 0x7f7fc8152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.844+0000 7f7fcdc6d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80caff0 con 0x7f7fc806eb50 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.844+0000 7f7fcdc6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8071b00 con 0x7f7fc8155570 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.844+0000 7f7fcdc6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc80717d0 con 0x7f7fc80cab60 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.844+0000 7f7fc77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc806eb50 0x7f7fc81563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.844+0000 7f7fc77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc806eb50 0x7f7fc81563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38580/0 (socket says 172.21.15.96:38580) 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.844+0000 7f7fc77fe640 1 -- 172.21.15.96:0/932118231 learned_addr learned my addr 172.21.15.96:0/932118231 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fc6ffd640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc80cab60 0x7f7fc81520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fc77fe640 1 -- 172.21.15.96:0/932118231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc80cab60 msgr2=0x7f7fc81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fc7fff640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8155570 0x7f7fc8152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:58.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fc77fe640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc80cab60 0x7f7fc81520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fc77fe640 1 -- 172.21.15.96:0/932118231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8155570 msgr2=0x7f7fc8152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fc77fe640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8155570 0x7f7fc8152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fc77fe640 1 -- 172.21.15.96:0/932118231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc8156900 con 0x7f7fc806eb50 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fc7fff640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8155570 0x7f7fc8152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fc77fe640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc806eb50 0x7f7fc81563c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800d800 tx=0x7f7fb800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7faffff640 1 -- 172.21.15.96:0/932118231 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800b6c0 con 0x7f7fc806eb50 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7faffff640 1 -- 172.21.15.96:0/932118231 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8019070 con 0x7f7fc806eb50 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/932118231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc806e2b0 con 0x7f7fc806eb50 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7faffff640 1 -- 172.21.15.96:0/932118231 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800ba80 con 0x7f7fc806eb50 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.845+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/932118231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc81f1e10 con 0x7f7fc806eb50 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.846+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/932118231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc80683e0 con 0x7f7fc806eb50 2024-06-02T23:46:58.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.846+0000 7f7faffff640 1 -- 172.21.15.96:0/932118231 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fb800bc20 con 0x7f7fc806eb50 2024-06-02T23:46:58.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.847+0000 7f7faffff640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7fb406be30 0x7f7fb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:46:58.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.847+0000 7f7faffff640 1 -- 172.21.15.96:0/932118231 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7fb808b670 con 0x7f7fc806eb50 2024-06-02T23:46:58.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.847+0000 7f7fc6ffd640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7fb406be30 0x7f7fb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:46:58.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.847+0000 7f7fc6ffd640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7fb406be30 0x7f7fb406e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc006fd0 tx=0x7f7fbc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:46:58.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:58.851+0000 7f7faffff640 1 -- 172.21.15.96:0/932118231 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7fb8059ce0 con 0x7f7fc806eb50 2024-06-02T23:46:59.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.067+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/932118231 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7fc806cc90 con 0x7f7fc806eb50 2024-06-02T23:46:59.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.068+0000 7f7faffff640 1 -- 172.21.15.96:0/932118231 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f7fb80595e0 con 0x7f7fc806eb50 2024-06-02T23:46:59.068 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-02T23:46:59.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/932118231 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7fb406be30 msgr2=0x7f7fb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:59.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7fb406be30 0x7f7fb406e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc006fd0 tx=0x7f7fbc008040 comp rx=0 tx=0).stop 2024-06-02T23:46:59.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/932118231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc806eb50 msgr2=0x7f7fc81563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:46:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc806eb50 0x7f7fc81563c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800d800 tx=0x7f7fb800dcc0 comp rx=0 tx=0).stop 2024-06-02T23:46:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/932118231 shutdown_connections 2024-06-02T23:46:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc8155570 0x7f7fc8152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fc80cab60 0x7f7fc81520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f7fb406be30 0x7f7fb406e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 --2- 172.21.15.96:0/932118231 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7fc806eb50 0x7f7fc81563c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:46:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/932118231 >> 172.21.15.96:0/932118231 conn(0x7f7fc80cfc30 msgr2=0x7f7fc815a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:46:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/932118231 shutdown_connections 2024-06-02T23:46:59.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:46:59.070+0000 7f7fcdc6d640 1 -- 172.21.15.96:0/932118231 wait complete. 2024-06-02T23:46:59.081 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T23:46:59.081 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T23:46:59.081 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-06-02T23:46:59.081 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-06-02T23:46:59.081 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-06-02T23:46:59.081 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T23:46:59.082 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T23:46:59.082 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T23:46:59.082 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-06-02T23:46:59.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:59.082 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-06-02T23:46:59.099 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:46:59.099 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:46:59.099 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:46:59.099 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.099 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-06-02T23:46:59.099 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.099 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:59.099 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:59.099 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42745sec preferred_lft 42745sec 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T23:46:59.100 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6e:30:09:0c:c1:3f brd ff:ff:ff:ff:ff:ff 2024-06-02T23:46:59.101 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T23:46:59.101 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.101 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::1486:1cff:fef1:e86a/64 scope link 2024-06-02T23:46:59.101 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.101 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T23:46:59.101 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6e:30:09:0c:c1:3f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:46:59.101 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6c30:9ff:fe0c:c13f/64 scope link tentative 2024-06-02T23:46:59.101 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:59.101 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T23:46:59.163 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-06-02T23:46:59.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:59.164 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-06-02T23:46:59.221 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-06-02T23:46:59.221 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T23:46:59.221 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T23:46:59.221 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T23:46:59.221 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T23:46:59.222 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:59.222 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-06-02T23:46:59.222 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T23:46:59.222 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T23:46:59.222 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T23:46:59.222 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-06-02T23:46:59.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:59.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:59.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:59.347 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-06-02T23:46:59.363 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-06-02T23:46:59.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:59.363 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-06-02T23:46:59.419 INFO:teuthology.orchestra.run.smithi162.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-06-02T23:46:59.420 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:59.420 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-06-02T23:46:59.420 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T23:46:59.420 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-06-02T23:46:59.420 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-06-02T23:46:59.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:59.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:59.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:59.536 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:47:35:66:d7:af brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::3047:35ff:fe66:d7af/64 scope link 2024-06-02T23:46:59.561 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:46:59.563 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:47:35:66:d7:af brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.628 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::3047:35ff:fe66:d7af/64 scope link 2024-06-02T23:46:59.629 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:46:59.629 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-06-02T23:46:59.630 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:59.630 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-06-02T23:46:59.630 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-06-02T23:46:59.630 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-06-02T23:46:59.630 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-06-02T23:46:59.630 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-06-02T23:46:59.630 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-06-02T23:46:59.630 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-06-02T23:46:59.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:59.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:59.783 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:46:59.783 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-06-02T23:46:59.783 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.1 up 2024-06-02T23:46:59.784 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.1 master ceph-brx 2024-06-02T23:46:59.784 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-06-02T23:46:59.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:46:59.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:46:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:46:59.861 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-06-02T23:46:59.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:46:59.862 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-06-02T23:46:59.877 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-06-02T23:46:59.877 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:46:59.878 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-06-02T23:46:59.933 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-06-02T23:46:59.999 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:47:00.062 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-06-02T23:47:00.062 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-06-02T23:47:00.062 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-06-02T23:47:00.062 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/selinux 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-06-02T23:47:00.063 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-4 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-5 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-6 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-7 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-06-02T23:47:00.064 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:47:00.065 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:47:00.065 INFO:teuthology.orchestra.run.smithi162.stdout:/home/ubuntu/cephtest/mnt.1 2024-06-02T23:47:00.065 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T23:47:00.065 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T23:47:00.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.065 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-06-02T23:47:00.124 INFO:teuthology.orchestra.run.smithi162.stdout:40 2024-06-02T23:47:00.124 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2024-06-02T23:47:00.125 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-06-02T23:47:00.172 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-06-02T23:47:00.197 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:47:00.256 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi162.stderr:2024-06-02T23:47:00.256+0000 7f10593d5480 -1 init, newargv = 0x563bf9ae9c90 newargc=15 2024-06-02T23:47:00.256 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi162.stderr:ceph-fuse[44733]: starting ceph client 2024-06-02T23:47:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-06-02T23:47:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-06-02T23:47:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-06-02T23:47:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-06-02T23:47:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-06-02T23:47:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-06-02T23:47:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-06-02T23:47:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/selinux 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:47:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-4 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-5 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-6 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-7 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/home/ubuntu/cephtest/mnt.1 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T23:47:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-02T23:47:00.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.261 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-06-02T23:47:00.262 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi162.stderr:ceph-fuse[44733]: starting fuse 2024-06-02T23:47:00.322 INFO:teuthology.orchestra.run.smithi162.stdout:40 2024-06-02T23:47:00.322 INFO:teuthology.orchestra.run.smithi162.stdout:43 2024-06-02T23:47:00.323 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 43] 2024-06-02T23:47:00.323 DEBUG:teuthology.orchestra.run.smithi162:> sudo stdin-killer -- python3 -c ' 2024-06-02T23:47:00.323 DEBUG:teuthology.orchestra.run.smithi162:> import glob 2024-06-02T23:47:00.323 DEBUG:teuthology.orchestra.run.smithi162:> import re 2024-06-02T23:47:00.323 DEBUG:teuthology.orchestra.run.smithi162:> import os 2024-06-02T23:47:00.323 DEBUG:teuthology.orchestra.run.smithi162:> import subprocess 2024-06-02T23:47:00.323 DEBUG:teuthology.orchestra.run.smithi162:> 2024-06-02T23:47:00.323 DEBUG:teuthology.orchestra.run.smithi162:> def _find_admin_socket(client_name): 2024-06-02T23:47:00.323 DEBUG:teuthology.orchestra.run.smithi162:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-06-02T23:47:00.323 DEBUG:teuthology.orchestra.run.smithi162:> files = glob.glob(asok_path) 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> # Given a non-glob path, it better be there 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> if "*" not in asok_path: 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> assert(len(files) == 1) 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> return files[0] 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> for f in files: 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> contents = proc_f.read() 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> if mountpoint in contents: 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> return f 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T23:47:00.324 DEBUG:teuthology.orchestra.run.smithi162:> 2024-06-02T23:47:00.325 DEBUG:teuthology.orchestra.run.smithi162:> print(_find_admin_socket("client.3")) 2024-06-02T23:47:00.325 DEBUG:teuthology.orchestra.run.smithi162:> ' 2024-06-02T23:47:00.444 INFO:teuthology.orchestra.run.smithi162.stdout:/var/run/ceph/ceph-client.3.44733.asok 2024-06-02T23:47:00.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T23:47:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:47:00.455 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44733.asok 2024-06-02T23:47:00.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.456 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44733.asok status 2024-06-02T23:47:00.593 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-06-02T23:47:00.593 INFO:teuthology.orchestra.run.smithi162.stdout: "metadata": { 2024-06-02T23:47:00.593 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T23:47:00.594 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T23:47:00.594 INFO:teuthology.orchestra.run.smithi162.stdout: "entity_id": "3", 2024-06-02T23:47:00.594 INFO:teuthology.orchestra.run.smithi162.stdout: "hostname": "smithi162", 2024-06-02T23:47:00.595 INFO:teuthology.orchestra.run.smithi162.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-06-02T23:47:00.595 INFO:teuthology.orchestra.run.smithi162.stdout: "pid": "44733", 2024-06-02T23:47:00.595 INFO:teuthology.orchestra.run.smithi162.stdout: "root": "/" 2024-06-02T23:47:00.595 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T23:47:00.595 INFO:teuthology.orchestra.run.smithi162.stdout: "dentry_count": 0, 2024-06-02T23:47:00.595 INFO:teuthology.orchestra.run.smithi162.stdout: "dentry_pinned_count": 0, 2024-06-02T23:47:00.595 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4633, 2024-06-02T23:47:00.595 INFO:teuthology.orchestra.run.smithi162.stdout: "inst": { 2024-06-02T23:47:00.595 INFO:teuthology.orchestra.run.smithi162.stdout: "name": { 2024-06-02T23:47:00.595 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "client", 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: "num": 4633 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": { 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "v1", 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": "192.168.0.2:0", 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: "nonce": 1462337625 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": { 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "v1", 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": "192.168.0.2:0", 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: "nonce": 1462337625 2024-06-02T23:47:00.596 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T23:47:00.597 INFO:teuthology.orchestra.run.smithi162.stdout: "inst_str": "client.4633 192.168.0.2:0/1462337625", 2024-06-02T23:47:00.597 INFO:teuthology.orchestra.run.smithi162.stdout: "addr_str": "192.168.0.2:0/1462337625", 2024-06-02T23:47:00.597 INFO:teuthology.orchestra.run.smithi162.stdout: "inode_count": 1, 2024-06-02T23:47:00.597 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_epoch": 8, 2024-06-02T23:47:00.597 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_epoch": 24, 2024-06-02T23:47:00.597 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_epoch_barrier": 0, 2024-06-02T23:47:00.597 INFO:teuthology.orchestra.run.smithi162.stdout: "blocklisted": false, 2024-06-02T23:47:00.597 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs" 2024-06-02T23:47:00.597 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-06-02T23:47:00.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.601 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2024-06-02T23:47:00.601 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T23:47:00.621 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2024-06-02T23:47:00.621 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T23:47:00.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.622 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T23:47:00.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.693 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2024-06-02T23:47:00.693 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.2 2024-06-02T23:47:00.751 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2024-06-02T23:47:00.752 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-06-02T23:47:00.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.752 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-06-02T23:47:00.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.820 DEBUG:teuthology.orchestra.run.smithi162:> stat --file-system '--printf=%T 2024-06-02T23:47:00.820 DEBUG:teuthology.orchestra.run.smithi162:> ' -- /home/ubuntu/cephtest/mnt.1 2024-06-02T23:47:00.837 INFO:teuthology.orchestra.run.smithi162.stdout:fuseblk 2024-06-02T23:47:00.837 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-06-02T23:47:00.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-06-02T23:47:00.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.902 DEBUG:teuthology.orchestra.run.smithi162:> stat --file-system '--printf=%T 2024-06-02T23:47:00.902 DEBUG:teuthology.orchestra.run.smithi162:> ' -- /home/ubuntu/cephtest/mnt.3 2024-06-02T23:47:00.957 INFO:teuthology.orchestra.run.smithi162.stdout:fuseblk 2024-06-02T23:47:00.958 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-06-02T23:47:00.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:00.958 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-06-02T23:47:01.023 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-06-02T23:47:01.102 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2024-06-02T23:47:01.103 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-06-02T23:47:01.103 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:47:01.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.216+0000 7fa1d3a64640 1 Processor -- start 2024-06-02T23:47:01.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.216+0000 7fa1d3a64640 1 -- start start 2024-06-02T23:47:01.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d3a64640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 0x7fa1cc0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d3a64640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa1cc0b4fa0 0x7fa1cc0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d3a64640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1cc0d4a90 con 0x7fa1cc0b5510 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d3a64640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa1cc0cf5c0 con 0x7fa1cc0b4fa0 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d3a64640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa1cc0caf70 con 0x7fa1cc161900 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d1800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 0x7fa1cc0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d1800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 0x7fa1cc0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:60338/0 (socket says 172.21.15.96:60338) 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d1800640 1 -- 172.21.15.96:0/1988628004 learned_addr learned my addr 172.21.15.96:0/1988628004 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d0fff640 1 --1- 172.21.15.96:0/1988628004 >> v1:172.21.15.162:6789/0 conn(0x7fa1cc0b5510 0x7fa1cc0d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:36536/0 (socket says 172.21.15.96:36536) 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d2001640 1 --2- 172.21.15.96:0/1988628004 >> v2:172.21.15.162:3300/0 conn(0x7fa1cc0b4fa0 0x7fa1cc0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d1800640 1 -- 172.21.15.96:0/1988628004 >> v2:172.21.15.162:3300/0 conn(0x7fa1cc0b4fa0 msgr2=0x7fa1cc0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d1800640 1 --2- 172.21.15.96:0/1988628004 >> v2:172.21.15.162:3300/0 conn(0x7fa1cc0b4fa0 0x7fa1cc0d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d1800640 1 -- 172.21.15.96:0/1988628004 >> v1:172.21.15.162:6789/0 conn(0x7fa1cc0b5510 legacy=0x7fa1cc0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.217+0000 7fa1d1800640 1 -- 172.21.15.96:0/1988628004 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1cc0d4d70 con 0x7fa1cc161900 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.218+0000 7fa1d1800640 1 --2- 172.21.15.96:0/1988628004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 0x7fa1cc0d0a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009e50 tx=0x7fa1bc02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f08b18103588ed7f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.218+0000 7fa1cbfff640 1 -- 172.21.15.96:0/1988628004 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc036070 con 0x7fa1cc161900 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.218+0000 7fa1cbfff640 1 -- 172.21.15.96:0/1988628004 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1bc031600 con 0x7fa1cc161900 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.218+0000 7fa1cbfff640 1 -- 172.21.15.96:0/1988628004 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc0319d0 con 0x7fa1cc161900 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.219+0000 7fa1d3a64640 1 -- 172.21.15.96:0/1988628004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 msgr2=0x7fa1cc0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.219+0000 7fa1d3a64640 1 --2- 172.21.15.96:0/1988628004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 0x7fa1cc0d0a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009e50 tx=0x7fa1bc02a680 comp rx=0 tx=0).stop 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.219+0000 7fa1d3a64640 1 -- 172.21.15.96:0/1988628004 shutdown_connections 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.219+0000 7fa1d3a64640 1 --2- 172.21.15.96:0/1988628004 >> v2:172.21.15.162:3300/0 conn(0x7fa1cc0b4fa0 0x7fa1cc0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.219+0000 7fa1d3a64640 1 --2- 172.21.15.96:0/1988628004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 0x7fa1cc0d0a10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.219+0000 7fa1d3a64640 1 -- 172.21.15.96:0/1988628004 >> 172.21.15.96:0/1988628004 conn(0x7fa1cc09d3b0 msgr2=0x7fa1cc0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.219+0000 7fa1d3a64640 1 -- 172.21.15.96:0/1988628004 shutdown_connections 2024-06-02T23:47:01.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.219+0000 7fa1d3a64640 1 -- 172.21.15.96:0/1988628004 wait complete. 2024-06-02T23:47:01.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.220+0000 7fa1d3a64640 1 Processor -- start 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d3a64640 1 -- start start 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d3a64640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc0b4fa0 0x7fa1cc1f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d3a64640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1cc0b5510 0x7fa1cc15e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d3a64640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 0x7fa1cc15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d3a64640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc0d4780 con 0x7fa1cc0b5510 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d3a64640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc0cfae0 con 0x7fa1cc0b4fa0 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d3a64640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa1cc161ce0 con 0x7fa1cc161900 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d0fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1cc0b5510 0x7fa1cc15e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d0fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1cc0b5510 0x7fa1cc15e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38588/0 (socket says 172.21.15.96:38588) 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d0fff640 1 -- 172.21.15.96:0/380695553 learned_addr learned my addr 172.21.15.96:0/380695553 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d2001640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 0x7fa1cc15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.221+0000 7fa1d1800640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc0b4fa0 0x7fa1cc1f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1d0fff640 1 -- 172.21.15.96:0/380695553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 msgr2=0x7fa1cc15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1d0fff640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 0x7fa1cc15ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1d0fff640 1 -- 172.21.15.96:0/380695553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc0b4fa0 msgr2=0x7fa1cc1f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1d0fff640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc0b4fa0 0x7fa1cc1f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1d0fff640 1 -- 172.21.15.96:0/380695553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1cc0cb1e0 con 0x7fa1cc0b5510 2024-06-02T23:47:01.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1d0fff640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1cc0b5510 0x7fa1cc15e7e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000c450 tx=0x7fa1c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:01.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1c9ffb640 1 -- 172.21.15.96:0/380695553 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0018070 con 0x7fa1cc0b5510 2024-06-02T23:47:01.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1c9ffb640 1 -- 172.21.15.96:0/380695553 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c0007480 con 0x7fa1cc0b5510 2024-06-02T23:47:01.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1d3a64640 1 -- 172.21.15.96:0/380695553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1cc0cb4c0 con 0x7fa1cc0b5510 2024-06-02T23:47:01.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1c9ffb640 1 -- 172.21.15.96:0/380695553 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c00047e0 con 0x7fa1cc0b5510 2024-06-02T23:47:01.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.222+0000 7fa1d3a64640 1 -- 172.21.15.96:0/380695553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1cc0cbfa0 con 0x7fa1cc0b5510 2024-06-02T23:47:01.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.223+0000 7fa1d3a64640 1 -- 172.21.15.96:0/380695553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1cc0683e0 con 0x7fa1cc0b5510 2024-06-02T23:47:01.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.224+0000 7fa1c9ffb640 1 -- 172.21.15.96:0/380695553 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1c001b070 con 0x7fa1cc0b5510 2024-06-02T23:47:01.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.224+0000 7fa1c9ffb640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa1b806be30 0x7fa1b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.224+0000 7fa1d1800640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa1b806be30 0x7fa1b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.224+0000 7fa1c9ffb640 1 -- 172.21.15.96:0/380695553 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa1c008a2d0 con 0x7fa1cc0b5510 2024-06-02T23:47:01.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.225+0000 7fa1d1800640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa1b806be30 0x7fa1b806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc033000 tx=0x7fa1bc009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:01.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.229+0000 7fa1c9ffb640 1 -- 172.21.15.96:0/380695553 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa1c0058380 con 0x7fa1cc0b5510 2024-06-02T23:47:01.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.403+0000 7fa1d3a64640 1 -- 172.21.15.96:0/380695553 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1cc0d05e0 con 0x7fa1cc0b5510 2024-06-02T23:47:01.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.404+0000 7fa1c9ffb640 1 -- 172.21.15.96:0/380695553 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18514 (secure 0 0 0) 0x7fa1c005c680 con 0x7fa1cc0b5510 2024-06-02T23:47:01.405 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:01.405 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":24,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:46:30.096314+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:47:01.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.406+0000 7fa1d3a64640 1 -- 172.21.15.96:0/380695553 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa1b806be30 msgr2=0x7fa1b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.406+0000 7fa1d3a64640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa1b806be30 0x7fa1b806e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc033000 tx=0x7fa1bc009000 comp rx=0 tx=0).stop 2024-06-02T23:47:01.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.406+0000 7fa1d3a64640 1 -- 172.21.15.96:0/380695553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1cc0b5510 msgr2=0x7fa1cc15e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.407+0000 7fa1d3a64640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1cc0b5510 0x7fa1cc15e7e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000c450 tx=0x7fa1c000c910 comp rx=0 tx=0).stop 2024-06-02T23:47:01.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.407+0000 7fa1d3a64640 1 -- 172.21.15.96:0/380695553 shutdown_connections 2024-06-02T23:47:01.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.407+0000 7fa1d3a64640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1cc161900 0x7fa1cc15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.407+0000 7fa1d3a64640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa1b806be30 0x7fa1b806e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.407+0000 7fa1d3a64640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1cc0b5510 0x7fa1cc15e7e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.407+0000 7fa1d3a64640 1 --2- 172.21.15.96:0/380695553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1cc0b4fa0 0x7fa1cc1f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.407+0000 7fa1d3a64640 1 -- 172.21.15.96:0/380695553 >> 172.21.15.96:0/380695553 conn(0x7fa1cc09d3b0 msgr2=0x7fa1cc15f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:01.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.407+0000 7fa1d3a64640 1 -- 172.21.15.96:0/380695553 shutdown_connections 2024-06-02T23:47:01.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.407+0000 7fa1d3a64640 1 -- 172.21.15.96:0/380695553 wait complete. 2024-06-02T23:47:01.418 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T23:46:14.025119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T23:46:22.850235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T23:46:24.030863+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-02T23:46:27.744207+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-02T23:47:01.419 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T23:47:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.521+0000 7f9954838640 1 Processor -- start 2024-06-02T23:47:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.521+0000 7f9954838640 1 -- start start 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.521+0000 7f9954838640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995006e610 0x7f995006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.521+0000 7f9954838640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f99500cd880 0x7f99500cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.521+0000 7f9954838640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99500723e0 con 0x7f995015e530 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.521+0000 7f9954838640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f995006efb0 con 0x7f99500cd880 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.521+0000 7f9954838640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f99500cb7b0 con 0x7f995006e610 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.522+0000 7f994ed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f99500cd880 0x7f99500cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.522+0000 7f994ed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f99500cd880 0x7f99500cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38600/0 (socket says 172.21.15.96:38600) 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.522+0000 7f994ed9d640 1 -- 172.21.15.96:0/1783393219 learned_addr learned my addr 172.21.15.96:0/1783393219 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.522+0000 7f9945d9b640 1 --2- 172.21.15.96:0/1783393219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995006e610 0x7f995006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.522+0000 7f994ed9d640 1 -- 172.21.15.96:0/1783393219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995006e610 msgr2=0x7f995006ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:01.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.522+0000 7f994ed9d640 1 --2- 172.21.15.96:0/1783393219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995006e610 0x7f995006ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.522+0000 7f994ed9d640 1 -- 172.21.15.96:0/1783393219 >> v1:172.21.15.162:6789/0 conn(0x7f995015e530 legacy=0x7f99500cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:01.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.522+0000 7f994ed9d640 1 -- 172.21.15.96:0/1783393219 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9950072680 con 0x7f99500cd880 2024-06-02T23:47:01.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.522+0000 7f9945d9b640 1 --2- 172.21.15.96:0/1783393219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995006e610 0x7f995006ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:01.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f994ed9d640 1 --2- 172.21.15.96:0/1783393219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99500cd880 0x7f99500cdcd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9948009e50 tx=0x7f994802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a39c7d6c5f83cb5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:01.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f994dd9b640 1 -- 172.21.15.96:0/1783393219 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948036070 con 0x7f99500cd880 2024-06-02T23:47:01.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f994dd9b640 1 -- 172.21.15.96:0/1783393219 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9948031600 con 0x7f99500cd880 2024-06-02T23:47:01.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f994dd9b640 1 -- 172.21.15.96:0/1783393219 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99480319d0 con 0x7f99500cd880 2024-06-02T23:47:01.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f9954838640 1 -- 172.21.15.96:0/1783393219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99500cd880 msgr2=0x7f99500cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f9954838640 1 --2- 172.21.15.96:0/1783393219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99500cd880 0x7f99500cdcd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9948009e50 tx=0x7f994802a5b0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f9954838640 1 -- 172.21.15.96:0/1783393219 shutdown_connections 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f9954838640 1 --2- 172.21.15.96:0/1783393219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99500cd880 0x7f99500cdcd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f9954838640 1 --2- 172.21.15.96:0/1783393219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995006e610 0x7f995006ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f9954838640 1 -- 172.21.15.96:0/1783393219 >> 172.21.15.96:0/1783393219 conn(0x7f99500cfcb0 msgr2=0x7f99500d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f9954838640 1 -- 172.21.15.96:0/1783393219 shutdown_connections 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.523+0000 7f9954838640 1 -- 172.21.15.96:0/1783393219 wait complete. 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.525+0000 7f9954838640 1 Processor -- start 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.525+0000 7f9954838640 1 -- start start 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.525+0000 7f9954838640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f995006e610 0x7f99500c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.525+0000 7f9954838640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99500cd880 0x7f9950150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.525+0000 7f9954838640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995015e530 0x7f9950151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.525+0000 7f9954838640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f995015e910 con 0x7f995006e610 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.525+0000 7f9954838640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9950072c40 con 0x7f99500cd880 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.525+0000 7f9954838640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9950073160 con 0x7f995015e530 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f994e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f995006e610 0x7f99500c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f994e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f995006e610 0x7f99500c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38614/0 (socket says 172.21.15.96:38614) 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f994e59c640 1 -- 172.21.15.96:0/2335017239 learned_addr learned my addr 172.21.15.96:0/2335017239 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f994ed9d640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995015e530 0x7f9950151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f9945d9b640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99500cd880 0x7f9950150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f994e59c640 1 -- 172.21.15.96:0/2335017239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995015e530 msgr2=0x7f9950151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f994e59c640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995015e530 0x7f9950151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f994e59c640 1 -- 172.21.15.96:0/2335017239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99500cd880 msgr2=0x7f9950150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f994e59c640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99500cd880 0x7f9950150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f994e59c640 1 -- 172.21.15.96:0/2335017239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99500b3af0 con 0x7f995006e610 2024-06-02T23:47:01.528 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f994e59c640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f995006e610 0x7f99500c8840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f994000b420 tx=0x7f994000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:01.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f99477fe640 1 -- 172.21.15.96:0/2335017239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940011830 con 0x7f995006e610 2024-06-02T23:47:01.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f99477fe640 1 -- 172.21.15.96:0/2335017239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9940016070 con 0x7f995006e610 2024-06-02T23:47:01.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f9954838640 1 -- 172.21.15.96:0/2335017239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99500b3dd0 con 0x7f995006e610 2024-06-02T23:47:01.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f99477fe640 1 -- 172.21.15.96:0/2335017239 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940011c10 con 0x7f995006e610 2024-06-02T23:47:01.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.526+0000 7f9954838640 1 -- 172.21.15.96:0/2335017239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99501567a0 con 0x7f995006e610 2024-06-02T23:47:01.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.527+0000 7f9954838640 1 -- 172.21.15.96:0/2335017239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99500683e0 con 0x7f995006e610 2024-06-02T23:47:01.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.528+0000 7f99477fe640 1 -- 172.21.15.96:0/2335017239 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f994001b460 con 0x7f995006e610 2024-06-02T23:47:01.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.528+0000 7f99477fe640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f993006be30 0x7f993006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.528+0000 7f9945d9b640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f993006be30 0x7f993006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.528+0000 7f99477fe640 1 -- 172.21.15.96:0/2335017239 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f994008ada0 con 0x7f995006e610 2024-06-02T23:47:01.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.529+0000 7f9945d9b640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f993006be30 0x7f993006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f99500c9350 tx=0x7f9938008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:01.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.533+0000 7f99477fe640 1 -- 172.21.15.96:0/2335017239 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9940058dc0 con 0x7f995006e610 2024-06-02T23:47:01.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.706+0000 7f9954838640 1 -- 172.21.15.96:0/2335017239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f99500ca1e0 con 0x7f995006e610 2024-06-02T23:47:01.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.706+0000 7f99477fe640 1 -- 172.21.15.96:0/2335017239 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f994005d0c0 con 0x7f995006e610 2024-06-02T23:47:01.706 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-06-02T23:47:01.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 -- 172.21.15.96:0/2335017239 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f993006be30 msgr2=0x7f993006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f993006be30 0x7f993006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f99500c9350 tx=0x7f9938008040 comp rx=0 tx=0).stop 2024-06-02T23:47:01.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 -- 172.21.15.96:0/2335017239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f995006e610 msgr2=0x7f99500c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f995006e610 0x7f99500c8840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f994000b420 tx=0x7f994000b8e0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 -- 172.21.15.96:0/2335017239 shutdown_connections 2024-06-02T23:47:01.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995015e530 0x7f9950151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99500cd880 0x7f9950150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f993006be30 0x7f993006e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 --2- 172.21.15.96:0/2335017239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f995006e610 0x7f99500c8840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 -- 172.21.15.96:0/2335017239 >> 172.21.15.96:0/2335017239 conn(0x7f99500cfcb0 msgr2=0x7f99500cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:01.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 -- 172.21.15.96:0/2335017239 shutdown_connections 2024-06-02T23:47:01.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.708+0000 7f9954838640 1 -- 172.21.15.96:0/2335017239 wait complete. 2024-06-02T23:47:01.719 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T23:47:01.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.822+0000 7f5565eca640 1 Processor -- start 2024-06-02T23:47:01.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.822+0000 7f5565eca640 1 -- start start 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f5565eca640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556015e530 0x7f55600cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f5565eca640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f556006ed20 0x7f55600cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f5565eca640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55600723e0 con 0x7f55600cb2a0 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f5565eca640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f55600cb7b0 con 0x7f556006ed20 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f5565eca640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5560072680 con 0x7f556015e530 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f555ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f556006ed20 0x7f55600cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f555effd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f55600cb2a0 0x7f556006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55122/0 (socket says 172.21.15.96:55122) 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f555effd640 1 -- 172.21.15.96:0/2684292779 learned_addr learned my addr 172.21.15.96:0/2684292779 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f555f7fe640 1 --2- 172.21.15.96:0/2684292779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556015e530 0x7f55600cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f555ffff640 1 -- 172.21.15.96:0/2684292779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556015e530 msgr2=0x7f55600cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f555ffff640 1 --2- 172.21.15.96:0/2684292779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556015e530 0x7f55600cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f555ffff640 1 -- 172.21.15.96:0/2684292779 >> v1:172.21.15.96:6789/0 conn(0x7f55600cb2a0 legacy=0x7f556006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f555e7fc640 1 -- 172.21.15.96:0/2684292779 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258676805 0 0) 0x7f55600723e0 con 0x7f55600cb2a0 2024-06-02T23:47:01.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.823+0000 7f555ffff640 1 -- 172.21.15.96:0/2684292779 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5560072960 con 0x7f556006ed20 2024-06-02T23:47:01.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.824+0000 7f555ffff640 1 --2- 172.21.15.96:0/2684292779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 0x7f55600cd880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5558009d90 tx=0x7f555802a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ad795d9341af81 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:01.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.824+0000 7f555e7fc640 1 -- 172.21.15.96:0/2684292779 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558007740 con 0x7f556006ed20 2024-06-02T23:47:01.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.824+0000 7f555e7fc640 1 -- 172.21.15.96:0/2684292779 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55580078e0 con 0x7f556006ed20 2024-06-02T23:47:01.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.824+0000 7f555e7fc640 1 -- 172.21.15.96:0/2684292779 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5558007cb0 con 0x7f556006ed20 2024-06-02T23:47:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.825+0000 7f5565eca640 1 -- 172.21.15.96:0/2684292779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 msgr2=0x7f55600cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.825+0000 7f5565eca640 1 --2- 172.21.15.96:0/2684292779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 0x7f55600cd880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5558009d90 tx=0x7f555802a530 comp rx=0 tx=0).stop 2024-06-02T23:47:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.825+0000 7f5565eca640 1 -- 172.21.15.96:0/2684292779 shutdown_connections 2024-06-02T23:47:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.825+0000 7f5565eca640 1 --2- 172.21.15.96:0/2684292779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 0x7f55600cd880 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.825+0000 7f5565eca640 1 --2- 172.21.15.96:0/2684292779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f556015e530 0x7f55600cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.825+0000 7f5565eca640 1 -- 172.21.15.96:0/2684292779 >> 172.21.15.96:0/2684292779 conn(0x7f55600cfcb0 msgr2=0x7f55600d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.825+0000 7f5565eca640 1 -- 172.21.15.96:0/2684292779 shutdown_connections 2024-06-02T23:47:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.825+0000 7f5565eca640 1 -- 172.21.15.96:0/2684292779 wait complete. 2024-06-02T23:47:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.826+0000 7f5565eca640 1 Processor -- start 2024-06-02T23:47:01.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.826+0000 7f5565eca640 1 -- start start 2024-06-02T23:47:01.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f5565eca640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 0x7f55601f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f5565eca640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55600cb2a0 0x7f55600c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f5565eca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f556015e530 0x7f5560159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f5565eca640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5560073160 con 0x7f556006ed20 2024-06-02T23:47:01.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f5565eca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f556015e910 con 0x7f556015e530 2024-06-02T23:47:01.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f5565eca640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f556006d120 con 0x7f55600cb2a0 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f555f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 0x7f55601f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f555f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 0x7f55601f52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38634/0 (socket says 172.21.15.96:38634) 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f555f7fe640 1 -- 172.21.15.96:0/1354816255 learned_addr learned my addr 172.21.15.96:0/1354816255 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f555ffff640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f556015e530 0x7f5560159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f555effd640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55600cb2a0 0x7f55600c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f555f7fe640 1 -- 172.21.15.96:0/1354816255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55600cb2a0 msgr2=0x7f55600c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f555f7fe640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55600cb2a0 0x7f55600c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f555f7fe640 1 -- 172.21.15.96:0/1354816255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f556015e530 msgr2=0x7f5560159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f555f7fe640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f556015e530 0x7f5560159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.827+0000 7f555f7fe640 1 -- 172.21.15.96:0/1354816255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55600c4bb0 con 0x7f556006ed20 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.828+0000 7f555f7fe640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 0x7f55601f52f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f555000c7f0 tx=0x7f555000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:01.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.828+0000 7f5547fff640 1 -- 172.21.15.96:0/1354816255 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550015070 con 0x7f556006ed20 2024-06-02T23:47:01.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.828+0000 7f5547fff640 1 -- 172.21.15.96:0/1354816255 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5550004240 con 0x7f556006ed20 2024-06-02T23:47:01.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.828+0000 7f5565eca640 1 -- 172.21.15.96:0/1354816255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55600c4e90 con 0x7f556006ed20 2024-06-02T23:47:01.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.828+0000 7f5547fff640 1 -- 172.21.15.96:0/1354816255 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550007620 con 0x7f556006ed20 2024-06-02T23:47:01.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.828+0000 7f5565eca640 1 -- 172.21.15.96:0/1354816255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55600c5450 con 0x7f556006ed20 2024-06-02T23:47:01.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.829+0000 7f5565eca640 1 -- 172.21.15.96:0/1354816255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55600683e0 con 0x7f556006ed20 2024-06-02T23:47:01.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.833+0000 7f5547fff640 1 -- 172.21.15.96:0/1354816255 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55500079d0 con 0x7f556006ed20 2024-06-02T23:47:01.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.834+0000 7f5547fff640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f554c06be60 0x7f554c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:01.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.834+0000 7f5547fff640 1 -- 172.21.15.96:0/1354816255 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f555008b5c0 con 0x7f556006ed20 2024-06-02T23:47:01.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.834+0000 7f555effd640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f554c06be60 0x7f554c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:01.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.834+0000 7f555effd640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f554c06be60 0x7f554c06e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f55601580c0 tx=0x7f5554009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:01.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:01.838+0000 7f5547fff640 1 -- 172.21.15.96:0/1354816255 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5550059da0 con 0x7f556006ed20 2024-06-02T23:47:02.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.012+0000 7f5565eca640 1 -- 172.21.15.96:0/1354816255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f55600c3570 con 0x7f556006ed20 2024-06-02T23:47:02.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.013+0000 7f5547fff640 1 -- 172.21.15.96:0/1354816255 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f55500596a0 con 0x7f556006ed20 2024-06-02T23:47:02.013 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-06-02T23:47:02.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 -- 172.21.15.96:0/1354816255 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f554c06be60 msgr2=0x7f554c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f554c06be60 0x7f554c06e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f55601580c0 tx=0x7f5554009040 comp rx=0 tx=0).stop 2024-06-02T23:47:02.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 -- 172.21.15.96:0/1354816255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 msgr2=0x7f55601f52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 0x7f55601f52f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f555000c7f0 tx=0x7f555000ccb0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 -- 172.21.15.96:0/1354816255 shutdown_connections 2024-06-02T23:47:02.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f556015e530 0x7f5560159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55600cb2a0 0x7f55600c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f554c06be60 0x7f554c06e320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 --2- 172.21.15.96:0/1354816255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f556006ed20 0x7f55601f52f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 -- 172.21.15.96:0/1354816255 >> 172.21.15.96:0/1354816255 conn(0x7f55600cfcb0 msgr2=0x7f55601506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:02.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 -- 172.21.15.96:0/1354816255 shutdown_connections 2024-06-02T23:47:02.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.015+0000 7f5565eca640 1 -- 172.21.15.96:0/1354816255 wait complete. 2024-06-02T23:47:02.026 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T23:47:02.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.129+0000 7fcfc8716640 1 Processor -- start 2024-06-02T23:47:02.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.129+0000 7fcfc8716640 1 -- start start 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc8716640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcfc006eaa0 0x7fcfc00cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc8716640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc00723e0 con 0x7fcfc015e530 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc8716640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc00cb7b0 con 0x7fcfc006e610 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc8716640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc0072680 con 0x7fcfc006eaa0 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc64b2640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fcfc015e530 0x7fcfc00cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55128/0 (socket says 172.21.15.96:55128) 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc64b2640 1 -- 172.21.15.96:0/3807029435 learned_addr learned my addr 172.21.15.96:0/3807029435 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130777545 0 0) 0x7fcfc00723e0 con 0x7fcfc015e530 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfac003520 con 0x7fcfc015e530 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc6cb3640 1 --2- 172.21.15.96:0/3807029435 >> v2:172.21.15.162:3300/0 conn(0x7fcfc006eaa0 0x7fcfc00cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 882718071 0 0) 0x7fcfac003520 con 0x7fcfc015e530 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 >> v2:172.21.15.162:3300/0 conn(0x7fcfc006eaa0 msgr2=0x7fcfc00cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 --2- 172.21.15.96:0/3807029435 >> v2:172.21.15.162:3300/0 conn(0x7fcfc006eaa0 0x7fcfc00cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 >> v1:172.21.15.162:6789/0 conn(0x7fcfc006e610 legacy=0x7fcfc00cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc0072960 con 0x7fcfc015e530 2024-06-02T23:47:02.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fcfbc001670 con 0x7fcfc015e530 2024-06-02T23:47:02.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 >> v1:172.21.15.96:6789/0 conn(0x7fcfc015e530 legacy=0x7fcfc00cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcfac0039b0 0x7fcfac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfac004800 0x7fcfac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc0072680 con 0x7fcfac0052e0 2024-06-02T23:47:02.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac00c1b0 con 0x7fcfac004800 2024-06-02T23:47:02.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.130+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcfac00c3b0 con 0x7fcfac0039b0 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.131+0000 7fcfc6cb3640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.131+0000 7fcfc5cb1640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfac004800 0x7fcfac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.131+0000 7fcfc64b2640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcfac0039b0 0x7fcfac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.131+0000 7fcfc6cb3640 1 -- 172.21.15.96:0/3807029435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcfac0039b0 msgr2=0x7fcfac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.131+0000 7fcfc6cb3640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcfac0039b0 0x7fcfac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.131+0000 7fcfc6cb3640 1 -- 172.21.15.96:0/3807029435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfac004800 msgr2=0x7fcfac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.131+0000 7fcfc6cb3640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfac004800 0x7fcfac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.131+0000 7fcfc6cb3640 1 -- 172.21.15.96:0/3807029435 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfac003520 con 0x7fcfac0052e0 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.131+0000 7fcfc6cb3640 1 -- 172.21.15.96:0/3807029435 reap_dead start 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.131+0000 7fcfc6cb3640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfac00b9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009f90 tx=0x7fcfac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbd59a3d19b9a16 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:02.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.132+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8035020 con 0x7fcfac0052e0 2024-06-02T23:47:02.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.132+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb8003b90 con 0x7fcfac0052e0 2024-06-02T23:47:02.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.132+0000 7fcfc54b0640 1 -- 172.21.15.96:0/3807029435 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8009c10 con 0x7fcfac0052e0 2024-06-02T23:47:02.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.132+0000 7fcfc8716640 1 -- 172.21.15.96:0/3807029435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 msgr2=0x7fcfac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.132+0000 7fcfc8716640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfac00b9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009f90 tx=0x7fcfac005830 comp rx=0 tx=0).stop 2024-06-02T23:47:02.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.132+0000 7fcfc8716640 1 -- 172.21.15.96:0/3807029435 shutdown_connections 2024-06-02T23:47:02.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.132+0000 7fcfc8716640 1 --2- 172.21.15.96:0/3807029435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfac00b9c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.132+0000 7fcfc8716640 1 -- 172.21.15.96:0/3807029435 >> 172.21.15.96:0/3807029435 conn(0x7fcfc00cfcb0 msgr2=0x7fcfc00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:02.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.132+0000 7fcfc8716640 1 -- 172.21.15.96:0/3807029435 shutdown_connections 2024-06-02T23:47:02.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.132+0000 7fcfc8716640 1 -- 172.21.15.96:0/3807029435 wait complete. 2024-06-02T23:47:02.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.133+0000 7fcfc8716640 1 Processor -- start 2024-06-02T23:47:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.133+0000 7fcfc8716640 1 -- start start 2024-06-02T23:47:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc8716640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfc01f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc8716640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcfc014fb10 0x7fcfc00c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc8716640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfc00c78a0 0x7fcfc00c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc8716640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc0073160 con 0x7fcfac0052e0 2024-06-02T23:47:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc8716640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc015e910 con 0x7fcfc00c78a0 2024-06-02T23:47:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc8716640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc006eeb0 con 0x7fcfc014fb10 2024-06-02T23:47:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc64b2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfc01f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc64b2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfc01f4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38652/0 (socket says 172.21.15.96:38652) 2024-06-02T23:47:02.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc64b2640 1 -- 172.21.15.96:0/1657613523 learned_addr learned my addr 172.21.15.96:0/1657613523 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc5cb1640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcfc014fb10 0x7fcfc00c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.134+0000 7fcfc6cb3640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfc00c78a0 0x7fcfc00c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfc64b2640 1 -- 172.21.15.96:0/1657613523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcfc014fb10 msgr2=0x7fcfc00c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfc64b2640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcfc014fb10 0x7fcfc00c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfc64b2640 1 -- 172.21.15.96:0/1657613523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfc00c78a0 msgr2=0x7fcfc00c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfc64b2640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfc00c78a0 0x7fcfc00c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfc64b2640 1 -- 172.21.15.96:0/1657613523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc00c5630 con 0x7fcfac0052e0 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfc5cb1640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcfc014fb10 0x7fcfc00c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfc6cb3640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfc00c78a0 0x7fcfc00c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfc64b2640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfc01f4e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc004ef0 tx=0x7fcfbc007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfb6ffd640 1 -- 172.21.15.96:0/1657613523 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc00f750 con 0x7fcfac0052e0 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfb6ffd640 1 -- 172.21.15.96:0/1657613523 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc018070 con 0x7fcfac0052e0 2024-06-02T23:47:02.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfc8716640 1 -- 172.21.15.96:0/1657613523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc00c5910 con 0x7fcfac0052e0 2024-06-02T23:47:02.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfb6ffd640 1 -- 172.21.15.96:0/1657613523 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc00fb10 con 0x7fcfac0052e0 2024-06-02T23:47:02.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.135+0000 7fcfc8716640 1 -- 172.21.15.96:0/1657613523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc00c5ed0 con 0x7fcfac0052e0 2024-06-02T23:47:02.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.136+0000 7fcfc8716640 1 -- 172.21.15.96:0/1657613523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc00683e0 con 0x7fcfac0052e0 2024-06-02T23:47:02.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.136+0000 7fcfb6ffd640 1 -- 172.21.15.96:0/1657613523 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfbc00fcb0 con 0x7fcfac0052e0 2024-06-02T23:47:02.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.137+0000 7fcfb6ffd640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcfa406be30 0x7fcfa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.137+0000 7fcfc5cb1640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcfa406be30 0x7fcfa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.137+0000 7fcfb6ffd640 1 -- 172.21.15.96:0/1657613523 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcfbc08b110 con 0x7fcfac0052e0 2024-06-02T23:47:02.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.137+0000 7fcfc5cb1640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcfa406be30 0x7fcfa406e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0000c00 tx=0x7fcfb0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:02.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.141+0000 7fcfb6ffd640 1 -- 172.21.15.96:0/1657613523 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcfbc059810 con 0x7fcfac0052e0 2024-06-02T23:47:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.315+0000 7fcfc8716640 1 -- 172.21.15.96:0/1657613523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcfc006cd40 con 0x7fcfac0052e0 2024-06-02T23:47:02.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.315+0000 7fcfb6ffd640 1 -- 172.21.15.96:0/1657613523 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fcfbc059110 con 0x7fcfac0052e0 2024-06-02T23:47:02.315 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-06-02T23:47:02.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 -- 172.21.15.96:0/1657613523 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcfa406be30 msgr2=0x7fcfa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcfa406be30 0x7fcfa406e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0000c00 tx=0x7fcfb0009040 comp rx=0 tx=0).stop 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 -- 172.21.15.96:0/1657613523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 msgr2=0x7fcfc01f4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfc01f4e50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc004ef0 tx=0x7fcfbc007430 comp rx=0 tx=0).stop 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 -- 172.21.15.96:0/1657613523 shutdown_connections 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfc00c78a0 0x7fcfc00c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcfc014fb10 0x7fcfc00c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcfa406be30 0x7fcfa406e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 --2- 172.21.15.96:0/1657613523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfac0052e0 0x7fcfc01f4e50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 -- 172.21.15.96:0/1657613523 >> 172.21.15.96:0/1657613523 conn(0x7fcfc00cfcb0 msgr2=0x7fcfc00c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 -- 172.21.15.96:0/1657613523 shutdown_connections 2024-06-02T23:47:02.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.317+0000 7fcfc8716640 1 -- 172.21.15.96:0/1657613523 wait complete. 2024-06-02T23:47:02.328 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-02T23:47:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.431+0000 7f2717d14640 1 Processor -- start 2024-06-02T23:47:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.431+0000 7f2717d14640 1 -- start start 2024-06-02T23:47:02.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.432+0000 7f2717d14640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f271015e530 0x7f27100cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.432+0000 7f2717d14640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271006ed20 0x7f27100cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.432+0000 7f2717d14640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27100723e0 con 0x7f27100cb2a0 2024-06-02T23:47:02.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.432+0000 7f2717d14640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f27100cb7b0 con 0x7f271015e530 2024-06-02T23:47:02.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.432+0000 7f2717d14640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2710072680 con 0x7f271006ed20 2024-06-02T23:47:02.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.432+0000 7f2715ab0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f271015e530 0x7f27100cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.432+0000 7f27152af640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f27100cb2a0 0x7f271006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:55144/0 (socket says 172.21.15.96:55144) 2024-06-02T23:47:02.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.432+0000 7f27152af640 1 -- 172.21.15.96:0/1087807338 learned_addr learned my addr 172.21.15.96:0/1087807338 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:02.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.432+0000 7f27162b1640 1 --2- 172.21.15.96:0/1087807338 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271006ed20 0x7f27100cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.433+0000 7f2715ab0640 1 -- 172.21.15.96:0/1087807338 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271006ed20 msgr2=0x7f27100cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:02.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.433+0000 7f2715ab0640 1 --2- 172.21.15.96:0/1087807338 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271006ed20 0x7f27100cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.433+0000 7f2715ab0640 1 -- 172.21.15.96:0/1087807338 >> v1:172.21.15.96:6789/0 conn(0x7f27100cb2a0 legacy=0x7f271006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.433+0000 7f2715ab0640 1 -- 172.21.15.96:0/1087807338 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2710072960 con 0x7f271015e530 2024-06-02T23:47:02.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.433+0000 7f2714aae640 1 -- 172.21.15.96:0/1087807338 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3290858956 0 0) 0x7f27100723e0 con 0x7f27100cb2a0 2024-06-02T23:47:02.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.433+0000 7f27162b1640 1 --2- 172.21.15.96:0/1087807338 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271006ed20 0x7f27100cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.433+0000 7f2715ab0640 1 --2- 172.21.15.96:0/1087807338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271015e530 0x7f27100cad60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f270c0097a0 tx=0x7f270c02c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706b121bc9394ba7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.433+0000 7f2714aae640 1 -- 172.21.15.96:0/1087807338 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c039070 con 0x7f271015e530 2024-06-02T23:47:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.433+0000 7f2714aae640 1 -- 172.21.15.96:0/1087807338 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f270c034440 con 0x7f271015e530 2024-06-02T23:47:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.433+0000 7f2714aae640 1 -- 172.21.15.96:0/1087807338 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c034810 con 0x7f271015e530 2024-06-02T23:47:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.434+0000 7f2717d14640 1 -- 172.21.15.96:0/1087807338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271015e530 msgr2=0x7f27100cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.434+0000 7f2717d14640 1 --2- 172.21.15.96:0/1087807338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271015e530 0x7f27100cad60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f270c0097a0 tx=0x7f270c02c270 comp rx=0 tx=0).stop 2024-06-02T23:47:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.434+0000 7f2717d14640 1 -- 172.21.15.96:0/1087807338 shutdown_connections 2024-06-02T23:47:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.434+0000 7f2717d14640 1 --2- 172.21.15.96:0/1087807338 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271006ed20 0x7f27100cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.434+0000 7f2717d14640 1 --2- 172.21.15.96:0/1087807338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271015e530 0x7f27100cad60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.434+0000 7f2717d14640 1 -- 172.21.15.96:0/1087807338 >> 172.21.15.96:0/1087807338 conn(0x7f27100cfcb0 msgr2=0x7f27100d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.434+0000 7f2717d14640 1 -- 172.21.15.96:0/1087807338 shutdown_connections 2024-06-02T23:47:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.434+0000 7f2717d14640 1 -- 172.21.15.96:0/1087807338 wait complete. 2024-06-02T23:47:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.435+0000 7f2717d14640 1 Processor -- start 2024-06-02T23:47:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.435+0000 7f2717d14640 1 -- start start 2024-06-02T23:47:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2717d14640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271006ed20 0x7f27101f0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2717d14640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27100cb2a0 0x7f271015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2717d14640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271015e530 0x7f27100c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2717d14640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2710073160 con 0x7f271006ed20 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2717d14640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f271015e910 con 0x7f27100cb2a0 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2717d14640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f271006d120 con 0x7f271015e530 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2715ab0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271006ed20 0x7f27101f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2715ab0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271006ed20 0x7f27101f0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38676/0 (socket says 172.21.15.96:38676) 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2715ab0640 1 -- 172.21.15.96:0/1201642064 learned_addr learned my addr 172.21.15.96:0/1201642064 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f27162b1640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271015e530 0x7f27100c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2715ab0640 1 -- 172.21.15.96:0/1201642064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271015e530 msgr2=0x7f27100c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f27152af640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27100cb2a0 0x7f271015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2715ab0640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271015e530 0x7f27100c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2715ab0640 1 -- 172.21.15.96:0/1201642064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27100cb2a0 msgr2=0x7f271015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2715ab0640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27100cb2a0 0x7f271015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2715ab0640 1 -- 172.21.15.96:0/1201642064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27101f0770 con 0x7f271006ed20 2024-06-02T23:47:02.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f27162b1640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271015e530 0x7f27100c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:02.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f27152af640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27100cb2a0 0x7f271015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:02.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.436+0000 7f2715ab0640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271006ed20 0x7f27101f0230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f270c000c00 tx=0x7f270c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:02.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.437+0000 7f27067fc640 1 -- 172.21.15.96:0/1201642064 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c039040 con 0x7f271006ed20 2024-06-02T23:47:02.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.437+0000 7f27067fc640 1 -- 172.21.15.96:0/1201642064 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f270c044070 con 0x7f271006ed20 2024-06-02T23:47:02.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.437+0000 7f2717d14640 1 -- 172.21.15.96:0/1201642064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27100b31f0 con 0x7f271006ed20 2024-06-02T23:47:02.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.437+0000 7f27067fc640 1 -- 172.21.15.96:0/1201642064 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270c032a70 con 0x7f271006ed20 2024-06-02T23:47:02.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.437+0000 7f2717d14640 1 -- 172.21.15.96:0/1201642064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27100b37b0 con 0x7f271006ed20 2024-06-02T23:47:02.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.438+0000 7f2717d14640 1 -- 172.21.15.96:0/1201642064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27100683e0 con 0x7f271006ed20 2024-06-02T23:47:02.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.438+0000 7f27067fc640 1 -- 172.21.15.96:0/1201642064 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f270c032c10 con 0x7f271006ed20 2024-06-02T23:47:02.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.438+0000 7f27067fc640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f26f406be30 0x7f26f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.439+0000 7f27067fc640 1 -- 172.21.15.96:0/1201642064 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f270c0adc10 con 0x7f271006ed20 2024-06-02T23:47:02.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.439+0000 7f27152af640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f26f406be30 0x7f26f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.439+0000 7f27152af640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f26f406be30 0x7f26f406e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f271006ec70 tx=0x7f2700009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:02.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.443+0000 7f27067fc640 1 -- 172.21.15.96:0/1201642064 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f27101f0770 con 0x7f271006ed20 2024-06-02T23:47:02.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.615+0000 7f2717d14640 1 -- 172.21.15.96:0/1201642064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f271006cd40 con 0x7f271006ed20 2024-06-02T23:47:02.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.615+0000 7f27067fc640 1 -- 172.21.15.96:0/1201642064 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f270c047360 con 0x7f271006ed20 2024-06-02T23:47:02.616 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-06-02T23:47:02.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 -- 172.21.15.96:0/1201642064 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f26f406be30 msgr2=0x7f26f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f26f406be30 0x7f26f406e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f271006ec70 tx=0x7f2700009040 comp rx=0 tx=0).stop 2024-06-02T23:47:02.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 -- 172.21.15.96:0/1201642064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271006ed20 msgr2=0x7f27101f0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271006ed20 0x7f27101f0230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f270c000c00 tx=0x7f270c0046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 -- 172.21.15.96:0/1201642064 shutdown_connections 2024-06-02T23:47:02.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f271015e530 0x7f27100c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27100cb2a0 0x7f271015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f26f406be30 0x7f26f406e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 --2- 172.21.15.96:0/1201642064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f271006ed20 0x7f27101f0230 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 -- 172.21.15.96:0/1201642064 >> 172.21.15.96:0/1201642064 conn(0x7f27100cfcb0 msgr2=0x7f27100c8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:02.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 -- 172.21.15.96:0/1201642064 shutdown_connections 2024-06-02T23:47:02.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.618+0000 7f2717d14640 1 -- 172.21.15.96:0/1201642064 wait complete. 2024-06-02T23:47:02.629 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2024-06-02T23:47:02.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.728+0000 7f76c7ca5640 1 Processor -- start 2024-06-02T23:47:02.728 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.728+0000 7f76c7ca5640 1 -- start start 2024-06-02T23:47:02.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.729+0000 7f76c7ca5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f76c0144130 0x7f76c0072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.729+0000 7f76c7ca5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76c00cffb0 0x7f76c00d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.729+0000 7f76c7ca5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c015f240 con 0x7f76c00cd150 2024-06-02T23:47:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.729+0000 7f76c7ca5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f76c0144510 con 0x7f76c0144130 2024-06-02T23:47:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.729+0000 7f76c7ca5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f76c00d0940 con 0x7f76c00cffb0 2024-06-02T23:47:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.729+0000 7f76c5a41640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f76c0144130 0x7f76c0072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.729+0000 7f76c5a41640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f76c0144130 0x7f76c0072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38682/0 (socket says 172.21.15.96:38682) 2024-06-02T23:47:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.729+0000 7f76c5a41640 1 -- 172.21.15.96:0/756853995 learned_addr learned my addr 172.21.15.96:0/756853995 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.729+0000 7f76c5a41640 1 -- 172.21.15.96:0/756853995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76c00cffb0 msgr2=0x7f76c00d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:02.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.729+0000 7f76c5a41640 1 --2- 172.21.15.96:0/756853995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76c00cffb0 0x7f76c00d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.730+0000 7f76c5a41640 1 -- 172.21.15.96:0/756853995 >> v1:172.21.15.162:6789/0 conn(0x7f76c00cd150 legacy=0x7f76c015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:02.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.730+0000 7f76c5a41640 1 -- 172.21.15.96:0/756853995 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c015f520 con 0x7f76c0144130 2024-06-02T23:47:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.730+0000 7f76c5a41640 1 --2- 172.21.15.96:0/756853995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 0x7f76c0072750 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f76b800bb40 tx=0x7f76b802c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aebf40c861854f9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.730+0000 7f76c4a3f640 1 -- 172.21.15.96:0/756853995 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8034620 con 0x7f76c0144130 2024-06-02T23:47:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.730+0000 7f76c4a3f640 1 -- 172.21.15.96:0/756853995 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b80347c0 con 0x7f76c0144130 2024-06-02T23:47:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.730+0000 7f76c4a3f640 1 -- 172.21.15.96:0/756853995 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8034b90 con 0x7f76c0144130 2024-06-02T23:47:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.731+0000 7f76c7ca5640 1 -- 172.21.15.96:0/756853995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 msgr2=0x7f76c0072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.731+0000 7f76c7ca5640 1 --2- 172.21.15.96:0/756853995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 0x7f76c0072750 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f76b800bb40 tx=0x7f76b802c870 comp rx=0 tx=0).stop 2024-06-02T23:47:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.731+0000 7f76c7ca5640 1 -- 172.21.15.96:0/756853995 shutdown_connections 2024-06-02T23:47:02.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.731+0000 7f76c7ca5640 1 --2- 172.21.15.96:0/756853995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76c00cffb0 0x7f76c00d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.731+0000 7f76c7ca5640 1 --2- 172.21.15.96:0/756853995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 0x7f76c0072750 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.731+0000 7f76c7ca5640 1 -- 172.21.15.96:0/756853995 >> 172.21.15.96:0/756853995 conn(0x7f76c006b7b0 msgr2=0x7f76c006bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.731+0000 7f76c7ca5640 1 -- 172.21.15.96:0/756853995 shutdown_connections 2024-06-02T23:47:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.731+0000 7f76c7ca5640 1 -- 172.21.15.96:0/756853995 wait complete. 2024-06-02T23:47:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.732+0000 7f76c7ca5640 1 Processor -- start 2024-06-02T23:47:02.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.732+0000 7f76c7ca5640 1 -- start start 2024-06-02T23:47:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c7ca5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c00cd150 0x7f76c0139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c7ca5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76c00cffb0 0x7f76c015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c7ca5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 0x7f76c015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c7ca5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00b3c70 con 0x7f76c0144130 2024-06-02T23:47:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c7ca5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00b3990 con 0x7f76c00cd150 2024-06-02T23:47:02.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c7ca5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f76c00cd5b0 con 0x7f76c00cffb0 2024-06-02T23:47:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c6242640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 0x7f76c015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c6242640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 0x7f76c015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38690/0 (socket says 172.21.15.96:38690) 2024-06-02T23:47:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c6242640 1 -- 172.21.15.96:0/1030270537 learned_addr learned my addr 172.21.15.96:0/1030270537 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c5240640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76c00cffb0 0x7f76c015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c5a41640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c00cd150 0x7f76c0139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c6242640 1 -- 172.21.15.96:0/1030270537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76c00cffb0 msgr2=0x7f76c015a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c6242640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76c00cffb0 0x7f76c015a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c6242640 1 -- 172.21.15.96:0/1030270537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c00cd150 msgr2=0x7f76c0139310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c6242640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c00cd150 0x7f76c0139310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c6242640 1 -- 172.21.15.96:0/1030270537 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c01f12d0 con 0x7f76c0144130 2024-06-02T23:47:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.733+0000 7f76c6242640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 0x7f76c015b620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b970 tx=0x7f76b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.734+0000 7f76be7fc640 1 -- 172.21.15.96:0/1030270537 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0019070 con 0x7f76c0144130 2024-06-02T23:47:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.734+0000 7f76be7fc640 1 -- 172.21.15.96:0/1030270537 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b000cb60 con 0x7f76c0144130 2024-06-02T23:47:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.734+0000 7f76c7ca5640 1 -- 172.21.15.96:0/1030270537 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c0139850 con 0x7f76c0144130 2024-06-02T23:47:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.734+0000 7f76be7fc640 1 -- 172.21.15.96:0/1030270537 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0014440 con 0x7f76c0144130 2024-06-02T23:47:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.734+0000 7f76c7ca5640 1 -- 172.21.15.96:0/1030270537 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c01f0a30 con 0x7f76c0144130 2024-06-02T23:47:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.735+0000 7f76c7ca5640 1 -- 172.21.15.96:0/1030270537 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c00683e0 con 0x7f76c0144130 2024-06-02T23:47:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.735+0000 7f76be7fc640 1 -- 172.21.15.96:0/1030270537 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76b001c070 con 0x7f76c0144130 2024-06-02T23:47:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.736+0000 7f76be7fc640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f76ac06be30 0x7f76ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.736+0000 7f76be7fc640 1 -- 172.21.15.96:0/1030270537 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f76b008ae70 con 0x7f76c0144130 2024-06-02T23:47:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.736+0000 7f76c5a41640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f76ac06be30 0x7f76ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.736+0000 7f76c5a41640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f76ac06be30 0x7f76ac06e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f76b8037000 tx=0x7f76b8032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:02.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.740+0000 7f76be7fc640 1 -- 172.21.15.96:0/1030270537 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f76b0059570 con 0x7f76c0144130 2024-06-02T23:47:02.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:02.981+0000 7f76c7ca5640 1 -- 172.21.15.96:0/1030270537 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) -- 0x7f76c013e900 con 0x7f76c0144130 2024-06-02T23:47:03.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.834+0000 7f76be7fc640 1 -- 172.21.15.96:0/1030270537 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v54) ==== 161+0+0 (secure 0 0 0) 0x7f76b0058e70 con 0x7f76c0144130 2024-06-02T23:47:03.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 -- 172.21.15.96:0/1030270537 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f76ac06be30 msgr2=0x7f76ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:03.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f76ac06be30 0x7f76ac06e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f76b8037000 tx=0x7f76b8032000 comp rx=0 tx=0).stop 2024-06-02T23:47:03.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 -- 172.21.15.96:0/1030270537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 msgr2=0x7f76c015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:03.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 0x7f76c015b620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b970 tx=0x7f76b000be30 comp rx=0 tx=0).stop 2024-06-02T23:47:03.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 -- 172.21.15.96:0/1030270537 shutdown_connections 2024-06-02T23:47:03.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f76ac06be30 0x7f76ac06e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:03.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76c0144130 0x7f76c015b620 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:03.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76c00cffb0 0x7f76c015a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:03.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 --2- 172.21.15.96:0/1030270537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76c00cd150 0x7f76c0139310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:03.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 -- 172.21.15.96:0/1030270537 >> 172.21.15.96:0/1030270537 conn(0x7f76c006b7b0 msgr2=0x7f76c015e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:03.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 -- 172.21.15.96:0/1030270537 shutdown_connections 2024-06-02T23:47:03.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.837+0000 7f76c7ca5640 1 -- 172.21.15.96:0/1030270537 wait complete. 2024-06-02T23:47:03.850 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-02T23:47:03.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.959+0000 7f66c9d70640 1 Processor -- start 2024-06-02T23:47:03.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.959+0000 7f66c9d70640 1 -- start start 2024-06-02T23:47:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c9d70640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c415fc40 0x7f66c4071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c9d70640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66c4072fa0 con 0x7f66c40729e0 2024-06-02T23:47:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c9d70640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66c40712a0 con 0x7f66c406ec50 2024-06-02T23:47:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c9d70640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66c40718f0 con 0x7f66c415fc40 2024-06-02T23:47:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c2ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f66c40729e0 0x7f66c4160020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46004/0 (socket says 172.21.15.96:46004) 2024-06-02T23:47:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c2ffd640 1 -- 172.21.15.96:0/3036136110 learned_addr learned my addr 172.21.15.96:0/3036136110 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c37fe640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c415fc40 0x7f66c4071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177509122 0 0) 0x7f66c4072fa0 con 0x7f66c40729e0 2024-06-02T23:47:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66ac003520 con 0x7f66c40729e0 2024-06-02T23:47:03.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 965702383 0 0) 0x7f66ac003520 con 0x7f66c40729e0 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c415fc40 msgr2=0x7f66c4071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c27fc640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c415fc40 0x7f66c4071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 >> v1:172.21.15.162:6789/0 conn(0x7f66c406ec50 legacy=0x7f66c40ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c4071580 con 0x7f66c40729e0 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f66b8001670 con 0x7f66c40729e0 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.960+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 >> v1:172.21.15.96:6789/0 conn(0x7f66c40729e0 legacy=0x7f66c4160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c27fc640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66ac0039e0 0x7f66ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c27fc640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ac004800 0x7f66ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c27fc640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c415fc40 0x7f66ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f66c40718f0 con 0x7f66ac0039e0 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac00ba70 con 0x7f66ac004800 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66ac00bc70 con 0x7f66c415fc40 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c37fe640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66ac0039e0 0x7f66ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c2ffd640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ac004800 0x7f66ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c3fff640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c415fc40 0x7f66ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c37fe640 1 -- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c415fc40 msgr2=0x7f66ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c37fe640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66c415fc40 0x7f66ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c37fe640 1 -- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ac004800 msgr2=0x7f66ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c37fe640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66ac004800 0x7f66ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.961+0000 7f66c37fe640 1 -- 172.21.15.96:0/3036136110 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac003520 con 0x7f66ac0039e0 2024-06-02T23:47:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c37fe640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66ac0039e0 0x7f66ac003e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009f90 tx=0x7f66ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f35961d516bc89 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4009c10 con 0x7f66ac0039e0 2024-06-02T23:47:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b4036070 con 0x7f66ac0039e0 2024-06-02T23:47:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c27fc640 1 -- 172.21.15.96:0/3036136110 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b4031830 con 0x7f66ac0039e0 2024-06-02T23:47:03.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c9d70640 1 -- 172.21.15.96:0/3036136110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66ac0039e0 msgr2=0x7f66ac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:03.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c9d70640 1 --2- 172.21.15.96:0/3036136110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66ac0039e0 0x7f66ac003e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009f90 tx=0x7f66ac005830 comp rx=0 tx=0).stop 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c3fff640 1 -- 172.21.15.96:0/3036136110 reap_dead start 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c9d70640 1 -- 172.21.15.96:0/3036136110 shutdown_connections 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c9d70640 1 -- 172.21.15.96:0/3036136110 >> 172.21.15.96:0/3036136110 conn(0x7f66c40cfcb0 msgr2=0x7f66c40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c9d70640 1 -- 172.21.15.96:0/3036136110 shutdown_connections 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.962+0000 7f66c9d70640 1 -- 172.21.15.96:0/3036136110 wait complete. 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.963+0000 7f66c9d70640 1 Processor -- start 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.964+0000 7f66c9d70640 1 -- start start 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.964+0000 7f66c9d70640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ac0039e0 0x7f66c4150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.964+0000 7f66c9d70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c41f1ce0 0x7f66c40c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.964+0000 7f66c9d70640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66c40c8d30 0x7f66c40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.964+0000 7f66c9d70640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f66c40cab90 con 0x7f66c40c8d30 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.964+0000 7f66c9d70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66c40caa10 con 0x7f66c41f1ce0 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.964+0000 7f66c9d70640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66c4071d80 con 0x7f66ac0039e0 2024-06-02T23:47:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.964+0000 7f66c3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66c40c8d30 0x7f66c40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.964+0000 7f66c3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66c40c8d30 0x7f66c40c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33436/0 (socket says 172.21.15.96:33436) 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c3fff640 1 -- 172.21.15.96:0/1293007547 learned_addr learned my addr 172.21.15.96:0/1293007547 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c2ffd640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c41f1ce0 0x7f66c40c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c37fe640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ac0039e0 0x7f66c4150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c3fff640 1 -- 172.21.15.96:0/1293007547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ac0039e0 msgr2=0x7f66c4150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c3fff640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ac0039e0 0x7f66c4150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c3fff640 1 -- 172.21.15.96:0/1293007547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c41f1ce0 msgr2=0x7f66c40c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c3fff640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c41f1ce0 0x7f66c40c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c3fff640 1 -- 172.21.15.96:0/1293007547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c414f8e0 con 0x7f66c40c8d30 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c2ffd640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c41f1ce0 0x7f66c40c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c3fff640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66c40c8d30 0x7f66c40c91b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f66c4069d40 tx=0x7f66bc00e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66abfff640 1 -- 172.21.15.96:0/1293007547 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc019070 con 0x7f66c40c8d30 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66abfff640 1 -- 172.21.15.96:0/1293007547 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66bc0052e0 con 0x7f66c40c8d30 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c9d70640 1 -- 172.21.15.96:0/1293007547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c41f2160 con 0x7f66c40c8d30 2024-06-02T23:47:03.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66abfff640 1 -- 172.21.15.96:0/1293007547 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc003830 con 0x7f66c40c8d30 2024-06-02T23:47:03.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.965+0000 7f66c9d70640 1 -- 172.21.15.96:0/1293007547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c41f2710 con 0x7f66c40c8d30 2024-06-02T23:47:03.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.966+0000 7f66c9d70640 1 -- 172.21.15.96:0/1293007547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c40683e0 con 0x7f66c40c8d30 2024-06-02T23:47:03.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.967+0000 7f66abfff640 1 -- 172.21.15.96:0/1293007547 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66bc01c070 con 0x7f66c40c8d30 2024-06-02T23:47:03.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.967+0000 7f66abfff640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f66b006be30 0x7f66b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:03.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.967+0000 7f66c37fe640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f66b006be30 0x7f66b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:03.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.967+0000 7f66abfff640 1 -- 172.21.15.96:0/1293007547 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f66bc08a550 con 0x7f66c40c8d30 2024-06-02T23:47:03.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.968+0000 7f66c37fe640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f66b006be30 0x7f66b006e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f66b4035000 tx=0x7f66b402f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:03.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:03.972+0000 7f66abfff640 1 -- 172.21.15.96:0/1293007547 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f66bc058bc0 con 0x7f66c40c8d30 2024-06-02T23:47:04.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.147+0000 7f66c9d70640 1 -- 172.21.15.96:0/1293007547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f66c40cbff0 con 0x7f66c40c8d30 2024-06-02T23:47:04.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.150+0000 7f66abfff640 1 -- 172.21.15.96:0/1293007547 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f66bc0584c0 con 0x7f66c40c8d30 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.152+0000 7f66c9d70640 1 -- 172.21.15.96:0/1293007547 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f66b006be30 msgr2=0x7f66b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.152+0000 7f66c9d70640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f66b006be30 0x7f66b006e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f66b4035000 tx=0x7f66b402f000 comp rx=0 tx=0).stop 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.152+0000 7f66c9d70640 1 -- 172.21.15.96:0/1293007547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66c40c8d30 msgr2=0x7f66c40c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.152+0000 7f66c9d70640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66c40c8d30 0x7f66c40c91b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f66c4069d40 tx=0x7f66bc00e8a0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.152+0000 7f66c9d70640 1 -- 172.21.15.96:0/1293007547 shutdown_connections 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.152+0000 7f66c9d70640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f66b006be30 0x7f66b006e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.152+0000 7f66c9d70640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66c40c8d30 0x7f66c40c91b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.152+0000 7f66c9d70640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66c41f1ce0 0x7f66c40c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.152+0000 7f66c9d70640 1 --2- 172.21.15.96:0/1293007547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f66ac0039e0 0x7f66c4150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.152+0000 7f66c9d70640 1 -- 172.21.15.96:0/1293007547 >> 172.21.15.96:0/1293007547 conn(0x7f66c40cfcb0 msgr2=0x7f66c41557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.153+0000 7f66c9d70640 1 -- 172.21.15.96:0/1293007547 shutdown_connections 2024-06-02T23:47:04.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.153+0000 7f66c9d70640 1 -- 172.21.15.96:0/1293007547 wait complete. 2024-06-02T23:47:04.164 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T23:47:04.164 DEBUG:teuthology.orchestra.run.smithi096:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T23:47:04.201 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T23:47:04.247 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T23:47:04.247 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:47:04.247 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:04.263 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:47:04.263 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:04.319 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:47:04.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.460+0000 7f2fe12d4640 1 Processor -- start 2024-06-02T23:47:04.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.460+0000 7f2fe12d4640 1 -- start start 2024-06-02T23:47:04.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fe12d4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2fdc0d2d10 0x7f2fdc0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fe12d4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc15e810 con 0x7f2fdc15e430 2024-06-02T23:47:04.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fe12d4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc0b70c0 con 0x7f2fdc0d4b40 2024-06-02T23:47:04.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fe12d4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2fdc0b6e70 con 0x7f2fdc0d2d10 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fdaffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2fdc15e430 0x7f2fdc0d2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46010/0 (socket says 172.21.15.96:46010) 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fdaffd640 1 -- 172.21.15.96:0/1646710495 learned_addr learned my addr 172.21.15.96:0/1646710495 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fda7fc640 1 --2- 172.21.15.96:0/1646710495 >> v2:172.21.15.162:3300/0 conn(0x7f2fdc0d2d10 0x7f2fdc0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1256295480 0 0) 0x7f2fdc15e810 con 0x7f2fdc15e430 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc4003520 con 0x7f2fdc15e430 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 871621844 0 0) 0x7f2fc4003520 con 0x7f2fdc15e430 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 >> v2:172.21.15.162:3300/0 conn(0x7f2fdc0d2d10 msgr2=0x7f2fdc0b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fd9ffb640 1 --2- 172.21.15.96:0/1646710495 >> v2:172.21.15.162:3300/0 conn(0x7f2fdc0d2d10 0x7f2fdc0b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 >> v1:172.21.15.162:6789/0 conn(0x7f2fdc0d4b40 legacy=0x7f2fdc0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc0b73a0 con 0x7f2fdc15e430 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f2fcc0019f0 con 0x7f2fdc15e430 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.461+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 >> v1:172.21.15.96:6789/0 conn(0x7f2fdc15e430 legacy=0x7f2fdc0d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fd9ffb640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc40039b0 0x7f2fc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fd9ffb640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fc4004800 0x7f2fc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fd9ffb640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc40051c0 0x7f2fc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc0b6e70 con 0x7f2fc4004800 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc400c060 con 0x7f2fc40051c0 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc400c260 con 0x7f2fc40039b0 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fda7fc640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fc4004800 0x7f2fc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fdaffd640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc40039b0 0x7f2fc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fdb7fe640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc40051c0 0x7f2fc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fda7fc640 1 -- 172.21.15.96:0/1646710495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc40039b0 msgr2=0x7f2fc4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fda7fc640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc40039b0 0x7f2fc4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fda7fc640 1 -- 172.21.15.96:0/1646710495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc40051c0 msgr2=0x7f2fc400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fda7fc640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc40051c0 0x7f2fc400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fdb7fe640 1 -- 172.21.15.96:0/1646710495 reap_dead start 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fda7fc640 1 -- 172.21.15.96:0/1646710495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc4003520 con 0x7f2fc4004800 2024-06-02T23:47:04.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.462+0000 7f2fdaffd640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc40039b0 0x7f2fc4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fda7fc640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fc4004800 0x7f2fc4004c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009ac0 tx=0x7f2fc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8593928da0a919f6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0036070 con 0x7f2fc4004800 2024-06-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd0031400 con 0x7f2fc4004800 2024-06-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fd9ffb640 1 -- 172.21.15.96:0/1646710495 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0009690 con 0x7f2fc4004800 2024-06-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fe12d4640 1 -- 172.21.15.96:0/1646710495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fc4004800 msgr2=0x7f2fc4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fe12d4640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fc4004800 0x7f2fc4004c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009ac0 tx=0x7f2fc4005830 comp rx=0 tx=0).stop 2024-06-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fe12d4640 1 -- 172.21.15.96:0/1646710495 shutdown_connections 2024-06-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fe12d4640 1 --2- 172.21.15.96:0/1646710495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fc4004800 0x7f2fc4004c80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fe12d4640 1 -- 172.21.15.96:0/1646710495 >> 172.21.15.96:0/1646710495 conn(0x7f2fdc0d4020 msgr2=0x7f2fdc0d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:04.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fe12d4640 1 -- 172.21.15.96:0/1646710495 shutdown_connections 2024-06-02T23:47:04.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.463+0000 7f2fe12d4640 1 -- 172.21.15.96:0/1646710495 wait complete. 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fe12d4640 1 Processor -- start 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fe12d4640 1 -- start start 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fe12d4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc4004800 0x7f2fdc15b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fe12d4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fdc09fff0 0x7f2fdc0a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fe12d4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fdc0a1b20 0x7f2fdc0b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fe12d4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc0d1260 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fe12d4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc0b7960 con 0x7f2fdc09fff0 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fe12d4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fdc0d13e0 con 0x7f2fc4004800 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fdb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fdc0a1b20 0x7f2fdc0b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fdb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fdc0a1b20 0x7f2fdc0b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33454/0 (socket says 172.21.15.96:33454) 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.465+0000 7f2fdb7fe640 1 -- 172.21.15.96:0/3918640351 learned_addr learned my addr 172.21.15.96:0/3918640351 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:04.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fda7fc640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fdc09fff0 0x7f2fdc0a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fdb7fe640 1 -- 172.21.15.96:0/3918640351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc4004800 msgr2=0x7f2fdc15b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fdaffd640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc4004800 0x7f2fdc15b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fdb7fe640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc4004800 0x7f2fdc15b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fdb7fe640 1 -- 172.21.15.96:0/3918640351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fdc09fff0 msgr2=0x7f2fdc0a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fdb7fe640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fdc09fff0 0x7f2fdc0a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fdb7fe640 1 -- 172.21.15.96:0/3918640351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc0a0540 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fda7fc640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fdc09fff0 0x7f2fdc0a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fdb7fe640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fdc0a1b20 0x7f2fdc0b1480 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc067af0 tx=0x7f2fd400f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fc37fe640 1 -- 172.21.15.96:0/3918640351 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd401a070 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fc37fe640 1 -- 172.21.15.96:0/3918640351 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd40053e0 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fe12d4640 1 -- 172.21.15.96:0/3918640351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fdc0a0820 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fc37fe640 1 -- 172.21.15.96:0/3918640351 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4007250 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.466+0000 7f2fe12d4640 1 -- 172.21.15.96:0/3918640351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fdc0a0de0 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.467+0000 7f2fe12d4640 1 -- 172.21.15.96:0/3918640351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fdc0683e0 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.468+0000 7f2fc37fe640 1 -- 172.21.15.96:0/3918640351 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fd401d070 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.468+0000 7f2fc37fe640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2fc806be30 0x7f2fc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.468+0000 7f2fdaffd640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2fc806be30 0x7f2fc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.468+0000 7f2fc37fe640 1 -- 172.21.15.96:0/3918640351 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2fd408a3b0 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.468+0000 7f2fdaffd640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2fc806be30 0x7f2fc806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc002230 tx=0x7f2fcc001e90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:04.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.472+0000 7f2fc37fe640 1 -- 172.21.15.96:0/3918640351 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2fd4058a20 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.657+0000 7f2fe12d4640 1 -- 172.21.15.96:0/3918640351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2fdc0d23e0 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.657+0000 7f2fc37fe640 1 -- 172.21.15.96:0/3918640351 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f2fd4058320 con 0x7f2fdc0a1b20 2024-06-02T23:47:04.658 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.659+0000 7f2fe12d4640 1 -- 172.21.15.96:0/3918640351 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2fc806be30 msgr2=0x7f2fc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.659+0000 7f2fe12d4640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2fc806be30 0x7f2fc806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc002230 tx=0x7f2fcc001e90 comp rx=0 tx=0).stop 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.659+0000 7f2fe12d4640 1 -- 172.21.15.96:0/3918640351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fdc0a1b20 msgr2=0x7f2fdc0b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.659+0000 7f2fe12d4640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fdc0a1b20 0x7f2fdc0b1480 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc067af0 tx=0x7f2fd400f890 comp rx=0 tx=0).stop 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.659+0000 7f2fe12d4640 1 -- 172.21.15.96:0/3918640351 shutdown_connections 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.659+0000 7f2fe12d4640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2fc806be30 0x7f2fc806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.659+0000 7f2fe12d4640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fdc0a1b20 0x7f2fdc0b1480 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.659+0000 7f2fe12d4640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fdc09fff0 0x7f2fdc0a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.659+0000 7f2fe12d4640 1 --2- 172.21.15.96:0/3918640351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fc4004800 0x7f2fdc15b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.659+0000 7f2fe12d4640 1 -- 172.21.15.96:0/3918640351 >> 172.21.15.96:0/3918640351 conn(0x7f2fdc0d4020 msgr2=0x7f2fdc0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.660+0000 7f2fe12d4640 1 -- 172.21.15.96:0/3918640351 shutdown_connections 2024-06-02T23:47:04.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.660+0000 7f2fe12d4640 1 -- 172.21.15.96:0/3918640351 wait complete. 2024-06-02T23:47:04.671 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:47:04.671 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:04.687 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:47:04.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.826+0000 7f70cd761640 1 Processor -- start 2024-06-02T23:47:04.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.826+0000 7f70cd761640 1 -- start start 2024-06-02T23:47:04.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.827+0000 7f70cd761640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c80d1120 0x7f70c80c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.827+0000 7f70cd761640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f70c80b5510 0x7f70c80c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.827+0000 7f70cd761640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c80d4a90 con 0x7f70c8161900 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.827+0000 7f70cd761640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f70c80cf5c0 con 0x7f70c80b5510 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.827+0000 7f70cd761640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f70c80caf70 con 0x7f70c80d1120 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.827+0000 7f70c6ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f70c8161900 0x7f70c80d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46022/0 (socket says 172.21.15.96:46022) 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.827+0000 7f70c6ffd640 1 -- 172.21.15.96:0/1662930 learned_addr learned my addr 172.21.15.96:0/1662930 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.828+0000 7f70c77fe640 1 --2- 172.21.15.96:0/1662930 >> v2:172.21.15.162:3300/0 conn(0x7f70c80b5510 0x7f70c80c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.828+0000 7f70c67fc640 1 --2- 172.21.15.96:0/1662930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c80d1120 0x7f70c80c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.828+0000 7f70c5ffb640 1 -- 172.21.15.96:0/1662930 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952741545 0 0) 0x7f70c80d4a90 con 0x7f70c8161900 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.828+0000 7f70c5ffb640 1 -- 172.21.15.96:0/1662930 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70b4003520 con 0x7f70c8161900 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.828+0000 7f70c5ffb640 1 -- 172.21.15.96:0/1662930 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3847671270 0 0) 0x7f70b4003520 con 0x7f70c8161900 2024-06-02T23:47:04.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.828+0000 7f70c77fe640 1 -- 172.21.15.96:0/1662930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c80d1120 msgr2=0x7f70c80c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.828+0000 7f70c77fe640 1 --2- 172.21.15.96:0/1662930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c80d1120 0x7f70c80c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.828+0000 7f70c77fe640 1 -- 172.21.15.96:0/1662930 >> v1:172.21.15.96:6789/0 conn(0x7f70c8161900 legacy=0x7f70c80d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.828+0000 7f70c77fe640 1 -- 172.21.15.96:0/1662930 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c80d4d70 con 0x7f70c80b5510 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70c77fe640 1 --2- 172.21.15.96:0/1662930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c80b5510 0x7f70c80c8100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f70c00097a0 tx=0x7f70c002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e294b6259859fc0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70c5ffb640 1 -- 172.21.15.96:0/1662930 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0037070 con 0x7f70c80b5510 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70c5ffb640 1 -- 172.21.15.96:0/1662930 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c002ab10 con 0x7f70c80b5510 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70c5ffb640 1 -- 172.21.15.96:0/1662930 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b80019f0 con 0x7f70c80b5510 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70cd761640 1 -- 172.21.15.96:0/1662930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c80b5510 msgr2=0x7f70c80c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70cd761640 1 --2- 172.21.15.96:0/1662930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c80b5510 0x7f70c80c8100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f70c00097a0 tx=0x7f70c002a080 comp rx=0 tx=0).stop 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70cd761640 1 -- 172.21.15.96:0/1662930 shutdown_connections 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70cd761640 1 --2- 172.21.15.96:0/1662930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c80b5510 0x7f70c80c8100 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70cd761640 1 --2- 172.21.15.96:0/1662930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c80d1120 0x7f70c80c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70cd761640 1 -- 172.21.15.96:0/1662930 >> 172.21.15.96:0/1662930 conn(0x7f70c809d3b0 msgr2=0x7f70c80d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:04.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70cd761640 1 -- 172.21.15.96:0/1662930 shutdown_connections 2024-06-02T23:47:04.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.829+0000 7f70cd761640 1 -- 172.21.15.96:0/1662930 wait complete. 2024-06-02T23:47:04.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.831+0000 7f70cd761640 1 Processor -- start 2024-06-02T23:47:04.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.831+0000 7f70cd761640 1 -- start start 2024-06-02T23:47:04.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.831+0000 7f70cd761640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70c80b5510 0x7f70c81f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.831+0000 7f70cd761640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c80d1120 0x7f70c80b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.831+0000 7f70cd761640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c8161900 0x7f70c8151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.831+0000 7f70cd761640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f70c80d4780 con 0x7f70c80b5510 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.831+0000 7f70cd761640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f70c80cfae0 con 0x7f70c80d1120 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.831+0000 7f70cd761640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f70c8161ce0 con 0x7f70c8161900 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70c80b5510 0x7f70c81f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70c80b5510 0x7f70c81f3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33462/0 (socket says 172.21.15.96:33462) 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c6ffd640 1 -- 172.21.15.96:0/6082676 learned_addr learned my addr 172.21.15.96:0/6082676 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c77fe640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c8161900 0x7f70c8151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c67fc640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c80d1120 0x7f70c80b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c6ffd640 1 -- 172.21.15.96:0/6082676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c8161900 msgr2=0x7f70c8151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c6ffd640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c8161900 0x7f70c8151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c6ffd640 1 -- 172.21.15.96:0/6082676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c80d1120 msgr2=0x7f70c80b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c6ffd640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c80d1120 0x7f70c80b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c6ffd640 1 -- 172.21.15.96:0/6082676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c8151040 con 0x7f70c80b5510 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70c6ffd640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70c80b5510 0x7f70c81f3460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f70b800cc40 tx=0x7f70b800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70bf7fe640 1 -- 172.21.15.96:0/6082676 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b8017070 con 0x7f70c80b5510 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70cd761640 1 -- 172.21.15.96:0/6082676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c80b3f50 con 0x7f70c80b5510 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70bf7fe640 1 -- 172.21.15.96:0/6082676 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b800ce50 con 0x7f70c80b5510 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70bf7fe640 1 -- 172.21.15.96:0/6082676 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b8012600 con 0x7f70c80b5510 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.832+0000 7f70cd761640 1 -- 172.21.15.96:0/6082676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c80b47f0 con 0x7f70c80b5510 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.833+0000 7f70cd761640 1 -- 172.21.15.96:0/6082676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c80683e0 con 0x7f70c80b5510 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.834+0000 7f70bf7fe640 1 -- 172.21.15.96:0/6082676 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70b801a070 con 0x7f70c80b5510 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.834+0000 7f70bf7fe640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70a806be30 0x7f70a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.834+0000 7f70bf7fe640 1 -- 172.21.15.96:0/6082676 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f70b808b060 con 0x7f70c80b5510 2024-06-02T23:47:04.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.834+0000 7f70c67fc640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70a806be30 0x7f70a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:04.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.835+0000 7f70c67fc640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70a806be30 0x7f70a806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70c806cb30 tx=0x7f70b0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:04.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:04.839+0000 7f70bf7fe640 1 -- 172.21.15.96:0/6082676 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f70b8059000 con 0x7f70c80b5510 2024-06-02T23:47:05.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.028+0000 7f70cd761640 1 -- 172.21.15.96:0/6082676 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f70c80d05e0 con 0x7f70c80b5510 2024-06-02T23:47:05.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.028+0000 7f70bf7fe640 1 -- 172.21.15.96:0/6082676 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f70b805d300 con 0x7f70c80b5510 2024-06-02T23:47:05.028 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 -- 172.21.15.96:0/6082676 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70a806be30 msgr2=0x7f70a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70a806be30 0x7f70a806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70c806cb30 tx=0x7f70b0008040 comp rx=0 tx=0).stop 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 -- 172.21.15.96:0/6082676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70c80b5510 msgr2=0x7f70c81f3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70c80b5510 0x7f70c81f3460 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f70b800cc40 tx=0x7f70b800a430 comp rx=0 tx=0).stop 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 -- 172.21.15.96:0/6082676 shutdown_connections 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c8161900 0x7f70c8151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c80d1120 0x7f70c80b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70a806be30 0x7f70a806e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 --2- 172.21.15.96:0/6082676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70c80b5510 0x7f70c81f3460 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 -- 172.21.15.96:0/6082676 >> 172.21.15.96:0/6082676 conn(0x7f70c809d3b0 msgr2=0x7f70c815e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 -- 172.21.15.96:0/6082676 shutdown_connections 2024-06-02T23:47:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.030+0000 7f70cd761640 1 -- 172.21.15.96:0/6082676 wait complete. 2024-06-02T23:47:05.042 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2024-06-02T23:47:05.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:05.042 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-02T23:47:05.067 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:47:05.067 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:47:05.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:05.067 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T23:47:05.123 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:47:05.123 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:05.143 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:47:05.143 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:05.202 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:47:05.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.303+0000 7fca0879d640 1 Processor -- start 2024-06-02T23:47:05.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.303+0000 7fca0879d640 1 -- start start 2024-06-02T23:47:05.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca0879d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca00155570 0x7fca0006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca0879d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fca0006eb50 0x7fca000ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca0879d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca000cab60 0x7fca0015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca0879d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fca00155950 con 0x7fca00155570 2024-06-02T23:47:05.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca0879d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fca000cb2e0 con 0x7fca0006eb50 2024-06-02T23:47:05.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca0879d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fca000cb5c0 con 0x7fca000cab60 2024-06-02T23:47:05.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca06539640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca00155570 0x7fca0006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca06539640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca00155570 0x7fca0006e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33466/0 (socket says 172.21.15.96:33466) 2024-06-02T23:47:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca06539640 1 -- 172.21.15.96:0/2337868238 learned_addr learned my addr 172.21.15.96:0/2337868238 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca05d38640 1 --2- 172.21.15.96:0/2337868238 >> v2:172.21.15.162:3300/0 conn(0x7fca0006eb50 0x7fca000ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca06d3a640 1 --2- 172.21.15.96:0/2337868238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca000cab60 0x7fca0015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca06539640 1 -- 172.21.15.96:0/2337868238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca000cab60 msgr2=0x7fca0015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca06539640 1 --2- 172.21.15.96:0/2337868238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca000cab60 0x7fca0015eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca06539640 1 -- 172.21.15.96:0/2337868238 >> v2:172.21.15.162:3300/0 conn(0x7fca0006eb50 msgr2=0x7fca000ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca06539640 1 --2- 172.21.15.96:0/2337868238 >> v2:172.21.15.162:3300/0 conn(0x7fca0006eb50 0x7fca000ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca06539640 1 -- 172.21.15.96:0/2337868238 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca000cb8a0 con 0x7fca00155570 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca06d3a640 1 --2- 172.21.15.96:0/2337868238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca000cab60 0x7fca0015eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.304+0000 7fca05d38640 1 --2- 172.21.15.96:0/2337868238 >> v2:172.21.15.162:3300/0 conn(0x7fca0006eb50 0x7fca000ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.305+0000 7fca06539640 1 --2- 172.21.15.96:0/2337868238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 0x7fca0006e610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fca00070b60 tx=0x7fc9fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bfc365f66c5574 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.305+0000 7fca05537640 1 -- 172.21.15.96:0/2337868238 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc037070 con 0x7fca00155570 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.305+0000 7fca05537640 1 -- 172.21.15.96:0/2337868238 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc032440 con 0x7fca00155570 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.305+0000 7fca05537640 1 -- 172.21.15.96:0/2337868238 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc032810 con 0x7fca00155570 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.305+0000 7fca0879d640 1 -- 172.21.15.96:0/2337868238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 msgr2=0x7fca0006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.305+0000 7fca0879d640 1 --2- 172.21.15.96:0/2337868238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 0x7fca0006e610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fca00070b60 tx=0x7fc9fc02a1e0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.306+0000 7fca0879d640 1 -- 172.21.15.96:0/2337868238 shutdown_connections 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.306+0000 7fca0879d640 1 --2- 172.21.15.96:0/2337868238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca000cab60 0x7fca0015eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.306+0000 7fca0879d640 1 --2- 172.21.15.96:0/2337868238 >> v2:172.21.15.162:3300/0 conn(0x7fca0006eb50 0x7fca000ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.306+0000 7fca0879d640 1 --2- 172.21.15.96:0/2337868238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 0x7fca0006e610 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.306+0000 7fca0879d640 1 -- 172.21.15.96:0/2337868238 >> 172.21.15.96:0/2337868238 conn(0x7fca000cfc30 msgr2=0x7fca000d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.306+0000 7fca0879d640 1 -- 172.21.15.96:0/2337868238 shutdown_connections 2024-06-02T23:47:05.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.306+0000 7fca0879d640 1 -- 172.21.15.96:0/2337868238 wait complete. 2024-06-02T23:47:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.307+0000 7fca0879d640 1 Processor -- start 2024-06-02T23:47:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.307+0000 7fca0879d640 1 -- start start 2024-06-02T23:47:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.307+0000 7fca0879d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca0006eb50 0x7fca001e66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.307+0000 7fca0879d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca000cab60 0x7fca0015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.307+0000 7fca0879d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 0x7fca0014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.307+0000 7fca0879d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fca000717d0 con 0x7fca00155570 2024-06-02T23:47:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.307+0000 7fca0879d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca000caff0 con 0x7fca000cab60 2024-06-02T23:47:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.307+0000 7fca0879d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fca0015eff0 con 0x7fca0006eb50 2024-06-02T23:47:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06d3a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 0x7fca0014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06d3a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 0x7fca0014d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33476/0 (socket says 172.21.15.96:33476) 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06d3a640 1 -- 172.21.15.96:0/2531200420 learned_addr learned my addr 172.21.15.96:0/2531200420 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06539640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca0006eb50 0x7fca001e66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca05d38640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca000cab60 0x7fca0015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06d3a640 1 -- 172.21.15.96:0/2531200420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca0006eb50 msgr2=0x7fca001e66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06d3a640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca0006eb50 0x7fca001e66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06d3a640 1 -- 172.21.15.96:0/2531200420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca000cab60 msgr2=0x7fca0015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06d3a640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca000cab60 0x7fca0015a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06d3a640 1 -- 172.21.15.96:0/2531200420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca001e6db0 con 0x7fca00155570 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06539640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca0006eb50 0x7fca001e66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca05d38640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca000cab60 0x7fca0015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca06d3a640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 0x7fca0014d9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800cf20 tx=0x7fc9f800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fc9f6ffd640 1 -- 172.21.15.96:0/2531200420 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f801a070 con 0x7fca00155570 2024-06-02T23:47:05.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fc9f6ffd640 1 -- 172.21.15.96:0/2531200420 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f800d840 con 0x7fca00155570 2024-06-02T23:47:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca0879d640 1 -- 172.21.15.96:0/2531200420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca001e7090 con 0x7fca00155570 2024-06-02T23:47:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fc9f6ffd640 1 -- 172.21.15.96:0/2531200420 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f800dc30 con 0x7fca00155570 2024-06-02T23:47:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.308+0000 7fca0879d640 1 -- 172.21.15.96:0/2531200420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca001e7650 con 0x7fca00155570 2024-06-02T23:47:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.309+0000 7fca0879d640 1 -- 172.21.15.96:0/2531200420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca000683e0 con 0x7fca00155570 2024-06-02T23:47:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.310+0000 7fc9f6ffd640 1 -- 172.21.15.96:0/2531200420 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9f801d070 con 0x7fca00155570 2024-06-02T23:47:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.310+0000 7fc9f6ffd640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc9e406be30 0x7fc9e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.310+0000 7fc9f6ffd640 1 -- 172.21.15.96:0/2531200420 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc9f808bae0 con 0x7fca00155570 2024-06-02T23:47:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.310+0000 7fca06539640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc9e406be30 0x7fc9e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.311+0000 7fca06539640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc9e406be30 0x7fc9e406e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc034000 tx=0x7fc9fc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:05.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.315+0000 7fc9f6ffd640 1 -- 172.21.15.96:0/2531200420 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc9f805a150 con 0x7fca00155570 2024-06-02T23:47:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.499+0000 7fca0879d640 1 -- 172.21.15.96:0/2531200420 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fca0015b000 con 0x7fca00155570 2024-06-02T23:47:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.500+0000 7fc9f6ffd640 1 -- 172.21.15.96:0/2531200420 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fc9f8059a50 con 0x7fca00155570 2024-06-02T23:47:05.500 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-02T23:47:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 -- 172.21.15.96:0/2531200420 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc9e406be30 msgr2=0x7fc9e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc9e406be30 0x7fc9e406e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc034000 tx=0x7fc9fc02e000 comp rx=0 tx=0).stop 2024-06-02T23:47:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 -- 172.21.15.96:0/2531200420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 msgr2=0x7fca0014d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 0x7fca0014d9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800cf20 tx=0x7fc9f800a7d0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 -- 172.21.15.96:0/2531200420 shutdown_connections 2024-06-02T23:47:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fc9e406be30 0x7fc9e406e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca00155570 0x7fca0014d9f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca000cab60 0x7fca0015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 --2- 172.21.15.96:0/2531200420 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca0006eb50 0x7fca001e66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 -- 172.21.15.96:0/2531200420 >> 172.21.15.96:0/2531200420 conn(0x7fca000cfc30 msgr2=0x7fca000c3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 -- 172.21.15.96:0/2531200420 shutdown_connections 2024-06-02T23:47:05.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.502+0000 7fca0879d640 1 -- 172.21.15.96:0/2531200420 wait complete. 2024-06-02T23:47:05.513 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:47:05.513 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:05.534 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:47:05.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.634+0000 7fe56eb5a640 1 Processor -- start 2024-06-02T23:47:05.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.634+0000 7fe56eb5a640 1 -- start start 2024-06-02T23:47:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.635+0000 7fe56eb5a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe5680d1120 0x7fe5680c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.635+0000 7fe56eb5a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5680b5510 0x7fe5680c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.635+0000 7fe56eb5a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5680d4a90 con 0x7fe568161900 2024-06-02T23:47:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.635+0000 7fe56eb5a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe5680cf5c0 con 0x7fe5680b5510 2024-06-02T23:47:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.635+0000 7fe56eb5a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe5680caf70 con 0x7fe5680d1120 2024-06-02T23:47:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.635+0000 7fe56d0f7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5680b5510 0x7fe5680c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.635+0000 7fe56d0f7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5680b5510 0x7fe5680c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33490/0 (socket says 172.21.15.96:33490) 2024-06-02T23:47:05.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.635+0000 7fe56d0f7640 1 -- 172.21.15.96:0/2087891668 learned_addr learned my addr 172.21.15.96:0/2087891668 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:05.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.636+0000 7fe567fff640 1 --2- 172.21.15.96:0/2087891668 >> v2:172.21.15.162:3300/0 conn(0x7fe5680d1120 0x7fe5680c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.636+0000 7fe56d0f7640 1 -- 172.21.15.96:0/2087891668 >> v2:172.21.15.162:3300/0 conn(0x7fe5680d1120 msgr2=0x7fe5680c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:05.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.636+0000 7fe56d0f7640 1 --2- 172.21.15.96:0/2087891668 >> v2:172.21.15.162:3300/0 conn(0x7fe5680d1120 0x7fe5680c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.636+0000 7fe56d0f7640 1 -- 172.21.15.96:0/2087891668 >> v1:172.21.15.162:6789/0 conn(0x7fe568161900 legacy=0x7fe5680d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:05.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.636+0000 7fe56d0f7640 1 -- 172.21.15.96:0/2087891668 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5680d4d70 con 0x7fe5680b5510 2024-06-02T23:47:05.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.636+0000 7fe567fff640 1 --2- 172.21.15.96:0/2087891668 >> v2:172.21.15.162:3300/0 conn(0x7fe5680d1120 0x7fe5680c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:05.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.636+0000 7fe56d0f7640 1 --2- 172.21.15.96:0/2087891668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680b5510 0x7fe5680c8100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe56808cc80 tx=0x7fe56002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6cb9dedc8afdd9d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.636+0000 7fe5677fe640 1 -- 172.21.15.96:0/2087891668 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe560036070 con 0x7fe5680b5510 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.636+0000 7fe5677fe640 1 -- 172.21.15.96:0/2087891668 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe560031600 con 0x7fe5680b5510 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.636+0000 7fe5677fe640 1 -- 172.21.15.96:0/2087891668 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5600319d0 con 0x7fe5680b5510 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.637+0000 7fe56eb5a640 1 -- 172.21.15.96:0/2087891668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680b5510 msgr2=0x7fe5680c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.637+0000 7fe56eb5a640 1 --2- 172.21.15.96:0/2087891668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680b5510 0x7fe5680c8100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe56808cc80 tx=0x7fe56002a660 comp rx=0 tx=0).stop 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.637+0000 7fe56eb5a640 1 -- 172.21.15.96:0/2087891668 shutdown_connections 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.637+0000 7fe56eb5a640 1 --2- 172.21.15.96:0/2087891668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680b5510 0x7fe5680c8100 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.637+0000 7fe56eb5a640 1 --2- 172.21.15.96:0/2087891668 >> v2:172.21.15.162:3300/0 conn(0x7fe5680d1120 0x7fe5680c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.637+0000 7fe56eb5a640 1 -- 172.21.15.96:0/2087891668 >> 172.21.15.96:0/2087891668 conn(0x7fe56809d3b0 msgr2=0x7fe5680d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.637+0000 7fe56eb5a640 1 -- 172.21.15.96:0/2087891668 shutdown_connections 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.637+0000 7fe56eb5a640 1 -- 172.21.15.96:0/2087891668 wait complete. 2024-06-02T23:47:05.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.638+0000 7fe56eb5a640 1 Processor -- start 2024-06-02T23:47:05.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.638+0000 7fe56eb5a640 1 -- start start 2024-06-02T23:47:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.639+0000 7fe56eb5a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5680b5510 0x7fe56814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.639+0000 7fe56eb5a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680d1120 0x7fe5680b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.639+0000 7fe56eb5a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe568161900 0x7fe5680cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.639+0000 7fe56eb5a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe5680d4780 con 0x7fe5680d1120 2024-06-02T23:47:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.639+0000 7fe56eb5a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5680cfae0 con 0x7fe5680b5510 2024-06-02T23:47:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.639+0000 7fe56eb5a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe568161ce0 con 0x7fe568161900 2024-06-02T23:47:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.639+0000 7fe567fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680d1120 0x7fe5680b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.639+0000 7fe567fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680d1120 0x7fe5680b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33500/0 (socket says 172.21.15.96:33500) 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.639+0000 7fe567fff640 1 -- 172.21.15.96:0/4286924342 learned_addr learned my addr 172.21.15.96:0/4286924342 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe56d0f7640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe568161900 0x7fe5680cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe56c8f6640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5680b5510 0x7fe56814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe567fff640 1 -- 172.21.15.96:0/4286924342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe568161900 msgr2=0x7fe5680cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe567fff640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe568161900 0x7fe5680cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe567fff640 1 -- 172.21.15.96:0/4286924342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5680b5510 msgr2=0x7fe56814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe567fff640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5680b5510 0x7fe56814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe567fff640 1 -- 172.21.15.96:0/4286924342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5680b86c0 con 0x7fe5680d1120 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe56c8f6640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5680b5510 0x7fe56814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe567fff640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680d1120 0x7fe5680b6bd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00c7f0 tx=0x7fe55c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe5657fa640 1 -- 172.21.15.96:0/4286924342 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c015070 con 0x7fe5680d1120 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe5657fa640 1 -- 172.21.15.96:0/4286924342 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c007a30 con 0x7fe5680d1120 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe56eb5a640 1 -- 172.21.15.96:0/4286924342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5680b7620 con 0x7fe5680d1120 2024-06-02T23:47:05.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe5657fa640 1 -- 172.21.15.96:0/4286924342 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c007e00 con 0x7fe5680d1120 2024-06-02T23:47:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.640+0000 7fe56eb5a640 1 -- 172.21.15.96:0/4286924342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5680b7be0 con 0x7fe5680d1120 2024-06-02T23:47:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.641+0000 7fe56eb5a640 1 -- 172.21.15.96:0/4286924342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5680683e0 con 0x7fe5680d1120 2024-06-02T23:47:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.641+0000 7fe5657fa640 1 -- 172.21.15.96:0/4286924342 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe55c018070 con 0x7fe5680d1120 2024-06-02T23:47:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.642+0000 7fe5657fa640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe55406be30 0x7fe55406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.642+0000 7fe5657fa640 1 -- 172.21.15.96:0/4286924342 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe55c08b090 con 0x7fe5680d1120 2024-06-02T23:47:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.642+0000 7fe56c8f6640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe55406be30 0x7fe55406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:05.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.642+0000 7fe56c8f6640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe55406be30 0x7fe55406e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe55800a830 tx=0x7fe558008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:05.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.646+0000 7fe5657fa640 1 -- 172.21.15.96:0/4286924342 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe55c059790 con 0x7fe5680d1120 2024-06-02T23:47:05.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.835+0000 7fe56eb5a640 1 -- 172.21.15.96:0/4286924342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe5680d05e0 con 0x7fe5680d1120 2024-06-02T23:47:05.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.836+0000 7fe5657fa640 1 -- 172.21.15.96:0/4286924342 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fe55c059090 con 0x7fe5680d1120 2024-06-02T23:47:05.836 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-02T23:47:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 -- 172.21.15.96:0/4286924342 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe55406be30 msgr2=0x7fe55406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe55406be30 0x7fe55406e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe55800a830 tx=0x7fe558008040 comp rx=0 tx=0).stop 2024-06-02T23:47:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 -- 172.21.15.96:0/4286924342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680d1120 msgr2=0x7fe5680b6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680d1120 0x7fe5680b6bd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00c7f0 tx=0x7fe55c00cbf0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 -- 172.21.15.96:0/4286924342 shutdown_connections 2024-06-02T23:47:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe568161900 0x7fe5680cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fe55406be30 0x7fe55406e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5680d1120 0x7fe5680b6bd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 --2- 172.21.15.96:0/4286924342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5680b5510 0x7fe56814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:05.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 -- 172.21.15.96:0/4286924342 >> 172.21.15.96:0/4286924342 conn(0x7fe56809d3b0 msgr2=0x7fe5680cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:05.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 -- 172.21.15.96:0/4286924342 shutdown_connections 2024-06-02T23:47:05.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:05.838+0000 7fe56eb5a640 1 -- 172.21.15.96:0/4286924342 wait complete. 2024-06-02T23:47:05.849 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi162.front.sepia.ceph.com... 2024-06-02T23:47:05.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:05.849 DEBUG:teuthology.orchestra.run.smithi162:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-06-02T23:47:05.880 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:47:05.880 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T23:47:05.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:05.880 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-02T23:47:05.964 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:47:05.964 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:05.980 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:47:05.980 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:06.037 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:47:06.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.177+0000 7f4daba5d640 1 Processor -- start 2024-06-02T23:47:06.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.177+0000 7f4daba5d640 1 -- start start 2024-06-02T23:47:06.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4daba5d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4da4155570 0x7f4da406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4daba5d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da406eb50 0x7f4da40ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4daba5d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da4155950 con 0x7f4da40cab60 2024-06-02T23:47:06.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4daba5d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4da406efb0 con 0x7f4da4155570 2024-06-02T23:47:06.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4daba5d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4da40cb2e0 con 0x7f4da406eb50 2024-06-02T23:47:06.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4da9ffa640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4da40cab60 0x7f4da415eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46038/0 (socket says 172.21.15.96:46038) 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4da9ffa640 1 -- 172.21.15.96:0/2048123933 learned_addr learned my addr 172.21.15.96:0/2048123933 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059008787 0 0) 0x7f4da4155950 con 0x7f4da40cab60 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d90003520 con 0x7f4da40cab60 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4da8ff8640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da406eb50 0x7f4da40ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4da97f9640 1 --2- 172.21.15.96:0/2048123933 >> v2:172.21.15.162:3300/0 conn(0x7f4da4155570 0x7f4da406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3275261032 0 0) 0x7f4d90003520 con 0x7f4da40cab60 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da406eb50 msgr2=0x7f4da40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da406eb50 0x7f4da40ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 >> v2:172.21.15.162:3300/0 conn(0x7f4da4155570 msgr2=0x7f4da406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 --2- 172.21.15.96:0/2048123933 >> v2:172.21.15.162:3300/0 conn(0x7f4da4155570 0x7f4da406e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da40cb5c0 con 0x7f4da40cab60 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f4d9c0019f0 con 0x7f4da40cab60 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4da97f9640 1 --2- 172.21.15.96:0/2048123933 >> v2:172.21.15.162:3300/0 conn(0x7f4da4155570 0x7f4da406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:06.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 >> v1:172.21.15.96:6789/0 conn(0x7f4da40cab60 legacy=0x7f4da415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da406eb50 0x7f4d900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.178+0000 7f4d9bfff640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d90003f30 0x7f4d90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4d9bfff640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d90004d40 0x7f4d900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4da40cb2e0 con 0x7f4d90004d40 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9000b9c0 con 0x7f4d90003f30 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9000bb90 con 0x7f4da406eb50 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4da9ffa640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d90004d40 0x7f4d900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4da8ff8640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d90003f30 0x7f4d90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4da97f9640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da406eb50 0x7f4d900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4da9ffa640 1 -- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da406eb50 msgr2=0x7f4d900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4da9ffa640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da406eb50 0x7f4d900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4da9ffa640 1 -- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d90003f30 msgr2=0x7f4d90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4da9ffa640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d90003f30 0x7f4d90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.179+0000 7f4da9ffa640 1 -- 172.21.15.96:0/2048123933 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d90003520 con 0x7f4d90004d40 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4da9ffa640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d90004d40 0x7f4d900051c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0013d0 tx=0x7f4d90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4b559c6e968786 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00a4e0 con 0x7f4d90004d40 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c02f070 con 0x7f4d90004d40 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4d9bfff640 1 -- 172.21.15.96:0/2048123933 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c02bce0 con 0x7f4d90004d40 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4daba5d640 1 -- 172.21.15.96:0/2048123933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d90004d40 msgr2=0x7f4d900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4daba5d640 1 --2- 172.21.15.96:0/2048123933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d90004d40 0x7f4d900051c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0013d0 tx=0x7f4d90005830 comp rx=0 tx=0).stop 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4da9ffa640 1 -- 172.21.15.96:0/2048123933 reap_dead start 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4daba5d640 1 -- 172.21.15.96:0/2048123933 shutdown_connections 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4daba5d640 1 -- 172.21.15.96:0/2048123933 >> 172.21.15.96:0/2048123933 conn(0x7f4da40cfc30 msgr2=0x7f4da40d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4daba5d640 1 -- 172.21.15.96:0/2048123933 shutdown_connections 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.180+0000 7f4daba5d640 1 -- 172.21.15.96:0/2048123933 wait complete. 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4daba5d640 1 Processor -- start 2024-06-02T23:47:06.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4daba5d640 1 -- start start 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4daba5d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4da40cd260 0x7f4da40cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4daba5d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da4158710 0x7f4da40c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4daba5d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da414a790 0x7f4da414abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4daba5d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4da40caff0 con 0x7f4da4158710 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4daba5d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4da4071b00 con 0x7f4da40cd260 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4daba5d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4da40717d0 con 0x7f4da414a790 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4da8ff8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da4158710 0x7f4da40c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4da8ff8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da4158710 0x7f4da40c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33508/0 (socket says 172.21.15.96:33508) 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.182+0000 7f4da8ff8640 1 -- 172.21.15.96:0/999768202 learned_addr learned my addr 172.21.15.96:0/999768202 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4da8ff8640 1 -- 172.21.15.96:0/999768202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da414a790 msgr2=0x7f4da414abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4da8ff8640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da414a790 0x7f4da414abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4da8ff8640 1 -- 172.21.15.96:0/999768202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4da40cd260 msgr2=0x7f4da40cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4da8ff8640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4da40cd260 0x7f4da40cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4da8ff8640 1 -- 172.21.15.96:0/999768202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da40cdb80 con 0x7f4da4158710 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4da8ff8640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da4158710 0x7f4da40c3d50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4d940118e0 tx=0x7f4d94011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4d99ffb640 1 -- 172.21.15.96:0/999768202 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9400fa70 con 0x7f4da4158710 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4d99ffb640 1 -- 172.21.15.96:0/999768202 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9400fc10 con 0x7f4da4158710 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4daba5d640 1 -- 172.21.15.96:0/999768202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da40c4910 con 0x7f4da4158710 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4d99ffb640 1 -- 172.21.15.96:0/999768202 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94014440 con 0x7f4da4158710 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.183+0000 7f4daba5d640 1 -- 172.21.15.96:0/999768202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da40c51b0 con 0x7f4da4158710 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.184+0000 7f4daba5d640 1 -- 172.21.15.96:0/999768202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da40683e0 con 0x7f4da4158710 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.184+0000 7f4d99ffb640 1 -- 172.21.15.96:0/999768202 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d94012040 con 0x7f4da4158710 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.185+0000 7f4d99ffb640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4d8806be60 0x7f4d8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.185+0000 7f4d99ffb640 1 -- 172.21.15.96:0/999768202 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4d9408b8f0 con 0x7f4da4158710 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.185+0000 7f4da97f9640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4d8806be60 0x7f4d8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.185+0000 7f4da97f9640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4d8806be60 0x7f4d8806e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4da0006fd0 tx=0x7f4da0009540 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:06.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.189+0000 7f4d99ffb640 1 -- 172.21.15.96:0/999768202 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4d94019030 con 0x7f4da4158710 2024-06-02T23:47:06.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.374+0000 7f4daba5d640 1 -- 172.21.15.96:0/999768202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4da406cc90 con 0x7f4da4158710 2024-06-02T23:47:06.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.374+0000 7f4d99ffb640 1 -- 172.21.15.96:0/999768202 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f4d94059880 con 0x7f4da4158710 2024-06-02T23:47:06.375 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-02T23:47:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.376+0000 7f4daba5d640 1 -- 172.21.15.96:0/999768202 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4d8806be60 msgr2=0x7f4d8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.376+0000 7f4daba5d640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4d8806be60 0x7f4d8806e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4da0006fd0 tx=0x7f4da0009540 comp rx=0 tx=0).stop 2024-06-02T23:47:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.376+0000 7f4daba5d640 1 -- 172.21.15.96:0/999768202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da4158710 msgr2=0x7f4da40c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.376+0000 7f4daba5d640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da4158710 0x7f4da40c3d50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4d940118e0 tx=0x7f4d94011da0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.376+0000 7f4daba5d640 1 -- 172.21.15.96:0/999768202 shutdown_connections 2024-06-02T23:47:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.376+0000 7f4daba5d640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da414a790 0x7f4da414abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.376+0000 7f4daba5d640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4d8806be60 0x7f4d8806e320 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.376+0000 7f4daba5d640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da4158710 0x7f4da40c3d50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.376+0000 7f4daba5d640 1 --2- 172.21.15.96:0/999768202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4da40cd260 0x7f4da40cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.377+0000 7f4daba5d640 1 -- 172.21.15.96:0/999768202 >> 172.21.15.96:0/999768202 conn(0x7f4da40cfc30 msgr2=0x7f4da40ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.377+0000 7f4daba5d640 1 -- 172.21.15.96:0/999768202 shutdown_connections 2024-06-02T23:47:06.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.377+0000 7f4daba5d640 1 -- 172.21.15.96:0/999768202 wait complete. 2024-06-02T23:47:06.388 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:47:06.388 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:06.404 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:47:06.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.543+0000 7f155cc6b640 1 Processor -- start 2024-06-02T23:47:06.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.543+0000 7f155cc6b640 1 -- start start 2024-06-02T23:47:06.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.544+0000 7f155cc6b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15580d1120 0x7f15580c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.544+0000 7f155cc6b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15580b5510 0x7f15580c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.544+0000 7f155cc6b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15580d4a90 con 0x7f1558161900 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.544+0000 7f155cc6b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f15580cf5c0 con 0x7f15580b5510 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.544+0000 7f155cc6b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f15580caf70 con 0x7f15580d1120 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.544+0000 7f1556d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15580b5510 0x7f15580c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.544+0000 7f1556d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15580b5510 0x7f15580c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33512/0 (socket says 172.21.15.96:33512) 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.544+0000 7f155659c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1558161900 0x7f15580d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46048/0 (socket says 172.21.15.96:46048) 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.544+0000 7f1556d9d640 1 -- 172.21.15.96:0/4037456322 learned_addr learned my addr 172.21.15.96:0/4037456322 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.544+0000 7f154dd9b640 1 --2- 172.21.15.96:0/4037456322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15580d1120 0x7f15580c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.545+0000 7f1556d9d640 1 -- 172.21.15.96:0/4037456322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15580d1120 msgr2=0x7f15580c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.545+0000 7f1556d9d640 1 --2- 172.21.15.96:0/4037456322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15580d1120 0x7f15580c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.545+0000 7f1556d9d640 1 -- 172.21.15.96:0/4037456322 >> v1:172.21.15.96:6789/0 conn(0x7f1558161900 legacy=0x7f15580d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.545+0000 7f1556d9d640 1 -- 172.21.15.96:0/4037456322 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15580d4d70 con 0x7f15580b5510 2024-06-02T23:47:06.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.545+0000 7f1555d9b640 1 -- 172.21.15.96:0/4037456322 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752848774 0 0) 0x7f15580d4a90 con 0x7f1558161900 2024-06-02T23:47:06.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.545+0000 7f1556d9d640 1 --2- 172.21.15.96:0/4037456322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580b5510 0x7f15580c8100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1550009e50 tx=0x7f155002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79fbbe1d153bedf server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:06.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.545+0000 7f1555d9b640 1 -- 172.21.15.96:0/4037456322 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1550036070 con 0x7f15580b5510 2024-06-02T23:47:06.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.545+0000 7f1555d9b640 1 -- 172.21.15.96:0/4037456322 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1550031600 con 0x7f15580b5510 2024-06-02T23:47:06.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.545+0000 7f1555d9b640 1 -- 172.21.15.96:0/4037456322 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15500319d0 con 0x7f15580b5510 2024-06-02T23:47:06.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.546+0000 7f155cc6b640 1 -- 172.21.15.96:0/4037456322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580b5510 msgr2=0x7f15580c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.546+0000 7f155cc6b640 1 --2- 172.21.15.96:0/4037456322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580b5510 0x7f15580c8100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1550009e50 tx=0x7f155002a680 comp rx=0 tx=0).stop 2024-06-02T23:47:06.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.546+0000 7f155cc6b640 1 -- 172.21.15.96:0/4037456322 shutdown_connections 2024-06-02T23:47:06.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.546+0000 7f155cc6b640 1 --2- 172.21.15.96:0/4037456322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580b5510 0x7f15580c8100 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.546+0000 7f155cc6b640 1 --2- 172.21.15.96:0/4037456322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15580d1120 0x7f15580c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.546+0000 7f155cc6b640 1 -- 172.21.15.96:0/4037456322 >> 172.21.15.96:0/4037456322 conn(0x7f155809d3b0 msgr2=0x7f15580d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.546+0000 7f155cc6b640 1 -- 172.21.15.96:0/4037456322 shutdown_connections 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.546+0000 7f155cc6b640 1 -- 172.21.15.96:0/4037456322 wait complete. 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.547+0000 7f155cc6b640 1 Processor -- start 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.547+0000 7f155cc6b640 1 -- start start 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f155cc6b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15580b5510 0x7f15580cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f155cc6b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580d1120 0x7f15580b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f155cc6b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1558161900 0x7f15580b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f155cc6b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f15580d4780 con 0x7f15580d1120 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f155cc6b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15580cfae0 con 0x7f15580b5510 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f155cc6b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1558161ce0 con 0x7f1558161900 2024-06-02T23:47:06.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f154dd9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580d1120 0x7f15580b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f154dd9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580d1120 0x7f15580b0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33520/0 (socket says 172.21.15.96:33520) 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f154dd9b640 1 -- 172.21.15.96:0/4269930306 learned_addr learned my addr 172.21.15.96:0/4269930306 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f1556d9d640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1558161900 0x7f15580b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.548+0000 7f155659c640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15580b5510 0x7f15580cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f154dd9b640 1 -- 172.21.15.96:0/4269930306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1558161900 msgr2=0x7f15580b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f154dd9b640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1558161900 0x7f15580b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f154dd9b640 1 -- 172.21.15.96:0/4269930306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15580b5510 msgr2=0x7f15580cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f154dd9b640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15580b5510 0x7f15580cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f154dd9b640 1 -- 172.21.15.96:0/4269930306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15580cdf40 con 0x7f15580d1120 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f1556d9d640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1558161900 0x7f15580b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f154dd9b640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580d1120 0x7f15580b0f10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f154000d800 tx=0x7f154000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f154f7fe640 1 -- 172.21.15.96:0/4269930306 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154000b6c0 con 0x7f15580d1120 2024-06-02T23:47:06.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f154f7fe640 1 -- 172.21.15.96:0/4269930306 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1540019070 con 0x7f15580d1120 2024-06-02T23:47:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f155cc6b640 1 -- 172.21.15.96:0/4269930306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15580b3060 con 0x7f15580d1120 2024-06-02T23:47:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f154f7fe640 1 -- 172.21.15.96:0/4269930306 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154000ba80 con 0x7f15580d1120 2024-06-02T23:47:06.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.549+0000 7f155cc6b640 1 -- 172.21.15.96:0/4269930306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15580b3620 con 0x7f15580d1120 2024-06-02T23:47:06.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.550+0000 7f155cc6b640 1 -- 172.21.15.96:0/4269930306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15580683e0 con 0x7f15580d1120 2024-06-02T23:47:06.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.550+0000 7f154f7fe640 1 -- 172.21.15.96:0/4269930306 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f154000bc20 con 0x7f15580d1120 2024-06-02T23:47:06.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.551+0000 7f154f7fe640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f153806be30 0x7f153806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:06.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.551+0000 7f154f7fe640 1 -- 172.21.15.96:0/4269930306 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f154008b670 con 0x7f15580d1120 2024-06-02T23:47:06.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.551+0000 7f155659c640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f153806be30 0x7f153806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:06.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.551+0000 7f155659c640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f153806be30 0x7f153806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1548000f60 tx=0x7f1548007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:06.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.555+0000 7f154f7fe640 1 -- 172.21.15.96:0/4269930306 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1540059ce0 con 0x7f15580d1120 2024-06-02T23:47:06.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.741+0000 7f155cc6b640 1 -- 172.21.15.96:0/4269930306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f15580d05e0 con 0x7f15580d1120 2024-06-02T23:47:06.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.741+0000 7f154f7fe640 1 -- 172.21.15.96:0/4269930306 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f15400595e0 con 0x7f15580d1120 2024-06-02T23:47:06.741 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-02T23:47:06.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 -- 172.21.15.96:0/4269930306 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f153806be30 msgr2=0x7f153806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f153806be30 0x7f153806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1548000f60 tx=0x7f1548007c00 comp rx=0 tx=0).stop 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 -- 172.21.15.96:0/4269930306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580d1120 msgr2=0x7f15580b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580d1120 0x7f15580b0f10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f154000d800 tx=0x7f154000dcc0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 -- 172.21.15.96:0/4269930306 shutdown_connections 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1558161900 0x7f15580b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f153806be30 0x7f153806e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15580d1120 0x7f15580b0f10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 --2- 172.21.15.96:0/4269930306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15580b5510 0x7f15580cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 -- 172.21.15.96:0/4269930306 >> 172.21.15.96:0/4269930306 conn(0x7f155809d3b0 msgr2=0x7f15580b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 -- 172.21.15.96:0/4269930306 shutdown_connections 2024-06-02T23:47:06.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:06.743+0000 7f155cc6b640 1 -- 172.21.15.96:0/4269930306 wait complete. 2024-06-02T23:47:06.755 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2024-06-02T23:47:06.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:06.755 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-06-02T23:47:06.779 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:47:06.779 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:47:06.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:06.780 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-02T23:47:06.835 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:47:06.835 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:06.857 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:47:06.857 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:06.916 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:47:07.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.016+0000 7f3cd5dab640 1 Processor -- start 2024-06-02T23:47:07.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.017+0000 7f3cd5dab640 1 -- start start 2024-06-02T23:47:07.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.017+0000 7f3cd5dab640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3cd015c360 0x7f3cd00ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.017+0000 7f3cd5dab640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3cd00cec20 0x7f3cd00c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.017+0000 7f3cd5dab640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd00d07f0 con 0x7f3cd00c6570 2024-06-02T23:47:07.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.017+0000 7f3cd5dab640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd00cf080 con 0x7f3cd015c360 2024-06-02T23:47:07.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.017+0000 7f3cd5dab640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd015c740 con 0x7f3cd00cec20 2024-06-02T23:47:07.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.017+0000 7f3ccf7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3cd015c360 0x7f3cd00ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.018+0000 7f3ccffff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3cd00c6570 0x7f3cd00c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46054/0 (socket says 172.21.15.96:46054) 2024-06-02T23:47:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.018+0000 7f3ccffff640 1 -- 172.21.15.96:0/1428178100 learned_addr learned my addr 172.21.15.96:0/1428178100 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.018+0000 7f3cc6ffd640 1 --2- 172.21.15.96:0/1428178100 >> v2:172.21.15.162:3300/0 conn(0x7f3cd00cec20 0x7f3cd00c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.018+0000 7f3ccf7fe640 1 -- 172.21.15.96:0/1428178100 >> v2:172.21.15.162:3300/0 conn(0x7f3cd00cec20 msgr2=0x7f3cd00c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.018+0000 7f3ccf7fe640 1 --2- 172.21.15.96:0/1428178100 >> v2:172.21.15.162:3300/0 conn(0x7f3cd00cec20 0x7f3cd00c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.018+0000 7f3ccf7fe640 1 -- 172.21.15.96:0/1428178100 >> v1:172.21.15.96:6789/0 conn(0x7f3cd00c6570 legacy=0x7f3cd00c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.018+0000 7f3ccf7fe640 1 -- 172.21.15.96:0/1428178100 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd00d0ad0 con 0x7f3cd015c360 2024-06-02T23:47:07.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.018+0000 7f3cceffd640 1 -- 172.21.15.96:0/1428178100 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869077771 0 0) 0x7f3cd00d07f0 con 0x7f3cd00c6570 2024-06-02T23:47:07.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3ccf7fe640 1 --2- 172.21.15.96:0/1428178100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd015c360 0x7f3cd00ce6e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00724d0 tx=0x7f3cc002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc0224e371a2f70 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:07.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cceffd640 1 -- 172.21.15.96:0/1428178100 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0037070 con 0x7f3cd015c360 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cceffd640 1 -- 172.21.15.96:0/1428178100 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc0032440 con 0x7f3cd015c360 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cceffd640 1 -- 172.21.15.96:0/1428178100 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc002ae60 con 0x7f3cd015c360 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1428178100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd015c360 msgr2=0x7f3cd00ce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cd5dab640 1 --2- 172.21.15.96:0/1428178100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd015c360 0x7f3cd00ce6e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00724d0 tx=0x7f3cc002a110 comp rx=0 tx=0).stop 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1428178100 shutdown_connections 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cd5dab640 1 --2- 172.21.15.96:0/1428178100 >> v2:172.21.15.162:3300/0 conn(0x7f3cd00cec20 0x7f3cd00c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cd5dab640 1 --2- 172.21.15.96:0/1428178100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd015c360 0x7f3cd00ce6e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1428178100 >> 172.21.15.96:0/1428178100 conn(0x7f3cd00d1db0 msgr2=0x7f3cd00d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1428178100 shutdown_connections 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.019+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1428178100 wait complete. 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.020+0000 7f3cd5dab640 1 Processor -- start 2024-06-02T23:47:07.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.021+0000 7f3cd5dab640 1 -- start start 2024-06-02T23:47:07.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.021+0000 7f3cd5dab640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00c6570 0x7f3cd01f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.021+0000 7f3cd5dab640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd00cec20 0x7f3cd01f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.021+0000 7f3cd5dab640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd015c360 0x7f3cd014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.021+0000 7f3cd5dab640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00d2b00 con 0x7f3cd00cec20 2024-06-02T23:47:07.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.021+0000 7f3cd5dab640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00d05a0 con 0x7f3cd015c360 2024-06-02T23:47:07.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.021+0000 7f3cd5dab640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd00c70f0 con 0x7f3cd00c6570 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.021+0000 7f3cc6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd00cec20 0x7f3cd01f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.021+0000 7f3cc6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd00cec20 0x7f3cd01f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33544/0 (socket says 172.21.15.96:33544) 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.021+0000 7f3cc6ffd640 1 -- 172.21.15.96:0/1865644572 learned_addr learned my addr 172.21.15.96:0/1865644572 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3ccffff640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd015c360 0x7f3cd014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3ccf7fe640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00c6570 0x7f3cd01f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cc6ffd640 1 -- 172.21.15.96:0/1865644572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00c6570 msgr2=0x7f3cd01f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cc6ffd640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00c6570 0x7f3cd01f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cc6ffd640 1 -- 172.21.15.96:0/1865644572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd015c360 msgr2=0x7f3cd014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cc6ffd640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd015c360 0x7f3cd014e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cc6ffd640 1 -- 172.21.15.96:0/1865644572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd01f6100 con 0x7f3cd00cec20 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cc6ffd640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd00cec20 0x7f3cd01f5bc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800d800 tx=0x7f3cb800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cccff9640 1 -- 172.21.15.96:0/1865644572 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb800b6c0 con 0x7f3cd00cec20 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cccff9640 1 -- 172.21.15.96:0/1865644572 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb8019070 con 0x7f3cd00cec20 2024-06-02T23:47:07.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1865644572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd01f2250 con 0x7f3cd00cec20 2024-06-02T23:47:07.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cccff9640 1 -- 172.21.15.96:0/1865644572 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb800ba80 con 0x7f3cd00cec20 2024-06-02T23:47:07.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.022+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1865644572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd01f2810 con 0x7f3cd00cec20 2024-06-02T23:47:07.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.023+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1865644572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd0073fc0 con 0x7f3cd00cec20 2024-06-02T23:47:07.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.024+0000 7f3cccff9640 1 -- 172.21.15.96:0/1865644572 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3cb800bc20 con 0x7f3cd00cec20 2024-06-02T23:47:07.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.024+0000 7f3cccff9640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3cb006be30 0x7f3cb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.024+0000 7f3cccff9640 1 -- 172.21.15.96:0/1865644572 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7f3cb808b6a0 con 0x7f3cd00cec20 2024-06-02T23:47:07.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.024+0000 7f3ccf7fe640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3cb006be30 0x7f3cb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.024+0000 7f3ccf7fe640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3cb006be30 0x7f3cb006e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0034000 tx=0x7f3cc002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:07.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.028+0000 7f3cccff9640 1 -- 172.21.15.96:0/1865644572 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3cd01f6100 con 0x7f3cd00cec20 2024-06-02T23:47:07.216 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.216+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1865644572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3cd0073410 con 0x7f3cd00cec20 2024-06-02T23:47:07.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.216+0000 7f3cccff9640 1 -- 172.21.15.96:0/1865644572 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f3cb801c360 con 0x7f3cd00cec20 2024-06-02T23:47:07.217 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-02T23:47:07.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1865644572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3cb006be30 msgr2=0x7f3cb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3cb006be30 0x7f3cb006e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0034000 tx=0x7f3cc002e000 comp rx=0 tx=0).stop 2024-06-02T23:47:07.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1865644572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd00cec20 msgr2=0x7f3cd01f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd00cec20 0x7f3cd01f5bc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800d800 tx=0x7f3cb800dcc0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1865644572 shutdown_connections 2024-06-02T23:47:07.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd015c360 0x7f3cd014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3cb006be30 0x7f3cb006e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cd00cec20 0x7f3cd01f5bc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 --2- 172.21.15.96:0/1865644572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00c6570 0x7f3cd01f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1865644572 >> 172.21.15.96:0/1865644572 conn(0x7f3cd00d1db0 msgr2=0x7f3cd00ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:07.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1865644572 shutdown_connections 2024-06-02T23:47:07.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.219+0000 7f3cd5dab640 1 -- 172.21.15.96:0/1865644572 wait complete. 2024-06-02T23:47:07.230 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:47:07.230 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:47:07.250 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:47:07.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.350+0000 7f22667e7640 1 Processor -- start 2024-06-02T23:47:07.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.350+0000 7f22667e7640 1 -- start start 2024-06-02T23:47:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f22667e7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2260155570 0x7f226006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f22667e7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f226006eb50 0x7f22600ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f22667e7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f22600cab60 0x7f226015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f22667e7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f226006efb0 con 0x7f22600cab60 2024-06-02T23:47:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f22667e7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2260155950 con 0x7f226006eb50 2024-06-02T23:47:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f22667e7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22600cb2e0 con 0x7f2260155570 2024-06-02T23:47:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f2264d84640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f22600cab60 0x7f226015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f2264d84640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f22600cab60 0x7f226015eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33550/0 (socket says 172.21.15.96:33550) 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f2264d84640 1 -- 172.21.15.96:0/3581185512 learned_addr learned my addr 172.21.15.96:0/3581185512 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f225ffff640 1 --2- 172.21.15.96:0/3581185512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2260155570 0x7f226006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f225f7fe640 1 --2- 172.21.15.96:0/3581185512 >> v2:172.21.15.162:3300/0 conn(0x7f226006eb50 0x7f22600ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f2264d84640 1 -- 172.21.15.96:0/3581185512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2260155570 msgr2=0x7f226006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f2264d84640 1 --2- 172.21.15.96:0/3581185512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2260155570 0x7f226006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f2264d84640 1 -- 172.21.15.96:0/3581185512 >> v2:172.21.15.162:3300/0 conn(0x7f226006eb50 msgr2=0x7f22600ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f2264d84640 1 --2- 172.21.15.96:0/3581185512 >> v2:172.21.15.162:3300/0 conn(0x7f226006eb50 0x7f22600ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.351+0000 7f2264d84640 1 -- 172.21.15.96:0/3581185512 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22600cb5c0 con 0x7f22600cab60 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.352+0000 7f2264d84640 1 --2- 172.21.15.96:0/3581185512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600cab60 0x7f226015eab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f226006ca30 tx=0x7f225802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5594be3bdb3bc1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.352+0000 7f225effd640 1 -- 172.21.15.96:0/3581185512 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258036070 con 0x7f22600cab60 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.352+0000 7f225effd640 1 -- 172.21.15.96:0/3581185512 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2258031600 con 0x7f22600cab60 2024-06-02T23:47:07.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.352+0000 7f225effd640 1 -- 172.21.15.96:0/3581185512 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22580319d0 con 0x7f22600cab60 2024-06-02T23:47:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.352+0000 7f22667e7640 1 -- 172.21.15.96:0/3581185512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600cab60 msgr2=0x7f226015eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.352+0000 7f22667e7640 1 --2- 172.21.15.96:0/3581185512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600cab60 0x7f226015eab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f226006ca30 tx=0x7f225802a6a0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.353+0000 7f22667e7640 1 -- 172.21.15.96:0/3581185512 shutdown_connections 2024-06-02T23:47:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.353+0000 7f22667e7640 1 --2- 172.21.15.96:0/3581185512 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22600cab60 0x7f226015eab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.353+0000 7f22667e7640 1 --2- 172.21.15.96:0/3581185512 >> v2:172.21.15.162:3300/0 conn(0x7f226006eb50 0x7f22600ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.353+0000 7f22667e7640 1 --2- 172.21.15.96:0/3581185512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2260155570 0x7f226006e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.353+0000 7f22667e7640 1 -- 172.21.15.96:0/3581185512 >> 172.21.15.96:0/3581185512 conn(0x7f22600cfc30 msgr2=0x7f22600d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.353+0000 7f22667e7640 1 -- 172.21.15.96:0/3581185512 shutdown_connections 2024-06-02T23:47:07.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.353+0000 7f22667e7640 1 -- 172.21.15.96:0/3581185512 wait complete. 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.354+0000 7f22667e7640 1 Processor -- start 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.354+0000 7f22667e7640 1 -- start start 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f22667e7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f226006eb50 0x7f2260151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f22667e7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22600cab60 0x7f2260157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f22667e7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260155570 0x7f22600b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f22667e7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f22600caff0 con 0x7f226006eb50 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f22667e7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2260071b00 con 0x7f2260155570 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f22667e7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22600717d0 con 0x7f22600cab60 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f226006eb50 0x7f2260151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f226006eb50 0x7f2260151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33562/0 (socket says 172.21.15.96:33562) 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225ffff640 1 -- 172.21.15.96:0/790551157 learned_addr learned my addr 172.21.15.96:0/790551157 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225f7fe640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22600cab60 0x7f2260157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f2264d84640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260155570 0x7f22600b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225ffff640 1 -- 172.21.15.96:0/790551157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22600cab60 msgr2=0x7f2260157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225ffff640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22600cab60 0x7f2260157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225ffff640 1 -- 172.21.15.96:0/790551157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260155570 msgr2=0x7f22600b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225ffff640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260155570 0x7f22600b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225ffff640 1 -- 172.21.15.96:0/790551157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22600c6790 con 0x7f226006eb50 2024-06-02T23:47:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225ffff640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f226006eb50 0x7f2260151ba0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f225000d800 tx=0x7f225000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225cff9640 1 -- 172.21.15.96:0/790551157 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225000b6c0 con 0x7f226006eb50 2024-06-02T23:47:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225cff9640 1 -- 172.21.15.96:0/790551157 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2250019070 con 0x7f226006eb50 2024-06-02T23:47:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f22667e7640 1 -- 172.21.15.96:0/790551157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22600c6a70 con 0x7f226006eb50 2024-06-02T23:47:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.355+0000 7f225cff9640 1 -- 172.21.15.96:0/790551157 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225000ba80 con 0x7f226006eb50 2024-06-02T23:47:07.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.356+0000 7f22667e7640 1 -- 172.21.15.96:0/790551157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22600cdb60 con 0x7f226006eb50 2024-06-02T23:47:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.356+0000 7f22667e7640 1 -- 172.21.15.96:0/790551157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22600683e0 con 0x7f226006eb50 2024-06-02T23:47:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.357+0000 7f225cff9640 1 -- 172.21.15.96:0/790551157 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f225000bc20 con 0x7f226006eb50 2024-06-02T23:47:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.357+0000 7f225cff9640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f224c06be30 0x7f224c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.357+0000 7f225cff9640 1 -- 172.21.15.96:0/790551157 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7f225008b5f0 con 0x7f226006eb50 2024-06-02T23:47:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.357+0000 7f225f7fe640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f224c06be30 0x7f224c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.358+0000 7f225f7fe640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f224c06be30 0x7f224c06e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f226006dc00 tx=0x7f2254008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:07.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.362+0000 7f225cff9640 1 -- 172.21.15.96:0/790551157 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2250059550 con 0x7f226006eb50 2024-06-02T23:47:07.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.546+0000 7f22667e7640 1 -- 172.21.15.96:0/790551157 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f226006cc90 con 0x7f226006eb50 2024-06-02T23:47:07.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.546+0000 7f225cff9640 1 -- 172.21.15.96:0/790551157 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f225005d850 con 0x7f226006eb50 2024-06-02T23:47:07.546 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-02T23:47:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 -- 172.21.15.96:0/790551157 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f224c06be30 msgr2=0x7f224c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f224c06be30 0x7f224c06e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f226006dc00 tx=0x7f2254008040 comp rx=0 tx=0).stop 2024-06-02T23:47:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 -- 172.21.15.96:0/790551157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f226006eb50 msgr2=0x7f2260151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f226006eb50 0x7f2260151ba0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f225000d800 tx=0x7f225000dcc0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 -- 172.21.15.96:0/790551157 shutdown_connections 2024-06-02T23:47:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260155570 0x7f22600b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22600cab60 0x7f2260157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f224c06be30 0x7f224c06e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 --2- 172.21.15.96:0/790551157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f226006eb50 0x7f2260151ba0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 -- 172.21.15.96:0/790551157 >> 172.21.15.96:0/790551157 conn(0x7f22600cfc30 msgr2=0x7f2260153e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:07.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 -- 172.21.15.96:0/790551157 shutdown_connections 2024-06-02T23:47:07.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.548+0000 7f22667e7640 1 -- 172.21.15.96:0/790551157 wait complete. 2024-06-02T23:47:07.559 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi162.front.sepia.ceph.com... 2024-06-02T23:47:07.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:07.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-06-02T23:47:07.590 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:47:07.591 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T23:47:07.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:07.591 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-02T23:47:07.649 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-02T23:47:07.650 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:47:07.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.749+0000 7f22302cd640 1 Processor -- start 2024-06-02T23:47:07.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.749+0000 7f22302cd640 1 -- start start 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.749+0000 7f22302cd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f222815a850 0x7f22280ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f22302cd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f22280ca9d0 0x7f222806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f22302cd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222806e650 0x7f22280cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f22302cd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f222806ee70 con 0x7f22280ca9d0 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f22302cd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f22280711b0 con 0x7f222815a850 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f22302cd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2228071490 con 0x7f222806e650 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222d868640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f22280ca9d0 0x7f222806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222d868640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f22280ca9d0 0x7f222806e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33578/0 (socket says 172.21.15.96:33578) 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222d868640 1 -- 172.21.15.96:0/300531457 learned_addr learned my addr 172.21.15.96:0/300531457 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222e069640 1 --2- 172.21.15.96:0/300531457 >> v2:172.21.15.162:3300/0 conn(0x7f222815a850 0x7f22280ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222e86a640 1 --2- 172.21.15.96:0/300531457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222806e650 0x7f22280cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222d868640 1 -- 172.21.15.96:0/300531457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222806e650 msgr2=0x7f22280cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:07.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222d868640 1 --2- 172.21.15.96:0/300531457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222806e650 0x7f22280cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222d868640 1 -- 172.21.15.96:0/300531457 >> v2:172.21.15.162:3300/0 conn(0x7f222815a850 msgr2=0x7f22280ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:07.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222d868640 1 --2- 172.21.15.96:0/300531457 >> v2:172.21.15.162:3300/0 conn(0x7f222815a850 0x7f22280ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222d868640 1 -- 172.21.15.96:0/300531457 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2228071770 con 0x7f22280ca9d0 2024-06-02T23:47:07.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222e069640 1 --2- 172.21.15.96:0/300531457 >> v2:172.21.15.162:3300/0 conn(0x7f222815a850 0x7f22280ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:07.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.750+0000 7f222e86a640 1 --2- 172.21.15.96:0/300531457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222806e650 0x7f22280cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:07.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f222d868640 1 --2- 172.21.15.96:0/300531457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22280ca9d0 0x7f222806e110 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f222400aa10 tx=0x7f222402b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292dfa65ee6d4106 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:07.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f222d067640 1 -- 172.21.15.96:0/300531457 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222400b040 con 0x7f22280ca9d0 2024-06-02T23:47:07.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f222d067640 1 -- 172.21.15.96:0/300531457 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2224030710 con 0x7f22280ca9d0 2024-06-02T23:47:07.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f222d067640 1 -- 172.21.15.96:0/300531457 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2224030ae0 con 0x7f22280ca9d0 2024-06-02T23:47:07.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f22302cd640 1 -- 172.21.15.96:0/300531457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22280ca9d0 msgr2=0x7f222806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f22302cd640 1 --2- 172.21.15.96:0/300531457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22280ca9d0 0x7f222806e110 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f222400aa10 tx=0x7f222402b650 comp rx=0 tx=0).stop 2024-06-02T23:47:07.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f22302cd640 1 -- 172.21.15.96:0/300531457 shutdown_connections 2024-06-02T23:47:07.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f22302cd640 1 --2- 172.21.15.96:0/300531457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222806e650 0x7f22280cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f22302cd640 1 --2- 172.21.15.96:0/300531457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f22280ca9d0 0x7f222806e110 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f22302cd640 1 --2- 172.21.15.96:0/300531457 >> v2:172.21.15.162:3300/0 conn(0x7f222815a850 0x7f22280ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f22302cd640 1 -- 172.21.15.96:0/300531457 >> 172.21.15.96:0/300531457 conn(0x7f22280cfc30 msgr2=0x7f22280d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.751+0000 7f22302cd640 1 -- 172.21.15.96:0/300531457 shutdown_connections 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.752+0000 7f22302cd640 1 -- 172.21.15.96:0/300531457 wait complete. 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f22302cd640 1 Processor -- start 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f22302cd640 1 -- start start 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f22302cd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222806e650 0x7f22281f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f22302cd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280ca9d0 0x7f2228158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f22302cd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222815a850 0x7f2228156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f22302cd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f222806cc70 con 0x7f222806e650 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f22302cd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f222806eae0 con 0x7f22280ca9d0 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f22302cd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f222806cdf0 con 0x7f222815a850 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f222e069640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222806e650 0x7f22281f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f222e069640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222806e650 0x7f22281f1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33582/0 (socket says 172.21.15.96:33582) 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.753+0000 7f222e069640 1 -- 172.21.15.96:0/4048043472 learned_addr learned my addr 172.21.15.96:0/4048043472 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f222e069640 1 -- 172.21.15.96:0/4048043472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222815a850 msgr2=0x7f2228156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f222e86a640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222815a850 0x7f2228156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f222d868640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280ca9d0 0x7f2228158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f222e069640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222815a850 0x7f2228156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f222e069640 1 -- 172.21.15.96:0/4048043472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280ca9d0 msgr2=0x7f2228158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f222e069640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280ca9d0 0x7f2228158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f222e069640 1 -- 172.21.15.96:0/4048043472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22281f2e20 con 0x7f222806e650 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f222d868640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280ca9d0 0x7f2228158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f222e86a640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222815a850 0x7f2228156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f222e069640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222806e650 0x7f22281f1c60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f221800c7f0 tx=0x7f221800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f221effd640 1 -- 172.21.15.96:0/4048043472 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218015070 con 0x7f222806e650 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f221effd640 1 -- 172.21.15.96:0/4048043472 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2218007820 con 0x7f222806e650 2024-06-02T23:47:07.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f221effd640 1 -- 172.21.15.96:0/4048043472 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218007bd0 con 0x7f222806e650 2024-06-02T23:47:07.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f22302cd640 1 -- 172.21.15.96:0/4048043472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22281f2240 con 0x7f222806e650 2024-06-02T23:47:07.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.754+0000 7f22302cd640 1 -- 172.21.15.96:0/4048043472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22281f2800 con 0x7f222806e650 2024-06-02T23:47:07.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.755+0000 7f22302cd640 1 -- 172.21.15.96:0/4048043472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22280683e0 con 0x7f222806e650 2024-06-02T23:47:07.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.755+0000 7f221effd640 1 -- 172.21.15.96:0/4048043472 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2218018070 con 0x7f222806e650 2024-06-02T23:47:07.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.756+0000 7f221effd640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f220c06be30 0x7f220c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:07.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.756+0000 7f221effd640 1 -- 172.21.15.96:0/4048043472 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6735+0+0 (secure 0 0 0) 0x7f221808b360 con 0x7f222806e650 2024-06-02T23:47:07.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.756+0000 7f222d868640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f220c06be30 0x7f220c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:07.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.756+0000 7f222d868640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f220c06be30 0x7f220c06e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2224035000 tx=0x7f222400c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:07.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.760+0000 7f221effd640 1 -- 172.21.15.96:0/4048043472 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2218059910 con 0x7f222806e650 2024-06-02T23:47:07.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.977+0000 7f22302cd640 1 -- 172.21.15.96:0/4048043472 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22280b0520 con 0x7f222806e650 2024-06-02T23:47:07.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.978+0000 7f221effd640 1 -- 172.21.15.96:0/4048043472 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f2218059210 con 0x7f222806e650 2024-06-02T23:47:07.978 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:07.978 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:46:25.060503+0000","modified":"2024-06-02T23:46:44.137908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-02T23:47:07.979 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 8 2024-06-02T23:47:07.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 -- 172.21.15.96:0/4048043472 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f220c06be30 msgr2=0x7f220c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f220c06be30 0x7f220c06e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2224035000 tx=0x7f222400c040 comp rx=0 tx=0).stop 2024-06-02T23:47:07.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 -- 172.21.15.96:0/4048043472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222806e650 msgr2=0x7f22281f1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:07.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222806e650 0x7f22281f1c60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f221800c7f0 tx=0x7f221800ccb0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 -- 172.21.15.96:0/4048043472 shutdown_connections 2024-06-02T23:47:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f222815a850 0x7f2228156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22280ca9d0 0x7f2228158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f220c06be30 0x7f220c06e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 --2- 172.21.15.96:0/4048043472 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f222806e650 0x7f22281f1c60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 -- 172.21.15.96:0/4048043472 >> 172.21.15.96:0/4048043472 conn(0x7f22280cfc30 msgr2=0x7f22280b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 -- 172.21.15.96:0/4048043472 shutdown_connections 2024-06-02T23:47:07.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:07.980+0000 7f22302cd640 1 -- 172.21.15.96:0/4048043472 wait complete. 2024-06-02T23:47:07.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:47:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.090+0000 7fafc21ed640 1 Processor -- start 2024-06-02T23:47:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.090+0000 7fafc21ed640 1 -- start start 2024-06-02T23:47:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.090+0000 7fafc21ed640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fafbc161900 0x7fafbc0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.090+0000 7fafc21ed640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafbc0b5510 0x7fafbc0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.090+0000 7fafc21ed640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafbc0d4a90 con 0x7fafbc0b4fa0 2024-06-02T23:47:08.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.090+0000 7fafc21ed640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fafbc0cf5c0 con 0x7fafbc161900 2024-06-02T23:47:08.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.090+0000 7fafc21ed640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fafbc0caf70 con 0x7fafbc0b5510 2024-06-02T23:47:08.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.091+0000 7fafb2ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafbc0b5510 0x7fafbc0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.091+0000 7fafbb7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fafbc161900 0x7fafbc0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.091+0000 7fafbbfff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fafbc0b4fa0 0x7fafbc0d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:38726/0 (socket says 172.21.15.96:38726) 2024-06-02T23:47:08.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.091+0000 7fafbbfff640 1 -- 172.21.15.96:0/486898518 learned_addr learned my addr 172.21.15.96:0/486898518 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:08.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.091+0000 7fafbb7fe640 1 -- 172.21.15.96:0/486898518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafbc0b5510 msgr2=0x7fafbc0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:08.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.091+0000 7fafbb7fe640 1 --2- 172.21.15.96:0/486898518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafbc0b5510 0x7fafbc0d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.091+0000 7fafbb7fe640 1 -- 172.21.15.96:0/486898518 >> v1:172.21.15.162:6789/0 conn(0x7fafbc0b4fa0 legacy=0x7fafbc0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.091+0000 7fafbaffd640 1 -- 172.21.15.96:0/486898518 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658968855 0 0) 0x7fafbc0d4a90 con 0x7fafbc0b4fa0 2024-06-02T23:47:08.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.091+0000 7fafbb7fe640 1 -- 172.21.15.96:0/486898518 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc0d4d70 con 0x7fafbc161900 2024-06-02T23:47:08.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.092+0000 7fafbb7fe640 1 --2- 172.21.15.96:0/486898518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafbc161900 0x7fafbc0d0a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fafac0097a0 tx=0x7fafac02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20dfa3cd7177e546 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:08.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.092+0000 7fafbaffd640 1 -- 172.21.15.96:0/486898518 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac037070 con 0x7fafbc161900 2024-06-02T23:47:08.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.092+0000 7fafbaffd640 1 -- 172.21.15.96:0/486898518 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafac02ae50 con 0x7fafbc161900 2024-06-02T23:47:08.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.092+0000 7fafbaffd640 1 -- 172.21.15.96:0/486898518 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac032660 con 0x7fafbc161900 2024-06-02T23:47:08.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.093+0000 7fafc21ed640 1 -- 172.21.15.96:0/486898518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafbc161900 msgr2=0x7fafbc0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.093+0000 7fafc21ed640 1 --2- 172.21.15.96:0/486898518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafbc161900 0x7fafbc0d0a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fafac0097a0 tx=0x7fafac02a100 comp rx=0 tx=0).stop 2024-06-02T23:47:08.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.093+0000 7fafc21ed640 1 -- 172.21.15.96:0/486898518 shutdown_connections 2024-06-02T23:47:08.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.093+0000 7fafc21ed640 1 --2- 172.21.15.96:0/486898518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafbc0b5510 0x7fafbc0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.093+0000 7fafc21ed640 1 --2- 172.21.15.96:0/486898518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafbc161900 0x7fafbc0d0a10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.093+0000 7fafc21ed640 1 -- 172.21.15.96:0/486898518 >> 172.21.15.96:0/486898518 conn(0x7fafbc09d3b0 msgr2=0x7fafbc0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:08.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.093+0000 7fafc21ed640 1 -- 172.21.15.96:0/486898518 shutdown_connections 2024-06-02T23:47:08.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.093+0000 7fafc21ed640 1 -- 172.21.15.96:0/486898518 wait complete. 2024-06-02T23:47:08.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.094+0000 7fafc21ed640 1 Processor -- start 2024-06-02T23:47:08.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.094+0000 7fafc21ed640 1 -- start start 2024-06-02T23:47:08.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafc21ed640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafbc0b4fa0 0x7fafbc0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafc21ed640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafbc0b5510 0x7fafbc0b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafc21ed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafbc161900 0x7fafbc0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafc21ed640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc0d4780 con 0x7fafbc0b5510 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafc21ed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc0cfae0 con 0x7fafbc161900 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafc21ed640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fafbc161ce0 con 0x7fafbc0b4fa0 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafb2ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafbc0b5510 0x7fafbc0b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafb2ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafbc0b5510 0x7fafbc0b75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33598/0 (socket says 172.21.15.96:33598) 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafb2ffd640 1 -- 172.21.15.96:0/3895683228 learned_addr learned my addr 172.21.15.96:0/3895683228 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafbb7fe640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafbc0b4fa0 0x7fafbc0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafbbfff640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafbc161900 0x7fafbc0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafb2ffd640 1 -- 172.21.15.96:0/3895683228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafbc0b4fa0 msgr2=0x7fafbc0cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafb2ffd640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafbc0b4fa0 0x7fafbc0cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafb2ffd640 1 -- 172.21.15.96:0/3895683228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafbc161900 msgr2=0x7fafbc0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafb2ffd640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafbc161900 0x7fafbc0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafb2ffd640 1 -- 172.21.15.96:0/3895683228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc0b7b30 con 0x7fafbc0b5510 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafbbfff640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafbc161900 0x7fafbc0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:08.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafb2ffd640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafbc0b5510 0x7fafbc0b75f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fafa400e9b0 tx=0x7fafa400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:08.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.095+0000 7fafb8ff9640 1 -- 172.21.15.96:0/3895683228 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4017070 con 0x7fafbc0b5510 2024-06-02T23:47:08.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.096+0000 7fafb8ff9640 1 -- 172.21.15.96:0/3895683228 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa400c9a0 con 0x7fafbc0b5510 2024-06-02T23:47:08.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.096+0000 7fafc21ed640 1 -- 172.21.15.96:0/3895683228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafbc0b7e00 con 0x7fafbc0b5510 2024-06-02T23:47:08.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.096+0000 7fafb8ff9640 1 -- 172.21.15.96:0/3895683228 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa400cd90 con 0x7fafbc0b5510 2024-06-02T23:47:08.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.096+0000 7fafc21ed640 1 -- 172.21.15.96:0/3895683228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafbc0b86a0 con 0x7fafbc0b5510 2024-06-02T23:47:08.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.096+0000 7fafc21ed640 1 -- 172.21.15.96:0/3895683228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafbc0683e0 con 0x7fafbc0b5510 2024-06-02T23:47:08.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.097+0000 7fafb8ff9640 1 -- 172.21.15.96:0/3895683228 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafa401a070 con 0x7fafbc0b5510 2024-06-02T23:47:08.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.097+0000 7fafb8ff9640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf9c06be60 0x7faf9c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.097+0000 7fafb8ff9640 1 -- 172.21.15.96:0/3895683228 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fafa408b2e0 con 0x7fafbc0b5510 2024-06-02T23:47:08.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.097+0000 7fafbb7fe640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf9c06be60 0x7faf9c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.098+0000 7fafbb7fe640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf9c06be60 0x7faf9c06e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fafac034000 tx=0x7fafac02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:08.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.102+0000 7fafb8ff9640 1 -- 172.21.15.96:0/3895683228 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fafa4059800 con 0x7fafbc0b5510 2024-06-02T23:47:08.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.312+0000 7fafc21ed640 1 -- 172.21.15.96:0/3895683228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafbc0d05e0 con 0x7fafbc0b5510 2024-06-02T23:47:08.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.312+0000 7fafb8ff9640 1 -- 172.21.15.96:0/3895683228 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7fafa4059100 con 0x7fafbc0b5510 2024-06-02T23:47:08.313 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:08.313 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:46:25.060503+0000","modified":"2024-06-02T23:46:44.137908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-02T23:47:08.313 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 8 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.314+0000 7fafc21ed640 1 -- 172.21.15.96:0/3895683228 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf9c06be60 msgr2=0x7faf9c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.314+0000 7fafc21ed640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf9c06be60 0x7faf9c06e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fafac034000 tx=0x7fafac02e000 comp rx=0 tx=0).stop 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.314+0000 7fafc21ed640 1 -- 172.21.15.96:0/3895683228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafbc0b5510 msgr2=0x7fafbc0b75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.314+0000 7fafc21ed640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafbc0b5510 0x7fafbc0b75f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fafa400e9b0 tx=0x7fafa400ee70 comp rx=0 tx=0).stop 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.314+0000 7fafc21ed640 1 -- 172.21.15.96:0/3895683228 shutdown_connections 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.314+0000 7fafc21ed640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafbc161900 0x7fafbc0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.314+0000 7fafc21ed640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7faf9c06be60 0x7faf9c06e320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.314+0000 7fafc21ed640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafbc0b5510 0x7fafbc0b75f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.314+0000 7fafc21ed640 1 --2- 172.21.15.96:0/3895683228 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafbc0b4fa0 0x7fafbc0cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.314+0000 7fafc21ed640 1 -- 172.21.15.96:0/3895683228 >> 172.21.15.96:0/3895683228 conn(0x7fafbc09d3b0 msgr2=0x7fafbc06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.315+0000 7fafc21ed640 1 -- 172.21.15.96:0/3895683228 shutdown_connections 2024-06-02T23:47:08.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.315+0000 7fafc21ed640 1 -- 172.21.15.96:0/3895683228 wait complete. 2024-06-02T23:47:08.326 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:47:08.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.425+0000 7fa17415a640 1 Processor -- start 2024-06-02T23:47:08.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.425+0000 7fa17415a640 1 -- start start 2024-06-02T23:47:08.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa17415a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c15c150 0x7fa16c0b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa17415a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa16c15c530 0x7fa16c0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa17415a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa16c06beb0 con 0x7fa16c0d0380 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa17415a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa16c06b3c0 con 0x7fa16c15c530 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa17415a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa16c0b00d0 con 0x7fa16c15c150 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa1726f7640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa16c0d0380 0x7fa16c0cccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46068/0 (socket says 172.21.15.96:46068) 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa1726f7640 1 -- 172.21.15.96:0/2946698193 learned_addr learned my addr 172.21.15.96:0/2946698193 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa171ef6640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c15c150 0x7fa16c0b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa1716f5640 1 --2- 172.21.15.96:0/2946698193 >> v2:172.21.15.162:3300/0 conn(0x7fa16c15c530 0x7fa16c0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235350050 0 0) 0x7fa16c06beb0 con 0x7fa16c0d0380 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa158003520 con 0x7fa16c0d0380 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 940213990 0 0) 0x7fa158003520 con 0x7fa16c0d0380 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c15c150 msgr2=0x7fa16c0b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa170ef4640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c15c150 0x7fa16c0b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 >> v2:172.21.15.162:3300/0 conn(0x7fa16c15c530 msgr2=0x7fa16c0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:08.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.426+0000 7fa170ef4640 1 --2- 172.21.15.96:0/2946698193 >> v2:172.21.15.162:3300/0 conn(0x7fa16c15c530 0x7fa16c0b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c06b610 con 0x7fa16c0d0380 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fa1640019f0 con 0x7fa16c0d0380 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 >> v1:172.21.15.96:6789/0 conn(0x7fa16c0d0380 legacy=0x7fa16c0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa170ef4640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1580039b0 0x7fa158003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa170ef4640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa158004800 0x7fa158004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa170ef4640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c15c150 0x7fa1580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c06b3c0 con 0x7fa158004800 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c0b00d0 con 0x7fa1580039b0 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa15800b9c0 con 0x7fa16c15c150 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa1716f5640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa158004800 0x7fa158004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa171ef6640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1580039b0 0x7fa158003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa1726f7640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c15c150 0x7fa1580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa1716f5640 1 -- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c15c150 msgr2=0x7fa1580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa1716f5640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c15c150 0x7fa1580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa1716f5640 1 -- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1580039b0 msgr2=0x7fa158003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa1716f5640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1580039b0 0x7fa158003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.427+0000 7fa1716f5640 1 -- 172.21.15.96:0/2946698193 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa158003520 con 0x7fa158004800 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa1716f5640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa158004800 0x7fa158004c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009af0 tx=0x7fa158005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3e6c682588a59c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c036070 con 0x7fa158004800 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa15c031400 con 0x7fa158004800 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa170ef4640 1 -- 172.21.15.96:0/2946698193 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c009690 con 0x7fa158004800 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa17415a640 1 -- 172.21.15.96:0/2946698193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa158004800 msgr2=0x7fa158004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa17415a640 1 --2- 172.21.15.96:0/2946698193 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa158004800 0x7fa158004c80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009af0 tx=0x7fa158005830 comp rx=0 tx=0).stop 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa1726f7640 1 -- 172.21.15.96:0/2946698193 reap_dead start 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa17415a640 1 -- 172.21.15.96:0/2946698193 shutdown_connections 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa17415a640 1 -- 172.21.15.96:0/2946698193 >> 172.21.15.96:0/2946698193 conn(0x7fa16c0b1f80 msgr2=0x7fa16c0b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa17415a640 1 -- 172.21.15.96:0/2946698193 shutdown_connections 2024-06-02T23:47:08.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.428+0000 7fa17415a640 1 -- 172.21.15.96:0/2946698193 wait complete. 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.430+0000 7fa17415a640 1 Processor -- start 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.430+0000 7fa17415a640 1 -- start start 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa17415a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa158004800 0x7fa16c0998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa17415a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c0ae5e0 0x7fa16c099110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa17415a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa16c155350 0x7fa16c1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa17415a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c0b18a0 con 0x7fa16c155350 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa17415a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c06bbd0 con 0x7fa158004800 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa17415a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa16c0b1a20 con 0x7fa16c0ae5e0 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1726f7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa16c155350 0x7fa16c1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1726f7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa16c155350 0x7fa16c1557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33612/0 (socket says 172.21.15.96:33612) 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1726f7640 1 -- 172.21.15.96:0/2098594011 learned_addr learned my addr 172.21.15.96:0/2098594011 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1716f5640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c0ae5e0 0x7fa16c099110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa171ef6640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa158004800 0x7fa16c0998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1726f7640 1 -- 172.21.15.96:0/2098594011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c0ae5e0 msgr2=0x7fa16c099110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1726f7640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c0ae5e0 0x7fa16c099110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1726f7640 1 -- 172.21.15.96:0/2098594011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa158004800 msgr2=0x7fa16c0998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1726f7640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa158004800 0x7fa16c0998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1726f7640 1 -- 172.21.15.96:0/2098594011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c15d9c0 con 0x7fa16c155350 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa171ef6640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa158004800 0x7fa16c0998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1726f7640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa16c155350 0x7fa16c1557d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0c3bd0 tx=0x7fa16400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1627fc640 1 -- 172.21.15.96:0/2098594011 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16400ec10 con 0x7fa16c155350 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1627fc640 1 -- 172.21.15.96:0/2098594011 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa164018070 con 0x7fa16c155350 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa1627fc640 1 -- 172.21.15.96:0/2098594011 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164013420 con 0x7fa16c155350 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa17415a640 1 -- 172.21.15.96:0/2098594011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa16c158080 con 0x7fa16c155350 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.431+0000 7fa17415a640 1 -- 172.21.15.96:0/2098594011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa16c158360 con 0x7fa16c155350 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.433+0000 7fa17415a640 1 -- 172.21.15.96:0/2098594011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa16c0683e0 con 0x7fa16c155350 2024-06-02T23:47:08.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.433+0000 7fa1627fc640 1 -- 172.21.15.96:0/2098594011 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1640135c0 con 0x7fa16c155350 2024-06-02T23:47:08.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.434+0000 7fa1627fc640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa15006be30 0x7fa15006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.434+0000 7fa1627fc640 1 -- 172.21.15.96:0/2098594011 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa16408b580 con 0x7fa16c155350 2024-06-02T23:47:08.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.434+0000 7fa171ef6640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa15006be30 0x7fa15006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.434+0000 7fa171ef6640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa15006be30 0x7fa15006e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa168006ce0 tx=0x7fa168008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:08.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.438+0000 7fa1627fc640 1 -- 172.21.15.96:0/2098594011 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa164059bc0 con 0x7fa16c155350 2024-06-02T23:47:08.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.614+0000 7fa17415a640 1 -- 172.21.15.96:0/2098594011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa16c06cf00 con 0x7fa16c155350 2024-06-02T23:47:08.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.615+0000 7fa1627fc640 1 -- 172.21.15.96:0/2098594011 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7fa1640594c0 con 0x7fa16c155350 2024-06-02T23:47:08.615 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:08.615 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:47:07.850047+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:47:08.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 -- 172.21.15.96:0/2098594011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa15006be30 msgr2=0x7fa15006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa15006be30 0x7fa15006e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa168006ce0 tx=0x7fa168008040 comp rx=0 tx=0).stop 2024-06-02T23:47:08.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 -- 172.21.15.96:0/2098594011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa16c155350 msgr2=0x7fa16c1557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa16c155350 0x7fa16c1557d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0c3bd0 tx=0x7fa16400e530 comp rx=0 tx=0).stop 2024-06-02T23:47:08.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 -- 172.21.15.96:0/2098594011 shutdown_connections 2024-06-02T23:47:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fa15006be30 0x7fa15006e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa16c155350 0x7fa16c1557d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa16c0ae5e0 0x7fa16c099110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 --2- 172.21.15.96:0/2098594011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa158004800 0x7fa16c0998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 -- 172.21.15.96:0/2098594011 >> 172.21.15.96:0/2098594011 conn(0x7fa16c0b1f80 msgr2=0x7fa16c0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 -- 172.21.15.96:0/2098594011 shutdown_connections 2024-06-02T23:47:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.617+0000 7fa17415a640 1 -- 172.21.15.96:0/2098594011 wait complete. 2024-06-02T23:47:08.628 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T23:47:08.628 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:47:08.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.726+0000 7f94c7c9e640 1 Processor -- start 2024-06-02T23:47:08.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.727+0000 7f94c7c9e640 1 -- start start 2024-06-02T23:47:08.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.727+0000 7f94c7c9e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94c00d1120 0x7f94c00c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.727+0000 7f94c7c9e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94c00d4a90 con 0x7f94c0161900 2024-06-02T23:47:08.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.727+0000 7f94c7c9e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94c00d4d70 con 0x7f94c00b5510 2024-06-02T23:47:08.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.727+0000 7f94c7c9e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f94c00cf5c0 con 0x7f94c00d1120 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c5a3a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f94c0161900 0x7f94c00d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46076/0 (socket says 172.21.15.96:46076) 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c5a3a640 1 -- 172.21.15.96:0/397340012 learned_addr learned my addr 172.21.15.96:0/397340012 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c5239640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94c00d1120 0x7f94c00c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94672729 0 0) 0x7f94c00d4a90 con 0x7f94c0161900 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94a8003520 con 0x7f94c0161900 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3390213731 0 0) 0x7f94a8003520 con 0x7f94c0161900 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94c00d1120 msgr2=0x7f94c00c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94c00d1120 0x7f94c00c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 >> v1:172.21.15.162:6789/0 conn(0x7f94c00b5510 legacy=0x7f94c00c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c00cf800 con 0x7f94c0161900 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f94b00019f0 con 0x7f94c0161900 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 >> v1:172.21.15.96:6789/0 conn(0x7f94c0161900 legacy=0x7f94c00d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94a80039e0 0x7f94a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94a8004390 0x7f94a8004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94c00d1120 0x7f94a8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f94c00cf5c0 con 0x7f94a80039e0 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94a800bad0 con 0x7f94a8004390 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f94a800bcd0 con 0x7f94c00d1120 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c5a3a640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94a80039e0 0x7f94a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c5239640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94a8004390 0x7f94a8004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.728+0000 7f94c623b640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94c00d1120 0x7f94a8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.729+0000 7f94c5a3a640 1 -- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94c00d1120 msgr2=0x7f94a8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.729+0000 7f94c5a3a640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94c00d1120 0x7f94a8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.729+0000 7f94c5a3a640 1 -- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94a8004390 msgr2=0x7f94a8004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.729+0000 7f94c5a3a640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94a8004390 0x7f94a8004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.729+0000 7f94c5a3a640 1 -- 172.21.15.96:0/397340012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a8003520 con 0x7f94a80039e0 2024-06-02T23:47:08.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.729+0000 7f94c5a3a640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94a80039e0 0x7f94a8003dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f94b000a880 tx=0x7f94a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8429f3b9ac0e804 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:08.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.729+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b000a4a0 con 0x7f94a80039e0 2024-06-02T23:47:08.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.729+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b002f070 con 0x7f94a80039e0 2024-06-02T23:47:08.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.729+0000 7f94c4a38640 1 -- 172.21.15.96:0/397340012 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b002bd00 con 0x7f94a80039e0 2024-06-02T23:47:08.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.730+0000 7f94c7c9e640 1 -- 172.21.15.96:0/397340012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94a80039e0 msgr2=0x7f94a8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.730+0000 7f94c7c9e640 1 --2- 172.21.15.96:0/397340012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94a80039e0 0x7f94a8003dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f94b000a880 tx=0x7f94a8005830 comp rx=0 tx=0).stop 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.730+0000 7f94c623b640 1 -- 172.21.15.96:0/397340012 reap_dead start 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.730+0000 7f94c7c9e640 1 -- 172.21.15.96:0/397340012 shutdown_connections 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.730+0000 7f94c7c9e640 1 -- 172.21.15.96:0/397340012 >> 172.21.15.96:0/397340012 conn(0x7f94c009d3b0 msgr2=0x7f94c00d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.730+0000 7f94c7c9e640 1 -- 172.21.15.96:0/397340012 shutdown_connections 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.730+0000 7f94c7c9e640 1 -- 172.21.15.96:0/397340012 wait complete. 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.731+0000 7f94c7c9e640 1 Processor -- start 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.731+0000 7f94c7c9e640 1 -- start start 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c7c9e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94a80039e0 0x7f94c0152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c7c9e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94c00cd080 0x7f94c00cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c7c9e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94c006d2e0 0x7f94c006d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c7c9e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f94c00d4780 con 0x7f94c006d2e0 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c7c9e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94c00caf70 con 0x7f94c00cd080 2024-06-02T23:47:08.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c7c9e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f94c0161ce0 con 0x7f94a80039e0 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c623b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94c006d2e0 0x7f94c006d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c623b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94c006d2e0 0x7f94c006d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33630/0 (socket says 172.21.15.96:33630) 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c623b640 1 -- 172.21.15.96:0/3957215322 learned_addr learned my addr 172.21.15.96:0/3957215322 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c623b640 1 -- 172.21.15.96:0/3957215322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94a80039e0 msgr2=0x7f94c0152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c623b640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94a80039e0 0x7f94c0152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c623b640 1 -- 172.21.15.96:0/3957215322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94c00cd080 msgr2=0x7f94c00cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c623b640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94c00cd080 0x7f94c00cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c623b640 1 -- 172.21.15.96:0/3957215322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c00cd5f0 con 0x7f94c006d2e0 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94c623b640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94c006d2e0 0x7f94c006d760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f94b800e370 tx=0x7f94b800e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.732+0000 7f94be7fc640 1 -- 172.21.15.96:0/3957215322 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8019070 con 0x7f94c006d2e0 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.733+0000 7f94be7fc640 1 -- 172.21.15.96:0/3957215322 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b80052e0 con 0x7f94c006d2e0 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.733+0000 7f94c7c9e640 1 -- 172.21.15.96:0/3957215322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c00b0ca0 con 0x7f94c006d2e0 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.733+0000 7f94be7fc640 1 -- 172.21.15.96:0/3957215322 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8005490 con 0x7f94c006d2e0 2024-06-02T23:47:08.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.733+0000 7f94c7c9e640 1 -- 172.21.15.96:0/3957215322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c00b1260 con 0x7f94c006d2e0 2024-06-02T23:47:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.734+0000 7f94c7c9e640 1 -- 172.21.15.96:0/3957215322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c00683e0 con 0x7f94c006d2e0 2024-06-02T23:47:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.734+0000 7f94be7fc640 1 -- 172.21.15.96:0/3957215322 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94b801c070 con 0x7f94c006d2e0 2024-06-02T23:47:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.735+0000 7f94be7fc640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f94ac06be30 0x7f94ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.735+0000 7f94be7fc640 1 -- 172.21.15.96:0/3957215322 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f94b808a790 con 0x7f94c006d2e0 2024-06-02T23:47:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.735+0000 7f94c5a3a640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f94ac06be30 0x7f94ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:08.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.735+0000 7f94c5a3a640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f94ac06be30 0x7f94ac06e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f94b0033000 tx=0x7f94b0007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:08.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.739+0000 7f94be7fc640 1 -- 172.21.15.96:0/3957215322 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f94b8058d40 con 0x7f94c006d2e0 2024-06-02T23:47:08.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.948+0000 7f94c7c9e640 1 -- 172.21.15.96:0/3957215322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94c00d05e0 con 0x7f94c006d2e0 2024-06-02T23:47:08.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.948+0000 7f94be7fc640 1 -- 172.21.15.96:0/3957215322 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f94b8058640 con 0x7f94c006d2e0 2024-06-02T23:47:08.948 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:08.949 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:46:25.060503+0000","modified":"2024-06-02T23:46:44.137908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-02T23:47:08.949 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 8 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 -- 172.21.15.96:0/3957215322 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f94ac06be30 msgr2=0x7f94ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f94ac06be30 0x7f94ac06e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f94b0033000 tx=0x7f94b0007000 comp rx=0 tx=0).stop 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 -- 172.21.15.96:0/3957215322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94c006d2e0 msgr2=0x7f94c006d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94c006d2e0 0x7f94c006d760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f94b800e370 tx=0x7f94b800e830 comp rx=0 tx=0).stop 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 -- 172.21.15.96:0/3957215322 shutdown_connections 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f94ac06be30 0x7f94ac06e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94c006d2e0 0x7f94c006d760 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94c00cd080 0x7f94c00cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 --2- 172.21.15.96:0/3957215322 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94a80039e0 0x7f94c0152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 -- 172.21.15.96:0/3957215322 >> 172.21.15.96:0/3957215322 conn(0x7f94c009d3b0 msgr2=0x7f94c006c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 -- 172.21.15.96:0/3957215322 shutdown_connections 2024-06-02T23:47:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:08.950+0000 7f94c7c9e640 1 -- 172.21.15.96:0/3957215322 wait complete. 2024-06-02T23:47:08.962 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:47:09.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.062+0000 7f4911714640 1 Processor -- start 2024-06-02T23:47:09.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.062+0000 7f4911714640 1 -- start start 2024-06-02T23:47:09.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f4911714640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0d1120 0x7f490c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f4911714640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f490c0b5510 0x7f490c0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f4911714640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490c0d4a90 con 0x7f490c161900 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f4911714640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f490c0cf5c0 con 0x7f490c0b5510 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f4911714640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f490c0caf70 con 0x7f490c0d1120 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490affd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f490c161900 0x7f490c0d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46086/0 (socket says 172.21.15.96:46086) 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490affd640 1 -- 172.21.15.96:0/1599883297 learned_addr learned my addr 172.21.15.96:0/1599883297 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1508377617 0 0) 0x7f490c0d4a90 con 0x7f490c161900 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48f8003520 con 0x7f490c161900 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f49027fc640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0d1120 0x7f490c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490b7fe640 1 --2- 172.21.15.96:0/1599883297 >> v2:172.21.15.162:3300/0 conn(0x7f490c0b5510 0x7f490c0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2419097766 0 0) 0x7f48f8003520 con 0x7f490c161900 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0d1120 msgr2=0x7f490c0c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:09.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0d1120 0x7f490c0c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 >> v2:172.21.15.162:3300/0 conn(0x7f490c0b5510 msgr2=0x7f490c0c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 --2- 172.21.15.96:0/1599883297 >> v2:172.21.15.162:3300/0 conn(0x7f490c0b5510 0x7f490c0c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490c0d4d70 con 0x7f490c161900 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f48fc001670 con 0x7f490c161900 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 >> v1:172.21.15.96:6789/0 conn(0x7f490c161900 legacy=0x7f490c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 0x7f48f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f8004800 0x7f48f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0d1120 0x7f48f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f490c0cf5c0 con 0x7f48f80039b0 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f490c0caf70 con 0x7f48f8004800 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48f800bb70 con 0x7f490c0d1120 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.063+0000 7f490affd640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 0x7f48f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.064+0000 7f49027fc640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f8004800 0x7f48f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.064+0000 7f490b7fe640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0d1120 0x7f48f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.064+0000 7f490affd640 1 -- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0d1120 msgr2=0x7f48f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.064+0000 7f490affd640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0d1120 0x7f48f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.064+0000 7f490affd640 1 -- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f8004800 msgr2=0x7f48f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.064+0000 7f490affd640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48f8004800 0x7f48f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.064+0000 7f490affd640 1 -- 172.21.15.96:0/1599883297 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f8003520 con 0x7f48f80039b0 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.064+0000 7f490affd640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 0x7f48f8003dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00c290 tx=0x7f48f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de8e9c294f31e2c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.065+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc007d50 con 0x7f48f80039b0 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.065+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48fc005af0 con 0x7f48f80039b0 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.065+0000 7f490a7fc640 1 -- 172.21.15.96:0/1599883297 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc007070 con 0x7f48f80039b0 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.065+0000 7f4911714640 1 -- 172.21.15.96:0/1599883297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 msgr2=0x7f48f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.065+0000 7f4911714640 1 --2- 172.21.15.96:0/1599883297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 0x7f48f8003dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00c290 tx=0x7f48f8005830 comp rx=0 tx=0).stop 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.065+0000 7f490b7fe640 1 -- 172.21.15.96:0/1599883297 reap_dead start 2024-06-02T23:47:09.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.065+0000 7f4911714640 1 -- 172.21.15.96:0/1599883297 shutdown_connections 2024-06-02T23:47:09.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.065+0000 7f4911714640 1 -- 172.21.15.96:0/1599883297 >> 172.21.15.96:0/1599883297 conn(0x7f490c09d3b0 msgr2=0x7f490c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:09.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.065+0000 7f4911714640 1 -- 172.21.15.96:0/1599883297 shutdown_connections 2024-06-02T23:47:09.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.065+0000 7f4911714640 1 -- 172.21.15.96:0/1599883297 wait complete. 2024-06-02T23:47:09.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.066+0000 7f4911714640 1 Processor -- start 2024-06-02T23:47:09.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f4911714640 1 -- start start 2024-06-02T23:47:09.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f4911714640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 0x7f490c0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f4911714640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0b9720 0x7f490c0b9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f4911714640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490c148c70 0x7f490c1490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f4911714640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f490c0d4780 con 0x7f48f80039b0 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f4911714640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f490c0cfae0 con 0x7f490c148c70 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f4911714640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f490c161ce0 con 0x7f490c0b9720 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f490affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 0x7f490c0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f490affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 0x7f490c0c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33658/0 (socket says 172.21.15.96:33658) 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f490affd640 1 -- 172.21.15.96:0/1701834617 learned_addr learned my addr 172.21.15.96:0/1701834617 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.067+0000 7f49027fc640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0b9720 0x7f490c0b9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f490b7fe640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490c148c70 0x7f490c1490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f490affd640 1 -- 172.21.15.96:0/1701834617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0b9720 msgr2=0x7f490c0b9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f490affd640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0b9720 0x7f490c0b9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f490affd640 1 -- 172.21.15.96:0/1701834617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490c148c70 msgr2=0x7f490c1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f490affd640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490c148c70 0x7f490c1490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f490affd640 1 -- 172.21.15.96:0/1701834617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490c0ca130 con 0x7f48f80039b0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f490affd640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 0x7f490c0c9bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f48fc001970 tx=0x7f490c0d4c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f4903fff640 1 -- 172.21.15.96:0/1701834617 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc042070 con 0x7f48f80039b0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f4903fff640 1 -- 172.21.15.96:0/1701834617 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48fc007480 con 0x7f48f80039b0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f4903fff640 1 -- 172.21.15.96:0/1701834617 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc001c80 con 0x7f48f80039b0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f4911714640 1 -- 172.21.15.96:0/1701834617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f490c0b8960 con 0x7f48f80039b0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.068+0000 7f4911714640 1 -- 172.21.15.96:0/1701834617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f490c0b8f20 con 0x7f48f80039b0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.069+0000 7f4911714640 1 -- 172.21.15.96:0/1701834617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f490c0683e0 con 0x7f48f80039b0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.069+0000 7f4903fff640 1 -- 172.21.15.96:0/1701834617 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48fc045070 con 0x7f48f80039b0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.070+0000 7f4903fff640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f48ec06be60 0x7f48ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.070+0000 7f4903fff640 1 -- 172.21.15.96:0/1701834617 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f48fc0abf30 con 0x7f48f80039b0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.070+0000 7f49027fc640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f48ec06be60 0x7f48ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.070+0000 7f49027fc640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f48ec06be60 0x7f48ec06e320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f490c161230 tx=0x7f48f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:09.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.074+0000 7f4903fff640 1 -- 172.21.15.96:0/1701834617 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f48fc005ac0 con 0x7f48f80039b0 2024-06-02T23:47:09.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.281+0000 7f4911714640 1 -- 172.21.15.96:0/1701834617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f490c0d0c50 con 0x7f48f80039b0 2024-06-02T23:47:09.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.281+0000 7f4903fff640 1 -- 172.21.15.96:0/1701834617 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5183 (secure 0 0 0) 0x7f48fc079e00 con 0x7f48f80039b0 2024-06-02T23:47:09.281 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:09.282 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3879058488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3879058488},{"type":"v1","addr":"172.21.15.162:6833","nonce":3879058488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/4071783948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":4071783948},{"type":"v1","addr":"172.21.15.162:6835","nonce":4071783948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/1005676342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":1005676342},{"type":"v1","addr":"172.21.15.96:6836","nonce":1005676342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:46:25.060503+0000","modified":"2024-06-02T23:46:44.137908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1720821828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1720821828},{"type":"v1","addr":"172.21.15.96:6837","nonce":1720821828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-06-02T23:47:09.282 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 8 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 -- 172.21.15.96:0/1701834617 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f48ec06be60 msgr2=0x7f48ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f48ec06be60 0x7f48ec06e320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f490c161230 tx=0x7f48f4008040 comp rx=0 tx=0).stop 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 -- 172.21.15.96:0/1701834617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 msgr2=0x7f490c0c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 0x7f490c0c9bf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f48fc001970 tx=0x7f490c0d4c60 comp rx=0 tx=0).stop 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 -- 172.21.15.96:0/1701834617 shutdown_connections 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490c148c70 0x7f490c1490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f490c0b9720 0x7f490c0b9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f48ec06be60 0x7f48ec06e320 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 --2- 172.21.15.96:0/1701834617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48f80039b0 0x7f490c0c9bf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 -- 172.21.15.96:0/1701834617 >> 172.21.15.96:0/1701834617 conn(0x7f490c09d3b0 msgr2=0x7f490c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 -- 172.21.15.96:0/1701834617 shutdown_connections 2024-06-02T23:47:09.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.283+0000 7f4911714640 1 -- 172.21.15.96:0/1701834617 wait complete. 2024-06-02T23:47:09.294 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:47:09.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.393+0000 7fd661bce640 1 Processor -- start 2024-06-02T23:47:09.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.394+0000 7fd661bce640 1 -- start start 2024-06-02T23:47:09.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.394+0000 7fd661bce640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd65c161900 0x7fd65c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.394+0000 7fd661bce640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd65c0b5510 0x7fd65c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.394+0000 7fd661bce640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd65c0d4a90 con 0x7fd65c0b4fa0 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.394+0000 7fd661bce640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd65c0cf5c0 con 0x7fd65c0b5510 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.394+0000 7fd661bce640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd65c0caf70 con 0x7fd65c161900 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.394+0000 7fd65affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd65c0b5510 0x7fd65c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.394+0000 7fd65bfff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd65c0b4fa0 0x7fd65c0d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46088/0 (socket says 172.21.15.96:46088) 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.394+0000 7fd65bfff640 1 -- 172.21.15.96:0/1183550740 learned_addr learned my addr 172.21.15.96:0/1183550740 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.394+0000 7fd65affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd65c0b5510 0x7fd65c0d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33664/0 (socket says 172.21.15.96:33664) 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.395+0000 7fd65affd640 1 -- 172.21.15.96:0/1183550740 >> v2:172.21.15.162:3300/0 conn(0x7fd65c161900 msgr2=0x7fd65c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.395+0000 7fd65b7fe640 1 --2- 172.21.15.96:0/1183550740 >> v2:172.21.15.162:3300/0 conn(0x7fd65c161900 0x7fd65c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.395+0000 7fd65a7fc640 1 -- 172.21.15.96:0/1183550740 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147238176 0 0) 0x7fd65c0d4a90 con 0x7fd65c0b4fa0 2024-06-02T23:47:09.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.395+0000 7fd65affd640 1 --2- 172.21.15.96:0/1183550740 >> v2:172.21.15.162:3300/0 conn(0x7fd65c161900 0x7fd65c0d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.395+0000 7fd65affd640 1 -- 172.21.15.96:0/1183550740 >> v1:172.21.15.96:6789/0 conn(0x7fd65c0b4fa0 legacy=0x7fd65c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.395+0000 7fd65affd640 1 -- 172.21.15.96:0/1183550740 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c0d4d70 con 0x7fd65c0b5510 2024-06-02T23:47:09.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.395+0000 7fd65b7fe640 1 --2- 172.21.15.96:0/1183550740 >> v2:172.21.15.162:3300/0 conn(0x7fd65c161900 0x7fd65c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:09.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd65affd640 1 --2- 172.21.15.96:0/1183550740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c0b5510 0x7fd65c0d0f50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0d1740 tx=0x7fd65002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96be0686d04a306 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:09.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd65a7fc640 1 -- 172.21.15.96:0/1183550740 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650037070 con 0x7fd65c0b5510 2024-06-02T23:47:09.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd65a7fc640 1 -- 172.21.15.96:0/1183550740 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650032440 con 0x7fd65c0b5510 2024-06-02T23:47:09.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd65a7fc640 1 -- 172.21.15.96:0/1183550740 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65002ae60 con 0x7fd65c0b5510 2024-06-02T23:47:09.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd661bce640 1 -- 172.21.15.96:0/1183550740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c0b5510 msgr2=0x7fd65c0d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd661bce640 1 --2- 172.21.15.96:0/1183550740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c0b5510 0x7fd65c0d0f50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0d1740 tx=0x7fd65002a110 comp rx=0 tx=0).stop 2024-06-02T23:47:09.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd661bce640 1 -- 172.21.15.96:0/1183550740 shutdown_connections 2024-06-02T23:47:09.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd661bce640 1 --2- 172.21.15.96:0/1183550740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c0b5510 0x7fd65c0d0f50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd661bce640 1 --2- 172.21.15.96:0/1183550740 >> v2:172.21.15.162:3300/0 conn(0x7fd65c161900 0x7fd65c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd661bce640 1 -- 172.21.15.96:0/1183550740 >> 172.21.15.96:0/1183550740 conn(0x7fd65c09d3b0 msgr2=0x7fd65c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:09.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd661bce640 1 -- 172.21.15.96:0/1183550740 shutdown_connections 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.396+0000 7fd661bce640 1 -- 172.21.15.96:0/1183550740 wait complete. 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.397+0000 7fd661bce640 1 Processor -- start 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.398+0000 7fd661bce640 1 -- start start 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.398+0000 7fd661bce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd65c0b4fa0 0x7fd65c1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.398+0000 7fd661bce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd65c0b5510 0x7fd65c0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.398+0000 7fd661bce640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c161900 0x7fd65c0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.398+0000 7fd661bce640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c0d4780 con 0x7fd65c161900 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.398+0000 7fd661bce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c0cfae0 con 0x7fd65c0b4fa0 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.398+0000 7fd661bce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd65c161ce0 con 0x7fd65c0b5510 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.398+0000 7fd65bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c161900 0x7fd65c0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.398+0000 7fd65bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c161900 0x7fd65c0cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33680/0 (socket says 172.21.15.96:33680) 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.398+0000 7fd65bfff640 1 -- 172.21.15.96:0/2915333414 learned_addr learned my addr 172.21.15.96:0/2915333414 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:09.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd65b7fe640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd65c0b4fa0 0x7fd65c1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd65affd640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd65c0b5510 0x7fd65c0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd65bfff640 1 -- 172.21.15.96:0/2915333414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd65c0b5510 msgr2=0x7fd65c0c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd65bfff640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd65c0b5510 0x7fd65c0c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd65bfff640 1 -- 172.21.15.96:0/2915333414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd65c0b4fa0 msgr2=0x7fd65c1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd65bfff640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd65c0b4fa0 0x7fd65c1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd65bfff640 1 -- 172.21.15.96:0/2915333414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c0ca130 con 0x7fd65c161900 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd65b7fe640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd65c0b4fa0 0x7fd65c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd65affd640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd65c0b5510 0x7fd65c0c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd65bfff640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c161900 0x7fd65c0cdd40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c450 tx=0x7fd65400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd643fff640 1 -- 172.21.15.96:0/2915333414 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654018070 con 0x7fd65c161900 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd643fff640 1 -- 172.21.15.96:0/2915333414 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd654007500 con 0x7fd65c161900 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd661bce640 1 -- 172.21.15.96:0/2915333414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65c155660 con 0x7fd65c161900 2024-06-02T23:47:09.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd643fff640 1 -- 172.21.15.96:0/2915333414 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654004a20 con 0x7fd65c161900 2024-06-02T23:47:09.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.399+0000 7fd661bce640 1 -- 172.21.15.96:0/2915333414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd65c0cd540 con 0x7fd65c161900 2024-06-02T23:47:09.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.400+0000 7fd661bce640 1 -- 172.21.15.96:0/2915333414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd65c0683e0 con 0x7fd65c161900 2024-06-02T23:47:09.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.400+0000 7fd643fff640 1 -- 172.21.15.96:0/2915333414 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd65401b070 con 0x7fd65c161900 2024-06-02T23:47:09.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.401+0000 7fd643fff640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd64806be30 0x7fd64806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.401+0000 7fd643fff640 1 -- 172.21.15.96:0/2915333414 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fd65408a4e0 con 0x7fd65c161900 2024-06-02T23:47:09.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.401+0000 7fd65b7fe640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd64806be30 0x7fd64806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.401+0000 7fd65b7fe640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd64806be30 0x7fd64806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd65c06ce40 tx=0x7fd64c0074b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:09.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.405+0000 7fd643fff640 1 -- 172.21.15.96:0/2915333414 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd65c0ca130 con 0x7fd65c161900 2024-06-02T23:47:09.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.581+0000 7fd661bce640 1 -- 172.21.15.96:0/2915333414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd65c0d4540 con 0x7fd65c161900 2024-06-02T23:47:09.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.582+0000 7fd643fff640 1 -- 172.21.15.96:0/2915333414 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18902 (secure 0 0 0) 0x7fd654058a90 con 0x7fd65c161900 2024-06-02T23:47:09.582 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:09.583 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:47:07.850047+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:46:22.850235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T23:46:24.030863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-02T23:46:27.744207+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:47:09.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 -- 172.21.15.96:0/2915333414 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd64806be30 msgr2=0x7fd64806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd64806be30 0x7fd64806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd65c06ce40 tx=0x7fd64c0074b0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 -- 172.21.15.96:0/2915333414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c161900 msgr2=0x7fd65c0cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c161900 0x7fd65c0cdd40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c450 tx=0x7fd65400c910 comp rx=0 tx=0).stop 2024-06-02T23:47:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 -- 172.21.15.96:0/2915333414 shutdown_connections 2024-06-02T23:47:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd64806be30 0x7fd64806e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd65c161900 0x7fd65c0cdd40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd65c0b5510 0x7fd65c0c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 --2- 172.21.15.96:0/2915333414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd65c0b4fa0 0x7fd65c1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 -- 172.21.15.96:0/2915333414 >> 172.21.15.96:0/2915333414 conn(0x7fd65c09d3b0 msgr2=0x7fd65c0d1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 -- 172.21.15.96:0/2915333414 shutdown_connections 2024-06-02T23:47:09.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.584+0000 7fd661bce640 1 -- 172.21.15.96:0/2915333414 wait complete. 2024-06-02T23:47:09.596 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-02T23:47:09.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.695+0000 7f75dc609640 1 Processor -- start 2024-06-02T23:47:09.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.695+0000 7f75dc609640 1 -- start start 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.696+0000 7f75dc609640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f75d40d1120 0x7f75d40c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.696+0000 7f75dc609640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f75d40b5510 0x7f75d40c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.696+0000 7f75dc609640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75d40d4a90 con 0x7f75d4161900 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.696+0000 7f75dc609640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f75d40cf5c0 con 0x7f75d40b5510 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.696+0000 7f75dc609640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f75d40caf70 con 0x7f75d40d1120 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.696+0000 7f75da3a5640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f75d4161900 0x7f75d40d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46102/0 (socket says 172.21.15.96:46102) 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.696+0000 7f75da3a5640 1 -- 172.21.15.96:0/3246648393 learned_addr learned my addr 172.21.15.96:0/3246648393 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.696+0000 7f75daba6640 1 --2- 172.21.15.96:0/3246648393 >> v2:172.21.15.96:3300/0 conn(0x7f75d40b5510 0x7f75d40c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.697+0000 7f75d9ba4640 1 --2- 172.21.15.96:0/3246648393 >> v2:172.21.15.162:3300/0 conn(0x7f75d40d1120 0x7f75d40c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.697+0000 7f75daba6640 1 -- 172.21.15.96:0/3246648393 >> v2:172.21.15.162:3300/0 conn(0x7f75d40d1120 msgr2=0x7f75d40c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.697+0000 7f75daba6640 1 --2- 172.21.15.96:0/3246648393 >> v2:172.21.15.162:3300/0 conn(0x7f75d40d1120 0x7f75d40c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.697+0000 7f75daba6640 1 -- 172.21.15.96:0/3246648393 >> v1:172.21.15.96:6789/0 conn(0x7f75d4161900 legacy=0x7f75d40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.697+0000 7f75daba6640 1 -- 172.21.15.96:0/3246648393 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d40d4d70 con 0x7f75d40b5510 2024-06-02T23:47:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.697+0000 7f75d93a3640 1 -- 172.21.15.96:0/3246648393 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880826703 0 0) 0x7f75d40d4a90 con 0x7f75d4161900 2024-06-02T23:47:09.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.697+0000 7f75d9ba4640 1 --2- 172.21.15.96:0/3246648393 >> v2:172.21.15.162:3300/0 conn(0x7f75d40d1120 0x7f75d40c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.697+0000 7f75daba6640 1 --2- 172.21.15.96:0/3246648393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40b5510 0x7f75d40c8100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f75d408cc80 tx=0x7f75cc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa68e870f180ada server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75d93a3640 1 -- 172.21.15.96:0/3246648393 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc007740 con 0x7f75d40b5510 2024-06-02T23:47:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75d93a3640 1 -- 172.21.15.96:0/3246648393 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75cc0078e0 con 0x7f75d40b5510 2024-06-02T23:47:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75d93a3640 1 -- 172.21.15.96:0/3246648393 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc007cb0 con 0x7f75d40b5510 2024-06-02T23:47:09.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75dc609640 1 -- 172.21.15.96:0/3246648393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40b5510 msgr2=0x7f75d40c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75dc609640 1 --2- 172.21.15.96:0/3246648393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40b5510 0x7f75d40c8100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f75d408cc80 tx=0x7f75cc02a5f0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75dc609640 1 -- 172.21.15.96:0/3246648393 shutdown_connections 2024-06-02T23:47:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75dc609640 1 --2- 172.21.15.96:0/3246648393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40b5510 0x7f75d40c8100 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75dc609640 1 --2- 172.21.15.96:0/3246648393 >> v2:172.21.15.162:3300/0 conn(0x7f75d40d1120 0x7f75d40c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75dc609640 1 -- 172.21.15.96:0/3246648393 >> 172.21.15.96:0/3246648393 conn(0x7f75d409d3b0 msgr2=0x7f75d40d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75dc609640 1 -- 172.21.15.96:0/3246648393 shutdown_connections 2024-06-02T23:47:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.698+0000 7f75dc609640 1 -- 172.21.15.96:0/3246648393 wait complete. 2024-06-02T23:47:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.699+0000 7f75dc609640 1 Processor -- start 2024-06-02T23:47:09.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.699+0000 7f75dc609640 1 -- start start 2024-06-02T23:47:09.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75dc609640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75d40b5510 0x7f75d415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75dc609640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40d1120 0x7f75d4155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75dc609640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75d4161900 0x7f75d41593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75dc609640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f75d40d4780 con 0x7f75d40d1120 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75dc609640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75d40cfae0 con 0x7f75d4161900 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75dc609640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75d4161ce0 con 0x7f75d40b5510 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75d9ba4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40d1120 0x7f75d4155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75d9ba4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40d1120 0x7f75d4155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33702/0 (socket says 172.21.15.96:33702) 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75d9ba4640 1 -- 172.21.15.96:0/3297549652 learned_addr learned my addr 172.21.15.96:0/3297549652 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75da3a5640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75d40b5510 0x7f75d415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75daba6640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75d4161900 0x7f75d41593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75d9ba4640 1 -- 172.21.15.96:0/3297549652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75d40b5510 msgr2=0x7f75d415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75d9ba4640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75d40b5510 0x7f75d415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75d9ba4640 1 -- 172.21.15.96:0/3297549652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75d4161900 msgr2=0x7f75d41593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75d9ba4640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75d4161900 0x7f75d41593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75d9ba4640 1 -- 172.21.15.96:0/3297549652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d40cb530 con 0x7f75d40d1120 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75da3a5640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75d40b5510 0x7f75d415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.700+0000 7f75daba6640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75d4161900 0x7f75d41593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.701+0000 7f75d9ba4640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40d1120 0x7f75d4155e70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c7f0 tx=0x7f75c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.701+0000 7f75caffd640 1 -- 172.21.15.96:0/3297549652 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4015070 con 0x7f75d40d1120 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.701+0000 7f75caffd640 1 -- 172.21.15.96:0/3297549652 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c4007a30 con 0x7f75d40d1120 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.701+0000 7f75dc609640 1 -- 172.21.15.96:0/3297549652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d40cb810 con 0x7f75d40d1120 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.701+0000 7f75caffd640 1 -- 172.21.15.96:0/3297549652 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4007e00 con 0x7f75d40d1120 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.701+0000 7f75dc609640 1 -- 172.21.15.96:0/3297549652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d415afa0 con 0x7f75d40d1120 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.702+0000 7f75dc609640 1 -- 172.21.15.96:0/3297549652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d40683e0 con 0x7f75d40d1120 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.702+0000 7f75caffd640 1 -- 172.21.15.96:0/3297549652 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75c4018070 con 0x7f75d40d1120 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.702+0000 7f75caffd640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f75b806be30 0x7f75b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.703+0000 7f75da3a5640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f75b806be30 0x7f75b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:09.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.703+0000 7f75caffd640 1 -- 172.21.15.96:0/3297549652 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f75c408b250 con 0x7f75d40d1120 2024-06-02T23:47:09.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.703+0000 7f75da3a5640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f75b806be30 0x7f75b806e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f75d0000f60 tx=0x7f75d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:09.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.707+0000 7f75caffd640 1 -- 172.21.15.96:0/3297549652 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f75c4059800 con 0x7f75d40d1120 2024-06-02T23:47:09.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.919+0000 7f75dc609640 1 -- 172.21.15.96:0/3297549652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f75d40d05e0 con 0x7f75d40d1120 2024-06-02T23:47:09.919 INFO:tasks.ceph.mon.a.smithi096.stderr:2024-06-02T23:47:09.919+0000 7f22ce064640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:47:09.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.920+0000 7f75caffd640 1 -- 172.21.15.96:0/3297549652 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f75c4059100 con 0x7f75d40d1120 2024-06-02T23:47:09.920 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-02T23:47:09.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 -- 172.21.15.96:0/3297549652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f75b806be30 msgr2=0x7f75b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f75b806be30 0x7f75b806e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f75d0000f60 tx=0x7f75d0009040 comp rx=0 tx=0).stop 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 -- 172.21.15.96:0/3297549652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40d1120 msgr2=0x7f75d4155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40d1120 0x7f75d4155e70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f75c400c7f0 tx=0x7f75c400cbf0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 -- 172.21.15.96:0/3297549652 shutdown_connections 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75d4161900 0x7f75d41593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f75b806be30 0x7f75b806e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75d40d1120 0x7f75d4155e70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 --2- 172.21.15.96:0/3297549652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75d40b5510 0x7f75d415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 -- 172.21.15.96:0/3297549652 >> 172.21.15.96:0/3297549652 conn(0x7f75d409d3b0 msgr2=0x7f75d406d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 -- 172.21.15.96:0/3297549652 shutdown_connections 2024-06-02T23:47:09.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:09.923+0000 7f75dc609640 1 -- 172.21.15.96:0/3297549652 wait complete. 2024-06-02T23:47:09.925 INFO:tasks.ceph.mds.c.smithi096.stderr: -3252> 2024-06-02T23:46:30.632+0000 7ff0b6f66640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T23:47:09.935 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-02T23:47:09.954 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2024-06-02T23:47:10.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.037+0000 7f6bba493640 1 Processor -- start 2024-06-02T23:47:10.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.037+0000 7f6bba493640 1 -- start start 2024-06-02T23:47:10.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.038+0000 7f6bba493640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6bb415e530 0x7f6bb40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:10.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.038+0000 7f6bba493640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb40723e0 con 0x7f6bb40cb2a0 2024-06-02T23:47:10.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.038+0000 7f6bba493640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb40cb7b0 con 0x7f6bb406ed20 2024-06-02T23:47:10.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.038+0000 7f6bba493640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb4072680 con 0x7f6bb415e530 2024-06-02T23:47:10.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.038+0000 7f6bb37fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f6bb40cb2a0 0x7f6bb406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46132/0 (socket says 172.21.15.96:46132) 2024-06-02T23:47:10.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.038+0000 7f6bb37fe640 1 -- 172.21.15.96:0/3370774180 learned_addr learned my addr 172.21.15.96:0/3370774180 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:10.039 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.038+0000 7f6bb3fff640 1 --2- 172.21.15.96:0/3370774180 >> v2:172.21.15.162:3300/0 conn(0x7f6bb415e530 0x7f6bb40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:10.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.039+0000 7f6bb2ffd640 1 -- 172.21.15.96:0/3370774180 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157588935 0 0) 0x7f6bb40723e0 con 0x7f6bb40cb2a0 2024-06-02T23:47:10.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.039+0000 7f6bb2ffd640 1 -- 172.21.15.96:0/3370774180 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b9c003520 con 0x7f6bb40cb2a0 2024-06-02T23:47:10.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.039+0000 7f6bb2ffd640 1 -- 172.21.15.96:0/3370774180 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992101275 0 0) 0x7f6bb40cb7b0 con 0x7f6bb406ed20 2024-06-02T23:47:10.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.039+0000 7f6bb2ffd640 1 -- 172.21.15.96:0/3370774180 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bb40723e0 con 0x7f6bb406ed20 2024-06-02T23:47:10.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.039+0000 7f6bb3fff640 1 -- 172.21.15.96:0/3370774180 >> v1:172.21.15.162:6789/0 conn(0x7f6bb406ed20 legacy=0x7f6bb40cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:10.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.039+0000 7f6bb3fff640 1 -- 172.21.15.96:0/3370774180 >> v1:172.21.15.96:6789/0 conn(0x7f6bb40cb2a0 legacy=0x7f6bb406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:10.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.039+0000 7f6bb3fff640 1 -- 172.21.15.96:0/3370774180 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb4072960 con 0x7f6bb415e530 2024-06-02T23:47:10.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.039+0000 7f6bb3fff640 1 --2- 172.21.15.96:0/3370774180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bb415e530 0x7f6bb40cad60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40097a0 tx=0x7f6ba402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c91620ec7357b4c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:10.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.040+0000 7f6bb2ffd640 1 -- 172.21.15.96:0/3370774180 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4037070 con 0x7f6bb415e530 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.040+0000 7f6bb2ffd640 1 -- 172.21.15.96:0/3370774180 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba4032440 con 0x7f6bb415e530 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.040+0000 7f6bb2ffd640 1 -- 172.21.15.96:0/3370774180 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba402ae60 con 0x7f6bb415e530 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.040+0000 7f6bba493640 1 -- 172.21.15.96:0/3370774180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bb415e530 msgr2=0x7f6bb40cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.040+0000 7f6bba493640 1 --2- 172.21.15.96:0/3370774180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bb415e530 0x7f6bb40cad60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40097a0 tx=0x7f6ba402a110 comp rx=0 tx=0).stop 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.040+0000 7f6bba493640 1 -- 172.21.15.96:0/3370774180 shutdown_connections 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.040+0000 7f6bba493640 1 --2- 172.21.15.96:0/3370774180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bb415e530 0x7f6bb40cad60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.040+0000 7f6bba493640 1 -- 172.21.15.96:0/3370774180 >> 172.21.15.96:0/3370774180 conn(0x7f6bb40cfcb0 msgr2=0x7f6bb40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.040+0000 7f6bba493640 1 -- 172.21.15.96:0/3370774180 shutdown_connections 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.040+0000 7f6bba493640 1 -- 172.21.15.96:0/3370774180 wait complete. 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.041+0000 7f6bba493640 1 Processor -- start 2024-06-02T23:47:10.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.042+0000 7f6bba493640 1 -- start start 2024-06-02T23:47:10.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.042+0000 7f6bba493640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bb406ed20 0x7f6bb414c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:10.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.042+0000 7f6bba493640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bb40cb2a0 0x7f6bb40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:10.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.042+0000 7f6bba493640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb415e530 0x7f6bb40b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.042+0000 7f6bba493640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb4073160 con 0x7f6bb415e530 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.042+0000 7f6bba493640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb415e910 con 0x7f6bb406ed20 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.042+0000 7f6bba493640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb406d120 con 0x7f6bb40cb2a0 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb8a30640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb415e530 0x7f6bb40b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb8a30640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb415e530 0x7f6bb40b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33738/0 (socket says 172.21.15.96:33738) 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bb406ed20 0x7f6bb414c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb8a30640 1 -- 172.21.15.96:0/651069029 learned_addr learned my addr 172.21.15.96:0/651069029 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb37fe640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bb40cb2a0 0x7f6bb40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb8a30640 1 -- 172.21.15.96:0/651069029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bb40cb2a0 msgr2=0x7f6bb40b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb8a30640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bb40cb2a0 0x7f6bb40b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb8a30640 1 -- 172.21.15.96:0/651069029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bb406ed20 msgr2=0x7f6bb414c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb8a30640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bb406ed20 0x7f6bb414c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:10.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb8a30640 1 -- 172.21.15.96:0/651069029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb40c3980 con 0x7f6bb415e530 2024-06-02T23:47:10.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb8a30640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb415e530 0x7f6bb40b07c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c6e0 tx=0x7f6bac00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:10.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb0ff9640 1 -- 172.21.15.96:0/651069029 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac003b70 con 0x7f6bb415e530 2024-06-02T23:47:10.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb0ff9640 1 -- 172.21.15.96:0/651069029 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac003d10 con 0x7f6bb415e530 2024-06-02T23:47:10.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bb0ff9640 1 -- 172.21.15.96:0/651069029 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0052d0 con 0x7f6bb415e530 2024-06-02T23:47:10.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bba493640 1 -- 172.21.15.96:0/651069029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb40c3c60 con 0x7f6bb415e530 2024-06-02T23:47:10.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.043+0000 7f6bba493640 1 -- 172.21.15.96:0/651069029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb40c4220 con 0x7f6bb415e530 2024-06-02T23:47:10.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.044+0000 7f6bba493640 1 -- 172.21.15.96:0/651069029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb40683e0 con 0x7f6bb415e530 2024-06-02T23:47:10.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.045+0000 7f6bb0ff9640 1 -- 172.21.15.96:0/651069029 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bac005470 con 0x7f6bb415e530 2024-06-02T23:47:10.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.045+0000 7f6bb0ff9640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6ba006be30 0x7f6ba006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:10.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.045+0000 7f6bb0ff9640 1 -- 172.21.15.96:0/651069029 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7f6bac08b060 con 0x7f6bb415e530 2024-06-02T23:47:10.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.045+0000 7f6bb3fff640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6ba006be30 0x7f6ba006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:10.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.046+0000 7f6bb3fff640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6ba006be30 0x7f6ba006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4034000 tx=0x7f6ba402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:10.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.049+0000 7f6bb0ff9640 1 -- 172.21.15.96:0/651069029 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6bac058f60 con 0x7f6bb415e530 2024-06-02T23:47:10.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.264+0000 7f6bba493640 1 -- 172.21.15.96:0/651069029 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6bb40721c0 con 0x7f6bb415e530 2024-06-02T23:47:10.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.925+0000 7f6bb0ff9640 1 -- 172.21.15.96:0/651069029 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f6bac05d260 con 0x7f6bb415e530 2024-06-02T23:47:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 -- 172.21.15.96:0/651069029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6ba006be30 msgr2=0x7f6ba006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6ba006be30 0x7f6ba006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4034000 tx=0x7f6ba402e000 comp rx=0 tx=0).stop 2024-06-02T23:47:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 -- 172.21.15.96:0/651069029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb415e530 msgr2=0x7f6bb40b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb415e530 0x7f6bb40b07c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c6e0 tx=0x7f6bac00cba0 comp rx=0 tx=0).stop 2024-06-02T23:47:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 -- 172.21.15.96:0/651069029 shutdown_connections 2024-06-02T23:47:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f6ba006be30 0x7f6ba006e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bb415e530 0x7f6bb40b07c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:10.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bb40cb2a0 0x7f6bb40b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:10.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 --2- 172.21.15.96:0/651069029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bb406ed20 0x7f6bb414c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:10.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 -- 172.21.15.96:0/651069029 >> 172.21.15.96:0/651069029 conn(0x7f6bb40cfcb0 msgr2=0x7f6bb40c7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:10.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 -- 172.21.15.96:0/651069029 shutdown_connections 2024-06-02T23:47:10.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:10.928+0000 7f6bba493640 1 -- 172.21.15.96:0/651069029 wait complete. 2024-06-02T23:47:10.941 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-02T23:47:11.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.090+0000 7f4b9b9f9640 1 Processor -- start 2024-06-02T23:47:11.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.090+0000 7f4b9b9f9640 1 -- start start 2024-06-02T23:47:11.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.091+0000 7f4b9b9f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b940cc480 0x7f4b9406e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:11.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.091+0000 7f4b9b9f9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b940af400 con 0x7f4b94071850 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.091+0000 7f4b9b9f9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9415e850 con 0x7f4b9415e470 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.091+0000 7f4b9b9f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4b940cc990 con 0x7f4b940cc480 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.091+0000 7f4b99f96640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4b94071850 0x7f4b940ce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:46134/0 (socket says 172.21.15.96:46134) 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.091+0000 7f4b99f96640 1 -- 172.21.15.96:0/452600532 learned_addr learned my addr 172.21.15.96:0/452600532 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.091+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288451347 0 0) 0x7f4b8c001490 con 0x7f4b94071850 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.091+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b80003520 con 0x7f4b94071850 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.091+0000 7f4b98f94640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b940cc480 0x7f4b9406e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2894326101 0 0) 0x7f4b80003520 con 0x7f4b94071850 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b940cc480 msgr2=0x7f4b9406e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b940cc480 0x7f4b9406e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 >> v1:172.21.15.162:6789/0 conn(0x7f4b9415e470 legacy=0x7f4b940cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:11.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b940ccc70 con 0x7f4b94071850 2024-06-02T23:47:11.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f4b8c001bc0 con 0x7f4b94071850 2024-06-02T23:47:11.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 >> v1:172.21.15.96:6789/0 conn(0x7f4b94071850 legacy=0x7f4b940ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:11.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b800039e0 0x7f4b80003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:11.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b940cc480 0x7f4b80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:11.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b80004d40 0x7f4b800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:11.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4b940cc990 con 0x7f4b80004d40 2024-06-02T23:47:11.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8000baa0 con 0x7f4b800039e0 2024-06-02T23:47:11.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4b8000deb0 con 0x7f4b940cc480 2024-06-02T23:47:11.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b99f96640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b80004d40 0x7f4b800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:11.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b98f94640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b940cc480 0x7f4b80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b99795640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b800039e0 0x7f4b80003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b99f96640 1 -- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b940cc480 msgr2=0x7f4b80004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b99f96640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b940cc480 0x7f4b80004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b99f96640 1 -- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b800039e0 msgr2=0x7f4b80003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b99f96640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b800039e0 0x7f4b80003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.092+0000 7f4b99f96640 1 -- 172.21.15.96:0/452600532 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b80003520 con 0x7f4b80004d40 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b99f96640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b80004d40 0x7f4b800051c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4b94071ca0 tx=0x7f4b80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a638aa2d0b78efb3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c00a640 con 0x7f4b80004d40 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8c02f070 con 0x7f4b80004d40 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b8bfff640 1 -- 172.21.15.96:0/452600532 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c02be40 con 0x7f4b80004d40 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/452600532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b80004d40 msgr2=0x7f4b800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b9b9f9640 1 --2- 172.21.15.96:0/452600532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b80004d40 0x7f4b800051c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4b94071ca0 tx=0x7f4b80005830 comp rx=0 tx=0).stop 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b99f96640 1 -- 172.21.15.96:0/452600532 reap_dead start 2024-06-02T23:47:11.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/452600532 shutdown_connections 2024-06-02T23:47:11.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/452600532 >> 172.21.15.96:0/452600532 conn(0x7f4b940b1a40 msgr2=0x7f4b940b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:11.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/452600532 shutdown_connections 2024-06-02T23:47:11.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.093+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/452600532 wait complete. 2024-06-02T23:47:11.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b9b9f9640 1 Processor -- start 2024-06-02T23:47:11.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b9b9f9640 1 -- start start 2024-06-02T23:47:11.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b9b9f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b80004d40 0x7f4b9409b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:11.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b9b9f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b940b4080 0x7f4b941f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:11.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b9b9f9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b94157d90 0x7f4b9409ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:11.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b9b9f9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4b940cd510 con 0x7f4b94157d90 2024-06-02T23:47:11.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b9b9f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b940cd230 con 0x7f4b940b4080 2024-06-02T23:47:11.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b9b9f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4b940ced30 con 0x7f4b80004d40 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b99f96640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b94157d90 0x7f4b9409ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b99f96640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b94157d90 0x7f4b9409ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33756/0 (socket says 172.21.15.96:33756) 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.095+0000 7f4b99f96640 1 -- 172.21.15.96:0/2639319552 learned_addr learned my addr 172.21.15.96:0/2639319552 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b99795640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b80004d40 0x7f4b9409b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b98f94640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b940b4080 0x7f4b941f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b99f96640 1 -- 172.21.15.96:0/2639319552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b80004d40 msgr2=0x7f4b9409b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b99f96640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b80004d40 0x7f4b9409b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b99f96640 1 -- 172.21.15.96:0/2639319552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b940b4080 msgr2=0x7f4b941f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b99f96640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b940b4080 0x7f4b941f4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b99f96640 1 -- 172.21.15.96:0/2639319552 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b940b4640 con 0x7f4b94157d90 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b99795640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b80004d40 0x7f4b9409b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b98f94640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b940b4080 0x7f4b941f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:11.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b99f96640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b94157d90 0x7f4b9409ce70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00aae0 tx=0x7f4b940cdd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b89ffb640 1 -- 172.21.15.96:0/2639319552 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c00a640 con 0x7f4b94157d90 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b89ffb640 1 -- 172.21.15.96:0/2639319552 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8c001bf0 con 0x7f4b94157d90 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b89ffb640 1 -- 172.21.15.96:0/2639319552 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c034a80 con 0x7f4b94157d90 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/2639319552 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b940b4920 con 0x7f4b94157d90 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.096+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/2639319552 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b940b4ee0 con 0x7f4b94157d90 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.097+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/2639319552 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b940683e0 con 0x7f4b94157d90 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.098+0000 7f4b89ffb640 1 -- 172.21.15.96:0/2639319552 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b8c02bd10 con 0x7f4b94157d90 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.098+0000 7f4b89ffb640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4b7806be30 0x7f4b7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.098+0000 7f4b99795640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4b7806be30 0x7f4b7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.098+0000 7f4b89ffb640 1 -- 172.21.15.96:0/2639319552 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6821+0+0 (secure 0 0 0) 0x7f4b8c0aaf40 con 0x7f4b94157d90 2024-06-02T23:47:11.101 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.099+0000 7f4b99795640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4b7806be30 0x7f4b7806e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b900035f0 tx=0x7f4b90009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:11.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.103+0000 7f4b89ffb640 1 -- 172.21.15.96:0/2639319552 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4b8c047030 con 0x7f4b94157d90 2024-06-02T23:47:11.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.279+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/2639319552 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4b940cdf90 con 0x7f4b94157d90 2024-06-02T23:47:11.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.929+0000 7f4b89ffb640 1 -- 172.21.15.96:0/2639319552 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f4b940af400 con 0x7f4b94157d90 2024-06-02T23:47:11.929 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2024-06-02T23:47:11.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/2639319552 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4b7806be30 msgr2=0x7f4b7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4b7806be30 0x7f4b7806e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b900035f0 tx=0x7f4b90009040 comp rx=0 tx=0).stop 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/2639319552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b94157d90 msgr2=0x7f4b9409ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b94157d90 0x7f4b9409ce70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00aae0 tx=0x7f4b940cdd30 comp rx=0 tx=0).stop 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/2639319552 shutdown_connections 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f4b7806be30 0x7f4b7806e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b94157d90 0x7f4b9409ce70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b940b4080 0x7f4b941f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 --2- 172.21.15.96:0/2639319552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b80004d40 0x7f4b9409b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/2639319552 >> 172.21.15.96:0/2639319552 conn(0x7f4b940b1a40 msgr2=0x7f4b940af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/2639319552 shutdown_connections 2024-06-02T23:47:11.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:11.931+0000 7f4b9b9f9640 1 -- 172.21.15.96:0/2639319552 wait complete. 2024-06-02T23:47:11.946 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-02T23:47:12.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.053+0000 7f3a31bc1640 1 Processor -- start 2024-06-02T23:47:12.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.053+0000 7f3a31bc1640 1 -- start start 2024-06-02T23:47:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a31bc1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3a2c15e470 0x7f3a2c0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a31bc1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 0x7f3a2c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a31bc1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2c0af400 con 0x7f3a2c0cc480 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a31bc1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2c15e850 con 0x7f3a2c15e470 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a31bc1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c0cc990 con 0x7f3a2c06e7b0 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a2b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3a2c15e470 0x7f3a2c0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a2b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3a2c15e470 0x7f3a2c0cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33762/0 (socket says 172.21.15.96:33762) 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a2b7fe640 1 -- 172.21.15.96:0/11785965 learned_addr learned my addr 172.21.15.96:0/11785965 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a2bfff640 1 --2- 172.21.15.96:0/11785965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 0x7f3a2c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a2b7fe640 1 -- 172.21.15.96:0/11785965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 msgr2=0x7f3a2c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a2b7fe640 1 --2- 172.21.15.96:0/11785965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 0x7f3a2c0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a2b7fe640 1 -- 172.21.15.96:0/11785965 >> v1:172.21.15.162:6789/0 conn(0x7f3a2c0cc480 legacy=0x7f3a2c06e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.054+0000 7f3a2b7fe640 1 -- 172.21.15.96:0/11785965 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c0ccc70 con 0x7f3a2c15e470 2024-06-02T23:47:12.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.055+0000 7f3a2b7fe640 1 --2- 172.21.15.96:0/11785965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c15e470 0x7f3a2c0cb370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009870 tx=0x7f3a1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462176f7e58e5893 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:12.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.055+0000 7f3a2a7fc640 1 -- 172.21.15.96:0/11785965 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c037070 con 0x7f3a2c15e470 2024-06-02T23:47:12.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.055+0000 7f3a2a7fc640 1 -- 172.21.15.96:0/11785965 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c032440 con 0x7f3a2c15e470 2024-06-02T23:47:12.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.055+0000 7f3a2a7fc640 1 -- 172.21.15.96:0/11785965 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c032810 con 0x7f3a2c15e470 2024-06-02T23:47:12.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.056+0000 7f3a31bc1640 1 -- 172.21.15.96:0/11785965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c15e470 msgr2=0x7f3a2c0cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:12.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.056+0000 7f3a31bc1640 1 --2- 172.21.15.96:0/11785965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c15e470 0x7f3a2c0cb370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009870 tx=0x7f3a1c02a270 comp rx=0 tx=0).stop 2024-06-02T23:47:12.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.056+0000 7f3a31bc1640 1 -- 172.21.15.96:0/11785965 shutdown_connections 2024-06-02T23:47:12.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.056+0000 7f3a31bc1640 1 --2- 172.21.15.96:0/11785965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 0x7f3a2c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:12.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.056+0000 7f3a31bc1640 1 --2- 172.21.15.96:0/11785965 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c15e470 0x7f3a2c0cb370 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:12.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.056+0000 7f3a31bc1640 1 -- 172.21.15.96:0/11785965 >> 172.21.15.96:0/11785965 conn(0x7f3a2c0b1a40 msgr2=0x7f3a2c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:12.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.056+0000 7f3a31bc1640 1 -- 172.21.15.96:0/11785965 shutdown_connections 2024-06-02T23:47:12.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.056+0000 7f3a31bc1640 1 -- 172.21.15.96:0/11785965 wait complete. 2024-06-02T23:47:12.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.057+0000 7f3a31bc1640 1 Processor -- start 2024-06-02T23:47:12.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.057+0000 7f3a31bc1640 1 -- start start 2024-06-02T23:47:12.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a31bc1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 0x7f3a2c15ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:12.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a31bc1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c0cc480 0x7f3a2c148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:12.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a31bc1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c15e470 0x7f3a2c1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:12.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a31bc1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0cd510 con 0x7f3a2c0cc480 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a31bc1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0cd230 con 0x7f3a2c15e470 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a31bc1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c0cb8b0 con 0x7f3a2c06e7b0 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c0cc480 0x7f3a2c148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c0cc480 0x7f3a2c148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33776/0 (socket says 172.21.15.96:33776) 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2affd640 1 -- 172.21.15.96:0/2369056236 learned_addr learned my addr 172.21.15.96:0/2369056236 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2b7fe640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 0x7f3a2c15ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2bfff640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c15e470 0x7f3a2c1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2affd640 1 -- 172.21.15.96:0/2369056236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 msgr2=0x7f3a2c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2affd640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 0x7f3a2c15ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2affd640 1 -- 172.21.15.96:0/2369056236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c15e470 msgr2=0x7f3a2c1488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2affd640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c15e470 0x7f3a2c1488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2affd640 1 -- 172.21.15.96:0/2369056236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c1f32f0 con 0x7f3a2c0cc480 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2b7fe640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 0x7f3a2c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.058+0000 7f3a2affd640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c0cc480 0x7f3a2c148370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c430 tx=0x7f3a2000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:12.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.059+0000 7f3a13fff640 1 -- 172.21.15.96:0/2369056236 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20017070 con 0x7f3a2c0cc480 2024-06-02T23:47:12.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.059+0000 7f3a13fff640 1 -- 172.21.15.96:0/2369056236 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a200052d0 con 0x7f3a2c0cc480 2024-06-02T23:47:12.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.059+0000 7f3a31bc1640 1 -- 172.21.15.96:0/2369056236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2c1f2530 con 0x7f3a2c0cc480 2024-06-02T23:47:12.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.059+0000 7f3a13fff640 1 -- 172.21.15.96:0/2369056236 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20003850 con 0x7f3a2c0cc480 2024-06-02T23:47:12.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.059+0000 7f3a31bc1640 1 -- 172.21.15.96:0/2369056236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2c1f2af0 con 0x7f3a2c0cc480 2024-06-02T23:47:12.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.060+0000 7f3a31bc1640 1 -- 172.21.15.96:0/2369056236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2c067cc0 con 0x7f3a2c0cc480 2024-06-02T23:47:12.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.060+0000 7f3a13fff640 1 -- 172.21.15.96:0/2369056236 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a2001a070 con 0x7f3a2c0cc480 2024-06-02T23:47:12.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.061+0000 7f3a13fff640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3a1806be30 0x7f3a1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:12.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.061+0000 7f3a2b7fe640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3a1806be30 0x7f3a1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:12.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.061+0000 7f3a13fff640 1 -- 172.21.15.96:0/2369056236 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6383+0+0 (secure 0 0 0) 0x7f3a2008a430 con 0x7f3a2c0cc480 2024-06-02T23:47:12.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.061+0000 7f3a2b7fe640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3a1806be30 0x7f3a1806e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c034000 tx=0x7f3a1c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:12.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.065+0000 7f3a13fff640 1 -- 172.21.15.96:0/2369056236 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3a2c067cc0 con 0x7f3a2c0cc480 2024-06-02T23:47:12.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.240+0000 7f3a31bc1640 1 -- 172.21.15.96:0/2369056236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3a2c0cdf90 con 0x7f3a2c0cc480 2024-06-02T23:47:12.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.934+0000 7f3a13fff640 1 -- 172.21.15.96:0/2369056236 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f3a2c0af400 con 0x7f3a2c0cc480 2024-06-02T23:47:12.934 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2024-06-02T23:47:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.938+0000 7f3a31bc1640 1 -- 172.21.15.96:0/2369056236 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3a1806be30 msgr2=0x7f3a1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.938+0000 7f3a31bc1640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3a1806be30 0x7f3a1806e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c034000 tx=0x7f3a1c02e000 comp rx=0 tx=0).stop 2024-06-02T23:47:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.938+0000 7f3a31bc1640 1 -- 172.21.15.96:0/2369056236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c0cc480 msgr2=0x7f3a2c148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.938+0000 7f3a31bc1640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c0cc480 0x7f3a2c148370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3a2000c430 tx=0x7f3a2000c8f0 comp rx=0 tx=0).stop 2024-06-02T23:47:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.938+0000 7f3a31bc1640 1 -- 172.21.15.96:0/2369056236 shutdown_connections 2024-06-02T23:47:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.938+0000 7f3a31bc1640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c15e470 0x7f3a2c1488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.938+0000 7f3a31bc1640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3a1806be30 0x7f3a1806e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.938+0000 7f3a31bc1640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a2c0cc480 0x7f3a2c148370 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.938+0000 7f3a31bc1640 1 --2- 172.21.15.96:0/2369056236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a2c06e7b0 0x7f3a2c15ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.938+0000 7f3a31bc1640 1 -- 172.21.15.96:0/2369056236 >> 172.21.15.96:0/2369056236 conn(0x7f3a2c0b1a40 msgr2=0x7f3a2c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.939+0000 7f3a31bc1640 1 -- 172.21.15.96:0/2369056236 shutdown_connections 2024-06-02T23:47:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:12.939+0000 7f3a31bc1640 1 -- 172.21.15.96:0/2369056236 wait complete. 2024-06-02T23:47:12.953 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-06-02T23:47:13.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.062+0000 7f70eea12640 1 Processor -- start 2024-06-02T23:47:13.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.062+0000 7f70eea12640 1 -- start start 2024-06-02T23:47:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.063+0000 7f70eea12640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f70e806d970 0x7f70e80cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.063+0000 7f70eea12640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80caad0 0x7f70e80ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.063+0000 7f70eea12640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e806de10 con 0x7f70e80af250 2024-06-02T23:47:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.063+0000 7f70eea12640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f70e806e0f0 con 0x7f70e806d970 2024-06-02T23:47:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.063+0000 7f70eea12640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f70e806e3d0 con 0x7f70e80caad0 2024-06-02T23:47:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.063+0000 7f70e77fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f70e806d970 0x7f70e80cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.063+0000 7f70e7fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f70e80af250 0x7f70e80ca3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:57626/0 (socket says 172.21.15.96:57626) 2024-06-02T23:47:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.063+0000 7f70e7fff640 1 -- 172.21.15.96:0/2117900697 learned_addr learned my addr 172.21.15.96:0/2117900697 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.064+0000 7f70ecfaf640 1 --2- 172.21.15.96:0/2117900697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80caad0 0x7f70e80ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:13.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.064+0000 7f70e77fe640 1 -- 172.21.15.96:0/2117900697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80caad0 msgr2=0x7f70e80ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:13.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.064+0000 7f70e77fe640 1 --2- 172.21.15.96:0/2117900697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80caad0 0x7f70e80ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:13.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.064+0000 7f70e77fe640 1 -- 172.21.15.96:0/2117900697 >> v1:172.21.15.96:6789/0 conn(0x7f70e80af250 legacy=0x7f70e80ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:13.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.064+0000 7f70e6ffd640 1 -- 172.21.15.96:0/2117900697 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 827255261 0 0) 0x7f70e806de10 con 0x7f70e80af250 2024-06-02T23:47:13.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.064+0000 7f70e77fe640 1 -- 172.21.15.96:0/2117900697 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e806e6b0 con 0x7f70e806d970 2024-06-02T23:47:13.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.064+0000 7f70ecfaf640 1 --2- 172.21.15.96:0/2117900697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80caad0 0x7f70e80ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.064+0000 7f70e77fe640 1 --2- 172.21.15.96:0/2117900697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e806d970 0x7f70e80cdc20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0097a0 tx=0x7f70dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b087beb4fdd68196 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70e6ffd640 1 -- 172.21.15.96:0/2117900697 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc037070 con 0x7f70e806d970 2024-06-02T23:47:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70e6ffd640 1 -- 172.21.15.96:0/2117900697 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70dc032440 con 0x7f70e806d970 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70e6ffd640 1 -- 172.21.15.96:0/2117900697 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70dc032810 con 0x7f70e806d970 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70eea12640 1 -- 172.21.15.96:0/2117900697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e806d970 msgr2=0x7f70e80cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70eea12640 1 --2- 172.21.15.96:0/2117900697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e806d970 0x7f70e80cdc20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0097a0 tx=0x7f70dc02a180 comp rx=0 tx=0).stop 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70eea12640 1 -- 172.21.15.96:0/2117900697 shutdown_connections 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70eea12640 1 --2- 172.21.15.96:0/2117900697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80caad0 0x7f70e80ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70eea12640 1 --2- 172.21.15.96:0/2117900697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e806d970 0x7f70e80cdc20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70eea12640 1 -- 172.21.15.96:0/2117900697 >> 172.21.15.96:0/2117900697 conn(0x7f70e80b1a40 msgr2=0x7f70e80b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70eea12640 1 -- 172.21.15.96:0/2117900697 shutdown_connections 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.065+0000 7f70eea12640 1 -- 172.21.15.96:0/2117900697 wait complete. 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.066+0000 7f70eea12640 1 Processor -- start 2024-06-02T23:47:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.066+0000 7f70eea12640 1 -- start start 2024-06-02T23:47:13.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.067+0000 7f70eea12640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70e806d970 0x7f70e8159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.067+0000 7f70eea12640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80af250 0x7f70e815e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.067+0000 7f70eea12640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e80caad0 0x7f70e8071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.067+0000 7f70eea12640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f70e80af7b0 con 0x7f70e80caad0 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.067+0000 7f70eea12640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f70e80af630 con 0x7f70e806d970 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.067+0000 7f70eea12640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f70e8143fa0 con 0x7f70e80af250 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.067+0000 7f70ecfaf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e80caad0 0x7f70e8071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.067+0000 7f70ecfaf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e80caad0 0x7f70e8071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38764/0 (socket says 172.21.15.96:38764) 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.067+0000 7f70ecfaf640 1 -- 172.21.15.96:0/428832318 learned_addr learned my addr 172.21.15.96:0/428832318 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70e77fe640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80af250 0x7f70e815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70e7fff640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70e806d970 0x7f70e8159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70ecfaf640 1 -- 172.21.15.96:0/428832318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80af250 msgr2=0x7f70e815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70ecfaf640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80af250 0x7f70e815e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70ecfaf640 1 -- 172.21.15.96:0/428832318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70e806d970 msgr2=0x7f70e8159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70ecfaf640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70e806d970 0x7f70e8159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70ecfaf640 1 -- 172.21.15.96:0/428832318 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e813f550 con 0x7f70e80caad0 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70e77fe640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80af250 0x7f70e815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70e7fff640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70e806d970 0x7f70e8159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70ecfaf640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e80caad0 0x7f70e8071490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f70e000ce90 tx=0x7f70e000e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70e4ff9640 1 -- 172.21.15.96:0/428832318 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e000c2e0 con 0x7f70e80caad0 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70e4ff9640 1 -- 172.21.15.96:0/428832318 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e000ebd0 con 0x7f70e80caad0 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70e4ff9640 1 -- 172.21.15.96:0/428832318 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e000a470 con 0x7f70e80caad0 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70eea12640 1 -- 172.21.15.96:0/428832318 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e809cf60 con 0x7f70e80caad0 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.068+0000 7f70eea12640 1 -- 172.21.15.96:0/428832318 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e809d520 con 0x7f70e80caad0 2024-06-02T23:47:13.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.069+0000 7f70eea12640 1 -- 172.21.15.96:0/428832318 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e80683e0 con 0x7f70e80caad0 2024-06-02T23:47:13.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.070+0000 7f70e4ff9640 1 -- 172.21.15.96:0/428832318 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f70e000a610 con 0x7f70e80caad0 2024-06-02T23:47:13.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.070+0000 7f70e4ff9640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70d406bfd0 0x7f70d406e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:13.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.070+0000 7f70e7fff640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70d406bfd0 0x7f70d406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:13.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.070+0000 7f70e4ff9640 1 -- 172.21.15.96:0/428832318 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7f70e008d320 con 0x7f70e80caad0 2024-06-02T23:47:13.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.071+0000 7f70e7fff640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70d406bfd0 0x7f70d406e490 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f70d8000f60 tx=0x7f70d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:13.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.075+0000 7f70e4ff9640 1 -- 172.21.15.96:0/428832318 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f70e005bcd0 con 0x7f70e80caad0 2024-06-02T23:47:13.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.247+0000 7f70eea12640 1 -- 172.21.15.96:0/428832318 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f70e80acd90 con 0x7f70e80caad0 2024-06-02T23:47:13.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.935+0000 7f70e4ff9640 1 -- 172.21.15.96:0/428832318 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f70e005b5d0 con 0x7f70e80caad0 2024-06-02T23:47:13.936 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data_ec' removed 2024-06-02T23:47:13.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 -- 172.21.15.96:0/428832318 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70d406bfd0 msgr2=0x7f70d406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:13.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70d406bfd0 0x7f70d406e490 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f70d8000f60 tx=0x7f70d8009040 comp rx=0 tx=0).stop 2024-06-02T23:47:13.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 -- 172.21.15.96:0/428832318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e80caad0 msgr2=0x7f70e8071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:13.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e80caad0 0x7f70e8071490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f70e000ce90 tx=0x7f70e000e420 comp rx=0 tx=0).stop 2024-06-02T23:47:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 -- 172.21.15.96:0/428832318 shutdown_connections 2024-06-02T23:47:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f70d406bfd0 0x7f70d406e490 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70e80caad0 0x7f70e8071490 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70e80af250 0x7f70e815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 --2- 172.21.15.96:0/428832318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70e806d970 0x7f70e8159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 -- 172.21.15.96:0/428832318 >> 172.21.15.96:0/428832318 conn(0x7f70e80b1a40 msgr2=0x7f70e80ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 -- 172.21.15.96:0/428832318 shutdown_connections 2024-06-02T23:47:13.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:13.938+0000 7f70eea12640 1 -- 172.21.15.96:0/428832318 wait complete. 2024-06-02T23:47:13.950 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-02T23:47:13.950 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-02T23:47:13.950 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-02T23:47:13.950 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:47:13.951 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-02T23:47:13.951 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-02T23:47:13.951 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-02T23:47:13.951 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:47:13.951 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-02T23:47:13.951 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-02T23:47:13.951 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-02T23:47:13.952 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:47:13.952 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-02T23:47:13.952 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-02T23:47:13.952 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-02T23:47:13.952 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:47:13.961 INFO:tasks.ceph.mds.a:Stopped 2024-06-02T23:47:13.961 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-02T23:47:13.962 INFO:tasks.ceph.mds.c:Stopped 2024-06-02T23:47:13.962 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-02T23:47:13.963 INFO:tasks.ceph.mds.d:Stopped 2024-06-02T23:47:13.964 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-02T23:47:14.003 INFO:tasks.ceph.mds.a:Started 2024-06-02T23:47:14.003 DEBUG:teuthology.parallel:result is None 2024-06-02T23:47:14.004 INFO:tasks.ceph.mds.c:Started 2024-06-02T23:47:14.004 DEBUG:teuthology.parallel:result is None 2024-06-02T23:47:14.006 INFO:tasks.ceph.mds.d:Started 2024-06-02T23:47:14.006 DEBUG:teuthology.parallel:result is None 2024-06-02T23:47:14.078 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-06-02T23:47:14.079 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2024-06-02T23:47:14.087 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-06-02T23:47:14.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-06-02T23:47:19.964 INFO:tasks.ceph.mds.b:Stopped 2024-06-02T23:47:19.964 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-02T23:47:19.967 INFO:tasks.ceph.mds.b:Started 2024-06-02T23:47:19.968 DEBUG:teuthology.parallel:result is None 2024-06-02T23:47:19.968 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-02T23:47:20.052 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-06-02T23:47:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.082+0000 7f0093853640 1 Processor -- start 2024-06-02T23:47:20.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.082+0000 7f0093853640 1 -- start start 2024-06-02T23:47:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.083+0000 7f0093853640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f008c155570 0x7f008c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.083+0000 7f0093853640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f008c0cad30 0x7f008c072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.083+0000 7f0093853640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c155950 con 0x7f008c06eb50 2024-06-02T23:47:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.083+0000 7f0093853640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f008c0cb2e0 con 0x7f008c0cad30 2024-06-02T23:47:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.083+0000 7f0093853640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f008c0cb5c0 con 0x7f008c155570 2024-06-02T23:47:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.083+0000 7f0091df0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f008c0cad30 0x7f008c072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:20.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.083+0000 7f0090dee640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f008c06eb50 0x7f008c0ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:57636/0 (socket says 172.21.15.96:57636) 2024-06-02T23:47:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.083+0000 7f0090dee640 1 -- 172.21.15.96:0/345466840 learned_addr learned my addr 172.21.15.96:0/345466840 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.084+0000 7f00915ef640 1 --2- 172.21.15.96:0/345466840 >> v2:172.21.15.162:3300/0 conn(0x7f008c155570 0x7f008c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.084+0000 7f0091df0640 1 -- 172.21.15.96:0/345466840 >> v2:172.21.15.162:3300/0 conn(0x7f008c155570 msgr2=0x7f008c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.084+0000 7f0091df0640 1 --2- 172.21.15.96:0/345466840 >> v2:172.21.15.162:3300/0 conn(0x7f008c155570 0x7f008c06e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.084+0000 7f0091df0640 1 -- 172.21.15.96:0/345466840 >> v1:172.21.15.96:6789/0 conn(0x7f008c06eb50 legacy=0x7f008c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.084+0000 7f008bfff640 1 -- 172.21.15.96:0/345466840 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3872201961 0 0) 0x7f008c155950 con 0x7f008c06eb50 2024-06-02T23:47:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.084+0000 7f0091df0640 1 -- 172.21.15.96:0/345466840 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c0cb8a0 con 0x7f008c0cad30 2024-06-02T23:47:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.084+0000 7f0091df0640 1 --2- 172.21.15.96:0/345466840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c0cad30 0x7f008c072020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f008c06f920 tx=0x7f008402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f172aedc7aa52b0a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:20.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f008bfff640 1 -- 172.21.15.96:0/345466840 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084007740 con 0x7f008c0cad30 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f008bfff640 1 -- 172.21.15.96:0/345466840 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00840078e0 con 0x7f008c0cad30 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f008bfff640 1 -- 172.21.15.96:0/345466840 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084007cb0 con 0x7f008c0cad30 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f0093853640 1 -- 172.21.15.96:0/345466840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c0cad30 msgr2=0x7f008c072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f0093853640 1 --2- 172.21.15.96:0/345466840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c0cad30 0x7f008c072020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f008c06f920 tx=0x7f008402a680 comp rx=0 tx=0).stop 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f0093853640 1 -- 172.21.15.96:0/345466840 shutdown_connections 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f0093853640 1 --2- 172.21.15.96:0/345466840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c0cad30 0x7f008c072020 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f0093853640 1 --2- 172.21.15.96:0/345466840 >> v2:172.21.15.162:3300/0 conn(0x7f008c155570 0x7f008c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f0093853640 1 -- 172.21.15.96:0/345466840 >> 172.21.15.96:0/345466840 conn(0x7f008c0cfc30 msgr2=0x7f008c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f0093853640 1 -- 172.21.15.96:0/345466840 shutdown_connections 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.085+0000 7f0093853640 1 -- 172.21.15.96:0/345466840 wait complete. 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.086+0000 7f0093853640 1 Processor -- start 2024-06-02T23:47:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0093853640 1 -- start start 2024-06-02T23:47:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0093853640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f008c06eb50 0x7f008c153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0093853640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f008c0cad30 0x7f008c151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0093853640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c155570 0x7f008c15e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0093853640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f008c072560 con 0x7f008c155570 2024-06-02T23:47:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0093853640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f008c0717d0 con 0x7f008c0cad30 2024-06-02T23:47:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0093853640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f008c0726e0 con 0x7f008c06eb50 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0091df0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c155570 0x7f008c15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0091df0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c155570 0x7f008c15e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38808/0 (socket says 172.21.15.96:38808) 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0091df0640 1 -- 172.21.15.96:0/933488280 learned_addr learned my addr 172.21.15.96:0/933488280 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.087+0000 7f0090dee640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f008c0cad30 0x7f008c151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f00915ef640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f008c06eb50 0x7f008c153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0091df0640 1 -- 172.21.15.96:0/933488280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f008c06eb50 msgr2=0x7f008c153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0091df0640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f008c06eb50 0x7f008c153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0091df0640 1 -- 172.21.15.96:0/933488280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f008c0cad30 msgr2=0x7f008c151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0091df0640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f008c0cad30 0x7f008c151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0091df0640 1 -- 172.21.15.96:0/933488280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c152230 con 0x7f008c155570 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0091df0640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c155570 0x7f008c15e260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0084009e50 tx=0x7f0084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0089ffb640 1 -- 172.21.15.96:0/933488280 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084040070 con 0x7f008c155570 2024-06-02T23:47:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0089ffb640 1 -- 172.21.15.96:0/933488280 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0084031bf0 con 0x7f008c155570 2024-06-02T23:47:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0089ffb640 1 -- 172.21.15.96:0/933488280 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084045460 con 0x7f008c155570 2024-06-02T23:47:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0093853640 1 -- 172.21.15.96:0/933488280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008c1524d0 con 0x7f008c155570 2024-06-02T23:47:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.088+0000 7f0093853640 1 -- 172.21.15.96:0/933488280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008c0c7230 con 0x7f008c155570 2024-06-02T23:47:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.089+0000 7f0093853640 1 -- 172.21.15.96:0/933488280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f008c0683e0 con 0x7f008c155570 2024-06-02T23:47:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.090+0000 7f0089ffb640 1 -- 172.21.15.96:0/933488280 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0084039040 con 0x7f008c155570 2024-06-02T23:47:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.091+0000 7f0089ffb640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f007806be30 0x7f007806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.091+0000 7f00915ef640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f007806be30 0x7f007806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.091+0000 7f0089ffb640 1 -- 172.21.15.96:0/933488280 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5335+0+0 (secure 0 0 0) 0x7f00840ac520 con 0x7f008c155570 2024-06-02T23:47:20.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.091+0000 7f00915ef640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f007806be30 0x7f007806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f007c0079a0 tx=0x7f007c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:20.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.095+0000 7f0089ffb640 1 -- 172.21.15.96:0/933488280 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f008407ab10 con 0x7f008c155570 2024-06-02T23:47:20.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:20.281+0000 7f0093853640 1 -- 172.21.15.96:0/933488280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f008c06cc90 con 0x7f008c155570 2024-06-02T23:47:21.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.062+0000 7f0089ffb640 1 -- 172.21.15.96:0/933488280 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) ==== 97+0+0 (secure 0 0 0) 0x7f008407ee10 con 0x7f008c155570 2024-06-02T23:47:21.063 INFO:teuthology.orchestra.run.smithi096.stderr: removed all blocklist entries 2024-06-02T23:47:21.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 -- 172.21.15.96:0/933488280 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f007806be30 msgr2=0x7f007806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f007806be30 0x7f007806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f007c0079a0 tx=0x7f007c008040 comp rx=0 tx=0).stop 2024-06-02T23:47:21.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 -- 172.21.15.96:0/933488280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c155570 msgr2=0x7f008c15e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c155570 0x7f008c15e260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0084009e50 tx=0x7f0084004a40 comp rx=0 tx=0).stop 2024-06-02T23:47:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 -- 172.21.15.96:0/933488280 shutdown_connections 2024-06-02T23:47:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f007806be30 0x7f007806e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f008c155570 0x7f008c15e260 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f008c0cad30 0x7f008c151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 --2- 172.21.15.96:0/933488280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f008c06eb50 0x7f008c153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 -- 172.21.15.96:0/933488280 >> 172.21.15.96:0/933488280 conn(0x7f008c0cfc30 msgr2=0x7f008c0af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 -- 172.21.15.96:0/933488280 shutdown_connections 2024-06-02T23:47:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.065+0000 7f0093853640 1 -- 172.21.15.96:0/933488280 wait complete. 2024-06-02T23:47:21.076 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-02T23:47:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.186+0000 7f9aab0df640 1 Processor -- start 2024-06-02T23:47:21.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.186+0000 7f9aab0df640 1 -- start start 2024-06-02T23:47:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aab0df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa4155570 0x7f9aa406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aab0df640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9aa406eb50 0x7f9aa40ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aab0df640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa4155950 con 0x7f9aa40cab60 2024-06-02T23:47:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aab0df640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa406efb0 con 0x7f9aa406eb50 2024-06-02T23:47:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aab0df640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa40cb2e0 con 0x7f9aa4155570 2024-06-02T23:47:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa8e7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa4155570 0x7f9aa406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa967c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9aa40cab60 0x7f9aa415eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:48094/0 (socket says 172.21.15.96:48094) 2024-06-02T23:47:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa3fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9aa406eb50 0x7f9aa40ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa967c640 1 -- 172.21.15.96:0/1235220926 learned_addr learned my addr 172.21.15.96:0/1235220926 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa37fe640 1 -- 172.21.15.96:0/1235220926 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590979060 0 0) 0x7f9aa4155950 con 0x7f9aa40cab60 2024-06-02T23:47:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa37fe640 1 -- 172.21.15.96:0/1235220926 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a94003520 con 0x7f9aa40cab60 2024-06-02T23:47:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa8e7b640 1 -- 172.21.15.96:0/1235220926 >> v2:172.21.15.162:3300/0 conn(0x7f9aa406eb50 msgr2=0x7f9aa40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa8e7b640 1 --2- 172.21.15.96:0/1235220926 >> v2:172.21.15.162:3300/0 conn(0x7f9aa406eb50 0x7f9aa40ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa8e7b640 1 -- 172.21.15.96:0/1235220926 >> v1:172.21.15.162:6789/0 conn(0x7f9aa40cab60 legacy=0x7f9aa415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa8e7b640 1 -- 172.21.15.96:0/1235220926 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa40cb5c0 con 0x7f9aa4155570 2024-06-02T23:47:21.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.187+0000 7f9aa3fff640 1 --2- 172.21.15.96:0/1235220926 >> v2:172.21.15.162:3300/0 conn(0x7f9aa406eb50 0x7f9aa40ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:47:21.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.188+0000 7f9aa8e7b640 1 --2- 172.21.15.96:0/1235220926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa4155570 0x7f9aa406e610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9a980097a0 tx=0x7f9a9802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a2e524d258283f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:21.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.188+0000 7f9aa37fe640 1 -- 172.21.15.96:0/1235220926 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a98037070 con 0x7f9aa4155570 2024-06-02T23:47:21.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.188+0000 7f9aa37fe640 1 -- 172.21.15.96:0/1235220926 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a98032440 con 0x7f9aa4155570 2024-06-02T23:47:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.188+0000 7f9aa37fe640 1 -- 172.21.15.96:0/1235220926 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a980327f0 con 0x7f9aa4155570 2024-06-02T23:47:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.189+0000 7f9aab0df640 1 -- 172.21.15.96:0/1235220926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa4155570 msgr2=0x7f9aa406e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.189+0000 7f9aab0df640 1 --2- 172.21.15.96:0/1235220926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa4155570 0x7f9aa406e610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9a980097a0 tx=0x7f9a9802a180 comp rx=0 tx=0).stop 2024-06-02T23:47:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.189+0000 7f9aab0df640 1 -- 172.21.15.96:0/1235220926 shutdown_connections 2024-06-02T23:47:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.189+0000 7f9aab0df640 1 --2- 172.21.15.96:0/1235220926 >> v2:172.21.15.162:3300/0 conn(0x7f9aa406eb50 0x7f9aa40ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.189+0000 7f9aab0df640 1 --2- 172.21.15.96:0/1235220926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa4155570 0x7f9aa406e610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.189+0000 7f9aab0df640 1 -- 172.21.15.96:0/1235220926 >> 172.21.15.96:0/1235220926 conn(0x7f9aa40cfc30 msgr2=0x7f9aa40d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.189+0000 7f9aab0df640 1 -- 172.21.15.96:0/1235220926 shutdown_connections 2024-06-02T23:47:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.189+0000 7f9aab0df640 1 -- 172.21.15.96:0/1235220926 wait complete. 2024-06-02T23:47:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.190+0000 7f9aab0df640 1 Processor -- start 2024-06-02T23:47:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.190+0000 7f9aab0df640 1 -- start start 2024-06-02T23:47:21.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aab0df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9aa406eb50 0x7f9aa4143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aab0df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa40cab60 0x7f9aa406d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aab0df640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa4155570 0x7f9aa406da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aab0df640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa40caff0 con 0x7f9aa4155570 2024-06-02T23:47:21.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aab0df640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa4071b00 con 0x7f9aa406eb50 2024-06-02T23:47:21.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aab0df640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa40717d0 con 0x7f9aa40cab60 2024-06-02T23:47:21.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aa967c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa4155570 0x7f9aa406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aa967c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa4155570 0x7f9aa406da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38810/0 (socket says 172.21.15.96:38810) 2024-06-02T23:47:21.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aa967c640 1 -- 172.21.15.96:0/2659970666 learned_addr learned my addr 172.21.15.96:0/2659970666 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:21.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aa8e7b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9aa406eb50 0x7f9aa4143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aa3fff640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa40cab60 0x7f9aa406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aa967c640 1 -- 172.21.15.96:0/2659970666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa40cab60 msgr2=0x7f9aa406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aa967c640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa40cab60 0x7f9aa406d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aa967c640 1 -- 172.21.15.96:0/2659970666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9aa406eb50 msgr2=0x7f9aa4143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aa967c640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9aa406eb50 0x7f9aa4143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.191+0000 7f9aa967c640 1 -- 172.21.15.96:0/2659970666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa415c720 con 0x7f9aa4155570 2024-06-02T23:47:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.192+0000 7f9aa967c640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa4155570 0x7f9aa406da40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00cad0 tx=0x7f9a9c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:21.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.192+0000 7f9aa17fa640 1 -- 172.21.15.96:0/2659970666 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c017070 con 0x7f9aa4155570 2024-06-02T23:47:21.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.192+0000 7f9aa17fa640 1 -- 172.21.15.96:0/2659970666 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c00ac30 con 0x7f9aa4155570 2024-06-02T23:47:21.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.192+0000 7f9aab0df640 1 -- 172.21.15.96:0/2659970666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa415ca00 con 0x7f9aa4155570 2024-06-02T23:47:21.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.192+0000 7f9aa17fa640 1 -- 172.21.15.96:0/2659970666 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c012400 con 0x7f9aa4155570 2024-06-02T23:47:21.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.192+0000 7f9aab0df640 1 -- 172.21.15.96:0/2659970666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa415cfc0 con 0x7f9aa4155570 2024-06-02T23:47:21.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.193+0000 7f9aab0df640 1 -- 172.21.15.96:0/2659970666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa40683e0 con 0x7f9aa4155570 2024-06-02T23:47:21.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.193+0000 7f9aa17fa640 1 -- 172.21.15.96:0/2659970666 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a9c01a070 con 0x7f9aa4155570 2024-06-02T23:47:21.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.194+0000 7f9aa17fa640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9a8806be30 0x7f9a8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.194+0000 7f9aa17fa640 1 -- 172.21.15.96:0/2659970666 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9a9c08a970 con 0x7f9aa4155570 2024-06-02T23:47:21.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.194+0000 7f9aa8e7b640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9a8806be30 0x7f9a8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.194+0000 7f9aa8e7b640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9a8806be30 0x7f9a8806e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a98034000 tx=0x7f9a9802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:21.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.198+0000 7f9aa17fa640 1 -- 172.21.15.96:0/2659970666 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9a9c058f20 con 0x7f9aa4155570 2024-06-02T23:47:21.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-06-02T23:47:21.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.449+0000 7f9aab0df640 1 -- 172.21.15.96:0/2659970666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9aa4153f40 con 0x7f9aa4155570 2024-06-02T23:47:21.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.449+0000 7f9aa17fa640 1 -- 172.21.15.96:0/2659970666 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f9a9c05d220 con 0x7f9aa4155570 2024-06-02T23:47:21.449 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_dump": [ 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.a", 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mv+yHEhAA5drjcpFFkuZtP9jn4RNKJg==", 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.450 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.b", 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1m7XM8HhAAKUlPE4OvGuBeKe6DGbkyHQ==", 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.c", 2024-06-02T23:47:21.451 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mVjKRGRAAC+vsd0hUCCQ/mOXFYGV5YA==", 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.d", 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1myBlaJRAAIjex3ET8YFlbLgoaY4JnKQ==", 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:47:21.452 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.0", 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAcBF1mte+CChAAPDwA0vI0SJosZ3U0rWu1mA==", 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.453 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.1", 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAfBF1m7PXNCBAAp/N/6XnBcejiNP+Gf4riJQ==", 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.2", 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAiBF1mJNZTBhAAO96HFWEr7FRUBPsfMIAyvQ==", 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:47:21.454 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.3", 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAlBF1mE3dFBBAAHQ/axJajuNqTcSyq3iuhzg==", 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.455 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.4", 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQArBF1mGCqhChAA2rAbXRqzMPrK0+00D7j+WA==", 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.5", 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAuBF1mj5VeCRAAwVs8J2MBZE6bXG4mW5g2Sg==", 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:47:21.456 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.6", 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAxBF1mYqZaBxAAiDIOH5xXTjT4+vj/u3MvNw==", 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.7", 2024-06-02T23:47:21.457 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQA0BF1mpoCvBBAAJYKc3QKLtU3cT/zALs8RLg==", 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.0", 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mSH5jKRAAiBQXUb900fop4NegNAGVlQ==", 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-06-02T23:47:21.458 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.1", 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mBgQeMhAA/ozEWt5lxs+djJ0fv79MKQ==", 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.459 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.2", 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mV+3yLhAAx/UoeSwIrsirjBB3auHGig==", 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.3", 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mGVOsNxAAmWB6RKMd/43AazTZCxqLYw==", 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:47:21.460 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.admin", 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAXBF1m2XWUMhAAkwdF+qDWwDkH27QrjIRiVA==", 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-mds", 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQA5BF1mQQ1CNRAAgTy7kHPiUg0G9doYz1QeKA==", 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-mds" 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-mgr", 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQA5BF1myhRCNRAAoWj8cceMnJ+8gY+61VXKew==", 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-mgr" 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.462 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-osd", 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQA5BF1m4xtCNRAAwWAM3pJO3qZYWp1wzfoHYw==", 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-osd" 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-rbd", 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQA5BF1mWCJCNRAAkNyNdRDnWpU/6Jiiomf1pw==", 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-rbd" 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.463 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQA5BF1m4ihCNRAAnhWdFePb1J+RvUSO8/mt2Q==", 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-rgw", 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQA5BF1mqi9CNRAAw0iGAqMnvYzPeyhsYOA9sg==", 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-rgw" 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.464 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mgr.x", 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mWkxYDxAAOgAEKD5eR7iDnKFLhTRz6Q==", 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile mgr", 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mgr.y", 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mQ/aZCxAAV7Dado7gJa/pxz43da1eVw==", 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2024-06-02T23:47:21.465 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile mgr", 2024-06-02T23:47:21.466 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:47:21.466 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.466 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:21.466 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-06-02T23:47:21.466 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:47:21.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.451+0000 7f9aab0df640 1 -- 172.21.15.96:0/2659970666 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9a8806be30 msgr2=0x7f9a8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.451+0000 7f9aab0df640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9a8806be30 0x7f9a8806e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a98034000 tx=0x7f9a9802e000 comp rx=0 tx=0).stop 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.451+0000 7f9aab0df640 1 -- 172.21.15.96:0/2659970666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa4155570 msgr2=0x7f9aa406da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.451+0000 7f9aab0df640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa4155570 0x7f9aa406da40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00cad0 tx=0x7f9a9c00cf90 comp rx=0 tx=0).stop 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.452+0000 7f9aab0df640 1 -- 172.21.15.96:0/2659970666 shutdown_connections 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.452+0000 7f9aab0df640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9a8806be30 0x7f9a8806e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.452+0000 7f9aab0df640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9aa4155570 0x7f9aa406da40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.452+0000 7f9aab0df640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa40cab60 0x7f9aa406d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.452+0000 7f9aab0df640 1 --2- 172.21.15.96:0/2659970666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9aa406eb50 0x7f9aa4143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.452+0000 7f9aab0df640 1 -- 172.21.15.96:0/2659970666 >> 172.21.15.96:0/2659970666 conn(0x7f9aa40cfc30 msgr2=0x7f9aa40ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.452+0000 7f9aab0df640 1 -- 172.21.15.96:0/2659970666 shutdown_connections 2024-06-02T23:47:21.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.452+0000 7f9aab0df640 1 -- 172.21.15.96:0/2659970666 wait complete. 2024-06-02T23:47:21.469 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-06-02T23:47:21.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.569+0000 7f8433914640 1 Processor -- start 2024-06-02T23:47:21.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.569+0000 7f8433914640 1 -- start start 2024-06-02T23:47:21.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.570+0000 7f8433914640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 0x7f842c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.570+0000 7f8433914640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f842c0b5510 0x7f842c0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.570+0000 7f8433914640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842c0d4a90 con 0x7f842c161900 2024-06-02T23:47:21.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.570+0000 7f8433914640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f842c0cf5c0 con 0x7f842c0b5510 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.570+0000 7f8433914640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f842c0caf70 con 0x7f842c0d1120 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.570+0000 7f8431eb1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f842c0b5510 0x7f842c0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.570+0000 7f8431eb1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f842c0b5510 0x7f842c0c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38820/0 (socket says 172.21.15.96:38820) 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.570+0000 7f8431eb1640 1 -- 172.21.15.96:0/303698396 learned_addr learned my addr 172.21.15.96:0/303698396 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.570+0000 7f8430eaf640 1 --2- 172.21.15.96:0/303698396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 0x7f842c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.571+0000 7f8431eb1640 1 -- 172.21.15.96:0/303698396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 msgr2=0x7f842c0c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.571+0000 7f8431eb1640 1 --2- 172.21.15.96:0/303698396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 0x7f842c0c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.571+0000 7f8431eb1640 1 -- 172.21.15.96:0/303698396 >> v1:172.21.15.162:6789/0 conn(0x7f842c161900 legacy=0x7f842c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.571+0000 7f8431eb1640 1 -- 172.21.15.96:0/303698396 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c0d4d70 con 0x7f842c0b5510 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.571+0000 7f8430eaf640 1 --2- 172.21.15.96:0/303698396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 0x7f842c0c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f8431eb1640 1 --2- 172.21.15.96:0/303698396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c0b5510 0x7f842c0c8100 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f841c009e50 tx=0x7f841c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b5f269b7a7cbbb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f842bfff640 1 -- 172.21.15.96:0/303698396 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c036070 con 0x7f842c0b5510 2024-06-02T23:47:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f842bfff640 1 -- 172.21.15.96:0/303698396 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841c031600 con 0x7f842c0b5510 2024-06-02T23:47:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f842bfff640 1 -- 172.21.15.96:0/303698396 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c0319d0 con 0x7f842c0b5510 2024-06-02T23:47:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f8433914640 1 -- 172.21.15.96:0/303698396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c0b5510 msgr2=0x7f842c0c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f8433914640 1 --2- 172.21.15.96:0/303698396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c0b5510 0x7f842c0c8100 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f841c009e50 tx=0x7f841c02a680 comp rx=0 tx=0).stop 2024-06-02T23:47:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f8433914640 1 -- 172.21.15.96:0/303698396 shutdown_connections 2024-06-02T23:47:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f8433914640 1 --2- 172.21.15.96:0/303698396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c0b5510 0x7f842c0c8100 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f8433914640 1 --2- 172.21.15.96:0/303698396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 0x7f842c0c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f8433914640 1 -- 172.21.15.96:0/303698396 >> 172.21.15.96:0/303698396 conn(0x7f842c09d3b0 msgr2=0x7f842c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f8433914640 1 -- 172.21.15.96:0/303698396 shutdown_connections 2024-06-02T23:47:21.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.572+0000 7f8433914640 1 -- 172.21.15.96:0/303698396 wait complete. 2024-06-02T23:47:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.574+0000 7f8433914640 1 Processor -- start 2024-06-02T23:47:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.574+0000 7f8433914640 1 -- start start 2024-06-02T23:47:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8433914640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f842c0b5510 0x7f842c0ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8433914640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 0x7f842c154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8433914640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c161900 0x7f842c0b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8433914640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f842c0d4780 con 0x7f842c161900 2024-06-02T23:47:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8433914640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f842c0cfae0 con 0x7f842c0b5510 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8433914640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f842c161ce0 con 0x7f842c0d1120 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8431eb1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c161900 0x7f842c0b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8431eb1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c161900 0x7f842c0b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38836/0 (socket says 172.21.15.96:38836) 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8431eb1640 1 -- 172.21.15.96:0/3825141428 learned_addr learned my addr 172.21.15.96:0/3825141428 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f84316b0640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f842c0b5510 0x7f842c0ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8430eaf640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 0x7f842c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8431eb1640 1 -- 172.21.15.96:0/3825141428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 msgr2=0x7f842c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8431eb1640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 0x7f842c154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8431eb1640 1 -- 172.21.15.96:0/3825141428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f842c0b5510 msgr2=0x7f842c0ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8431eb1640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f842c0b5510 0x7f842c0ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.575+0000 7f8431eb1640 1 -- 172.21.15.96:0/3825141428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c0b7170 con 0x7f842c161900 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.576+0000 7f8431eb1640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c161900 0x7f842c0b6c30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f841c009f70 tx=0x7f841c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.576+0000 7f8429ffb640 1 -- 172.21.15.96:0/3825141428 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c03f020 con 0x7f842c161900 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.576+0000 7f8429ffb640 1 -- 172.21.15.96:0/3825141428 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841c037040 con 0x7f842c161900 2024-06-02T23:47:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.576+0000 7f8429ffb640 1 -- 172.21.15.96:0/3825141428 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c036070 con 0x7f842c161900 2024-06-02T23:47:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.576+0000 7f8433914640 1 -- 172.21.15.96:0/3825141428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842c0b7440 con 0x7f842c161900 2024-06-02T23:47:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.576+0000 7f8433914640 1 -- 172.21.15.96:0/3825141428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842c0b7a00 con 0x7f842c161900 2024-06-02T23:47:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.577+0000 7f8433914640 1 -- 172.21.15.96:0/3825141428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842c0cb140 con 0x7f842c161900 2024-06-02T23:47:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.578+0000 7f8429ffb640 1 -- 172.21.15.96:0/3825141428 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f841c042020 con 0x7f842c161900 2024-06-02T23:47:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.578+0000 7f8429ffb640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f841806be30 0x7f841806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.578+0000 7f8429ffb640 1 -- 172.21.15.96:0/3825141428 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f841c0ab020 con 0x7f842c161900 2024-06-02T23:47:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.578+0000 7f84316b0640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f841806be30 0x7f841806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.579+0000 7f84316b0640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f841806be30 0x7f841806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f84240016e0 tx=0x7f8424009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:21.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.583+0000 7f8429ffb640 1 -- 172.21.15.96:0/3825141428 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f841c049030 con 0x7f842c161900 2024-06-02T23:47:21.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.821+0000 7f8433914640 1 -- 172.21.15.96:0/3825141428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f842c0d05e0 con 0x7f842c161900 2024-06-02T23:47:21.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.824+0000 7f8429ffb640 1 -- 172.21.15.96:0/3825141428 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f841c079540 con 0x7f842c161900 2024-06-02T23:47:21.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.826+0000 7f8433914640 1 -- 172.21.15.96:0/3825141428 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f841806be30 msgr2=0x7f841806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.826+0000 7f8433914640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f841806be30 0x7f841806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f84240016e0 tx=0x7f8424009040 comp rx=0 tx=0).stop 2024-06-02T23:47:21.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.826+0000 7f8433914640 1 -- 172.21.15.96:0/3825141428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c161900 msgr2=0x7f842c0b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.826+0000 7f8433914640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c161900 0x7f842c0b6c30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f841c009f70 tx=0x7f841c004a40 comp rx=0 tx=0).stop 2024-06-02T23:47:21.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.826+0000 7f8433914640 1 -- 172.21.15.96:0/3825141428 shutdown_connections 2024-06-02T23:47:21.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.826+0000 7f8433914640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f841806be30 0x7f841806e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.826+0000 7f8433914640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f842c161900 0x7f842c0b6c30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.826+0000 7f8433914640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f842c0d1120 0x7f842c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.826+0000 7f8433914640 1 --2- 172.21.15.96:0/3825141428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f842c0b5510 0x7f842c0ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.826+0000 7f8433914640 1 -- 172.21.15.96:0/3825141428 >> 172.21.15.96:0/3825141428 conn(0x7f842c09d3b0 msgr2=0x7f842c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:21.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.827+0000 7f8433914640 1 -- 172.21.15.96:0/3825141428 shutdown_connections 2024-06-02T23:47:21.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.827+0000 7f8433914640 1 -- 172.21.15.96:0/3825141428 wait complete. 2024-06-02T23:47:21.837 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-06-02T23:47:21.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.937+0000 7fc013129640 1 Processor -- start 2024-06-02T23:47:21.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.937+0000 7fc013129640 1 -- start start 2024-06-02T23:47:21.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.938+0000 7fc013129640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 0x7fc00c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.938+0000 7fc013129640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc00c06eb50 0x7fc00c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.938+0000 7fc013129640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc00c155950 con 0x7fc00c0cab60 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.938+0000 7fc013129640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc00c06efb0 con 0x7fc00c06eb50 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.938+0000 7fc013129640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc00c0cb2e0 con 0x7fc00c155570 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.938+0000 7fc00bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc00c06eb50 0x7fc00c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.938+0000 7fc00bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc00c06eb50 0x7fc00c0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38850/0 (socket says 172.21.15.96:38850) 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.938+0000 7fc00bfff640 1 -- 172.21.15.96:0/3968579057 learned_addr learned my addr 172.21.15.96:0/3968579057 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.938+0000 7fc010ec5640 1 --2- 172.21.15.96:0/3968579057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 0x7fc00c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.938+0000 7fc00bfff640 1 -- 172.21.15.96:0/3968579057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 msgr2=0x7fc00c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.939+0000 7fc00bfff640 1 --2- 172.21.15.96:0/3968579057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 0x7fc00c06e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.939+0000 7fc00bfff640 1 -- 172.21.15.96:0/3968579057 >> v1:172.21.15.162:6789/0 conn(0x7fc00c0cab60 legacy=0x7fc00c15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.939+0000 7fc00bfff640 1 -- 172.21.15.96:0/3968579057 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c0cb5c0 con 0x7fc00c06eb50 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.939+0000 7fc00bfff640 1 --2- 172.21.15.96:0/3968579057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 0x7fc00c0ca620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc00000bb10 tx=0x7fc00002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a984913cd6a6ac0f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:21.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.939+0000 7fc00b7fe640 1 -- 172.21.15.96:0/3968579057 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000036020 con 0x7fc00c06eb50 2024-06-02T23:47:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.939+0000 7fc00b7fe640 1 -- 172.21.15.96:0/3968579057 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc000032820 con 0x7fc00c06eb50 2024-06-02T23:47:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.939+0000 7fc00b7fe640 1 -- 172.21.15.96:0/3968579057 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000032bf0 con 0x7fc00c06eb50 2024-06-02T23:47:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.940+0000 7fc013129640 1 -- 172.21.15.96:0/3968579057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 msgr2=0x7fc00c0ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.940+0000 7fc013129640 1 --2- 172.21.15.96:0/3968579057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 0x7fc00c0ca620 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc00000bb10 tx=0x7fc00002c920 comp rx=0 tx=0).stop 2024-06-02T23:47:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.940+0000 7fc013129640 1 -- 172.21.15.96:0/3968579057 shutdown_connections 2024-06-02T23:47:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.940+0000 7fc013129640 1 --2- 172.21.15.96:0/3968579057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 0x7fc00c0ca620 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.940+0000 7fc013129640 1 --2- 172.21.15.96:0/3968579057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 0x7fc00c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.940+0000 7fc013129640 1 -- 172.21.15.96:0/3968579057 >> 172.21.15.96:0/3968579057 conn(0x7fc00c0cfc30 msgr2=0x7fc00c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.940+0000 7fc013129640 1 -- 172.21.15.96:0/3968579057 shutdown_connections 2024-06-02T23:47:21.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.940+0000 7fc013129640 1 -- 172.21.15.96:0/3968579057 wait complete. 2024-06-02T23:47:21.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.941+0000 7fc013129640 1 Processor -- start 2024-06-02T23:47:21.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.941+0000 7fc013129640 1 -- start start 2024-06-02T23:47:21.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc013129640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 0x7fc00c14d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc013129640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc00c0cab60 0x7fc00c0ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc013129640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 0x7fc00c14de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc013129640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c0caff0 con 0x7fc00c06eb50 2024-06-02T23:47:21.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc013129640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c071b00 con 0x7fc00c0cab60 2024-06-02T23:47:21.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc013129640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc00c0717d0 con 0x7fc00c155570 2024-06-02T23:47:21.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc010ec5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 0x7fc00c14d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc010ec5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 0x7fc00c14d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38854/0 (socket says 172.21.15.96:38854) 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc010ec5640 1 -- 172.21.15.96:0/1046499289 learned_addr learned my addr 172.21.15.96:0/1046499289 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc00bfff640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc00c0cab60 0x7fc00c0ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc0116c6640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 0x7fc00c14de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc010ec5640 1 -- 172.21.15.96:0/1046499289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 msgr2=0x7fc00c14de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc010ec5640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 0x7fc00c14de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc010ec5640 1 -- 172.21.15.96:0/1046499289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc00c0cab60 msgr2=0x7fc00c0ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc010ec5640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc00c0cab60 0x7fc00c0ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc010ec5640 1 -- 172.21.15.96:0/1046499289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c0af2b0 con 0x7fc00c06eb50 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc00bfff640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc00c0cab60 0x7fc00c0ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.942+0000 7fc0116c6640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 0x7fc00c14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.943+0000 7fc010ec5640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 0x7fc00c14d010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00d800 tx=0x7fbffc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:21.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.943+0000 7fc0097fa640 1 -- 172.21.15.96:0/1046499289 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00b6c0 con 0x7fc00c06eb50 2024-06-02T23:47:21.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.943+0000 7fc0097fa640 1 -- 172.21.15.96:0/1046499289 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc019070 con 0x7fc00c06eb50 2024-06-02T23:47:21.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.943+0000 7fc013129640 1 -- 172.21.15.96:0/1046499289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00c0ae270 con 0x7fc00c06eb50 2024-06-02T23:47:21.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.943+0000 7fc0097fa640 1 -- 172.21.15.96:0/1046499289 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00ba80 con 0x7fc00c06eb50 2024-06-02T23:47:21.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.943+0000 7fc013129640 1 -- 172.21.15.96:0/1046499289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00c0aeab0 con 0x7fc00c06eb50 2024-06-02T23:47:21.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.944+0000 7fc013129640 1 -- 172.21.15.96:0/1046499289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc00c0683e0 con 0x7fc00c06eb50 2024-06-02T23:47:21.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.944+0000 7fc0097fa640 1 -- 172.21.15.96:0/1046499289 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbffc00bc20 con 0x7fc00c06eb50 2024-06-02T23:47:21.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.945+0000 7fc0097fa640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbff806be30 0x7fbff806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:21.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.945+0000 7fc0097fa640 1 -- 172.21.15.96:0/1046499289 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fbffc08b170 con 0x7fc00c06eb50 2024-06-02T23:47:21.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.945+0000 7fc00bfff640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbff806be30 0x7fbff806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:21.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.945+0000 7fc00bfff640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbff806be30 0x7fbff806e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc000037000 tx=0x7fc000008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:21.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:21.949+0000 7fc0097fa640 1 -- 172.21.15.96:0/1046499289 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc00c0ae270 con 0x7fc00c06eb50 2024-06-02T23:47:22.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.195+0000 7fc013129640 1 -- 172.21.15.96:0/1046499289 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fc00c06cc90 con 0x7fc00c06eb50 2024-06-02T23:47:22.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.197+0000 7fc0097fa640 1 -- 172.21.15.96:0/1046499289 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7fbffc059ce0 con 0x7fc00c06eb50 2024-06-02T23:47:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 -- 172.21.15.96:0/1046499289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbff806be30 msgr2=0x7fbff806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbff806be30 0x7fbff806e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc000037000 tx=0x7fc000008040 comp rx=0 tx=0).stop 2024-06-02T23:47:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 -- 172.21.15.96:0/1046499289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 msgr2=0x7fc00c14d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 0x7fc00c14d010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00d800 tx=0x7fbffc00dcc0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 -- 172.21.15.96:0/1046499289 shutdown_connections 2024-06-02T23:47:22.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc00c155570 0x7fc00c14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc00c0cab60 0x7fc00c0ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbff806be30 0x7fbff806e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 --2- 172.21.15.96:0/1046499289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc00c06eb50 0x7fc00c14d010 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 -- 172.21.15.96:0/1046499289 >> 172.21.15.96:0/1046499289 conn(0x7fc00c0cfc30 msgr2=0x7fc00c071e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 -- 172.21.15.96:0/1046499289 shutdown_connections 2024-06-02T23:47:22.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.200+0000 7fc013129640 1 -- 172.21.15.96:0/1046499289 wait complete. 2024-06-02T23:47:22.211 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-06-02T23:47:22.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.310+0000 7f900e1b6640 1 Processor -- start 2024-06-02T23:47:22.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.310+0000 7f900e1b6640 1 -- start start 2024-06-02T23:47:22.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.311+0000 7f900e1b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080cad30 0x7f9008165e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.311+0000 7f900e1b6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9008155950 con 0x7f900806ed20 2024-06-02T23:47:22.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.311+0000 7f900e1b6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90080cb2e0 con 0x7f9008155570 2024-06-02T23:47:22.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.311+0000 7f900e1b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f90080cb5c0 con 0x7f90080cad30 2024-06-02T23:47:22.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.311+0000 7f9006ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f900806ed20 0x7f90080ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:57638/0 (socket says 172.21.15.96:57638) 2024-06-02T23:47:22.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.311+0000 7f9006ffd640 1 -- 172.21.15.96:0/201061099 learned_addr learned my addr 172.21.15.96:0/201061099 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.311+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339287814 0 0) 0x7f9008155950 con 0x7f900806ed20 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.311+0000 7f9007fff640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080cad30 0x7f9008165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.311+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ff0003520 con 0x7f900806ed20 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3766802143 0 0) 0x7f8ff0003520 con 0x7f900806ed20 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080cad30 msgr2=0x7f9008165e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080cad30 0x7f9008165e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 >> v1:172.21.15.162:6789/0 conn(0x7f9008155570 legacy=0x7f900806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90080cb8a0 con 0x7f900806ed20 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f8ffc001670 con 0x7f900806ed20 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 >> v1:172.21.15.96:6789/0 conn(0x7f900806ed20 legacy=0x7f90080ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ff00039e0 0x7f8ff0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080cad30 0x7f8ff0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff0004d40 0x7f8ff00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f90080cb5c0 con 0x7f8ff0004d40 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff000ba70 con 0x7f8ff00039e0 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff000bc70 con 0x7f90080cad30 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f9007fff640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff0004d40 0x7f8ff00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f9006ffd640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080cad30 0x7f8ff0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f90077fe640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ff00039e0 0x7f8ff0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f9007fff640 1 -- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080cad30 msgr2=0x7f8ff0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f9007fff640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080cad30 0x7f8ff0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f9007fff640 1 -- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ff00039e0 msgr2=0x7f8ff0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f9007fff640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ff00039e0 0x7f8ff0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.312+0000 7f9007fff640 1 -- 172.21.15.96:0/201061099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff0003520 con 0x7f8ff0004d40 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.313+0000 7f9007fff640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff0004d40 0x7f8ff00051c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9000009f90 tx=0x7f8ff0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce77a8dcea28389 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.313+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000009c10 con 0x7f8ff0004d40 2024-06-02T23:47:22.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.313+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9000036070 con 0x7f8ff0004d40 2024-06-02T23:47:22.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.313+0000 7f90067fc640 1 -- 172.21.15.96:0/201061099 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000031850 con 0x7f8ff0004d40 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.314+0000 7f900e1b6640 1 -- 172.21.15.96:0/201061099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff0004d40 msgr2=0x7f8ff00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.314+0000 7f900e1b6640 1 --2- 172.21.15.96:0/201061099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ff0004d40 0x7f8ff00051c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9000009f90 tx=0x7f8ff0005830 comp rx=0 tx=0).stop 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.314+0000 7f9007fff640 1 -- 172.21.15.96:0/201061099 reap_dead start 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.314+0000 7f900e1b6640 1 -- 172.21.15.96:0/201061099 shutdown_connections 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.314+0000 7f900e1b6640 1 -- 172.21.15.96:0/201061099 >> 172.21.15.96:0/201061099 conn(0x7f90080cfc30 msgr2=0x7f90080d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.314+0000 7f900e1b6640 1 -- 172.21.15.96:0/201061099 shutdown_connections 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.314+0000 7f900e1b6640 1 -- 172.21.15.96:0/201061099 wait complete. 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.315+0000 7f900e1b6640 1 Processor -- start 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.315+0000 7f900e1b6640 1 -- start start 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f900e1b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ff0004d40 0x7f900815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f900e1b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080c9610 0x7f90080c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f900e1b6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90081f7cc0 0x7f90081f8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f900e1b6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9008073030 con 0x7f90081f7cc0 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f900e1b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90080717d0 con 0x7f8ff0004d40 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f900e1b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f90080731b0 con 0x7f90080c9610 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f9007fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90081f7cc0 0x7f90081f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f9007fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90081f7cc0 0x7f90081f8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38876/0 (socket says 172.21.15.96:38876) 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f9007fff640 1 -- 172.21.15.96:0/4154799443 learned_addr learned my addr 172.21.15.96:0/4154799443 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f90077fe640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ff0004d40 0x7f900815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f9006ffd640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080c9610 0x7f90080c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f9007fff640 1 -- 172.21.15.96:0/4154799443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080c9610 msgr2=0x7f90080c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f9007fff640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080c9610 0x7f90080c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f9007fff640 1 -- 172.21.15.96:0/4154799443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ff0004d40 msgr2=0x7f900815aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f9007fff640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ff0004d40 0x7f900815aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f9007fff640 1 -- 172.21.15.96:0/4154799443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900815af70 con 0x7f90081f7cc0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f9007fff640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90081f7cc0 0x7f90081f8110 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9000009f90 tx=0x7f9000009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f8feffff640 1 -- 172.21.15.96:0/4154799443 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000009c10 con 0x7f90081f7cc0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f8feffff640 1 -- 172.21.15.96:0/4154799443 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9000003990 con 0x7f90081f7cc0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f8feffff640 1 -- 172.21.15.96:0/4154799443 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000003d80 con 0x7f90081f7cc0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.316+0000 7f900e1b6640 1 -- 172.21.15.96:0/4154799443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9008159c70 con 0x7f90081f7cc0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.317+0000 7f900e1b6640 1 -- 172.21.15.96:0/4154799443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f900815a230 con 0x7f90081f7cc0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.317+0000 7f900e1b6640 1 -- 172.21.15.96:0/4154799443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90080683e0 con 0x7f90081f7cc0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.318+0000 7f8feffff640 1 -- 172.21.15.96:0/4154799443 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9000005d10 con 0x7f90081f7cc0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.318+0000 7f8feffff640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8ff406be30 0x7f8ff406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.318+0000 7f8feffff640 1 -- 172.21.15.96:0/4154799443 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f90000ac2e0 con 0x7f90081f7cc0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.318+0000 7f90077fe640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8ff406be30 0x7f8ff406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.319+0000 7f90077fe640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8ff406be30 0x7f8ff406e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80017e0 tx=0x7f8ff8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:22.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.323+0000 7f8feffff640 1 -- 172.21.15.96:0/4154799443 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f900004a060 con 0x7f90081f7cc0 2024-06-02T23:47:22.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.561+0000 7f900e1b6640 1 -- 172.21.15.96:0/4154799443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f900806cc90 con 0x7f90081f7cc0 2024-06-02T23:47:22.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.563+0000 7f8feffff640 1 -- 172.21.15.96:0/4154799443 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f900002e050 con 0x7f90081f7cc0 2024-06-02T23:47:22.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 -- 172.21.15.96:0/4154799443 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8ff406be30 msgr2=0x7f8ff406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8ff406be30 0x7f8ff406e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80017e0 tx=0x7f8ff8009040 comp rx=0 tx=0).stop 2024-06-02T23:47:22.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 -- 172.21.15.96:0/4154799443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90081f7cc0 msgr2=0x7f90081f8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90081f7cc0 0x7f90081f8110 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9000009f90 tx=0x7f9000009750 comp rx=0 tx=0).stop 2024-06-02T23:47:22.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 -- 172.21.15.96:0/4154799443 shutdown_connections 2024-06-02T23:47:22.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f8ff406be30 0x7f8ff406e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90081f7cc0 0x7f90081f8110 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90080c9610 0x7f90080c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 --2- 172.21.15.96:0/4154799443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ff0004d40 0x7f900815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 -- 172.21.15.96:0/4154799443 >> 172.21.15.96:0/4154799443 conn(0x7f90080cfc30 msgr2=0x7f900806e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:22.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 -- 172.21.15.96:0/4154799443 shutdown_connections 2024-06-02T23:47:22.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.566+0000 7f900e1b6640 1 -- 172.21.15.96:0/4154799443 wait complete. 2024-06-02T23:47:22.577 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-06-02T23:47:22.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.676+0000 7f356381c640 1 Processor -- start 2024-06-02T23:47:22.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.676+0000 7f356381c640 1 -- start start 2024-06-02T23:47:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f356381c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f355c155570 0x7f355c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f356381c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c06eb50 0x7f355c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f356381c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f355c155950 con 0x7f355c0cab60 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f356381c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f355c06efb0 con 0x7f355c155570 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f356381c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f355c0cb2e0 con 0x7f355c06eb50 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f35615b8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f355c155570 0x7f355c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f35615b8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f355c155570 0x7f355c06e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38888/0 (socket says 172.21.15.96:38888) 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f35615b8640 1 -- 172.21.15.96:0/1240444926 learned_addr learned my addr 172.21.15.96:0/1240444926 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f3560db7640 1 --2- 172.21.15.96:0/1240444926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c06eb50 0x7f355c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f35615b8640 1 -- 172.21.15.96:0/1240444926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c06eb50 msgr2=0x7f355c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f35615b8640 1 --2- 172.21.15.96:0/1240444926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c06eb50 0x7f355c0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f35615b8640 1 -- 172.21.15.96:0/1240444926 >> v1:172.21.15.162:6789/0 conn(0x7f355c0cab60 legacy=0x7f355c15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f35615b8640 1 -- 172.21.15.96:0/1240444926 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c0cb5c0 con 0x7f355c155570 2024-06-02T23:47:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.677+0000 7f3560db7640 1 --2- 172.21.15.96:0/1240444926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c06eb50 0x7f355c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.678+0000 7f35615b8640 1 --2- 172.21.15.96:0/1240444926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c155570 0x7f355c06e610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3558009870 tx=0x7f355802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deed10ddc02bef54 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.678+0000 7f3553fff640 1 -- 172.21.15.96:0/1240444926 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3558037070 con 0x7f355c155570 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.678+0000 7f3553fff640 1 -- 172.21.15.96:0/1240444926 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3558032440 con 0x7f355c155570 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.678+0000 7f3553fff640 1 -- 172.21.15.96:0/1240444926 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3558032810 con 0x7f355c155570 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.678+0000 7f356381c640 1 -- 172.21.15.96:0/1240444926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c155570 msgr2=0x7f355c06e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.678+0000 7f356381c640 1 --2- 172.21.15.96:0/1240444926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c155570 0x7f355c06e610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3558009870 tx=0x7f355802a250 comp rx=0 tx=0).stop 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.679+0000 7f356381c640 1 -- 172.21.15.96:0/1240444926 shutdown_connections 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.679+0000 7f356381c640 1 --2- 172.21.15.96:0/1240444926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c06eb50 0x7f355c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.679+0000 7f356381c640 1 --2- 172.21.15.96:0/1240444926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c155570 0x7f355c06e610 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.679+0000 7f356381c640 1 -- 172.21.15.96:0/1240444926 >> 172.21.15.96:0/1240444926 conn(0x7f355c0cfc30 msgr2=0x7f355c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.679+0000 7f356381c640 1 -- 172.21.15.96:0/1240444926 shutdown_connections 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.679+0000 7f356381c640 1 -- 172.21.15.96:0/1240444926 wait complete. 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.680+0000 7f356381c640 1 Processor -- start 2024-06-02T23:47:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.680+0000 7f356381c640 1 -- start start 2024-06-02T23:47:22.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.680+0000 7f356381c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c06eb50 0x7f355c1f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.680+0000 7f356381c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355c0cab60 0x7f355c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.680+0000 7f356381c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c155570 0x7f355c0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.680+0000 7f356381c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f355c0caff0 con 0x7f355c06eb50 2024-06-02T23:47:22.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.680+0000 7f356381c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f355c071b00 con 0x7f355c0cab60 2024-06-02T23:47:22.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.680+0000 7f356381c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f355c0717d0 con 0x7f355c155570 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f35615b8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c06eb50 0x7f355c1f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f35615b8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c06eb50 0x7f355c1f1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38900/0 (socket says 172.21.15.96:38900) 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f35615b8640 1 -- 172.21.15.96:0/2274808612 learned_addr learned my addr 172.21.15.96:0/2274808612 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f3560db7640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355c0cab60 0x7f355c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f3561db9640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c155570 0x7f355c0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f35615b8640 1 -- 172.21.15.96:0/2274808612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c155570 msgr2=0x7f355c0c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f35615b8640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c155570 0x7f355c0c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f35615b8640 1 -- 172.21.15.96:0/2274808612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355c0cab60 msgr2=0x7f355c0c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f35615b8640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355c0cab60 0x7f355c0c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f35615b8640 1 -- 172.21.15.96:0/2274808612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c0b35e0 con 0x7f355c06eb50 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f3560db7640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355c0cab60 0x7f355c0c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f35615b8640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c06eb50 0x7f355c1f1720 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3558000c00 tx=0x7f35580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f3551ffb640 1 -- 172.21.15.96:0/2274808612 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3558037040 con 0x7f355c06eb50 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f3551ffb640 1 -- 172.21.15.96:0/2274808612 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3558042070 con 0x7f355c06eb50 2024-06-02T23:47:22.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f356381c640 1 -- 172.21.15.96:0/2274808612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355c0b38c0 con 0x7f355c06eb50 2024-06-02T23:47:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f3551ffb640 1 -- 172.21.15.96:0/2274808612 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3558030bd0 con 0x7f355c06eb50 2024-06-02T23:47:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.681+0000 7f356381c640 1 -- 172.21.15.96:0/2274808612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f355c0b3e80 con 0x7f355c06eb50 2024-06-02T23:47:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.682+0000 7f356381c640 1 -- 172.21.15.96:0/2274808612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f355c0683e0 con 0x7f355c06eb50 2024-06-02T23:47:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.683+0000 7f3551ffb640 1 -- 172.21.15.96:0/2274808612 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3558047460 con 0x7f355c06eb50 2024-06-02T23:47:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.683+0000 7f3551ffb640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f354006be30 0x7f354006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:22.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.683+0000 7f3560db7640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f354006be30 0x7f354006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:22.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.683+0000 7f3551ffb640 1 -- 172.21.15.96:0/2274808612 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f35580ab8f0 con 0x7f355c06eb50 2024-06-02T23:47:22.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.684+0000 7f3560db7640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f354006be30 0x7f354006e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f355c154720 tx=0x7f354c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:22.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.688+0000 7f3551ffb640 1 -- 172.21.15.96:0/2274808612 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3558045360 con 0x7f355c06eb50 2024-06-02T23:47:22.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.929+0000 7f356381c640 1 -- 172.21.15.96:0/2274808612 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f355c0ca6c0 con 0x7f355c06eb50 2024-06-02T23:47:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.931+0000 7f3551ffb640 1 -- 172.21.15.96:0/2274808612 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f355807a460 con 0x7f355c06eb50 2024-06-02T23:47:22.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 -- 172.21.15.96:0/2274808612 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f354006be30 msgr2=0x7f354006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f354006be30 0x7f354006e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f355c154720 tx=0x7f354c008040 comp rx=0 tx=0).stop 2024-06-02T23:47:22.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 -- 172.21.15.96:0/2274808612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c06eb50 msgr2=0x7f355c1f1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:22.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c06eb50 0x7f355c1f1720 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3558000c00 tx=0x7f35580046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 -- 172.21.15.96:0/2274808612 shutdown_connections 2024-06-02T23:47:22.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f355c155570 0x7f355c0c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355c0cab60 0x7f355c0c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f354006be30 0x7f354006e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 --2- 172.21.15.96:0/2274808612 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f355c06eb50 0x7f355c1f1720 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:22.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 -- 172.21.15.96:0/2274808612 >> 172.21.15.96:0/2274808612 conn(0x7f355c0cfc30 msgr2=0x7f355c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:22.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 -- 172.21.15.96:0/2274808612 shutdown_connections 2024-06-02T23:47:22.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:22.933+0000 7f356381c640 1 -- 172.21.15.96:0/2274808612 wait complete. 2024-06-02T23:47:22.944 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-06-02T23:47:23.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.044+0000 7f2393de2640 1 Processor -- start 2024-06-02T23:47:23.044 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.044+0000 7f2393de2640 1 -- start start 2024-06-02T23:47:23.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2393de2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f238c06b3c0 0x7f238c06b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2393de2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f238c15f290 0x7f238c0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2393de2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238c06bce0 con 0x7f238c067100 2024-06-02T23:47:23.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2393de2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f238c15ee00 con 0x7f238c06b3c0 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2393de2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f238c1627e0 con 0x7f238c15f290 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2391b7e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f238c06b3c0 0x7f238c06b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2391b7e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f238c06b3c0 0x7f238c06b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40290/0 (socket says 172.21.15.96:40290) 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2391b7e640 1 -- 172.21.15.96:0/2099715313 learned_addr learned my addr 172.21.15.96:0/2099715313 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f239137d640 1 --1- 172.21.15.96:0/2099715313 >> v1:172.21.15.96:6789/0 conn(0x7f238c067100 0x7f238c161f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:42920/0 (socket says 172.21.15.96:42920) 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f239237f640 1 --2- 172.21.15.96:0/2099715313 >> v2:172.21.15.162:3300/0 conn(0x7f238c15f290 0x7f238c0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2391b7e640 1 -- 172.21.15.96:0/2099715313 >> v2:172.21.15.162:3300/0 conn(0x7f238c15f290 msgr2=0x7f238c0b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2391b7e640 1 --2- 172.21.15.96:0/2099715313 >> v2:172.21.15.162:3300/0 conn(0x7f238c15f290 0x7f238c0b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2391b7e640 1 -- 172.21.15.96:0/2099715313 >> v1:172.21.15.96:6789/0 conn(0x7f238c067100 legacy=0x7f238c161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2391b7e640 1 -- 172.21.15.96:0/2099715313 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c162ac0 con 0x7f238c06b3c0 2024-06-02T23:47:23.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.045+0000 7f2390b7c640 1 -- 172.21.15.96:0/2099715313 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1003157966 0 0) 0x7f238c06bce0 con 0x7f238c067100 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.046+0000 7f2391b7e640 1 --2- 172.21.15.96:0/2099715313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c06b3c0 0x7f238c06b7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f238c073c10 tx=0x7f238802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40aa44add25deb94 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.046+0000 7f2390b7c640 1 -- 172.21.15.96:0/2099715313 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388037070 con 0x7f238c06b3c0 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.046+0000 7f2390b7c640 1 -- 172.21.15.96:0/2099715313 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2388032440 con 0x7f238c06b3c0 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.046+0000 7f2390b7c640 1 -- 172.21.15.96:0/2099715313 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388032810 con 0x7f238c06b3c0 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.046+0000 7f2393de2640 1 -- 172.21.15.96:0/2099715313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c06b3c0 msgr2=0x7f238c06b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.046+0000 7f2393de2640 1 --2- 172.21.15.96:0/2099715313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c06b3c0 0x7f238c06b7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f238c073c10 tx=0x7f238802a270 comp rx=0 tx=0).stop 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.046+0000 7f2393de2640 1 -- 172.21.15.96:0/2099715313 shutdown_connections 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.046+0000 7f2393de2640 1 --2- 172.21.15.96:0/2099715313 >> v2:172.21.15.162:3300/0 conn(0x7f238c15f290 0x7f238c0b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.046+0000 7f2393de2640 1 --2- 172.21.15.96:0/2099715313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c06b3c0 0x7f238c06b7a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.046+0000 7f2393de2640 1 -- 172.21.15.96:0/2099715313 >> 172.21.15.96:0/2099715313 conn(0x7f238c0b1f80 msgr2=0x7f238c0b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:23.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.047+0000 7f2393de2640 1 -- 172.21.15.96:0/2099715313 shutdown_connections 2024-06-02T23:47:23.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.047+0000 7f2393de2640 1 -- 172.21.15.96:0/2099715313 wait complete. 2024-06-02T23:47:23.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.048+0000 7f2393de2640 1 Processor -- start 2024-06-02T23:47:23.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.048+0000 7f2393de2640 1 -- start start 2024-06-02T23:47:23.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.048+0000 7f2393de2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c067100 0x7f238c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.048+0000 7f2393de2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f238c06b3c0 0x7f238c15fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.048+0000 7f2393de2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f238c15f290 0x7f238c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.048+0000 7f2393de2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f238c15f720 con 0x7f238c067100 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.048+0000 7f2393de2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f238c0afe90 con 0x7f238c06b3c0 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.048+0000 7f2393de2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f238c15f8a0 con 0x7f238c15f290 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2391b7e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c067100 0x7f238c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2391b7e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c067100 0x7f238c15c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40306/0 (socket says 172.21.15.96:40306) 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2391b7e640 1 -- 172.21.15.96:0/3580992652 learned_addr learned my addr 172.21.15.96:0/3580992652 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f239137d640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f238c06b3c0 0x7f238c15fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2391b7e640 1 -- 172.21.15.96:0/3580992652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f238c15f290 msgr2=0x7f238c15a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f239237f640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f238c15f290 0x7f238c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2391b7e640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f238c15f290 0x7f238c15a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2391b7e640 1 -- 172.21.15.96:0/3580992652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f238c06b3c0 msgr2=0x7f238c15fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2391b7e640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f238c06b3c0 0x7f238c15fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2391b7e640 1 -- 172.21.15.96:0/3580992652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238c09b7e0 con 0x7f238c067100 2024-06-02T23:47:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2391b7e640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c067100 0x7f238c15c130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f238802a2b0 tx=0x7f23880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f23827fc640 1 -- 172.21.15.96:0/3580992652 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388041070 con 0x7f238c067100 2024-06-02T23:47:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f23827fc640 1 -- 172.21.15.96:0/3580992652 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238803c870 con 0x7f238c067100 2024-06-02T23:47:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f23827fc640 1 -- 172.21.15.96:0/3580992652 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388037040 con 0x7f238c067100 2024-06-02T23:47:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2393de2640 1 -- 172.21.15.96:0/3580992652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238c160390 con 0x7f238c067100 2024-06-02T23:47:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.049+0000 7f2393de2640 1 -- 172.21.15.96:0/3580992652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238c160950 con 0x7f238c067100 2024-06-02T23:47:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.050+0000 7f2393de2640 1 -- 172.21.15.96:0/3580992652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238c0683e0 con 0x7f238c067100 2024-06-02T23:47:23.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.051+0000 7f23827fc640 1 -- 172.21.15.96:0/3580992652 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2388044070 con 0x7f238c067100 2024-06-02T23:47:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.051+0000 7f23827fc640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.051+0000 7f23827fc640 1 -- 172.21.15.96:0/3580992652 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f23880aba90 con 0x7f238c067100 2024-06-02T23:47:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.051+0000 7f239137d640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.052+0000 7f239137d640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f237006be30 0x7f237006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f237c007fd0 tx=0x7f237c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:23.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.055+0000 7f23827fc640 1 -- 172.21.15.96:0/3580992652 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f238807a720 con 0x7f238c067100 2024-06-02T23:47:23.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.295+0000 7f2393de2640 1 -- 172.21.15.96:0/3580992652 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f238c0b2cc0 con 0x7f238c067100 2024-06-02T23:47:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.297+0000 7f23827fc640 1 -- 172.21.15.96:0/3580992652 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f238807a020 con 0x7f238c067100 2024-06-02T23:47:23.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 -- 172.21.15.96:0/3580992652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f237006be30 msgr2=0x7f237006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f237006be30 0x7f237006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f237c007fd0 tx=0x7f237c009040 comp rx=0 tx=0).stop 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 -- 172.21.15.96:0/3580992652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c067100 msgr2=0x7f238c15c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c067100 0x7f238c15c130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f238802a2b0 tx=0x7f23880046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 -- 172.21.15.96:0/3580992652 shutdown_connections 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f238c15f290 0x7f238c15a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f238c06b3c0 0x7f238c15fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f237006be30 0x7f237006e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 --2- 172.21.15.96:0/3580992652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c067100 0x7f238c15c130 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 -- 172.21.15.96:0/3580992652 >> 172.21.15.96:0/3580992652 conn(0x7f238c0b1f80 msgr2=0x7f238c06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 -- 172.21.15.96:0/3580992652 shutdown_connections 2024-06-02T23:47:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.299+0000 7f2393de2640 1 -- 172.21.15.96:0/3580992652 wait complete. 2024-06-02T23:47:23.310 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-06-02T23:47:23.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.410+0000 7fabc03e2640 1 Processor -- start 2024-06-02T23:47:23.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.410+0000 7fabc03e2640 1 -- start start 2024-06-02T23:47:23.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabc03e2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fabb815a850 0x7fabb80ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabc03e2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80ca9d0 0x7fabb806e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabc03e2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb806ee70 con 0x7fabb806e650 2024-06-02T23:47:23.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabc03e2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fabb80cae30 con 0x7fabb815a850 2024-06-02T23:47:23.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabc03e2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fabb80711b0 con 0x7fabb80ca9d0 2024-06-02T23:47:23.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabbe97f640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fabb806e650 0x7fabb80cdbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:42932/0 (socket says 172.21.15.96:42932) 2024-06-02T23:47:23.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabbe97f640 1 -- 172.21.15.96:0/1798130718 learned_addr learned my addr 172.21.15.96:0/1798130718 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:23.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291614835 0 0) 0x7fabb806ee70 con 0x7fabb806e650 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabbe17e640 1 --2- 172.21.15.96:0/1798130718 >> v2:172.21.15.162:3300/0 conn(0x7fabb815a850 0x7fabb80ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabbd97d640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80ca9d0 0x7fabb806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.411+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faba4003520 con 0x7fabb806e650 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1775469090 0 0) 0x7faba4003520 con 0x7fabb806e650 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80ca9d0 msgr2=0x7fabb806e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80ca9d0 0x7fabb806e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 >> v2:172.21.15.162:3300/0 conn(0x7fabb815a850 msgr2=0x7fabb80ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 --2- 172.21.15.96:0/1798130718 >> v2:172.21.15.162:3300/0 conn(0x7fabb815a850 0x7fabb80ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb8071490 con 0x7fabb806e650 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fabb00019f0 con 0x7fabb806e650 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 >> v1:172.21.15.96:6789/0 conn(0x7fabb806e650 legacy=0x7fabb80cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba40039b0 0x7faba4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faba4004800 0x7faba4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80ca9d0 0x7faba40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fabb80711b0 con 0x7faba4004800 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faba400dbd0 con 0x7faba40039b0 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faba400dd80 con 0x7fabb80ca9d0 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd97d640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faba4004800 0x7faba4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbe17e640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba40039b0 0x7faba4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbe97f640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80ca9d0 0x7faba40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd97d640 1 -- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80ca9d0 msgr2=0x7faba40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd97d640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80ca9d0 0x7faba40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd97d640 1 -- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba40039b0 msgr2=0x7faba4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd97d640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba40039b0 0x7faba4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbd97d640 1 -- 172.21.15.96:0/1798130718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba4003520 con 0x7faba4004800 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.412+0000 7fabbe17e640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba40039b0 0x7faba4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.413+0000 7fabbd97d640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faba4004800 0x7faba4004c80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faba8009ac0 tx=0x7faba4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32b6058fcdb304b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.413+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8036070 con 0x7faba4004800 2024-06-02T23:47:23.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.413+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba8031400 con 0x7faba4004800 2024-06-02T23:47:23.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.413+0000 7fabbd17c640 1 -- 172.21.15.96:0/1798130718 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8009690 con 0x7faba4004800 2024-06-02T23:47:23.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.414+0000 7fabc03e2640 1 -- 172.21.15.96:0/1798130718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faba4004800 msgr2=0x7faba4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.414+0000 7fabc03e2640 1 --2- 172.21.15.96:0/1798130718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faba4004800 0x7faba4004c80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faba8009ac0 tx=0x7faba4005830 comp rx=0 tx=0).stop 2024-06-02T23:47:23.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.414+0000 7fabbe97f640 1 -- 172.21.15.96:0/1798130718 reap_dead start 2024-06-02T23:47:23.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.414+0000 7fabc03e2640 1 -- 172.21.15.96:0/1798130718 shutdown_connections 2024-06-02T23:47:23.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.414+0000 7fabc03e2640 1 -- 172.21.15.96:0/1798130718 >> 172.21.15.96:0/1798130718 conn(0x7fabb80cfc30 msgr2=0x7fabb80d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:23.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.414+0000 7fabc03e2640 1 -- 172.21.15.96:0/1798130718 shutdown_connections 2024-06-02T23:47:23.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.414+0000 7fabc03e2640 1 -- 172.21.15.96:0/1798130718 wait complete. 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.415+0000 7fabc03e2640 1 Processor -- start 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.415+0000 7fabc03e2640 1 -- start start 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabc03e2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004800 0x7fabb814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabc03e2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb8071f70 0x7fabb80723f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabc03e2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80c4980 0x7fabb80c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabc03e2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fabb806eae0 con 0x7fabb8071f70 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabc03e2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fabb8071a50 con 0x7faba4004800 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabc03e2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fabb8072f80 con 0x7fabb80c4980 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbd97d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb8071f70 0x7fabb80723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbd97d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb8071f70 0x7fabb80723f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40318/0 (socket says 172.21.15.96:40318) 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbd97d640 1 -- 172.21.15.96:0/3599352212 learned_addr learned my addr 172.21.15.96:0/3599352212 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbe17e640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004800 0x7fabb814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbe97f640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80c4980 0x7fabb80c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbd97d640 1 -- 172.21.15.96:0/3599352212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80c4980 msgr2=0x7fabb80c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbd97d640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80c4980 0x7fabb80c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbd97d640 1 -- 172.21.15.96:0/3599352212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004800 msgr2=0x7fabb814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbd97d640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004800 0x7fabb814ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbd97d640 1 -- 172.21.15.96:0/3599352212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb81504e0 con 0x7fabb8071f70 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbe17e640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004800 0x7fabb814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabbd97d640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb8071f70 0x7fabb80723f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faba8009be0 tx=0x7faba8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabaeffd640 1 -- 172.21.15.96:0/3599352212 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8041020 con 0x7fabb8071f70 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabaeffd640 1 -- 172.21.15.96:0/3599352212 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba803c470 con 0x7fabb8071f70 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabaeffd640 1 -- 172.21.15.96:0/3599352212 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8036040 con 0x7fabb8071f70 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabc03e2640 1 -- 172.21.15.96:0/3599352212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb80c5560 con 0x7fabb8071f70 2024-06-02T23:47:23.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.416+0000 7fabc03e2640 1 -- 172.21.15.96:0/3599352212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb80c7e80 con 0x7fabb8071f70 2024-06-02T23:47:23.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.417+0000 7fabc03e2640 1 -- 172.21.15.96:0/3599352212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb80683e0 con 0x7fabb8071f70 2024-06-02T23:47:23.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.418+0000 7fabaeffd640 1 -- 172.21.15.96:0/3599352212 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faba8044020 con 0x7fabb8071f70 2024-06-02T23:47:23.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.418+0000 7fabaeffd640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab9c06be30 0x7fab9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.419+0000 7fabbe17e640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab9c06be30 0x7fab9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.419+0000 7fabaeffd640 1 -- 172.21.15.96:0/3599352212 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7faba80ab3b0 con 0x7fabb8071f70 2024-06-02T23:47:23.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.419+0000 7fabbe17e640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab9c06be30 0x7fab9c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009bd0 tx=0x7fabb4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:23.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.423+0000 7fabaeffd640 1 -- 172.21.15.96:0/3599352212 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faba804b030 con 0x7fabb8071f70 2024-06-02T23:47:23.663 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.663+0000 7fabc03e2640 1 -- 172.21.15.96:0/3599352212 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fabb81efbc0 con 0x7fabb8071f70 2024-06-02T23:47:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.664+0000 7fabaeffd640 1 -- 172.21.15.96:0/3599352212 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7faba8079fb0 con 0x7fabb8071f70 2024-06-02T23:47:23.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.666+0000 7fabc03e2640 1 -- 172.21.15.96:0/3599352212 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab9c06be30 msgr2=0x7fab9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab9c06be30 0x7fab9c06e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009bd0 tx=0x7fabb4008040 comp rx=0 tx=0).stop 2024-06-02T23:47:23.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 -- 172.21.15.96:0/3599352212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb8071f70 msgr2=0x7fabb80723f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb8071f70 0x7fabb80723f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faba8009be0 tx=0x7faba8004730 comp rx=0 tx=0).stop 2024-06-02T23:47:23.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 -- 172.21.15.96:0/3599352212 shutdown_connections 2024-06-02T23:47:23.667 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80c4980 0x7fabb80c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab9c06be30 0x7fab9c06e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabb8071f70 0x7fabb80723f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 --2- 172.21.15.96:0/3599352212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004800 0x7fabb814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 -- 172.21.15.96:0/3599352212 >> 172.21.15.96:0/3599352212 conn(0x7fabb80cfc30 msgr2=0x7fabb80c9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:23.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 -- 172.21.15.96:0/3599352212 shutdown_connections 2024-06-02T23:47:23.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.667+0000 7fabc03e2640 1 -- 172.21.15.96:0/3599352212 wait complete. 2024-06-02T23:47:23.678 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T23:47:23.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.776+0000 7f3b04264640 1 Processor -- start 2024-06-02T23:47:23.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.776+0000 7f3b04264640 1 -- start start 2024-06-02T23:47:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.777+0000 7f3b04264640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3afc155570 0x7f3afc06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.777+0000 7f3b04264640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3afc0cad30 0x7f3afc072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.777+0000 7f3b04264640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3afc155950 con 0x7f3afc06eb50 2024-06-02T23:47:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.777+0000 7f3b04264640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f3afc0cb2e0 con 0x7f3afc0cad30 2024-06-02T23:47:23.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.777+0000 7f3b04264640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3afc0cb5c0 con 0x7f3afc155570 2024-06-02T23:47:23.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.777+0000 7f3b02801640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3afc0cad30 0x7f3afc072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.778+0000 7f3b02801640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3afc0cad30 0x7f3afc072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40330/0 (socket says 172.21.15.96:40330) 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.778+0000 7f3b02801640 1 -- 172.21.15.96:0/397469529 learned_addr learned my addr 172.21.15.96:0/397469529 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.778+0000 7f3b02000640 1 --2- 172.21.15.96:0/397469529 >> v2:172.21.15.162:3300/0 conn(0x7f3afc155570 0x7f3afc06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.778+0000 7f3b02801640 1 -- 172.21.15.96:0/397469529 >> v2:172.21.15.162:3300/0 conn(0x7f3afc155570 msgr2=0x7f3afc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.778+0000 7f3b02801640 1 --2- 172.21.15.96:0/397469529 >> v2:172.21.15.162:3300/0 conn(0x7f3afc155570 0x7f3afc06e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.778+0000 7f3b02801640 1 -- 172.21.15.96:0/397469529 >> v1:172.21.15.162:6789/0 conn(0x7f3afc06eb50 legacy=0x7f3afc0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.778+0000 7f3b02801640 1 -- 172.21.15.96:0/397469529 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc0cb8a0 con 0x7f3afc0cad30 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.778+0000 7f3b02801640 1 --2- 172.21.15.96:0/397469529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0cad30 0x7f3afc072020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3afc06f920 tx=0x7f3af402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f567ded61711b9b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b00ffe640 1 -- 172.21.15.96:0/397469529 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4036070 con 0x7f3afc0cad30 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b00ffe640 1 -- 172.21.15.96:0/397469529 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af4031600 con 0x7f3afc0cad30 2024-06-02T23:47:23.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b00ffe640 1 -- 172.21.15.96:0/397469529 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40319d0 con 0x7f3afc0cad30 2024-06-02T23:47:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b04264640 1 -- 172.21.15.96:0/397469529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0cad30 msgr2=0x7f3afc072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b04264640 1 --2- 172.21.15.96:0/397469529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0cad30 0x7f3afc072020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3afc06f920 tx=0x7f3af402a6f0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b04264640 1 -- 172.21.15.96:0/397469529 shutdown_connections 2024-06-02T23:47:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b04264640 1 --2- 172.21.15.96:0/397469529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc0cad30 0x7f3afc072020 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b04264640 1 --2- 172.21.15.96:0/397469529 >> v2:172.21.15.162:3300/0 conn(0x7f3afc155570 0x7f3afc06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b04264640 1 -- 172.21.15.96:0/397469529 >> 172.21.15.96:0/397469529 conn(0x7f3afc0cfc30 msgr2=0x7f3afc0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b04264640 1 -- 172.21.15.96:0/397469529 shutdown_connections 2024-06-02T23:47:23.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.779+0000 7f3b04264640 1 -- 172.21.15.96:0/397469529 wait complete. 2024-06-02T23:47:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b04264640 1 Processor -- start 2024-06-02T23:47:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b04264640 1 -- start start 2024-06-02T23:47:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b04264640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc06eb50 0x7f3afc15db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b04264640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3afc0cad30 0x7f3afc0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b04264640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3afc155570 0x7f3afc15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b04264640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc072560 con 0x7f3afc06eb50 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b04264640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc0717d0 con 0x7f3afc0cad30 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b04264640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3afc0726e0 con 0x7f3afc155570 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b02000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc06eb50 0x7f3afc15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b02000640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc06eb50 0x7f3afc15db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40342/0 (socket says 172.21.15.96:40342) 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.781+0000 7f3b02000640 1 -- 172.21.15.96:0/4223455841 learned_addr learned my addr 172.21.15.96:0/4223455841 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3b02801640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3afc155570 0x7f3afc15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3b02000640 1 -- 172.21.15.96:0/4223455841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3afc155570 msgr2=0x7f3afc15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3b02000640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3afc155570 0x7f3afc15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3b017ff640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3afc0cad30 0x7f3afc0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3b02000640 1 -- 172.21.15.96:0/4223455841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3afc0cad30 msgr2=0x7f3afc0b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3b02000640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3afc0cad30 0x7f3afc0b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3b02000640 1 -- 172.21.15.96:0/4223455841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc0b4980 con 0x7f3afc06eb50 2024-06-02T23:47:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3b02000640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc06eb50 0x7f3afc15db10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3af800d620 tx=0x7f3af800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3af27fc640 1 -- 172.21.15.96:0/4223455841 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af800b620 con 0x7f3afc06eb50 2024-06-02T23:47:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3af27fc640 1 -- 172.21.15.96:0/4223455841 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af8019070 con 0x7f3afc06eb50 2024-06-02T23:47:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3b04264640 1 -- 172.21.15.96:0/4223455841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3afc0b4c00 con 0x7f3afc06eb50 2024-06-02T23:47:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3af27fc640 1 -- 172.21.15.96:0/4223455841 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af800ba00 con 0x7f3afc06eb50 2024-06-02T23:47:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.782+0000 7f3b04264640 1 -- 172.21.15.96:0/4223455841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3afc0b51c0 con 0x7f3afc06eb50 2024-06-02T23:47:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.783+0000 7f3b04264640 1 -- 172.21.15.96:0/4223455841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3afc0b5400 con 0x7f3afc06eb50 2024-06-02T23:47:23.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.784+0000 7f3af27fc640 1 -- 172.21.15.96:0/4223455841 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3af800bba0 con 0x7f3afc06eb50 2024-06-02T23:47:23.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.784+0000 7f3af27fc640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3ae006be30 0x7f3ae006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:23.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.784+0000 7f3af27fc640 1 -- 172.21.15.96:0/4223455841 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f3af808b0b0 con 0x7f3afc06eb50 2024-06-02T23:47:23.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.784+0000 7f3b017ff640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3ae006be30 0x7f3ae006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:23.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.785+0000 7f3b017ff640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3ae006be30 0x7f3ae006e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3afc15f780 tx=0x7f3aec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:23.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.788+0000 7f3af27fc640 1 -- 172.21.15.96:0/4223455841 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3afc0b4980 con 0x7f3afc06eb50 2024-06-02T23:47:23.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.963+0000 7f3b04264640 1 -- 172.21.15.96:0/4223455841 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3afc06cc90 con 0x7f3afc06eb50 2024-06-02T23:47:23.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.964+0000 7f3af27fc640 1 -- 172.21.15.96:0/4223455841 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f3af8059c20 con 0x7f3afc06eb50 2024-06-02T23:47:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:23.964 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-06-02T23:47:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2024-06-02T23:47:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2024-06-02T23:47:23.964 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:23.965 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-06-02T23:47:23.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 -- 172.21.15.96:0/4223455841 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3ae006be30 msgr2=0x7f3ae006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3ae006be30 0x7f3ae006e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3afc15f780 tx=0x7f3aec009040 comp rx=0 tx=0).stop 2024-06-02T23:47:23.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 -- 172.21.15.96:0/4223455841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc06eb50 msgr2=0x7f3afc15db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:23.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc06eb50 0x7f3afc15db10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3af800d620 tx=0x7f3af800dae0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 -- 172.21.15.96:0/4223455841 shutdown_connections 2024-06-02T23:47:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3afc155570 0x7f3afc15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3afc0cad30 0x7f3afc0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f3ae006be30 0x7f3ae006e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 --2- 172.21.15.96:0/4223455841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3afc06eb50 0x7f3afc15db10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 -- 172.21.15.96:0/4223455841 >> 172.21.15.96:0/4223455841 conn(0x7f3afc0cfc30 msgr2=0x7f3afc06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 -- 172.21.15.96:0/4223455841 shutdown_connections 2024-06-02T23:47:23.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:23.966+0000 7f3b04264640 1 -- 172.21.15.96:0/4223455841 wait complete. 2024-06-02T23:47:23.977 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T23:47:23.977 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T23:47:24.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.080+0000 7f360456a640 1 Processor -- start 2024-06-02T23:47:24.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.080+0000 7f360456a640 1 -- start start 2024-06-02T23:47:24.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.081+0000 7f360456a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc15e470 0x7f35fc0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:24.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.081+0000 7f360456a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f35fc06e7b0 0x7f35fc0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:24.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.081+0000 7f360456a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35fc0af400 con 0x7f35fc0cc480 2024-06-02T23:47:24.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.081+0000 7f360456a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f35fc15e850 con 0x7f35fc06e7b0 2024-06-02T23:47:24.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.081+0000 7f360456a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f35fc0cc990 con 0x7f35fc15e470 2024-06-02T23:47:24.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.081+0000 7f3602306640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc15e470 0x7f35fc0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:24.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.081+0000 7f3602306640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc15e470 0x7f35fc0cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:40958/0 (socket says 172.21.15.96:40958) 2024-06-02T23:47:24.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.081+0000 7f3602306640 1 -- 172.21.15.96:0/1423460969 learned_addr learned my addr 172.21.15.96:0/1423460969 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:24.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.081+0000 7f3602b07640 1 --2- 172.21.15.96:0/1423460969 >> v2:172.21.15.162:3300/0 conn(0x7f35fc06e7b0 0x7f35fc0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:24.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.082+0000 7f3602b07640 1 -- 172.21.15.96:0/1423460969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc15e470 msgr2=0x7f35fc0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:24.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.082+0000 7f3602b07640 1 --2- 172.21.15.96:0/1423460969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc15e470 0x7f35fc0cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:24.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.082+0000 7f3602b07640 1 -- 172.21.15.96:0/1423460969 >> v1:172.21.15.162:6789/0 conn(0x7f35fc0cc480 legacy=0x7f35fc06e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:24.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.082+0000 7f3602b07640 1 -- 172.21.15.96:0/1423460969 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc0ccc70 con 0x7f35fc06e7b0 2024-06-02T23:47:24.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.082+0000 7f3602306640 1 --2- 172.21.15.96:0/1423460969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc15e470 0x7f35fc0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:47:24.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.082+0000 7f3602b07640 1 --2- 172.21.15.96:0/1423460969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35fc06e7b0 0x7f35fc0ce620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009d90 tx=0x7f35f402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba8c147e1afd749c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:24.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.082+0000 7f3601304640 1 -- 172.21.15.96:0/1423460969 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4007740 con 0x7f35fc06e7b0 2024-06-02T23:47:24.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.083+0000 7f3601304640 1 -- 172.21.15.96:0/1423460969 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f40078e0 con 0x7f35fc06e7b0 2024-06-02T23:47:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.083+0000 7f3601304640 1 -- 172.21.15.96:0/1423460969 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4007cb0 con 0x7f35fc06e7b0 2024-06-02T23:47:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.083+0000 7f360456a640 1 -- 172.21.15.96:0/1423460969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35fc06e7b0 msgr2=0x7f35fc0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.083+0000 7f360456a640 1 --2- 172.21.15.96:0/1423460969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35fc06e7b0 0x7f35fc0ce620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009d90 tx=0x7f35f402a660 comp rx=0 tx=0).stop 2024-06-02T23:47:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.083+0000 7f360456a640 1 -- 172.21.15.96:0/1423460969 shutdown_connections 2024-06-02T23:47:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.083+0000 7f360456a640 1 --2- 172.21.15.96:0/1423460969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35fc06e7b0 0x7f35fc0ce620 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.083+0000 7f360456a640 1 --2- 172.21.15.96:0/1423460969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc15e470 0x7f35fc0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:24.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.083+0000 7f360456a640 1 -- 172.21.15.96:0/1423460969 >> 172.21.15.96:0/1423460969 conn(0x7f35fc0b1a40 msgr2=0x7f35fc0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:24.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.083+0000 7f360456a640 1 -- 172.21.15.96:0/1423460969 shutdown_connections 2024-06-02T23:47:24.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.083+0000 7f360456a640 1 -- 172.21.15.96:0/1423460969 wait complete. 2024-06-02T23:47:24.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.084+0000 7f360456a640 1 Processor -- start 2024-06-02T23:47:24.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.084+0000 7f360456a640 1 -- start start 2024-06-02T23:47:24.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f360456a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc06e7b0 0x7f35fc0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f360456a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35fc0cc480 0x7f35fc14d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f360456a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35fc15e470 0x7f35fc14b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f360456a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc0cd510 con 0x7f35fc0cc480 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f360456a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc0cd230 con 0x7f35fc15e470 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f360456a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f35fc0cb8b0 con 0x7f35fc06e7b0 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f3601b05640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35fc0cc480 0x7f35fc14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f3601b05640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35fc0cc480 0x7f35fc14d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40358/0 (socket says 172.21.15.96:40358) 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f3601b05640 1 -- 172.21.15.96:0/3440458999 learned_addr learned my addr 172.21.15.96:0/3440458999 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f3602306640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc06e7b0 0x7f35fc0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f3602b07640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35fc15e470 0x7f35fc14b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f3601b05640 1 -- 172.21.15.96:0/3440458999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc06e7b0 msgr2=0x7f35fc0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:24.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f3601b05640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc06e7b0 0x7f35fc0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f3601b05640 1 -- 172.21.15.96:0/3440458999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35fc15e470 msgr2=0x7f35fc14b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.085+0000 7f3601b05640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35fc15e470 0x7f35fc14b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.086+0000 7f3601b05640 1 -- 172.21.15.96:0/3440458999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc0ad720 con 0x7f35fc0cc480 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.086+0000 7f3602306640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc06e7b0 0x7f35fc0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.086+0000 7f3602b07640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35fc15e470 0x7f35fc14b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.086+0000 7f3601b05640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35fc0cc480 0x7f35fc14d760 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c3c0 tx=0x7f35ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.086+0000 7f35f2ffd640 1 -- 172.21.15.96:0/3440458999 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec017070 con 0x7f35fc0cc480 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.086+0000 7f35f2ffd640 1 -- 172.21.15.96:0/3440458999 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec0052f0 con 0x7f35fc0cc480 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.086+0000 7f35f2ffd640 1 -- 172.21.15.96:0/3440458999 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec003850 con 0x7f35fc0cc480 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.086+0000 7f360456a640 1 -- 172.21.15.96:0/3440458999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35fc0ada00 con 0x7f35fc0cc480 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.086+0000 7f360456a640 1 -- 172.21.15.96:0/3440458999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35fc0adfc0 con 0x7f35fc0cc480 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.087+0000 7f360456a640 1 -- 172.21.15.96:0/3440458999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35fc0683e0 con 0x7f35fc0cc480 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.087+0000 7f35f2ffd640 1 -- 172.21.15.96:0/3440458999 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35ec01a070 con 0x7f35fc0cc480 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.088+0000 7f35f2ffd640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f35e006be30 0x7f35e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.088+0000 7f3602306640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f35e006be30 0x7f35e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:24.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.088+0000 7f35f2ffd640 1 -- 172.21.15.96:0/3440458999 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f35ec08a000 con 0x7f35fc0cc480 2024-06-02T23:47:24.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.088+0000 7f3602306640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f35e006be30 0x7f35e006e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35fc15da90 tx=0x7f35f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:24.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.092+0000 7f35f2ffd640 1 -- 172.21.15.96:0/3440458999 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f35fc0af400 con 0x7f35fc0cc480 2024-06-02T23:47:24.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:24.265+0000 7f360456a640 1 -- 172.21.15.96:0/3440458999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f35fc0cdf90 con 0x7f35fc0cc480 2024-06-02T23:47:25.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.071+0000 7f35f2ffd640 1 -- 172.21.15.96:0/3440458999 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f35ec058b70 con 0x7f35fc0cc480 2024-06-02T23:47:25.071 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2024-06-02T23:47:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 -- 172.21.15.96:0/3440458999 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f35e006be30 msgr2=0x7f35e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f35e006be30 0x7f35e006e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35fc15da90 tx=0x7f35f8008040 comp rx=0 tx=0).stop 2024-06-02T23:47:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 -- 172.21.15.96:0/3440458999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35fc0cc480 msgr2=0x7f35fc14d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35fc0cc480 0x7f35fc14d760 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c3c0 tx=0x7f35ec00c880 comp rx=0 tx=0).stop 2024-06-02T23:47:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 -- 172.21.15.96:0/3440458999 shutdown_connections 2024-06-02T23:47:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35fc15e470 0x7f35fc14b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f35e006be30 0x7f35e006e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35fc0cc480 0x7f35fc14d760 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 --2- 172.21.15.96:0/3440458999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35fc06e7b0 0x7f35fc0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 -- 172.21.15.96:0/3440458999 >> 172.21.15.96:0/3440458999 conn(0x7f35fc0b1a40 msgr2=0x7f35fc06d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.074+0000 7f360456a640 1 -- 172.21.15.96:0/3440458999 shutdown_connections 2024-06-02T23:47:25.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.075+0000 7f360456a640 1 -- 172.21.15.96:0/3440458999 wait complete. 2024-06-02T23:47:25.090 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T23:47:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.201+0000 7ff22f237640 1 Processor -- start 2024-06-02T23:47:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.201+0000 7ff22f237640 1 -- start start 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff22f237640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff22815fc40 0x7ff228071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff22f237640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff228072fa0 con 0x7ff2280729e0 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff22f237640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2280712a0 con 0x7ff22806ec50 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff22f237640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff2280718f0 con 0x7ff22815fc40 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21ffff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff2280729e0 0x7ff228160020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:42948/0 (socket says 172.21.15.96:42948) 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21ffff640 1 -- 172.21.15.96:0/2021702171 learned_addr learned my addr 172.21.15.96:0/2021702171 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129525608 0 0) 0x7ff228072fa0 con 0x7ff2280729e0 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff210003520 con 0x7ff2280729e0 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff22cfd3640 1 --2- 172.21.15.96:0/2021702171 >> v2:172.21.15.162:3300/0 conn(0x7ff22815fc40 0x7ff228071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 220705682 0 0) 0x7ff210003520 con 0x7ff2280729e0 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 >> v2:172.21.15.162:3300/0 conn(0x7ff22815fc40 msgr2=0x7ff228071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 --2- 172.21.15.96:0/2021702171 >> v2:172.21.15.162:3300/0 conn(0x7ff22815fc40 0x7ff228071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 >> v1:172.21.15.162:6789/0 conn(0x7ff22806ec50 legacy=0x7ff2280ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff228071580 con 0x7ff2280729e0 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7ff218001670 con 0x7ff2280729e0 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 >> v1:172.21.15.96:6789/0 conn(0x7ff2280729e0 legacy=0x7ff228160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2100039b0 0x7ff210003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.202+0000 7ff21f7fe640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff210004800 0x7ff210004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21f7fe640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210005210 0x7ff21000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff2280718f0 con 0x7ff210004800 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff21000c140 con 0x7ff210005210 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff21000c340 con 0x7ff2100039b0 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21ffff640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff210004800 0x7ff210004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff22cfd3640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2100039b0 0x7ff210003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff22d7d4640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210005210 0x7ff21000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21ffff640 1 -- 172.21.15.96:0/2021702171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2100039b0 msgr2=0x7ff210003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21ffff640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2100039b0 0x7ff210003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21ffff640 1 -- 172.21.15.96:0/2021702171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210005210 msgr2=0x7ff21000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:25.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21ffff640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210005210 0x7ff21000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21ffff640 1 -- 172.21.15.96:0/2021702171 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff210003520 con 0x7ff210004800 2024-06-02T23:47:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff22d7d4640 1 -- 172.21.15.96:0/2021702171 reap_dead start 2024-06-02T23:47:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff22cfd3640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2100039b0 0x7ff210003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.203+0000 7ff21ffff640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff210004800 0x7ff210004c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff21800c240 tx=0x7ff210005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecf2c904bb22ab5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.204+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218007cf0 con 0x7ff210004800 2024-06-02T23:47:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.204+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2180058d0 con 0x7ff210004800 2024-06-02T23:47:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.204+0000 7ff21f7fe640 1 -- 172.21.15.96:0/2021702171 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218005d20 con 0x7ff210004800 2024-06-02T23:47:25.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.204+0000 7ff22f237640 1 -- 172.21.15.96:0/2021702171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff210004800 msgr2=0x7ff210004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:25.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.204+0000 7ff22f237640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff210004800 0x7ff210004c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff21800c240 tx=0x7ff210005830 comp rx=0 tx=0).stop 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.204+0000 7ff22f237640 1 -- 172.21.15.96:0/2021702171 shutdown_connections 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.204+0000 7ff22f237640 1 --2- 172.21.15.96:0/2021702171 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff210004800 0x7ff210004c80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.204+0000 7ff22f237640 1 -- 172.21.15.96:0/2021702171 >> 172.21.15.96:0/2021702171 conn(0x7ff2280cfcb0 msgr2=0x7ff2280d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.204+0000 7ff22f237640 1 -- 172.21.15.96:0/2021702171 shutdown_connections 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.204+0000 7ff22f237640 1 -- 172.21.15.96:0/2021702171 wait complete. 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.205+0000 7ff22f237640 1 Processor -- start 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.205+0000 7ff22f237640 1 -- start start 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.206+0000 7ff22f237640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210004800 0x7ff2280c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.206+0000 7ff22f237640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2280c6010 0x7ff228152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.206+0000 7ff22f237640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff228156d10 0x7ff22815af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.206+0000 7ff22f237640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff228071f00 con 0x7ff228156d10 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.206+0000 7ff22f237640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff228071d80 con 0x7ff210004800 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.206+0000 7ff22f237640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff228072080 con 0x7ff2280c6010 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.206+0000 7ff22d7d4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff228156d10 0x7ff22815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:25.209 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.206+0000 7ff22d7d4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff228156d10 0x7ff22815af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40378/0 (socket says 172.21.15.96:40378) 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.206+0000 7ff22d7d4640 1 -- 172.21.15.96:0/4223613574 learned_addr learned my addr 172.21.15.96:0/4223613574 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff22cfd3640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210004800 0x7ff2280c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff21ffff640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2280c6010 0x7ff228152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff22d7d4640 1 -- 172.21.15.96:0/4223613574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2280c6010 msgr2=0x7ff228152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff22d7d4640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2280c6010 0x7ff228152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff22d7d4640 1 -- 172.21.15.96:0/4223613574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210004800 msgr2=0x7ff2280c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff22d7d4640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210004800 0x7ff2280c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff22d7d4640 1 -- 172.21.15.96:0/4223613574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff228159f00 con 0x7ff228156d10 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff22cfd3640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210004800 0x7ff2280c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff22d7d4640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff228156d10 0x7ff22815af60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff220007fd0 tx=0x7ff22000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff21d7fa640 1 -- 172.21.15.96:0/4223613574 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220019070 con 0x7ff228156d10 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff21d7fa640 1 -- 172.21.15.96:0/4223613574 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff220006d60 con 0x7ff228156d10 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff21d7fa640 1 -- 172.21.15.96:0/4223613574 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220003b90 con 0x7ff228156d10 2024-06-02T23:47:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff22f237640 1 -- 172.21.15.96:0/4223613574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22815a1a0 con 0x7ff228156d10 2024-06-02T23:47:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.207+0000 7ff22f237640 1 -- 172.21.15.96:0/4223613574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22815a760 con 0x7ff228156d10 2024-06-02T23:47:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.208+0000 7ff22f237640 1 -- 172.21.15.96:0/4223613574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2280683e0 con 0x7ff228156d10 2024-06-02T23:47:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.209+0000 7ff21d7fa640 1 -- 172.21.15.96:0/4223613574 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff22001c070 con 0x7ff228156d10 2024-06-02T23:47:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.209+0000 7ff21d7fa640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff21406be30 0x7ff21406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.209+0000 7ff21d7fa640 1 -- 172.21.15.96:0/4223613574 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7ff22008a3f0 con 0x7ff228156d10 2024-06-02T23:47:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.209+0000 7ff22cfd3640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff21406be30 0x7ff21406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:25.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.209+0000 7ff22cfd3640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff21406be30 0x7ff21406e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff228069fa0 tx=0x7ff224008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:25.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.214+0000 7ff21d7fa640 1 -- 172.21.15.96:0/4223613574 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff220058e80 con 0x7ff228156d10 2024-06-02T23:47:25.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:25.387+0000 7ff22f237640 1 -- 172.21.15.96:0/4223613574 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff2280c3550 con 0x7ff228156d10 2024-06-02T23:47:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.078+0000 7ff21d7fa640 1 -- 172.21.15.96:0/4223613574 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7ff220058780 con 0x7ff228156d10 2024-06-02T23:47:26.079 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2024-06-02T23:47:26.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 -- 172.21.15.96:0/4223613574 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff21406be30 msgr2=0x7ff21406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:26.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff21406be30 0x7ff21406e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff228069fa0 tx=0x7ff224008040 comp rx=0 tx=0).stop 2024-06-02T23:47:26.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 -- 172.21.15.96:0/4223613574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff228156d10 msgr2=0x7ff22815af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:26.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff228156d10 0x7ff22815af60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff220007fd0 tx=0x7ff22000ea00 comp rx=0 tx=0).stop 2024-06-02T23:47:26.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 -- 172.21.15.96:0/4223613574 shutdown_connections 2024-06-02T23:47:26.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff21406be30 0x7ff21406e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:26.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff228156d10 0x7ff22815af60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:26.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2280c6010 0x7ff228152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:26.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 --2- 172.21.15.96:0/4223613574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff210004800 0x7ff2280c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:26.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 -- 172.21.15.96:0/4223613574 >> 172.21.15.96:0/4223613574 conn(0x7ff2280cfcb0 msgr2=0x7ff228154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:26.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 -- 172.21.15.96:0/4223613574 shutdown_connections 2024-06-02T23:47:26.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.081+0000 7ff22f237640 1 -- 172.21.15.96:0/4223613574 wait complete. 2024-06-02T23:47:26.105 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T23:47:26.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.211+0000 7f48159a5640 1 Processor -- start 2024-06-02T23:47:26.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.211+0000 7f48159a5640 1 -- start start 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.212+0000 7f48159a5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f48100d2d70 0x7f48100b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.212+0000 7f48159a5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f48100d4ba0 0x7f48100b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.212+0000 7f48159a5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48100d1310 con 0x7f481015e490 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.212+0000 7f48159a5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f48100d10c0 con 0x7f48100d4ba0 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.212+0000 7f48159a5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f48100b0d40 con 0x7f48100d2d70 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.212+0000 7f480f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f48100d4ba0 0x7f48100b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.212+0000 7f480f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f48100d4ba0 0x7f48100b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40394/0 (socket says 172.21.15.96:40394) 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.212+0000 7f480f7fe640 1 -- 172.21.15.96:0/3580270520 learned_addr learned my addr 172.21.15.96:0/3580270520 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.213+0000 7f48067fc640 1 --2- 172.21.15.96:0/3580270520 >> v2:172.21.15.162:3300/0 conn(0x7f48100d2d70 0x7f48100b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.213+0000 7f480f7fe640 1 -- 172.21.15.96:0/3580270520 >> v2:172.21.15.162:3300/0 conn(0x7f48100d2d70 msgr2=0x7f48100b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.213+0000 7f480f7fe640 1 --2- 172.21.15.96:0/3580270520 >> v2:172.21.15.162:3300/0 conn(0x7f48100d2d70 0x7f48100b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.213+0000 7f480f7fe640 1 -- 172.21.15.96:0/3580270520 >> v1:172.21.15.162:6789/0 conn(0x7f481015e490 legacy=0x7f48100d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.213+0000 7f480f7fe640 1 -- 172.21.15.96:0/3580270520 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48100d15f0 con 0x7f48100d4ba0 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.213+0000 7f480f7fe640 1 --2- 172.21.15.96:0/3580270520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 0x7f48100b1710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f48100ba130 tx=0x7f480802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed089ece6dc55877 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.213+0000 7f480e7fc640 1 -- 172.21.15.96:0/3580270520 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808036070 con 0x7f48100d4ba0 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.214+0000 7f480e7fc640 1 -- 172.21.15.96:0/3580270520 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4808031600 con 0x7f48100d4ba0 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.214+0000 7f480e7fc640 1 -- 172.21.15.96:0/3580270520 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48080319d0 con 0x7f48100d4ba0 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.214+0000 7f48159a5640 1 -- 172.21.15.96:0/3580270520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 msgr2=0x7f48100b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.214+0000 7f48159a5640 1 --2- 172.21.15.96:0/3580270520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 0x7f48100b1710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f48100ba130 tx=0x7f480802a660 comp rx=0 tx=0).stop 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.214+0000 7f48159a5640 1 -- 172.21.15.96:0/3580270520 shutdown_connections 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.214+0000 7f48159a5640 1 --2- 172.21.15.96:0/3580270520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 0x7f48100b1710 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.214+0000 7f48159a5640 1 --2- 172.21.15.96:0/3580270520 >> v2:172.21.15.162:3300/0 conn(0x7f48100d2d70 0x7f48100b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.214+0000 7f48159a5640 1 -- 172.21.15.96:0/3580270520 >> 172.21.15.96:0/3580270520 conn(0x7f48100d4080 msgr2=0x7f48100d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.214+0000 7f48159a5640 1 -- 172.21.15.96:0/3580270520 shutdown_connections 2024-06-02T23:47:26.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.214+0000 7f48159a5640 1 -- 172.21.15.96:0/3580270520 wait complete. 2024-06-02T23:47:26.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.215+0000 7f48159a5640 1 Processor -- start 2024-06-02T23:47:26.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.215+0000 7f48159a5640 1 -- start start 2024-06-02T23:47:26.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f48159a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48100d2d70 0x7f48100b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:26.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f48159a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 0x7f4810152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:26.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f48159a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f481015e490 0x7f48100ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:26.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f48159a5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f48100d2020 con 0x7f48100d4ba0 2024-06-02T23:47:26.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f48159a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f481015e870 con 0x7f481015e490 2024-06-02T23:47:26.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f48159a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48100d21a0 con 0x7f48100d2d70 2024-06-02T23:47:26.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f48067fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 0x7f4810152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:26.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f48067fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 0x7f4810152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40406/0 (socket says 172.21.15.96:40406) 2024-06-02T23:47:26.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f48067fc640 1 -- 172.21.15.96:0/3217619011 learned_addr learned my addr 172.21.15.96:0/3217619011 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:26.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f480effd640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48100d2d70 0x7f48100b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:26.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.216+0000 7f480f7fe640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f481015e490 0x7f48100ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:26.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f48067fc640 1 -- 172.21.15.96:0/3217619011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48100d2d70 msgr2=0x7f48100b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f48067fc640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48100d2d70 0x7f48100b6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f48067fc640 1 -- 172.21.15.96:0/3217619011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f481015e490 msgr2=0x7f48100ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f48067fc640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f481015e490 0x7f48100ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f48067fc640 1 -- 172.21.15.96:0/3217619011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48100b71a0 con 0x7f48100d4ba0 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f480effd640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48100d2d70 0x7f48100b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f48067fc640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 0x7f4810152340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f47f800d620 tx=0x7f47f800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f480cff9640 1 -- 172.21.15.96:0/3217619011 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f800b620 con 0x7f48100d4ba0 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f480cff9640 1 -- 172.21.15.96:0/3217619011 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f8019070 con 0x7f48100d4ba0 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f48159a5640 1 -- 172.21.15.96:0/3217619011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48100b7480 con 0x7f48100d4ba0 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f480cff9640 1 -- 172.21.15.96:0/3217619011 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f800ba00 con 0x7f48100d4ba0 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.217+0000 7f48159a5640 1 -- 172.21.15.96:0/3217619011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48100b7a40 con 0x7f48100d4ba0 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.218+0000 7f48159a5640 1 -- 172.21.15.96:0/3217619011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48100683e0 con 0x7f48100d4ba0 2024-06-02T23:47:26.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.218+0000 7f480cff9640 1 -- 172.21.15.96:0/3217619011 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47f800bba0 con 0x7f48100d4ba0 2024-06-02T23:47:26.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.219+0000 7f480cff9640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f47f006be30 0x7f47f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:26.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.219+0000 7f480cff9640 1 -- 172.21.15.96:0/3217619011 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7f47f808b260 con 0x7f48100d4ba0 2024-06-02T23:47:26.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.219+0000 7f480effd640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f47f006be30 0x7f47f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:26.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.219+0000 7f480effd640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f47f006be30 0x7f47f006e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4800003eb0 tx=0x7f4800009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:26.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.224+0000 7f480cff9640 1 -- 172.21.15.96:0/3217619011 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f47f8059b70 con 0x7f48100d4ba0 2024-06-02T23:47:26.253 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:47:26.256 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:47:26.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:26.437+0000 7f48159a5640 1 -- 172.21.15.96:0/3217619011 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f48100b2e60 con 0x7f48100d4ba0 2024-06-02T23:47:27.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.080+0000 7f480cff9640 1 -- 172.21.15.96:0/3217619011 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f47f8059470 con 0x7f48100d4ba0 2024-06-02T23:47:27.080 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 5 and data pool 6 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.083+0000 7f48159a5640 1 -- 172.21.15.96:0/3217619011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f47f006be30 msgr2=0x7f47f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.083+0000 7f48159a5640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f47f006be30 0x7f47f006e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4800003eb0 tx=0x7f4800009040 comp rx=0 tx=0).stop 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.083+0000 7f48159a5640 1 -- 172.21.15.96:0/3217619011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 msgr2=0x7f4810152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.083+0000 7f48159a5640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 0x7f4810152340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f47f800d620 tx=0x7f47f800dae0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.084+0000 7f48159a5640 1 -- 172.21.15.96:0/3217619011 shutdown_connections 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.084+0000 7f48159a5640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f481015e490 0x7f48100ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.084+0000 7f48159a5640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f47f006be30 0x7f47f006e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.084+0000 7f48159a5640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48100d4ba0 0x7f4810152340 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.084+0000 7f48159a5640 1 --2- 172.21.15.96:0/3217619011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48100d2d70 0x7f48100b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.084+0000 7f48159a5640 1 -- 172.21.15.96:0/3217619011 >> 172.21.15.96:0/3217619011 conn(0x7f48100d4080 msgr2=0x7f481006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.084+0000 7f48159a5640 1 -- 172.21.15.96:0/3217619011 shutdown_connections 2024-06-02T23:47:27.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.084+0000 7f48159a5640 1 -- 172.21.15.96:0/3217619011 wait complete. 2024-06-02T23:47:27.109 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:47:27.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.215+0000 7f2df2529640 1 Processor -- start 2024-06-02T23:47:27.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.215+0000 7f2df2529640 1 -- start start 2024-06-02T23:47:27.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2df2529640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2dec155570 0x7f2dec06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2df2529640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec06eb50 0x7f2dec0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2df2529640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2dec0cab60 0x7f2dec15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2df2529640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2dec06efb0 con 0x7f2dec155570 2024-06-02T23:47:27.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2df2529640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2dec155950 con 0x7f2dec0cab60 2024-06-02T23:47:27.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2df2529640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2dec0cb2e0 con 0x7f2dec06eb50 2024-06-02T23:47:27.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2debfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2dec155570 0x7f2dec06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2debfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2dec155570 0x7f2dec06e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40408/0 (socket says 172.21.15.96:40408) 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2debfff640 1 -- 172.21.15.96:0/3107761253 learned_addr learned my addr 172.21.15.96:0/3107761253 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2debfff640 1 -- 172.21.15.96:0/3107761253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec06eb50 msgr2=0x7f2dec0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2debfff640 1 --2- 172.21.15.96:0/3107761253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec06eb50 0x7f2dec0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2debfff640 1 -- 172.21.15.96:0/3107761253 >> v2:172.21.15.162:3300/0 conn(0x7f2dec0cab60 msgr2=0x7f2dec15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2df0ac6640 1 --2- 172.21.15.96:0/3107761253 >> v2:172.21.15.162:3300/0 conn(0x7f2dec0cab60 0x7f2dec15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2debfff640 1 --2- 172.21.15.96:0/3107761253 >> v2:172.21.15.162:3300/0 conn(0x7f2dec0cab60 0x7f2dec15eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.216+0000 7f2debfff640 1 -- 172.21.15.96:0/3107761253 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dec0cb5c0 con 0x7f2dec155570 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.217+0000 7f2debfff640 1 --2- 172.21.15.96:0/3107761253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec155570 0x7f2dec06e610 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0af6e0 tx=0x7f2ddc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9415ba65ecd6c6f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.217+0000 7f2deaffd640 1 -- 172.21.15.96:0/3107761253 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc037070 con 0x7f2dec155570 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.217+0000 7f2deaffd640 1 -- 172.21.15.96:0/3107761253 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ddc032440 con 0x7f2dec155570 2024-06-02T23:47:27.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.217+0000 7f2deaffd640 1 -- 172.21.15.96:0/3107761253 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc032810 con 0x7f2dec155570 2024-06-02T23:47:27.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.218+0000 7f2df2529640 1 -- 172.21.15.96:0/3107761253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec155570 msgr2=0x7f2dec06e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.218+0000 7f2df2529640 1 --2- 172.21.15.96:0/3107761253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec155570 0x7f2dec06e610 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0af6e0 tx=0x7f2ddc02a1e0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.218+0000 7f2df2529640 1 -- 172.21.15.96:0/3107761253 shutdown_connections 2024-06-02T23:47:27.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.218+0000 7f2df2529640 1 --2- 172.21.15.96:0/3107761253 >> v2:172.21.15.162:3300/0 conn(0x7f2dec0cab60 0x7f2dec15eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.218+0000 7f2df2529640 1 --2- 172.21.15.96:0/3107761253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec06eb50 0x7f2dec0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.218+0000 7f2df2529640 1 --2- 172.21.15.96:0/3107761253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec155570 0x7f2dec06e610 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.218+0000 7f2df2529640 1 -- 172.21.15.96:0/3107761253 >> 172.21.15.96:0/3107761253 conn(0x7f2dec0cfc30 msgr2=0x7f2dec0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:27.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.218+0000 7f2df2529640 1 -- 172.21.15.96:0/3107761253 shutdown_connections 2024-06-02T23:47:27.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.218+0000 7f2df2529640 1 -- 172.21.15.96:0/3107761253 wait complete. 2024-06-02T23:47:27.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.219+0000 7f2df2529640 1 Processor -- start 2024-06-02T23:47:27.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.219+0000 7f2df2529640 1 -- start start 2024-06-02T23:47:27.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2df2529640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec06eb50 0x7f2dec0b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2df2529640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec0cab60 0x7f2dec155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2df2529640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dec155570 0x7f2dec157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2df2529640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2dec0caff0 con 0x7f2dec0cab60 2024-06-02T23:47:27.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2df2529640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2dec071b00 con 0x7f2dec155570 2024-06-02T23:47:27.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2df2529640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2dec0717d0 con 0x7f2dec06eb50 2024-06-02T23:47:27.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2deb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec0cab60 0x7f2dec155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2deb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec0cab60 0x7f2dec155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40424/0 (socket says 172.21.15.96:40424) 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2deb7fe640 1 -- 172.21.15.96:0/1216864371 learned_addr learned my addr 172.21.15.96:0/1216864371 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2df0ac6640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dec155570 0x7f2dec157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2debfff640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec06eb50 0x7f2dec0b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2deb7fe640 1 -- 172.21.15.96:0/1216864371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec06eb50 msgr2=0x7f2dec0b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2deb7fe640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec06eb50 0x7f2dec0b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2deb7fe640 1 -- 172.21.15.96:0/1216864371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dec155570 msgr2=0x7f2dec157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2deb7fe640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dec155570 0x7f2dec157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2deb7fe640 1 -- 172.21.15.96:0/1216864371 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dec156460 con 0x7f2dec0cab60 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.220+0000 7f2deb7fe640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec0cab60 0x7f2dec155b60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2de000b410 tx=0x7f2de000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.221+0000 7f2de8ff9640 1 -- 172.21.15.96:0/1216864371 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0015020 con 0x7f2dec0cab60 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.221+0000 7f2de8ff9640 1 -- 172.21.15.96:0/1216864371 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de0011850 con 0x7f2dec0cab60 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.221+0000 7f2df2529640 1 -- 172.21.15.96:0/1216864371 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dec156740 con 0x7f2dec0cab60 2024-06-02T23:47:27.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.221+0000 7f2de8ff9640 1 -- 172.21.15.96:0/1216864371 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0011c40 con 0x7f2dec0cab60 2024-06-02T23:47:27.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.221+0000 7f2df2529640 1 -- 172.21.15.96:0/1216864371 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dec156d00 con 0x7f2dec0cab60 2024-06-02T23:47:27.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.222+0000 7f2df2529640 1 -- 172.21.15.96:0/1216864371 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dec0683e0 con 0x7f2dec0cab60 2024-06-02T23:47:27.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.222+0000 7f2de8ff9640 1 -- 172.21.15.96:0/1216864371 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2de0018020 con 0x7f2dec0cab60 2024-06-02T23:47:27.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.222+0000 7f2de8ff9640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2dd806be60 0x7f2dd806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.222+0000 7f2de8ff9640 1 -- 172.21.15.96:0/1216864371 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f2de008ae00 con 0x7f2dec0cab60 2024-06-02T23:47:27.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.223+0000 7f2debfff640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2dd806be60 0x7f2dd806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.223+0000 7f2debfff640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2dd806be60 0x7f2dd806e320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc034000 tx=0x7f2ddc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:27.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.227+0000 7f2de8ff9640 1 -- 172.21.15.96:0/1216864371 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2de001f020 con 0x7f2dec0cab60 2024-06-02T23:47:27.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.401+0000 7f2df2529640 1 -- 172.21.15.96:0/1216864371 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2dec06cc90 con 0x7f2dec0cab60 2024-06-02T23:47:27.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.402+0000 7f2de8ff9640 1 -- 172.21.15.96:0/1216864371 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16955 (secure 0 0 0) 0x7f2de0058fd0 con 0x7f2dec0cab60 2024-06-02T23:47:27.403 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:27.403 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":38,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:47:26.438445+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:47:24.283901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T23:47:25.405802+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:47:27.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 -- 172.21.15.96:0/1216864371 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2dd806be60 msgr2=0x7f2dd806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2dd806be60 0x7f2dd806e320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc034000 tx=0x7f2ddc02e000 comp rx=0 tx=0).stop 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 -- 172.21.15.96:0/1216864371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec0cab60 msgr2=0x7f2dec155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec0cab60 0x7f2dec155b60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2de000b410 tx=0x7f2de000b8d0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 -- 172.21.15.96:0/1216864371 shutdown_connections 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dec155570 0x7f2dec157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f2dd806be60 0x7f2dd806e320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2dec0cab60 0x7f2dec155b60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 --2- 172.21.15.96:0/1216864371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec06eb50 0x7f2dec0b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 -- 172.21.15.96:0/1216864371 >> 172.21.15.96:0/1216864371 conn(0x7f2dec0cfc30 msgr2=0x7f2dec0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 -- 172.21.15.96:0/1216864371 shutdown_connections 2024-06-02T23:47:27.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.404+0000 7f2df2529640 1 -- 172.21.15.96:0/1216864371 wait complete. 2024-06-02T23:47:27.416 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:47:27.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.515+0000 7fb8d5963640 1 Processor -- start 2024-06-02T23:47:27.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.515+0000 7fb8d5963640 1 -- start start 2024-06-02T23:47:27.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.516+0000 7fb8d5963640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8d00d1120 0x7fb8d00c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.516+0000 7fb8d5963640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d00d4a90 con 0x7fb8d0161900 2024-06-02T23:47:27.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.516+0000 7fb8d5963640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d00d4d70 con 0x7fb8d00b5510 2024-06-02T23:47:27.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.516+0000 7fb8d5963640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d00cf5c0 con 0x7fb8d00d1120 2024-06-02T23:47:27.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.516+0000 7fb8c67fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8d00d1120 0x7fb8d00c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.516+0000 7fb8c67fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb8d00d1120 0x7fb8d00c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40436/0 (socket says 172.21.15.96:40436) 2024-06-02T23:47:27.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.516+0000 7fb8c67fc640 1 -- 172.21.15.96:0/1459388060 learned_addr learned my addr 172.21.15.96:0/1459388060 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:27.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.516+0000 7fb8ceffd640 1 --1- 172.21.15.96:0/1459388060 >> v1:172.21.15.96:6789/0 conn(0x7fb8d0161900 0x7fb8d00d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:42952/0 (socket says 172.21.15.96:42952) 2024-06-02T23:47:27.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.517+0000 7fb8c67fc640 1 -- 172.21.15.96:0/1459388060 >> v1:172.21.15.162:6789/0 conn(0x7fb8d00b5510 legacy=0x7fb8d00c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:27.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.517+0000 7fb8c67fc640 1 -- 172.21.15.96:0/1459388060 >> v1:172.21.15.96:6789/0 conn(0x7fb8d0161900 legacy=0x7fb8d00d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.517+0000 7fb8ce7fc640 1 -- 172.21.15.96:0/1459388060 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359926859 0 0) 0x7fb8d00d4a90 con 0x7fb8d0161900 2024-06-02T23:47:27.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.517+0000 7fb8c67fc640 1 -- 172.21.15.96:0/1459388060 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d00cf800 con 0x7fb8d00d1120 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.517+0000 7fb8c67fc640 1 --2- 172.21.15.96:0/1459388060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 0x7fb8d00c7bc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009870 tx=0x7fb8b802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1226b3648cfc9cd2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.517+0000 7fb8ce7fc640 1 -- 172.21.15.96:0/1459388060 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8037070 con 0x7fb8d00d1120 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.517+0000 7fb8ce7fc640 1 -- 172.21.15.96:0/1459388060 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8b8032440 con 0x7fb8d00d1120 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.517+0000 7fb8ce7fc640 1 -- 172.21.15.96:0/1459388060 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8032810 con 0x7fb8d00d1120 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.518+0000 7fb8d5963640 1 -- 172.21.15.96:0/1459388060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 msgr2=0x7fb8d00c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.518+0000 7fb8d5963640 1 --2- 172.21.15.96:0/1459388060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 0x7fb8d00c7bc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009870 tx=0x7fb8b802a210 comp rx=0 tx=0).stop 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.518+0000 7fb8d5963640 1 -- 172.21.15.96:0/1459388060 shutdown_connections 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.518+0000 7fb8d5963640 1 --2- 172.21.15.96:0/1459388060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 0x7fb8d00c7bc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.518+0000 7fb8d5963640 1 -- 172.21.15.96:0/1459388060 >> 172.21.15.96:0/1459388060 conn(0x7fb8d009d3b0 msgr2=0x7fb8d00d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.518+0000 7fb8d5963640 1 -- 172.21.15.96:0/1459388060 shutdown_connections 2024-06-02T23:47:27.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.518+0000 7fb8d5963640 1 -- 172.21.15.96:0/1459388060 wait complete. 2024-06-02T23:47:27.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.519+0000 7fb8d5963640 1 Processor -- start 2024-06-02T23:47:27.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.519+0000 7fb8d5963640 1 -- start start 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8d5963640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8d00b5510 0x7fb8d0157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8d5963640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 0x7fb8d00cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8d5963640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8d0161900 0x7fb8d00cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8d5963640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d00d4780 con 0x7fb8d00d1120 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8d5963640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d00caf70 con 0x7fb8d00b5510 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8d5963640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d0161ce0 con 0x7fb8d0161900 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8c67fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 0x7fb8d00cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8c67fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 0x7fb8d00cde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40442/0 (socket says 172.21.15.96:40442) 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8c67fc640 1 -- 172.21.15.96:0/4235322955 learned_addr learned my addr 172.21.15.96:0/4235322955 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8ceffd640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8d00b5510 0x7fb8d0157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.520+0000 7fb8cf7fe640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8d0161900 0x7fb8d00cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8c67fc640 1 -- 172.21.15.96:0/4235322955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8d0161900 msgr2=0x7fb8d00cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8c67fc640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8d0161900 0x7fb8d00cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8c67fc640 1 -- 172.21.15.96:0/4235322955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8d00b5510 msgr2=0x7fb8d0157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8c67fc640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8d00b5510 0x7fb8d0157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8c67fc640 1 -- 172.21.15.96:0/4235322955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d00ccdb0 con 0x7fb8d00d1120 2024-06-02T23:47:27.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8c67fc640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 0x7fb8d00cde50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009870 tx=0x7fb8b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:27.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8ccff9640 1 -- 172.21.15.96:0/4235322955 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8037040 con 0x7fb8d00d1120 2024-06-02T23:47:27.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8ccff9640 1 -- 172.21.15.96:0/4235322955 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8b8004250 con 0x7fb8d00d1120 2024-06-02T23:47:27.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8ccff9640 1 -- 172.21.15.96:0/4235322955 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b803c670 con 0x7fb8d00d1120 2024-06-02T23:47:27.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8d5963640 1 -- 172.21.15.96:0/4235322955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d00cd090 con 0x7fb8d00d1120 2024-06-02T23:47:27.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.521+0000 7fb8d5963640 1 -- 172.21.15.96:0/4235322955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d00cd650 con 0x7fb8d00d1120 2024-06-02T23:47:27.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.522+0000 7fb8d5963640 1 -- 172.21.15.96:0/4235322955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d00683e0 con 0x7fb8d00d1120 2024-06-02T23:47:27.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.522+0000 7fb8ccff9640 1 -- 172.21.15.96:0/4235322955 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8b803a070 con 0x7fb8d00d1120 2024-06-02T23:47:27.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.523+0000 7fb8ccff9640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb8b006be30 0x7fb8b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.523+0000 7fb8ccff9640 1 -- 172.21.15.96:0/4235322955 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fb8b80ab880 con 0x7fb8d00d1120 2024-06-02T23:47:27.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.523+0000 7fb8ceffd640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb8b006be30 0x7fb8b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.523+0000 7fb8ceffd640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb8b006be30 0x7fb8b006e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000f60 tx=0x7fb8c0007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:27.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.527+0000 7fb8ccff9640 1 -- 172.21.15.96:0/4235322955 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb8b8041020 con 0x7fb8d00d1120 2024-06-02T23:47:27.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.704+0000 7fb8d5963640 1 -- 172.21.15.96:0/4235322955 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8d00d05e0 con 0x7fb8d00d1120 2024-06-02T23:47:27.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.706+0000 7fb8ccff9640 1 -- 172.21.15.96:0/4235322955 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16955 (secure 0 0 0) 0x7fb8b807a130 con 0x7fb8d00d1120 2024-06-02T23:47:27.706 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:27.706 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":38,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:47:26.438445+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:47:24.283901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T23:47:25.405802+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:47:27.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 -- 172.21.15.96:0/4235322955 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb8b006be30 msgr2=0x7fb8b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb8b006be30 0x7fb8b006e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000f60 tx=0x7fb8c0007c00 comp rx=0 tx=0).stop 2024-06-02T23:47:27.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 -- 172.21.15.96:0/4235322955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 msgr2=0x7fb8d00cde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 0x7fb8d00cde50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009870 tx=0x7fb8b80046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 -- 172.21.15.96:0/4235322955 shutdown_connections 2024-06-02T23:47:27.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8d0161900 0x7fb8d00cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb8b006be30 0x7fb8b006e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8d00d1120 0x7fb8d00cde50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 --2- 172.21.15.96:0/4235322955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8d00b5510 0x7fb8d0157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 -- 172.21.15.96:0/4235322955 >> 172.21.15.96:0/4235322955 conn(0x7fb8d009d3b0 msgr2=0x7fb8d006c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:27.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 -- 172.21.15.96:0/4235322955 shutdown_connections 2024-06-02T23:47:27.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.708+0000 7fb8d5963640 1 -- 172.21.15.96:0/4235322955 wait complete. 2024-06-02T23:47:27.719 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T23:47:27.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.821+0000 7f695125d640 1 Processor -- start 2024-06-02T23:47:27.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.821+0000 7f695125d640 1 -- start start 2024-06-02T23:47:27.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f695125d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694c15a510 0x7f694c0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f695125d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f694c15a8f0 0x7f694c0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f695125d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f694c072070 0x7f694c072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f695125d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f694c073200 con 0x7f694c15a8f0 2024-06-02T23:47:27.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f695125d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f694c071030 con 0x7f694c072070 2024-06-02T23:47:27.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f695125d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f694c0712b0 con 0x7f694c15a510 2024-06-02T23:47:27.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f6943fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f694c15a8f0 0x7f694c0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f6943fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f694c15a8f0 0x7f694c0cdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40452/0 (socket says 172.21.15.96:40452) 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f6943fff640 1 -- 172.21.15.96:0/212402537 learned_addr learned my addr 172.21.15.96:0/212402537 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f694b59e640 1 --2- 172.21.15.96:0/212402537 >> v2:172.21.15.162:3300/0 conn(0x7f694c072070 0x7f694c072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f694ad9d640 1 --2- 172.21.15.96:0/212402537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694c15a510 0x7f694c0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f6943fff640 1 -- 172.21.15.96:0/212402537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694c15a510 msgr2=0x7f694c0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f6943fff640 1 --2- 172.21.15.96:0/212402537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694c15a510 0x7f694c0cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f6943fff640 1 -- 172.21.15.96:0/212402537 >> v2:172.21.15.162:3300/0 conn(0x7f694c072070 msgr2=0x7f694c072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f6943fff640 1 --2- 172.21.15.96:0/212402537 >> v2:172.21.15.162:3300/0 conn(0x7f694c072070 0x7f694c072520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.822+0000 7f6943fff640 1 -- 172.21.15.96:0/212402537 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694c071590 con 0x7f694c15a8f0 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.823+0000 7f6943fff640 1 --2- 172.21.15.96:0/212402537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 0x7f694c0cdd90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f694c0cdb20 tx=0x7f693402c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5436b01454127ff server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.823+0000 7f694a59c640 1 -- 172.21.15.96:0/212402537 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934032700 con 0x7f694c15a8f0 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.823+0000 7f694a59c640 1 -- 172.21.15.96:0/212402537 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69340328a0 con 0x7f694c15a8f0 2024-06-02T23:47:27.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.823+0000 7f694a59c640 1 -- 172.21.15.96:0/212402537 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934032c70 con 0x7f694c15a8f0 2024-06-02T23:47:27.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.824+0000 7f695125d640 1 -- 172.21.15.96:0/212402537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 msgr2=0x7f694c0cdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.824+0000 7f695125d640 1 --2- 172.21.15.96:0/212402537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 0x7f694c0cdd90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f694c0cdb20 tx=0x7f693402c800 comp rx=0 tx=0).stop 2024-06-02T23:47:27.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.824+0000 7f695125d640 1 -- 172.21.15.96:0/212402537 shutdown_connections 2024-06-02T23:47:27.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.824+0000 7f695125d640 1 --2- 172.21.15.96:0/212402537 >> v2:172.21.15.162:3300/0 conn(0x7f694c072070 0x7f694c072520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.824+0000 7f695125d640 1 --2- 172.21.15.96:0/212402537 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 0x7f694c0cdd90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.824+0000 7f695125d640 1 --2- 172.21.15.96:0/212402537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694c15a510 0x7f694c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.824+0000 7f695125d640 1 -- 172.21.15.96:0/212402537 >> 172.21.15.96:0/212402537 conn(0x7f694c0cfcb0 msgr2=0x7f694c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.824+0000 7f695125d640 1 -- 172.21.15.96:0/212402537 shutdown_connections 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.824+0000 7f695125d640 1 -- 172.21.15.96:0/212402537 wait complete. 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.825+0000 7f695125d640 1 Processor -- start 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.825+0000 7f695125d640 1 -- start start 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f695125d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f694c072070 0x7f694c151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f695125d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694c15a510 0x7f694c0b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f695125d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 0x7f694c13fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f695125d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f694c0ce2d0 con 0x7f694c15a8f0 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f695125d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f694c071b50 con 0x7f694c072070 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f695125d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f694c072a60 con 0x7f694c15a510 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f694b59e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 0x7f694c13fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f694b59e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 0x7f694c13fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40466/0 (socket says 172.21.15.96:40466) 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f694b59e640 1 -- 172.21.15.96:0/1822943561 learned_addr learned my addr 172.21.15.96:0/1822943561 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:27.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f694ad9d640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f694c072070 0x7f694c151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f6943fff640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694c15a510 0x7f694c0b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f694b59e640 1 -- 172.21.15.96:0/1822943561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694c15a510 msgr2=0x7f694c0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f694b59e640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694c15a510 0x7f694c0b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f694b59e640 1 -- 172.21.15.96:0/1822943561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f694c072070 msgr2=0x7f694c151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f694b59e640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f694c072070 0x7f694c151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f694b59e640 1 -- 172.21.15.96:0/1822943561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694c0b3bc0 con 0x7f694c15a8f0 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f694b59e640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 0x7f694c13fa40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f694400ccf0 tx=0x7f694400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f69437fe640 1 -- 172.21.15.96:0/1822943561 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944003b90 con 0x7f694c15a8f0 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f69437fe640 1 -- 172.21.15.96:0/1822943561 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6944003d30 con 0x7f694c15a8f0 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f69437fe640 1 -- 172.21.15.96:0/1822943561 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944004240 con 0x7f694c15a8f0 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f695125d640 1 -- 172.21.15.96:0/1822943561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f694c0b3ea0 con 0x7f694c15a8f0 2024-06-02T23:47:27.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.826+0000 7f695125d640 1 -- 172.21.15.96:0/1822943561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f694c0b4460 con 0x7f694c15a8f0 2024-06-02T23:47:27.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.827+0000 7f695125d640 1 -- 172.21.15.96:0/1822943561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f694c0683e0 con 0x7f694c15a8f0 2024-06-02T23:47:27.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.828+0000 7f69437fe640 1 -- 172.21.15.96:0/1822943561 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69440043e0 con 0x7f694c15a8f0 2024-06-02T23:47:27.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.828+0000 7f69437fe640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f692c06be30 0x7f692c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:27.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.829+0000 7f694ad9d640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f692c06be30 0x7f692c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:27.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.829+0000 7f69437fe640 1 -- 172.21.15.96:0/1822943561 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f694408b970 con 0x7f694c15a8f0 2024-06-02T23:47:27.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.829+0000 7f694ad9d640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f692c06be30 0x7f692c06e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f693c00aac0 tx=0x7f693c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:27.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:27.833+0000 7f69437fe640 1 -- 172.21.15.96:0/1822943561 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f694405a220 con 0x7f694c15a8f0 2024-06-02T23:47:28.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.042+0000 7f695125d640 1 -- 172.21.15.96:0/1822943561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f694c0ca630 con 0x7f694c15a8f0 2024-06-02T23:47:28.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.105+0000 7f69437fe640 1 -- 172.21.15.96:0/1822943561 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f6944059b20 con 0x7f694c15a8f0 2024-06-02T23:47:28.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 -- 172.21.15.96:0/1822943561 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f692c06be30 msgr2=0x7f692c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f692c06be30 0x7f692c06e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f693c00aac0 tx=0x7f693c008040 comp rx=0 tx=0).stop 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 -- 172.21.15.96:0/1822943561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 msgr2=0x7f694c13fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 0x7f694c13fa40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f694400ccf0 tx=0x7f694400a660 comp rx=0 tx=0).stop 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 -- 172.21.15.96:0/1822943561 shutdown_connections 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f692c06be30 0x7f692c06e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f694c15a8f0 0x7f694c13fa40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f694c15a510 0x7f694c0b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 --2- 172.21.15.96:0/1822943561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f694c072070 0x7f694c151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 -- 172.21.15.96:0/1822943561 >> 172.21.15.96:0/1822943561 conn(0x7f694c0cfcb0 msgr2=0x7f694c0cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 -- 172.21.15.96:0/1822943561 shutdown_connections 2024-06-02T23:47:28.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.107+0000 7f695125d640 1 -- 172.21.15.96:0/1822943561 wait complete. 2024-06-02T23:47:28.118 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-02T23:47:28.119 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-02T23:47:28.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.221+0000 7fab25838640 1 Processor -- start 2024-06-02T23:47:28.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.221+0000 7fab25838640 1 -- start start 2024-06-02T23:47:28.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab25838640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fab2015e1e0 0x7fab200b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:28.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab25838640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab200d2b70 con 0x7fab200b3ed0 2024-06-02T23:47:28.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab25838640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab200d2e50 con 0x7fab200d26d0 2024-06-02T23:47:28.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab25838640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fab200cef50 con 0x7fab2015e1e0 2024-06-02T23:47:28.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab1effd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fab2015e1e0 0x7fab200b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:28.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab1effd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fab2015e1e0 0x7fab200b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40474/0 (socket says 172.21.15.96:40474) 2024-06-02T23:47:28.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab17fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fab200b3ed0 0x7fab200cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:42958/0 (socket says 172.21.15.96:42958) 2024-06-02T23:47:28.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab1effd640 1 -- 172.21.15.96:0/1329970532 learned_addr learned my addr 172.21.15.96:0/1329970532 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:28.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab1effd640 1 -- 172.21.15.96:0/1329970532 >> v1:172.21.15.162:6789/0 conn(0x7fab200d26d0 legacy=0x7fab20161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:28.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab1effd640 1 -- 172.21.15.96:0/1329970532 >> v1:172.21.15.96:6789/0 conn(0x7fab200b3ed0 legacy=0x7fab200cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:28.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab1effd640 1 -- 172.21.15.96:0/1329970532 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab200cf230 con 0x7fab2015e1e0 2024-06-02T23:47:28.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.222+0000 7fab1e7fc640 1 -- 172.21.15.96:0/1329970532 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038276785 0 0) 0x7fab200d2b70 con 0x7fab200b3ed0 2024-06-02T23:47:28.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.223+0000 7fab1effd640 1 --2- 172.21.15.96:0/1329970532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab2015e1e0 0x7fab200b3990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fab10009870 tx=0x7fab1002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8229594e48a90b9a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:28.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.223+0000 7fab1e7fc640 1 -- 172.21.15.96:0/1329970532 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10037070 con 0x7fab2015e1e0 2024-06-02T23:47:28.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.223+0000 7fab1e7fc640 1 -- 172.21.15.96:0/1329970532 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab10032440 con 0x7fab2015e1e0 2024-06-02T23:47:28.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.223+0000 7fab1e7fc640 1 -- 172.21.15.96:0/1329970532 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10032810 con 0x7fab2015e1e0 2024-06-02T23:47:28.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.224+0000 7fab25838640 1 -- 172.21.15.96:0/1329970532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab2015e1e0 msgr2=0x7fab200b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:28.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.224+0000 7fab25838640 1 --2- 172.21.15.96:0/1329970532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab2015e1e0 0x7fab200b3990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fab10009870 tx=0x7fab1002a210 comp rx=0 tx=0).stop 2024-06-02T23:47:28.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.224+0000 7fab25838640 1 -- 172.21.15.96:0/1329970532 shutdown_connections 2024-06-02T23:47:28.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.224+0000 7fab25838640 1 --2- 172.21.15.96:0/1329970532 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab2015e1e0 0x7fab200b3990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:28.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.224+0000 7fab25838640 1 -- 172.21.15.96:0/1329970532 >> 172.21.15.96:0/1329970532 conn(0x7fab200d40f0 msgr2=0x7fab200d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:28.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.224+0000 7fab25838640 1 -- 172.21.15.96:0/1329970532 shutdown_connections 2024-06-02T23:47:28.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.224+0000 7fab25838640 1 -- 172.21.15.96:0/1329970532 wait complete. 2024-06-02T23:47:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.225+0000 7fab25838640 1 Processor -- start 2024-06-02T23:47:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.225+0000 7fab25838640 1 -- start start 2024-06-02T23:47:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab25838640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab200d26d0 0x7fab201533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:28.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab25838640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2015e1e0 0x7fab200b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab25838640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab200b6cb0 0x7fab200b9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab25838640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fab200b37f0 con 0x7fab200d26d0 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab25838640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab200b3670 con 0x7fab200b6cb0 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab25838640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab200cfe60 con 0x7fab2015e1e0 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab200d26d0 0x7fab201533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab200d26d0 0x7fab201533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40482/0 (socket says 172.21.15.96:40482) 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1effd640 1 -- 172.21.15.96:0/3834775572 learned_addr learned my addr 172.21.15.96:0/3834775572 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1f7fe640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab200b6cb0 0x7fab200b9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab17fff640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2015e1e0 0x7fab200b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1effd640 1 -- 172.21.15.96:0/3834775572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2015e1e0 msgr2=0x7fab200b9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:28.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1effd640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2015e1e0 0x7fab200b9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1effd640 1 -- 172.21.15.96:0/3834775572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab200b6cb0 msgr2=0x7fab200b9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1effd640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab200b6cb0 0x7fab200b9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1effd640 1 -- 172.21.15.96:0/3834775572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab200b7220 con 0x7fab200d26d0 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab17fff640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2015e1e0 0x7fab200b9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1f7fe640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab200b6cb0 0x7fab200b9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1effd640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab200d26d0 0x7fab201533c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fab10009870 tx=0x7fab100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1cff9640 1 -- 172.21.15.96:0/3834775572 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10041070 con 0x7fab200d26d0 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1cff9640 1 -- 172.21.15.96:0/3834775572 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1003c870 con 0x7fab200d26d0 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab25838640 1 -- 172.21.15.96:0/3834775572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab200b7500 con 0x7fab200d26d0 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab1cff9640 1 -- 172.21.15.96:0/3834775572 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10037040 con 0x7fab200d26d0 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.226+0000 7fab25838640 1 -- 172.21.15.96:0/3834775572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab200b7ac0 con 0x7fab200d26d0 2024-06-02T23:47:28.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.227+0000 7fab25838640 1 -- 172.21.15.96:0/3834775572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab200683e0 con 0x7fab200d26d0 2024-06-02T23:47:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.228+0000 7fab1cff9640 1 -- 172.21.15.96:0/3834775572 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab10044070 con 0x7fab200d26d0 2024-06-02T23:47:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.228+0000 7fab1cff9640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab0006be30 0x7fab0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.228+0000 7fab1cff9640 1 -- 172.21.15.96:0/3834775572 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fab100abb40 con 0x7fab200d26d0 2024-06-02T23:47:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.228+0000 7fab17fff640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab0006be30 0x7fab0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:28.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.229+0000 7fab17fff640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab0006be30 0x7fab0006e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fab200b8ef0 tx=0x7fab08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:28.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.232+0000 7fab1cff9640 1 -- 172.21.15.96:0/3834775572 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fab1007a360 con 0x7fab200d26d0 2024-06-02T23:47:28.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:28.442+0000 7fab25838640 1 -- 172.21.15.96:0/3834775572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fab2008c110 con 0x7fab200d26d0 2024-06-02T23:47:29.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.107+0000 7fab1cff9640 1 -- 172.21.15.96:0/3834775572 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fab10079c60 con 0x7fab200d26d0 2024-06-02T23:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.110+0000 7fab25838640 1 -- 172.21.15.96:0/3834775572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab0006be30 msgr2=0x7fab0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.110+0000 7fab25838640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab0006be30 0x7fab0006e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fab200b8ef0 tx=0x7fab08009040 comp rx=0 tx=0).stop 2024-06-02T23:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.110+0000 7fab25838640 1 -- 172.21.15.96:0/3834775572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab200d26d0 msgr2=0x7fab201533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.110+0000 7fab25838640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab200d26d0 0x7fab201533c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fab10009870 tx=0x7fab100046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.111+0000 7fab25838640 1 -- 172.21.15.96:0/3834775572 shutdown_connections 2024-06-02T23:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.111+0000 7fab25838640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab200b6cb0 0x7fab200b9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.111+0000 7fab25838640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2015e1e0 0x7fab200b9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.111+0000 7fab25838640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fab0006be30 0x7fab0006e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.111+0000 7fab25838640 1 --2- 172.21.15.96:0/3834775572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab200d26d0 0x7fab201533c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.111+0000 7fab25838640 1 -- 172.21.15.96:0/3834775572 >> 172.21.15.96:0/3834775572 conn(0x7fab200d40f0 msgr2=0x7fab2015d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:29.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.111+0000 7fab25838640 1 -- 172.21.15.96:0/3834775572 shutdown_connections 2024-06-02T23:47:29.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.111+0000 7fab25838640 1 -- 172.21.15.96:0/3834775572 wait complete. 2024-06-02T23:47:29.125 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-02T23:47:29.125 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:47:29.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.228+0000 7fec89b70640 1 Processor -- start 2024-06-02T23:47:29.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.228+0000 7fec89b70640 1 -- start start 2024-06-02T23:47:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.229+0000 7fec89b70640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fec8415e740 0x7fec840ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.229+0000 7fec89b70640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 0x7fec840ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.229+0000 7fec89b70640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fec840cf0c0 0x7fec840cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.229+0000 7fec89b70640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fec8415eb20 con 0x7fec840cf0c0 2024-06-02T23:47:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.229+0000 7fec89b70640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fec840cf670 con 0x7fec8415e740 2024-06-02T23:47:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.229+0000 7fec89b70640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fec8406d6d0 con 0x7fec840b0b00 2024-06-02T23:47:29.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.229+0000 7fec83fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fec840cf0c0 0x7fec840cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.229+0000 7fec83fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fec840cf0c0 0x7fec840cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40492/0 (socket says 172.21.15.96:40492) 2024-06-02T23:47:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.229+0000 7fec83fff640 1 -- 172.21.15.96:0/497610190 learned_addr learned my addr 172.21.15.96:0/497610190 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.230+0000 7fec837fe640 1 --2- 172.21.15.96:0/497610190 >> v2:172.21.15.162:3300/0 conn(0x7fec8415e740 0x7fec840ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.230+0000 7fec82ffd640 1 --2- 172.21.15.96:0/497610190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 0x7fec840ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.230+0000 7fec83fff640 1 -- 172.21.15.96:0/497610190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 msgr2=0x7fec840ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.230+0000 7fec83fff640 1 --2- 172.21.15.96:0/497610190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 0x7fec840ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.230+0000 7fec83fff640 1 -- 172.21.15.96:0/497610190 >> v2:172.21.15.162:3300/0 conn(0x7fec8415e740 msgr2=0x7fec840ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.230+0000 7fec83fff640 1 --2- 172.21.15.96:0/497610190 >> v2:172.21.15.162:3300/0 conn(0x7fec8415e740 0x7fec840ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.230+0000 7fec83fff640 1 -- 172.21.15.96:0/497610190 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8406d9b0 con 0x7fec840cf0c0 2024-06-02T23:47:29.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.230+0000 7fec82ffd640 1 --2- 172.21.15.96:0/497610190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 0x7fec840ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:29.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.230+0000 7fec83fff640 1 --2- 172.21.15.96:0/497610190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 0x7fec840cfcc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fec84071e10 tx=0x7fec7c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2dc9d23d8324130 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec827fc640 1 -- 172.21.15.96:0/497610190 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c037070 con 0x7fec840cf0c0 2024-06-02T23:47:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec827fc640 1 -- 172.21.15.96:0/497610190 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec7c032440 con 0x7fec840cf0c0 2024-06-02T23:47:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec827fc640 1 -- 172.21.15.96:0/497610190 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7c032810 con 0x7fec840cf0c0 2024-06-02T23:47:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec89b70640 1 -- 172.21.15.96:0/497610190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 msgr2=0x7fec840cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec89b70640 1 --2- 172.21.15.96:0/497610190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 0x7fec840cfcc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fec84071e10 tx=0x7fec7c02a1e0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec89b70640 1 -- 172.21.15.96:0/497610190 shutdown_connections 2024-06-02T23:47:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec89b70640 1 --2- 172.21.15.96:0/497610190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 0x7fec840cfcc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec89b70640 1 --2- 172.21.15.96:0/497610190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 0x7fec840ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec89b70640 1 --2- 172.21.15.96:0/497610190 >> v2:172.21.15.162:3300/0 conn(0x7fec8415e740 0x7fec840ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec89b70640 1 -- 172.21.15.96:0/497610190 >> 172.21.15.96:0/497610190 conn(0x7fec840d1dc0 msgr2=0x7fec840d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:29.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec89b70640 1 -- 172.21.15.96:0/497610190 shutdown_connections 2024-06-02T23:47:29.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.231+0000 7fec89b70640 1 -- 172.21.15.96:0/497610190 wait complete. 2024-06-02T23:47:29.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.232+0000 7fec89b70640 1 Processor -- start 2024-06-02T23:47:29.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.233+0000 7fec89b70640 1 -- start start 2024-06-02T23:47:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.233+0000 7fec89b70640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 0x7fec840ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.233+0000 7fec89b70640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 0x7fec841f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.233+0000 7fec89b70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8415e740 0x7fec840cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.233+0000 7fec89b70640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fec840b1320 con 0x7fec840cf0c0 2024-06-02T23:47:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.233+0000 7fec89b70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec840b11a0 con 0x7fec8415e740 2024-06-02T23:47:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.233+0000 7fec89b70640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fec840d0200 con 0x7fec840b0b00 2024-06-02T23:47:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.233+0000 7fec82ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 0x7fec841f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.233+0000 7fec82ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 0x7fec841f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40508/0 (socket says 172.21.15.96:40508) 2024-06-02T23:47:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.233+0000 7fec82ffd640 1 -- 172.21.15.96:0/3025481852 learned_addr learned my addr 172.21.15.96:0/3025481852 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec83fff640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8415e740 0x7fec840cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec837fe640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 0x7fec840ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec82ffd640 1 -- 172.21.15.96:0/3025481852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 msgr2=0x7fec840ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec82ffd640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 0x7fec840ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec82ffd640 1 -- 172.21.15.96:0/3025481852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8415e740 msgr2=0x7fec840cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec82ffd640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8415e740 0x7fec840cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec82ffd640 1 -- 172.21.15.96:0/3025481852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec841f5150 con 0x7fec840cf0c0 2024-06-02T23:47:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec83fff640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8415e740 0x7fec840cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec82ffd640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 0x7fec841f4c10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c7c0 tx=0x7fec7800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec6bfff640 1 -- 172.21.15.96:0/3025481852 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78015070 con 0x7fec840cf0c0 2024-06-02T23:47:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec6bfff640 1 -- 172.21.15.96:0/3025481852 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec780079d0 con 0x7fec840cf0c0 2024-06-02T23:47:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec89b70640 1 -- 172.21.15.96:0/3025481852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec840c9410 con 0x7fec840cf0c0 2024-06-02T23:47:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec6bfff640 1 -- 172.21.15.96:0/3025481852 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78007da0 con 0x7fec840cf0c0 2024-06-02T23:47:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.234+0000 7fec89b70640 1 -- 172.21.15.96:0/3025481852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec840c99d0 con 0x7fec840cf0c0 2024-06-02T23:47:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.235+0000 7fec89b70640 1 -- 172.21.15.96:0/3025481852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec840683e0 con 0x7fec840cf0c0 2024-06-02T23:47:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.235+0000 7fec6bfff640 1 -- 172.21.15.96:0/3025481852 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec78018070 con 0x7fec840cf0c0 2024-06-02T23:47:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.236+0000 7fec6bfff640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fec7006be30 0x7fec7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.236+0000 7fec6bfff640 1 -- 172.21.15.96:0/3025481852 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fec7808ae80 con 0x7fec840cf0c0 2024-06-02T23:47:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.236+0000 7fec837fe640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fec7006be30 0x7fec7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.236+0000 7fec837fe640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fec7006be30 0x7fec7006e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fec740099c0 tx=0x7fec74003990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:29.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.240+0000 7fec6bfff640 1 -- 172.21.15.96:0/3025481852 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fec841f5150 con 0x7fec840cf0c0 2024-06-02T23:47:29.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.446+0000 7fec89b70640 1 -- 172.21.15.96:0/3025481852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec840d1440 con 0x7fec840cf0c0 2024-06-02T23:47:29.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.446+0000 7fec6bfff640 1 -- 172.21.15.96:0/3025481852 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5181 (secure 0 0 0) 0x7fec780596a0 con 0x7fec840cf0c0 2024-06-02T23:47:29.447 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:29.447 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/980156426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":980156426},{"type":"v1","addr":"172.21.15.162:6833","nonce":980156426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1567915962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1567915962},{"type":"v1","addr":"172.21.15.162:6835","nonce":1567915962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2700846904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2700846904},{"type":"v1","addr":"172.21.15.96:6835","nonce":2700846904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:47:26.438755+0000","modified":"2024-06-02T23:47:28.444285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.96:6837/593845400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":593845400},{"type":"v1","addr":"172.21.15.96:6837","nonce":593845400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-06-02T23:47:29.447 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2024-06-02T23:47:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.448+0000 7fec89b70640 1 -- 172.21.15.96:0/3025481852 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fec7006be30 msgr2=0x7fec7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.448+0000 7fec89b70640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fec7006be30 0x7fec7006e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fec740099c0 tx=0x7fec74003990 comp rx=0 tx=0).stop 2024-06-02T23:47:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.448+0000 7fec89b70640 1 -- 172.21.15.96:0/3025481852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 msgr2=0x7fec841f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.448+0000 7fec89b70640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 0x7fec841f4c10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fec7800c7c0 tx=0x7fec7800cc80 comp rx=0 tx=0).stop 2024-06-02T23:47:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.448+0000 7fec89b70640 1 -- 172.21.15.96:0/3025481852 shutdown_connections 2024-06-02T23:47:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.448+0000 7fec89b70640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec8415e740 0x7fec840cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.448+0000 7fec89b70640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fec7006be30 0x7fec7006e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.449+0000 7fec89b70640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec840cf0c0 0x7fec841f4c10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.449+0000 7fec89b70640 1 --2- 172.21.15.96:0/3025481852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec840b0b00 0x7fec840ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.449+0000 7fec89b70640 1 -- 172.21.15.96:0/3025481852 >> 172.21.15.96:0/3025481852 conn(0x7fec840d1dc0 msgr2=0x7fec840ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:29.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.449+0000 7fec89b70640 1 -- 172.21.15.96:0/3025481852 shutdown_connections 2024-06-02T23:47:29.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.449+0000 7fec89b70640 1 -- 172.21.15.96:0/3025481852 wait complete. 2024-06-02T23:47:29.460 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:47:29.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.558+0000 7fd739e6d640 1 Processor -- start 2024-06-02T23:47:29.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.558+0000 7fd739e6d640 1 -- start start 2024-06-02T23:47:29.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.559+0000 7fd739e6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd734155570 0x7fd73406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.559+0000 7fd739e6d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd73406eb50 0x7fd7340ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.559+0000 7fd739e6d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd7340cab60 0x7fd73415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.559+0000 7fd739e6d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd73406efb0 con 0x7fd73406eb50 2024-06-02T23:47:29.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.559+0000 7fd739e6d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd734155950 con 0x7fd7340cab60 2024-06-02T23:47:29.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.559+0000 7fd739e6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd7340cb2e0 con 0x7fd734155570 2024-06-02T23:47:29.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.560+0000 7fd733fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd7340cab60 0x7fd73415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.560+0000 7fd733fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd7340cab60 0x7fd73415eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:42016/0 (socket says 172.21.15.96:42016) 2024-06-02T23:47:29.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.560+0000 7fd733fff640 1 -- 172.21.15.96:0/2951487573 learned_addr learned my addr 172.21.15.96:0/2951487573 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:29.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.560+0000 7fd732ffd640 1 --2- 172.21.15.96:0/2951487573 >> v2:172.21.15.96:3300/0 conn(0x7fd73406eb50 0x7fd7340ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.560+0000 7fd7337fe640 1 --2- 172.21.15.96:0/2951487573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd734155570 0x7fd73406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.560+0000 7fd732ffd640 1 -- 172.21.15.96:0/2951487573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd734155570 msgr2=0x7fd73406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:29.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.560+0000 7fd732ffd640 1 --2- 172.21.15.96:0/2951487573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd734155570 0x7fd73406e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.560+0000 7fd732ffd640 1 -- 172.21.15.96:0/2951487573 >> v2:172.21.15.162:3300/0 conn(0x7fd7340cab60 msgr2=0x7fd73415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:29.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.560+0000 7fd732ffd640 1 --2- 172.21.15.96:0/2951487573 >> v2:172.21.15.162:3300/0 conn(0x7fd7340cab60 0x7fd73415eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.560+0000 7fd732ffd640 1 -- 172.21.15.96:0/2951487573 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7340cb5c0 con 0x7fd73406eb50 2024-06-02T23:47:29.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.561+0000 7fd732ffd640 1 --2- 172.21.15.96:0/2951487573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd73406eb50 0x7fd7340ca620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd7340af6e0 tx=0x7fd728032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5833bf67fc61d2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:29.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.561+0000 7fd7327fc640 1 -- 172.21.15.96:0/2951487573 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728040070 con 0x7fd73406eb50 2024-06-02T23:47:29.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.561+0000 7fd7327fc640 1 -- 172.21.15.96:0/2951487573 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd728033b40 con 0x7fd73406eb50 2024-06-02T23:47:29.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.561+0000 7fd7327fc640 1 -- 172.21.15.96:0/2951487573 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72803b440 con 0x7fd73406eb50 2024-06-02T23:47:29.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.562+0000 7fd739e6d640 1 -- 172.21.15.96:0/2951487573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd73406eb50 msgr2=0x7fd7340ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.562+0000 7fd739e6d640 1 --2- 172.21.15.96:0/2951487573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd73406eb50 0x7fd7340ca620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd7340af6e0 tx=0x7fd728032df0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.562+0000 7fd739e6d640 1 -- 172.21.15.96:0/2951487573 shutdown_connections 2024-06-02T23:47:29.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.562+0000 7fd739e6d640 1 --2- 172.21.15.96:0/2951487573 >> v2:172.21.15.162:3300/0 conn(0x7fd7340cab60 0x7fd73415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.562+0000 7fd739e6d640 1 --2- 172.21.15.96:0/2951487573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd73406eb50 0x7fd7340ca620 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.562+0000 7fd739e6d640 1 --2- 172.21.15.96:0/2951487573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd734155570 0x7fd73406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.562+0000 7fd739e6d640 1 -- 172.21.15.96:0/2951487573 >> 172.21.15.96:0/2951487573 conn(0x7fd7340cfc30 msgr2=0x7fd7340d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:29.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.562+0000 7fd739e6d640 1 -- 172.21.15.96:0/2951487573 shutdown_connections 2024-06-02T23:47:29.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.562+0000 7fd739e6d640 1 -- 172.21.15.96:0/2951487573 wait complete. 2024-06-02T23:47:29.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.563+0000 7fd739e6d640 1 Processor -- start 2024-06-02T23:47:29.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.563+0000 7fd739e6d640 1 -- start start 2024-06-02T23:47:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.564+0000 7fd739e6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd73406eb50 0x7fd734150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.564+0000 7fd739e6d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7340cab60 0x7fd734151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.564+0000 7fd739e6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd734155570 0x7fd7341f0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.564+0000 7fd739e6d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd7340caff0 con 0x7fd7340cab60 2024-06-02T23:47:29.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.564+0000 7fd739e6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd734071b00 con 0x7fd73406eb50 2024-06-02T23:47:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.564+0000 7fd739e6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd7340717d0 con 0x7fd734155570 2024-06-02T23:47:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.564+0000 7fd732ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7340cab60 0x7fd734151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.564+0000 7fd732ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7340cab60 0x7fd734151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40526/0 (socket says 172.21.15.96:40526) 2024-06-02T23:47:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.564+0000 7fd732ffd640 1 -- 172.21.15.96:0/2710262656 learned_addr learned my addr 172.21.15.96:0/2710262656 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd732ffd640 1 -- 172.21.15.96:0/2710262656 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd734155570 msgr2=0x7fd7341f0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd732ffd640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd734155570 0x7fd7341f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd732ffd640 1 -- 172.21.15.96:0/2710262656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd73406eb50 msgr2=0x7fd734150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd732ffd640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd73406eb50 0x7fd734150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd732ffd640 1 -- 172.21.15.96:0/2710262656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73414fdd0 con 0x7fd7340cab60 2024-06-02T23:47:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd732ffd640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7340cab60 0x7fd734151760 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd72800b9a0 tx=0x7fd7280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd71bfff640 1 -- 172.21.15.96:0/2710262656 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72804b020 con 0x7fd7340cab60 2024-06-02T23:47:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd71bfff640 1 -- 172.21.15.96:0/2710262656 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd728046470 con 0x7fd7340cab60 2024-06-02T23:47:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd739e6d640 1 -- 172.21.15.96:0/2710262656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7341500b0 con 0x7fd7340cab60 2024-06-02T23:47:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd71bfff640 1 -- 172.21.15.96:0/2710262656 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728040040 con 0x7fd7340cab60 2024-06-02T23:47:29.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.565+0000 7fd739e6d640 1 -- 172.21.15.96:0/2710262656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd734150670 con 0x7fd7340cab60 2024-06-02T23:47:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.566+0000 7fd739e6d640 1 -- 172.21.15.96:0/2710262656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7340683e0 con 0x7fd7340cab60 2024-06-02T23:47:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.566+0000 7fd71bfff640 1 -- 172.21.15.96:0/2710262656 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd72804e020 con 0x7fd7340cab60 2024-06-02T23:47:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.567+0000 7fd71bfff640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd72006be30 0x7fd72006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.567+0000 7fd71bfff640 1 -- 172.21.15.96:0/2710262656 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd7280b4a40 con 0x7fd7340cab60 2024-06-02T23:47:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.567+0000 7fd7337fe640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd72006be30 0x7fd72006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.567+0000 7fd7337fe640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd72006be30 0x7fd72006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd7341ed1c0 tx=0x7fd72400f040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:29.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.571+0000 7fd71bfff640 1 -- 172.21.15.96:0/2710262656 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd728055030 con 0x7fd7340cab60 2024-06-02T23:47:29.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.748+0000 7fd739e6d640 1 -- 172.21.15.96:0/2710262656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd73406cc90 con 0x7fd7340cab60 2024-06-02T23:47:29.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.749+0000 7fd71bfff640 1 -- 172.21.15.96:0/2710262656 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16942 (secure 0 0 0) 0x7fd7280b4e20 con 0x7fd7340cab60 2024-06-02T23:47:29.750 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:29.750 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":39,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:47:28.081069+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:47:24.283901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T23:47:25.405802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:47:29.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 -- 172.21.15.96:0/2710262656 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd72006be30 msgr2=0x7fd72006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd72006be30 0x7fd72006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd7341ed1c0 tx=0x7fd72400f040 comp rx=0 tx=0).stop 2024-06-02T23:47:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 -- 172.21.15.96:0/2710262656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7340cab60 msgr2=0x7fd734151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7340cab60 0x7fd734151760 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd72800b9a0 tx=0x7fd7280046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 -- 172.21.15.96:0/2710262656 shutdown_connections 2024-06-02T23:47:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd734155570 0x7fd7341f0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fd72006be30 0x7fd72006e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7340cab60 0x7fd734151760 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 --2- 172.21.15.96:0/2710262656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd73406eb50 0x7fd734150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 -- 172.21.15.96:0/2710262656 >> 172.21.15.96:0/2710262656 conn(0x7fd7340cfc30 msgr2=0x7fd734159090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 -- 172.21.15.96:0/2710262656 shutdown_connections 2024-06-02T23:47:29.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.751+0000 7fd739e6d640 1 -- 172.21.15.96:0/2710262656 wait complete. 2024-06-02T23:47:29.763 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T23:47:29.763 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:47:29.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.862+0000 7fcc7355a640 1 Processor -- start 2024-06-02T23:47:29.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.862+0000 7fcc7355a640 1 -- start start 2024-06-02T23:47:29.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc7355a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcc6c164f10 0x7fcc6c167300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc7355a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc6c071f20 con 0x7fcc6c06ea70 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc7355a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc6c06f210 con 0x7fcc6c15f5e0 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc7355a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcc6c06ef30 con 0x7fcc6c164f10 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc70af5640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fcc6c06ea70 0x7fcc6c071810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:42966/0 (socket says 172.21.15.96:42966) 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc70af5640 1 -- 172.21.15.96:0/568226183 learned_addr learned my addr 172.21.15.96:0/568226183 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc71af7640 1 --2- 172.21.15.96:0/568226183 >> v2:172.21.15.162:3300/0 conn(0x7fcc6c164f10 0x7fcc6c167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc5ffff640 1 -- 172.21.15.96:0/568226183 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924469247 0 0) 0x7fcc6c071f20 con 0x7fcc6c06ea70 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc5ffff640 1 -- 172.21.15.96:0/568226183 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc58003520 con 0x7fcc6c06ea70 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc5ffff640 1 -- 172.21.15.96:0/568226183 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 242808851 0 0) 0x7fcc58003520 con 0x7fcc6c06ea70 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc71af7640 1 -- 172.21.15.96:0/568226183 >> v1:172.21.15.162:6789/0 conn(0x7fcc6c15f5e0 legacy=0x7fcc6c071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc71af7640 1 -- 172.21.15.96:0/568226183 >> v1:172.21.15.96:6789/0 conn(0x7fcc6c06ea70 legacy=0x7fcc6c071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.863+0000 7fcc71af7640 1 -- 172.21.15.96:0/568226183 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c0ca320 con 0x7fcc6c164f10 2024-06-02T23:47:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.864+0000 7fcc71af7640 1 --2- 172.21.15.96:0/568226183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c164f10 0x7fcc6c167300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009d90 tx=0x7fcc6402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa9500878e83834 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.864+0000 7fcc5ffff640 1 -- 172.21.15.96:0/568226183 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68001670 con 0x7fcc6c164f10 2024-06-02T23:47:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.864+0000 7fcc5ffff640 1 -- 172.21.15.96:0/568226183 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc64007540 con 0x7fcc6c164f10 2024-06-02T23:47:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.865+0000 7fcc5ffff640 1 -- 172.21.15.96:0/568226183 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc640078f0 con 0x7fcc6c164f10 2024-06-02T23:47:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.865+0000 7fcc7355a640 1 -- 172.21.15.96:0/568226183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c164f10 msgr2=0x7fcc6c167300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.865+0000 7fcc7355a640 1 --2- 172.21.15.96:0/568226183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c164f10 0x7fcc6c167300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc64009d90 tx=0x7fcc6402a680 comp rx=0 tx=0).stop 2024-06-02T23:47:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.865+0000 7fcc7355a640 1 -- 172.21.15.96:0/568226183 shutdown_connections 2024-06-02T23:47:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.865+0000 7fcc7355a640 1 --2- 172.21.15.96:0/568226183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c164f10 0x7fcc6c167300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.865+0000 7fcc7355a640 1 -- 172.21.15.96:0/568226183 >> 172.21.15.96:0/568226183 conn(0x7fcc6c0cfc30 msgr2=0x7fcc6c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.865+0000 7fcc7355a640 1 -- 172.21.15.96:0/568226183 shutdown_connections 2024-06-02T23:47:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.865+0000 7fcc7355a640 1 -- 172.21.15.96:0/568226183 wait complete. 2024-06-02T23:47:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.866+0000 7fcc7355a640 1 Processor -- start 2024-06-02T23:47:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.866+0000 7fcc7355a640 1 -- start start 2024-06-02T23:47:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc7355a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc6c06ea70 0x7fcc6c14bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc7355a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c15f5e0 0x7fcc6c14b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc7355a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc6c164f10 0x7fcc6c158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc7355a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c073030 con 0x7fcc6c06ea70 2024-06-02T23:47:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc7355a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c0ca8e0 con 0x7fcc6c15f5e0 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc7355a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6c0731b0 con 0x7fcc6c164f10 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc712f6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc6c06ea70 0x7fcc6c14bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc712f6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc6c06ea70 0x7fcc6c14bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40532/0 (socket says 172.21.15.96:40532) 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc712f6640 1 -- 172.21.15.96:0/1184846150 learned_addr learned my addr 172.21.15.96:0/1184846150 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc712f6640 1 -- 172.21.15.96:0/1184846150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc6c164f10 msgr2=0x7fcc6c158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc712f6640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc6c164f10 0x7fcc6c158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc712f6640 1 -- 172.21.15.96:0/1184846150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c15f5e0 msgr2=0x7fcc6c14b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc712f6640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c15f5e0 0x7fcc6c14b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.867+0000 7fcc712f6640 1 -- 172.21.15.96:0/1184846150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c14bc20 con 0x7fcc6c06ea70 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.868+0000 7fcc712f6640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc6c06ea70 0x7fcc6c14bf00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000c450 tx=0x7fcc6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.868+0000 7fcc5dffb640 1 -- 172.21.15.96:0/1184846150 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc600052d0 con 0x7fcc6c06ea70 2024-06-02T23:47:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.868+0000 7fcc5dffb640 1 -- 172.21.15.96:0/1184846150 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc60005470 con 0x7fcc6c06ea70 2024-06-02T23:47:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.868+0000 7fcc7355a640 1 -- 172.21.15.96:0/1184846150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c0c7b80 con 0x7fcc6c06ea70 2024-06-02T23:47:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.868+0000 7fcc5dffb640 1 -- 172.21.15.96:0/1184846150 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60012870 con 0x7fcc6c06ea70 2024-06-02T23:47:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.868+0000 7fcc7355a640 1 -- 172.21.15.96:0/1184846150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c14b850 con 0x7fcc6c06ea70 2024-06-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.869+0000 7fcc7355a640 1 -- 172.21.15.96:0/1184846150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6c0683e0 con 0x7fcc6c06ea70 2024-06-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.869+0000 7fcc5dffb640 1 -- 172.21.15.96:0/1184846150 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc60012a10 con 0x7fcc6c06ea70 2024-06-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.869+0000 7fcc5dffb640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.870+0000 7fcc5dffb640 1 -- 172.21.15.96:0/1184846150 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fcc6008ab70 con 0x7fcc6c06ea70 2024-06-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.870+0000 7fcc70af5640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:29.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.870+0000 7fcc70af5640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcc5006be30 0x7fcc5006e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c156ab0 tx=0x7fcc68001180 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:29.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:29.874+0000 7fcc5dffb640 1 -- 172.21.15.96:0/1184846150 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcc60059420 con 0x7fcc6c06ea70 2024-06-02T23:47:30.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.044+0000 7fcc7355a640 1 -- 172.21.15.96:0/1184846150 --> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc6c0b3070 con 0x7fcc5006be30 2024-06-02T23:47:30.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.050+0000 7fcc5dffb640 1 -- 172.21.15.96:0/1184846150 <== mgr.4113 v2:172.21.15.96:6832/1776728888 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7fcc6c0b3070 con 0x7fcc5006be30 2024-06-02T23:47:30.053 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:30.054 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:47:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.053+0000 7fcc7355a640 1 -- 172.21.15.96:0/1184846150 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcc5006be30 msgr2=0x7fcc5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.053+0000 7fcc7355a640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcc5006be30 0x7fcc5006e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c156ab0 tx=0x7fcc68001180 comp rx=0 tx=0).stop 2024-06-02T23:47:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.053+0000 7fcc7355a640 1 -- 172.21.15.96:0/1184846150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc6c06ea70 msgr2=0x7fcc6c14bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.053+0000 7fcc7355a640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc6c06ea70 0x7fcc6c14bf00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000c450 tx=0x7fcc6000c910 comp rx=0 tx=0).stop 2024-06-02T23:47:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.053+0000 7fcc7355a640 1 -- 172.21.15.96:0/1184846150 shutdown_connections 2024-06-02T23:47:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.054+0000 7fcc7355a640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc6c164f10 0x7fcc6c158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.054+0000 7fcc7355a640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c15f5e0 0x7fcc6c14b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.054+0000 7fcc7355a640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fcc5006be30 0x7fcc5006e2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.054+0000 7fcc7355a640 1 --2- 172.21.15.96:0/1184846150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc6c06ea70 0x7fcc6c14bf00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.054+0000 7fcc7355a640 1 -- 172.21.15.96:0/1184846150 >> 172.21.15.96:0/1184846150 conn(0x7fcc6c0cfc30 msgr2=0x7fcc6c15da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:30.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.054+0000 7fcc7355a640 1 -- 172.21.15.96:0/1184846150 shutdown_connections 2024-06-02T23:47:30.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.054+0000 7fcc7355a640 1 -- 172.21.15.96:0/1184846150 wait complete. 2024-06-02T23:47:30.065 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-06-02T23:47:30.006967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220848,"kb_used_data":4672,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753872,"statfs":{"total":773094113280,"available":772867964928,"internally_reserved":0,"allocated":4784128,"data_stored":2711220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.934302"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114427+0000","last_change":"2024-06-02T23:47:27.103661+0000","last_active":"2024-06-02T23:47:27.114427+0000","last_peered":"2024-06-02T23:47:27.114427+0000","last_clean":"2024-06-02T23:47:27.114427+0000","last_became_active":"2024-06-02T23:47:27.103265+0000","last_became_peered":"2024-06-02T23:47:27.103265+0000","last_unstale":"2024-06-02T23:47:27.114427+0000","last_undegraded":"2024-06-02T23:47:27.114427+0000","last_fullsized":"2024-06-02T23:47:27.114427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:49.349189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.115065+0000","last_change":"2024-06-02T23:47:27.107634+0000","last_active":"2024-06-02T23:47:27.115065+0000","last_peered":"2024-06-02T23:47:27.115065+0000","last_clean":"2024-06-02T23:47:27.115065+0000","last_became_active":"2024-06-02T23:47:27.107371+0000","last_became_peered":"2024-06-02T23:47:27.107371+0000","last_unstale":"2024-06-02T23:47:27.115065+0000","last_undegraded":"2024-06-02T23:47:27.115065+0000","last_fullsized":"2024-06-02T23:47:27.115065+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:38:12.527231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121510+0000","last_change":"2024-06-02T23:47:27.113670+0000","last_active":"2024-06-02T23:47:27.121510+0000","last_peered":"2024-06-02T23:47:27.121510+0000","last_clean":"2024-06-02T23:47:27.121510+0000","last_became_active":"2024-06-02T23:47:27.113372+0000","last_became_peered":"2024-06-02T23:47:27.113372+0000","last_unstale":"2024-06-02T23:47:27.121510+0000","last_undegraded":"2024-06-02T23:47:27.121510+0000","last_fullsized":"2024-06-02T23:47:27.121510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:46:02.699267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.106587+0000","last_change":"2024-06-02T23:47:27.103269+0000","last_active":"2024-06-02T23:47:27.106587+0000","last_peered":"2024-06-02T23:47:27.106587+0000","last_clean":"2024-06-02T23:47:27.106587+0000","last_became_active":"2024-06-02T23:47:27.102988+0000","last_became_peered":"2024-06-02T23:47:27.102988+0000","last_unstale":"2024-06-02T23:47:27.106587+0000","last_undegraded":"2024-06-02T23:47:27.106587+0000","last_fullsized":"2024-06-02T23:47:27.106587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:12.455393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.109988+0000","last_change":"2024-06-02T23:47:27.105071+0000","last_active":"2024-06-02T23:47:27.109988+0000","last_peered":"2024-06-02T23:47:27.109988+0000","last_clean":"2024-06-02T23:47:27.109988+0000","last_became_active":"2024-06-02T23:47:27.104823+0000","last_became_peered":"2024-06-02T23:47:27.104823+0000","last_unstale":"2024-06-02T23:47:27.109988+0000","last_undegraded":"2024-06-02T23:47:27.109988+0000","last_fullsized":"2024-06-02T23:47:27.109988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:57:15.992056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084522+0000","last_change":"2024-06-02T23:47:27.104797+0000","last_active":"2024-06-02T23:47:28.084522+0000","last_peered":"2024-06-02T23:47:28.084522+0000","last_clean":"2024-06-02T23:47:28.084522+0000","last_became_active":"2024-06-02T23:47:27.104533+0000","last_became_peered":"2024-06-02T23:47:27.104533+0000","last_unstale":"2024-06-02T23:47:28.084522+0000","last_undegraded":"2024-06-02T23:47:28.084522+0000","last_fullsized":"2024-06-02T23:47:28.084522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:49.349189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.626948+0000","last_change":"2024-06-02T23:47:27.112961+0000","last_active":"2024-06-02T23:47:28.626948+0000","last_peered":"2024-06-02T23:47:28.626948+0000","last_clean":"2024-06-02T23:47:28.626948+0000","last_became_active":"2024-06-02T23:47:27.112136+0000","last_became_peered":"2024-06-02T23:47:27.112136+0000","last_unstale":"2024-06-02T23:47:28.626948+0000","last_undegraded":"2024-06-02T23:47:28.626948+0000","last_fullsized":"2024-06-02T23:47:28.626948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:10:04.950476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114262+0000","last_change":"2024-06-02T23:47:27.104020+0000","last_active":"2024-06-02T23:47:27.114262+0000","last_peered":"2024-06-02T23:47:27.114262+0000","last_clean":"2024-06-02T23:47:27.114262+0000","last_became_active":"2024-06-02T23:47:27.103703+0000","last_became_peered":"2024-06-02T23:47:27.103703+0000","last_unstale":"2024-06-02T23:47:27.114262+0000","last_undegraded":"2024-06-02T23:47:27.114262+0000","last_fullsized":"2024-06-02T23:47:27.114262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:51.155082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121537+0000","last_change":"2024-06-02T23:47:27.113712+0000","last_active":"2024-06-02T23:47:27.121537+0000","last_peered":"2024-06-02T23:47:27.121537+0000","last_clean":"2024-06-02T23:47:27.121537+0000","last_became_active":"2024-06-02T23:47:27.113421+0000","last_became_peered":"2024-06-02T23:47:27.113421+0000","last_unstale":"2024-06-02T23:47:27.121537+0000","last_undegraded":"2024-06-02T23:47:27.121537+0000","last_fullsized":"2024-06-02T23:47:27.121537+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:48.217019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627357+0000","last_change":"2024-06-02T23:47:27.106984+0000","last_active":"2024-06-02T23:47:28.627357+0000","last_peered":"2024-06-02T23:47:28.627357+0000","last_clean":"2024-06-02T23:47:28.627357+0000","last_became_active":"2024-06-02T23:47:27.105643+0000","last_became_peered":"2024-06-02T23:47:27.105643+0000","last_unstale":"2024-06-02T23:47:28.627357+0000","last_undegraded":"2024-06-02T23:47:28.627357+0000","last_fullsized":"2024-06-02T23:47:28.627357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:39:48.768088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627368+0000","last_change":"2024-06-02T23:47:27.111940+0000","last_active":"2024-06-02T23:47:28.627368+0000","last_peered":"2024-06-02T23:47:28.627368+0000","last_clean":"2024-06-02T23:47:28.627368+0000","last_became_active":"2024-06-02T23:47:27.106455+0000","last_became_peered":"2024-06-02T23:47:27.106455+0000","last_unstale":"2024-06-02T23:47:28.627368+0000","last_undegraded":"2024-06-02T23:47:28.627368+0000","last_fullsized":"2024-06-02T23:47:28.627368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:19.694350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114798+0000","last_change":"2024-06-02T23:47:27.110762+0000","last_active":"2024-06-02T23:47:27.114798+0000","last_peered":"2024-06-02T23:47:27.114798+0000","last_clean":"2024-06-02T23:47:27.114798+0000","last_became_active":"2024-06-02T23:47:27.110474+0000","last_became_peered":"2024-06-02T23:47:27.110474+0000","last_unstale":"2024-06-02T23:47:27.114798+0000","last_undegraded":"2024-06-02T23:47:27.114798+0000","last_fullsized":"2024-06-02T23:47:27.114798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:02:52.102989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627250+0000","last_change":"2024-06-02T23:47:27.099931+0000","last_active":"2024-06-02T23:47:28.627250+0000","last_peered":"2024-06-02T23:47:28.627250+0000","last_clean":"2024-06-02T23:47:28.627250+0000","last_became_active":"2024-06-02T23:47:27.097525+0000","last_became_peered":"2024-06-02T23:47:27.097525+0000","last_unstale":"2024-06-02T23:47:28.627250+0000","last_undegraded":"2024-06-02T23:47:28.627250+0000","last_fullsized":"2024-06-02T23:47:28.627250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:12.574393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085100+0000","last_change":"2024-06-02T23:47:27.102154+0000","last_active":"2024-06-02T23:47:28.085100+0000","last_peered":"2024-06-02T23:47:28.085100+0000","last_clean":"2024-06-02T23:47:28.085100+0000","last_became_active":"2024-06-02T23:47:27.101885+0000","last_became_peered":"2024-06-02T23:47:27.101885+0000","last_unstale":"2024-06-02T23:47:28.085100+0000","last_undegraded":"2024-06-02T23:47:28.085100+0000","last_fullsized":"2024-06-02T23:47:28.085100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:46:38.432462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627071+0000","last_change":"2024-06-02T23:47:27.108597+0000","last_active":"2024-06-02T23:47:28.627071+0000","last_peered":"2024-06-02T23:47:28.627071+0000","last_clean":"2024-06-02T23:47:28.627071+0000","last_became_active":"2024-06-02T23:47:27.108107+0000","last_became_peered":"2024-06-02T23:47:27.108107+0000","last_unstale":"2024-06-02T23:47:28.627071+0000","last_undegraded":"2024-06-02T23:47:28.627071+0000","last_fullsized":"2024-06-02T23:47:28.627071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:02.446584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.907871+0000","last_change":"2024-06-02T23:47:27.104535+0000","last_active":"2024-06-02T23:47:28.907871+0000","last_peered":"2024-06-02T23:47:28.907871+0000","last_clean":"2024-06-02T23:47:28.907871+0000","last_became_active":"2024-06-02T23:47:27.104267+0000","last_became_peered":"2024-06-02T23:47:27.104267+0000","last_unstale":"2024-06-02T23:47:28.907871+0000","last_undegraded":"2024-06-02T23:47:28.907871+0000","last_fullsized":"2024-06-02T23:47:28.907871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:49.349189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908377+0000","last_change":"2024-06-02T23:47:27.105241+0000","last_active":"2024-06-02T23:47:28.908377+0000","last_peered":"2024-06-02T23:47:28.908377+0000","last_clean":"2024-06-02T23:47:28.908377+0000","last_became_active":"2024-06-02T23:47:27.104988+0000","last_became_peered":"2024-06-02T23:47:27.104988+0000","last_unstale":"2024-06-02T23:47:28.908377+0000","last_undegraded":"2024-06-02T23:47:28.908377+0000","last_fullsized":"2024-06-02T23:47:28.908377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:09:03.165248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.105494+0000","last_change":"2024-06-02T23:47:27.096712+0000","last_active":"2024-06-02T23:47:27.105494+0000","last_peered":"2024-06-02T23:47:27.105494+0000","last_clean":"2024-06-02T23:47:27.105494+0000","last_became_active":"2024-06-02T23:47:27.096393+0000","last_became_peered":"2024-06-02T23:47:27.096393+0000","last_unstale":"2024-06-02T23:47:27.105494+0000","last_undegraded":"2024-06-02T23:47:27.105494+0000","last_fullsized":"2024-06-02T23:47:27.105494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:14.510393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.110951+0000","last_change":"2024-06-02T23:47:27.106168+0000","last_active":"2024-06-02T23:47:27.110951+0000","last_peered":"2024-06-02T23:47:27.110951+0000","last_clean":"2024-06-02T23:47:27.110951+0000","last_became_active":"2024-06-02T23:47:27.105530+0000","last_became_peered":"2024-06-02T23:47:27.105530+0000","last_unstale":"2024-06-02T23:47:27.110951+0000","last_undegraded":"2024-06-02T23:47:27.110951+0000","last_fullsized":"2024-06-02T23:47:27.110951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:15:05.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.110168+0000","last_change":"2024-06-02T23:47:27.103794+0000","last_active":"2024-06-02T23:47:27.110168+0000","last_peered":"2024-06-02T23:47:27.110168+0000","last_clean":"2024-06-02T23:47:27.110168+0000","last_became_active":"2024-06-02T23:47:27.103479+0000","last_became_peered":"2024-06-02T23:47:27.103479+0000","last_unstale":"2024-06-02T23:47:27.110168+0000","last_undegraded":"2024-06-02T23:47:27.110168+0000","last_fullsized":"2024-06-02T23:47:27.110168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:02:52.102989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627140+0000","last_change":"2024-06-02T23:47:27.111847+0000","last_active":"2024-06-02T23:47:28.627140+0000","last_peered":"2024-06-02T23:47:28.627140+0000","last_clean":"2024-06-02T23:47:28.627140+0000","last_became_active":"2024-06-02T23:47:27.108939+0000","last_became_peered":"2024-06-02T23:47:27.108939+0000","last_unstale":"2024-06-02T23:47:28.627140+0000","last_undegraded":"2024-06-02T23:47:28.627140+0000","last_fullsized":"2024-06-02T23:47:28.627140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:37:44.449453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085316+0000","last_change":"2024-06-02T23:47:27.103043+0000","last_active":"2024-06-02T23:47:28.085316+0000","last_peered":"2024-06-02T23:47:28.085316+0000","last_clean":"2024-06-02T23:47:28.085316+0000","last_became_active":"2024-06-02T23:47:27.102749+0000","last_became_peered":"2024-06-02T23:47:27.102749+0000","last_unstale":"2024-06-02T23:47:28.085316+0000","last_undegraded":"2024-06-02T23:47:28.085316+0000","last_fullsized":"2024-06-02T23:47:28.085316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:46.912233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908233+0000","last_change":"2024-06-02T23:47:27.108573+0000","last_active":"2024-06-02T23:47:28.908233+0000","last_peered":"2024-06-02T23:47:28.908233+0000","last_clean":"2024-06-02T23:47:28.908233+0000","last_became_active":"2024-06-02T23:47:27.108294+0000","last_became_peered":"2024-06-02T23:47:27.108294+0000","last_unstale":"2024-06-02T23:47:28.908233+0000","last_undegraded":"2024-06-02T23:47:28.908233+0000","last_fullsized":"2024-06-02T23:47:28.908233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:30.729164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.109932+0000","last_change":"2024-06-02T23:47:27.106029+0000","last_active":"2024-06-02T23:47:27.109932+0000","last_peered":"2024-06-02T23:47:27.109932+0000","last_clean":"2024-06-02T23:47:27.109932+0000","last_became_active":"2024-06-02T23:47:27.105324+0000","last_became_peered":"2024-06-02T23:47:27.105324+0000","last_unstale":"2024-06-02T23:47:27.109932+0000","last_undegraded":"2024-06-02T23:47:27.109932+0000","last_fullsized":"2024-06-02T23:47:27.109932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:25:58.508787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.113297+0000","last_change":"2024-06-02T23:47:27.106685+0000","last_active":"2024-06-02T23:47:27.113297+0000","last_peered":"2024-06-02T23:47:27.113297+0000","last_clean":"2024-06-02T23:47:27.113297+0000","last_became_active":"2024-06-02T23:47:27.103586+0000","last_became_peered":"2024-06-02T23:47:27.103586+0000","last_unstale":"2024-06-02T23:47:27.113297+0000","last_undegraded":"2024-06-02T23:47:27.113297+0000","last_fullsized":"2024-06-02T23:47:27.113297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:46:02.699267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084678+0000","last_change":"2024-06-02T23:47:27.103645+0000","last_active":"2024-06-02T23:47:28.084678+0000","last_peered":"2024-06-02T23:47:28.084678+0000","last_clean":"2024-06-02T23:47:28.084678+0000","last_became_active":"2024-06-02T23:47:27.103340+0000","last_became_peered":"2024-06-02T23:47:27.103340+0000","last_unstale":"2024-06-02T23:47:28.084678+0000","last_undegraded":"2024-06-02T23:47:28.084678+0000","last_fullsized":"2024-06-02T23:47:28.084678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:44.346475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.092520+0000","last_change":"2024-06-02T23:47:27.089314+0000","last_active":"2024-06-02T23:47:27.092520+0000","last_peered":"2024-06-02T23:47:27.092520+0000","last_clean":"2024-06-02T23:47:27.092520+0000","last_became_active":"2024-06-02T23:47:27.089041+0000","last_became_peered":"2024-06-02T23:47:27.089041+0000","last_unstale":"2024-06-02T23:47:27.092520+0000","last_undegraded":"2024-06-02T23:47:27.092520+0000","last_fullsized":"2024-06-02T23:47:27.092520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:33.192640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627342+0000","last_change":"2024-06-02T23:47:27.106879+0000","last_active":"2024-06-02T23:47:28.627342+0000","last_peered":"2024-06-02T23:47:28.627342+0000","last_clean":"2024-06-02T23:47:28.627342+0000","last_became_active":"2024-06-02T23:47:27.105321+0000","last_became_peered":"2024-06-02T23:47:27.105321+0000","last_unstale":"2024-06-02T23:47:28.627342+0000","last_undegraded":"2024-06-02T23:47:28.627342+0000","last_fullsized":"2024-06-02T23:47:28.627342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:32:01.461806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.096230+0000","last_change":"2024-06-02T23:47:27.095016+0000","last_active":"2024-06-02T23:47:27.096230+0000","last_peered":"2024-06-02T23:47:27.096230+0000","last_clean":"2024-06-02T23:47:27.096230+0000","last_became_active":"2024-06-02T23:47:27.094731+0000","last_became_peered":"2024-06-02T23:47:27.094731+0000","last_unstale":"2024-06-02T23:47:27.096230+0000","last_undegraded":"2024-06-02T23:47:27.096230+0000","last_fullsized":"2024-06-02T23:47:27.096230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:46:33.731978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.110469+0000","last_change":"2024-06-02T23:47:27.104554+0000","last_active":"2024-06-02T23:47:27.110469+0000","last_peered":"2024-06-02T23:47:27.110469+0000","last_clean":"2024-06-02T23:47:27.110469+0000","last_became_active":"2024-06-02T23:47:27.104274+0000","last_became_peered":"2024-06-02T23:47:27.104274+0000","last_unstale":"2024-06-02T23:47:27.110469+0000","last_undegraded":"2024-06-02T23:47:27.110469+0000","last_fullsized":"2024-06-02T23:47:27.110469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:57.543823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908148+0000","last_change":"2024-06-02T23:47:27.108704+0000","last_active":"2024-06-02T23:47:28.908148+0000","last_peered":"2024-06-02T23:47:28.908148+0000","last_clean":"2024-06-02T23:47:28.908148+0000","last_became_active":"2024-06-02T23:47:27.108464+0000","last_became_peered":"2024-06-02T23:47:27.108464+0000","last_unstale":"2024-06-02T23:47:28.908148+0000","last_undegraded":"2024-06-02T23:47:28.908148+0000","last_fullsized":"2024-06-02T23:47:28.908148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:51.155082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084648+0000","last_change":"2024-06-02T23:47:27.107150+0000","last_active":"2024-06-02T23:47:28.084648+0000","last_peered":"2024-06-02T23:47:28.084648+0000","last_clean":"2024-06-02T23:47:28.084648+0000","last_became_active":"2024-06-02T23:47:27.106858+0000","last_became_peered":"2024-06-02T23:47:27.106858+0000","last_unstale":"2024-06-02T23:47:28.084648+0000","last_undegraded":"2024-06-02T23:47:28.084648+0000","last_fullsized":"2024-06-02T23:47:28.084648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:55:39.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908109+0000","last_change":"2024-06-02T23:47:27.103859+0000","last_active":"2024-06-02T23:47:28.908109+0000","last_peered":"2024-06-02T23:47:28.908109+0000","last_clean":"2024-06-02T23:47:28.908109+0000","last_became_active":"2024-06-02T23:47:27.103396+0000","last_became_peered":"2024-06-02T23:47:27.103396+0000","last_unstale":"2024-06-02T23:47:28.908109+0000","last_undegraded":"2024-06-02T23:47:28.908109+0000","last_fullsized":"2024-06-02T23:47:28.908109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:55:39.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.110534+0000","last_change":"2024-06-02T23:47:26.105262+0000","last_active":"2024-06-02T23:47:27.110534+0000","last_peered":"2024-06-02T23:47:27.110534+0000","last_clean":"2024-06-02T23:47:27.110534+0000","last_became_active":"2024-06-02T23:47:26.104994+0000","last_became_peered":"2024-06-02T23:47:26.104994+0000","last_unstale":"2024-06-02T23:47:27.110534+0000","last_undegraded":"2024-06-02T23:47:27.110534+0000","last_fullsized":"2024-06-02T23:47:27.110534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:42.080112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085124+0000","last_change":"2024-06-02T23:47:27.108410+0000","last_active":"2024-06-02T23:47:28.085124+0000","last_peered":"2024-06-02T23:47:28.085124+0000","last_clean":"2024-06-02T23:47:28.085124+0000","last_became_active":"2024-06-02T23:47:27.108100+0000","last_became_peered":"2024-06-02T23:47:27.108100+0000","last_unstale":"2024-06-02T23:47:28.085124+0000","last_undegraded":"2024-06-02T23:47:28.085124+0000","last_fullsized":"2024-06-02T23:47:28.085124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:38:12.527231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.119467+0000","last_change":"2024-06-02T23:47:26.104535+0000","last_active":"2024-06-02T23:47:27.119467+0000","last_peered":"2024-06-02T23:47:27.119467+0000","last_clean":"2024-06-02T23:47:27.119467+0000","last_became_active":"2024-06-02T23:47:26.104253+0000","last_became_peered":"2024-06-02T23:47:26.104253+0000","last_unstale":"2024-06-02T23:47:27.119467+0000","last_undegraded":"2024-06-02T23:47:27.119467+0000","last_fullsized":"2024-06-02T23:47:27.119467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:46:32.727074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085636+0000","last_change":"2024-06-02T23:47:27.095863+0000","last_active":"2024-06-02T23:47:28.085636+0000","last_peered":"2024-06-02T23:47:28.085636+0000","last_clean":"2024-06-02T23:47:28.085636+0000","last_became_active":"2024-06-02T23:47:27.095592+0000","last_became_peered":"2024-06-02T23:47:27.095592+0000","last_unstale":"2024-06-02T23:47:28.085636+0000","last_undegraded":"2024-06-02T23:47:28.085636+0000","last_fullsized":"2024-06-02T23:47:28.085636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:51.155082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085005+0000","last_change":"2024-06-02T23:47:26.104543+0000","last_active":"2024-06-02T23:47:28.085005+0000","last_peered":"2024-06-02T23:47:28.085005+0000","last_clean":"2024-06-02T23:47:28.085005+0000","last_became_active":"2024-06-02T23:47:26.104238+0000","last_became_peered":"2024-06-02T23:47:26.104238+0000","last_unstale":"2024-06-02T23:47:28.085005+0000","last_undegraded":"2024-06-02T23:47:28.085005+0000","last_fullsized":"2024-06-02T23:47:28.085005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:14.013885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.117782+0000","last_change":"2024-06-02T23:47:27.111744+0000","last_active":"2024-06-02T23:47:27.117782+0000","last_peered":"2024-06-02T23:47:27.117782+0000","last_clean":"2024-06-02T23:47:27.117782+0000","last_became_active":"2024-06-02T23:47:27.111489+0000","last_became_peered":"2024-06-02T23:47:27.111489+0000","last_unstale":"2024-06-02T23:47:27.117782+0000","last_undegraded":"2024-06-02T23:47:27.117782+0000","last_fullsized":"2024-06-02T23:47:27.117782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:02.446584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085514+0000","last_change":"2024-06-02T23:47:26.101135+0000","last_active":"2024-06-02T23:47:28.085514+0000","last_peered":"2024-06-02T23:47:28.085514+0000","last_clean":"2024-06-02T23:47:28.085514+0000","last_became_active":"2024-06-02T23:47:26.100875+0000","last_became_peered":"2024-06-02T23:47:26.100875+0000","last_unstale":"2024-06-02T23:47:28.085514+0000","last_undegraded":"2024-06-02T23:47:28.085514+0000","last_fullsized":"2024-06-02T23:47:28.085514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:56.538919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121588+0000","last_change":"2024-06-02T23:47:27.114864+0000","last_active":"2024-06-02T23:47:27.121588+0000","last_peered":"2024-06-02T23:47:27.121588+0000","last_clean":"2024-06-02T23:47:27.121588+0000","last_became_active":"2024-06-02T23:47:27.114611+0000","last_became_peered":"2024-06-02T23:47:27.114611+0000","last_unstale":"2024-06-02T23:47:27.121588+0000","last_undegraded":"2024-06-02T23:47:27.121588+0000","last_fullsized":"2024-06-02T23:47:27.121588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:42.699970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627340+0000","last_change":"2024-06-02T23:47:26.101131+0000","last_active":"2024-06-02T23:47:28.627340+0000","last_peered":"2024-06-02T23:47:28.627340+0000","last_clean":"2024-06-02T23:47:28.627340+0000","last_became_active":"2024-06-02T23:47:26.100832+0000","last_became_peered":"2024-06-02T23:47:26.100832+0000","last_unstale":"2024-06-02T23:47:28.627340+0000","last_undegraded":"2024-06-02T23:47:28.627340+0000","last_fullsized":"2024-06-02T23:47:28.627340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:46:01.694363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627228+0000","last_change":"2024-06-02T23:47:27.108357+0000","last_active":"2024-06-02T23:47:28.627228+0000","last_peered":"2024-06-02T23:47:28.627228+0000","last_clean":"2024-06-02T23:47:28.627228+0000","last_became_active":"2024-06-02T23:47:27.107725+0000","last_became_peered":"2024-06-02T23:47:27.107725+0000","last_unstale":"2024-06-02T23:47:28.627228+0000","last_undegraded":"2024-06-02T23:47:28.627228+0000","last_fullsized":"2024-06-02T23:47:28.627228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:47:20.524998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908006+0000","last_change":"2024-06-02T23:47:26.107071+0000","last_active":"2024-06-02T23:47:28.908006+0000","last_peered":"2024-06-02T23:47:28.908006+0000","last_clean":"2024-06-02T23:47:28.908006+0000","last_became_active":"2024-06-02T23:47:26.106762+0000","last_became_peered":"2024-06-02T23:47:26.106762+0000","last_unstale":"2024-06-02T23:47:28.908006+0000","last_undegraded":"2024-06-02T23:47:28.908006+0000","last_fullsized":"2024-06-02T23:47:28.908006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:13.505489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085304+0000","last_change":"2024-06-02T23:47:27.100462+0000","last_active":"2024-06-02T23:47:28.085304+0000","last_peered":"2024-06-02T23:47:28.085304+0000","last_clean":"2024-06-02T23:47:28.085304+0000","last_became_active":"2024-06-02T23:47:27.100177+0000","last_became_peered":"2024-06-02T23:47:27.100177+0000","last_unstale":"2024-06-02T23:47:28.085304+0000","last_undegraded":"2024-06-02T23:47:28.085304+0000","last_fullsized":"2024-06-02T23:47:28.085304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:31:23.857785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084548+0000","last_change":"2024-06-02T23:47:26.102991+0000","last_active":"2024-06-02T23:47:28.084548+0000","last_peered":"2024-06-02T23:47:28.084548+0000","last_clean":"2024-06-02T23:47:28.084548+0000","last_became_active":"2024-06-02T23:47:26.101182+0000","last_became_peered":"2024-06-02T23:47:26.101182+0000","last_unstale":"2024-06-02T23:47:28.084548+0000","last_undegraded":"2024-06-02T23:47:28.084548+0000","last_fullsized":"2024-06-02T23:47:28.084548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:46:01.694363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114895+0000","last_change":"2024-06-02T23:47:27.106889+0000","last_active":"2024-06-02T23:47:27.114895+0000","last_peered":"2024-06-02T23:47:27.114895+0000","last_clean":"2024-06-02T23:47:27.114895+0000","last_became_active":"2024-06-02T23:47:27.106630+0000","last_became_peered":"2024-06-02T23:47:27.106630+0000","last_unstale":"2024-06-02T23:47:27.114895+0000","last_undegraded":"2024-06-02T23:47:27.114895+0000","last_fullsized":"2024-06-02T23:47:27.114895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:44:53.959179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084924+0000","last_change":"2024-06-02T23:47:26.099887+0000","last_active":"2024-06-02T23:47:28.084924+0000","last_peered":"2024-06-02T23:47:28.084924+0000","last_clean":"2024-06-02T23:47:28.084924+0000","last_became_active":"2024-06-02T23:47:26.099605+0000","last_became_peered":"2024-06-02T23:47:26.099605+0000","last_unstale":"2024-06-02T23:47:28.084924+0000","last_undegraded":"2024-06-02T23:47:28.084924+0000","last_fullsized":"2024-06-02T23:47:28.084924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:46:32.727074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.110039+0000","last_change":"2024-06-02T23:47:27.104441+0000","last_active":"2024-06-02T23:47:27.110039+0000","last_peered":"2024-06-02T23:47:27.110039+0000","last_clean":"2024-06-02T23:47:27.110039+0000","last_became_active":"2024-06-02T23:47:27.104187+0000","last_became_peered":"2024-06-02T23:47:27.104187+0000","last_unstale":"2024-06-02T23:47:27.110039+0000","last_undegraded":"2024-06-02T23:47:27.110039+0000","last_fullsized":"2024-06-02T23:47:27.110039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:12:37.064000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.099411+0000","last_change":"2024-06-02T23:47:26.102150+0000","last_active":"2024-06-02T23:47:27.099411+0000","last_peered":"2024-06-02T23:47:27.099411+0000","last_clean":"2024-06-02T23:47:27.099411+0000","last_became_active":"2024-06-02T23:47:26.101845+0000","last_became_peered":"2024-06-02T23:47:26.101845+0000","last_unstale":"2024-06-02T23:47:27.099411+0000","last_undegraded":"2024-06-02T23:47:27.099411+0000","last_fullsized":"2024-06-02T23:47:27.099411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:45.907329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908289+0000","last_change":"2024-06-02T23:47:27.111500+0000","last_active":"2024-06-02T23:47:28.908289+0000","last_peered":"2024-06-02T23:47:28.908289+0000","last_clean":"2024-06-02T23:47:28.908289+0000","last_became_active":"2024-06-02T23:47:27.111205+0000","last_became_peered":"2024-06-02T23:47:27.111205+0000","last_unstale":"2024-06-02T23:47:28.908289+0000","last_undegraded":"2024-06-02T23:47:28.908289+0000","last_fullsized":"2024-06-02T23:47:28.908289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:38:12.527231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627559+0000","last_change":"2024-06-02T23:47:26.101019+0000","last_active":"2024-06-02T23:47:28.627559+0000","last_peered":"2024-06-02T23:47:28.627559+0000","last_clean":"2024-06-02T23:47:28.627559+0000","last_became_active":"2024-06-02T23:47:26.100734+0000","last_became_peered":"2024-06-02T23:47:26.100734+0000","last_unstale":"2024-06-02T23:47:28.627559+0000","last_undegraded":"2024-06-02T23:47:28.627559+0000","last_fullsized":"2024-06-02T23:47:28.627559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:49:17.869728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121906+0000","last_change":"2024-06-02T23:47:27.119842+0000","last_active":"2024-06-02T23:47:27.121906+0000","last_peered":"2024-06-02T23:47:27.121906+0000","last_clean":"2024-06-02T23:47:27.121906+0000","last_became_active":"2024-06-02T23:47:27.119568+0000","last_became_peered":"2024-06-02T23:47:27.119568+0000","last_unstale":"2024-06-02T23:47:27.121906+0000","last_undegraded":"2024-06-02T23:47:27.121906+0000","last_fullsized":"2024-06-02T23:47:27.121906+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:49:18.874631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627482+0000","last_change":"2024-06-02T23:47:26.101962+0000","last_active":"2024-06-02T23:47:28.627482+0000","last_peered":"2024-06-02T23:47:28.627482+0000","last_clean":"2024-06-02T23:47:28.627482+0000","last_became_active":"2024-06-02T23:47:26.101650+0000","last_became_peered":"2024-06-02T23:47:26.101650+0000","last_unstale":"2024-06-02T23:47:28.627482+0000","last_undegraded":"2024-06-02T23:47:28.627482+0000","last_fullsized":"2024-06-02T23:47:28.627482+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:47.212115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085717+0000","last_change":"2024-06-02T23:47:27.103825+0000","last_active":"2024-06-02T23:47:28.085717+0000","last_peered":"2024-06-02T23:47:28.085717+0000","last_clean":"2024-06-02T23:47:28.085717+0000","last_became_active":"2024-06-02T23:47:27.102734+0000","last_became_peered":"2024-06-02T23:47:27.102734+0000","last_unstale":"2024-06-02T23:47:28.085717+0000","last_undegraded":"2024-06-02T23:47:28.085717+0000","last_fullsized":"2024-06-02T23:47:28.085717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:55:39.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121823+0000","last_change":"2024-06-02T23:47:26.105353+0000","last_active":"2024-06-02T23:47:27.121823+0000","last_peered":"2024-06-02T23:47:27.121823+0000","last_clean":"2024-06-02T23:47:27.121823+0000","last_became_active":"2024-06-02T23:47:26.105129+0000","last_became_peered":"2024-06-02T23:47:26.105129+0000","last_unstale":"2024-06-02T23:47:27.121823+0000","last_undegraded":"2024-06-02T23:47:27.121823+0000","last_fullsized":"2024-06-02T23:47:27.121823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:46:37.427558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.118165+0000","last_change":"2024-06-02T23:47:27.112862+0000","last_active":"2024-06-02T23:47:27.118165+0000","last_peered":"2024-06-02T23:47:27.118165+0000","last_clean":"2024-06-02T23:47:27.118165+0000","last_became_active":"2024-06-02T23:47:27.112555+0000","last_became_peered":"2024-06-02T23:47:27.112555+0000","last_unstale":"2024-06-02T23:47:27.118165+0000","last_undegraded":"2024-06-02T23:47:27.118165+0000","last_fullsized":"2024-06-02T23:47:27.118165+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:57.543823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.109339+0000","last_change":"2024-06-02T23:47:26.104279+0000","last_active":"2024-06-02T23:47:27.109339+0000","last_peered":"2024-06-02T23:47:27.109339+0000","last_clean":"2024-06-02T23:47:27.109339+0000","last_became_active":"2024-06-02T23:47:26.103868+0000","last_became_peered":"2024-06-02T23:47:26.103868+0000","last_unstale":"2024-06-02T23:47:27.109339+0000","last_undegraded":"2024-06-02T23:47:27.109339+0000","last_fullsized":"2024-06-02T23:47:27.109339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:26:18.531872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114395+0000","last_change":"2024-06-02T23:47:27.103209+0000","last_active":"2024-06-02T23:47:27.114395+0000","last_peered":"2024-06-02T23:47:27.114395+0000","last_clean":"2024-06-02T23:47:27.114395+0000","last_became_active":"2024-06-02T23:47:27.102927+0000","last_became_peered":"2024-06-02T23:47:27.102927+0000","last_unstale":"2024-06-02T23:47:27.114395+0000","last_undegraded":"2024-06-02T23:47:27.114395+0000","last_fullsized":"2024-06-02T23:47:27.114395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:31:23.857785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084582+0000","last_change":"2024-06-02T23:47:26.101124+0000","last_active":"2024-06-02T23:47:28.084582+0000","last_peered":"2024-06-02T23:47:28.084582+0000","last_clean":"2024-06-02T23:47:28.084582+0000","last_became_active":"2024-06-02T23:47:26.100832+0000","last_became_peered":"2024-06-02T23:47:26.100832+0000","last_unstale":"2024-06-02T23:47:28.084582+0000","last_undegraded":"2024-06-02T23:47:28.084582+0000","last_fullsized":"2024-06-02T23:47:28.084582+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:47.212115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908136+0000","last_change":"2024-06-02T23:47:27.108483+0000","last_active":"2024-06-02T23:47:28.908136+0000","last_peered":"2024-06-02T23:47:28.908136+0000","last_clean":"2024-06-02T23:47:28.908136+0000","last_became_active":"2024-06-02T23:47:27.108190+0000","last_became_peered":"2024-06-02T23:47:27.108190+0000","last_unstale":"2024-06-02T23:47:28.908136+0000","last_undegraded":"2024-06-02T23:47:28.908136+0000","last_fullsized":"2024-06-02T23:47:28.908136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:44.346475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.084209+0000","last_change":"2024-06-02T23:47:26.104414+0000","last_active":"2024-06-02T23:47:27.084209+0000","last_peered":"2024-06-02T23:47:27.084209+0000","last_clean":"2024-06-02T23:47:27.084209+0000","last_became_active":"2024-06-02T23:47:26.104113+0000","last_became_peered":"2024-06-02T23:47:26.104113+0000","last_unstale":"2024-06-02T23:47:27.084209+0000","last_undegraded":"2024-06-02T23:47:27.084209+0000","last_fullsized":"2024-06-02T23:47:27.084209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:38:34.476925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114884+0000","last_change":"2024-06-02T23:47:27.104713+0000","last_active":"2024-06-02T23:47:27.114884+0000","last_peered":"2024-06-02T23:47:27.114884+0000","last_clean":"2024-06-02T23:47:27.114884+0000","last_became_active":"2024-06-02T23:47:27.104082+0000","last_became_peered":"2024-06-02T23:47:27.104082+0000","last_unstale":"2024-06-02T23:47:27.114884+0000","last_undegraded":"2024-06-02T23:47:27.114884+0000","last_fullsized":"2024-06-02T23:47:27.114884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:44.346475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.907833+0000","last_change":"2024-06-02T23:47:26.107095+0000","last_active":"2024-06-02T23:47:28.907833+0000","last_peered":"2024-06-02T23:47:28.907833+0000","last_clean":"2024-06-02T23:47:28.907833+0000","last_became_active":"2024-06-02T23:47:26.106787+0000","last_became_peered":"2024-06-02T23:47:26.106787+0000","last_unstale":"2024-06-02T23:47:28.907833+0000","last_undegraded":"2024-06-02T23:47:28.907833+0000","last_fullsized":"2024-06-02T23:47:28.907833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:46:32.727074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.117722+0000","last_change":"2024-06-02T23:47:27.110988+0000","last_active":"2024-06-02T23:47:27.117722+0000","last_peered":"2024-06-02T23:47:27.117722+0000","last_clean":"2024-06-02T23:47:27.117722+0000","last_became_active":"2024-06-02T23:47:27.110714+0000","last_became_peered":"2024-06-02T23:47:27.110714+0000","last_unstale":"2024-06-02T23:47:27.117722+0000","last_undegraded":"2024-06-02T23:47:27.117722+0000","last_fullsized":"2024-06-02T23:47:27.117722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:10:04.950476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627542+0000","last_change":"2024-06-02T23:47:26.098262+0000","last_active":"2024-06-02T23:47:28.627542+0000","last_peered":"2024-06-02T23:47:28.627542+0000","last_clean":"2024-06-02T23:47:28.627542+0000","last_became_active":"2024-06-02T23:47:26.097963+0000","last_became_peered":"2024-06-02T23:47:26.097963+0000","last_unstale":"2024-06-02T23:47:28.627542+0000","last_undegraded":"2024-06-02T23:47:28.627542+0000","last_fullsized":"2024-06-02T23:47:28.627542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:41.695067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627450+0000","last_change":"2024-06-02T23:47:27.108890+0000","last_active":"2024-06-02T23:47:28.627450+0000","last_peered":"2024-06-02T23:47:28.627450+0000","last_clean":"2024-06-02T23:47:28.627450+0000","last_became_active":"2024-06-02T23:47:27.107299+0000","last_became_peered":"2024-06-02T23:47:27.107299+0000","last_unstale":"2024-06-02T23:47:28.627450+0000","last_undegraded":"2024-06-02T23:47:28.627450+0000","last_fullsized":"2024-06-02T23:47:28.627450+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:37.205777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085694+0000","last_change":"2024-06-02T23:47:26.098338+0000","last_active":"2024-06-02T23:47:28.085694+0000","last_peered":"2024-06-02T23:47:28.085694+0000","last_clean":"2024-06-02T23:47:28.085694+0000","last_became_active":"2024-06-02T23:47:26.097963+0000","last_became_peered":"2024-06-02T23:47:26.097963+0000","last_unstale":"2024-06-02T23:47:28.085694+0000","last_undegraded":"2024-06-02T23:47:28.085694+0000","last_fullsized":"2024-06-02T23:47:28.085694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:13.505489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085570+0000","last_change":"2024-06-02T23:47:27.106404+0000","last_active":"2024-06-02T23:47:28.085570+0000","last_peered":"2024-06-02T23:47:28.085570+0000","last_clean":"2024-06-02T23:47:28.085570+0000","last_became_active":"2024-06-02T23:47:27.103771+0000","last_became_peered":"2024-06-02T23:47:27.103771+0000","last_unstale":"2024-06-02T23:47:28.085570+0000","last_undegraded":"2024-06-02T23:47:28.085570+0000","last_fullsized":"2024-06-02T23:47:28.085570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:49.349189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.105186+0000","last_change":"2024-06-02T23:47:26.102295+0000","last_active":"2024-06-02T23:47:27.105186+0000","last_peered":"2024-06-02T23:47:27.105186+0000","last_clean":"2024-06-02T23:47:27.105186+0000","last_became_active":"2024-06-02T23:47:26.102029+0000","last_became_peered":"2024-06-02T23:47:26.102029+0000","last_unstale":"2024-06-02T23:47:27.105186+0000","last_undegraded":"2024-06-02T23:47:27.105186+0000","last_fullsized":"2024-06-02T23:47:27.105186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:33:27.871876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.115880+0000","last_change":"2024-06-02T23:47:27.108959+0000","last_active":"2024-06-02T23:47:27.115880+0000","last_peered":"2024-06-02T23:47:27.115880+0000","last_clean":"2024-06-02T23:47:27.115880+0000","last_became_active":"2024-06-02T23:47:27.108701+0000","last_became_peered":"2024-06-02T23:47:27.108701+0000","last_unstale":"2024-06-02T23:47:27.115880+0000","last_undegraded":"2024-06-02T23:47:27.115880+0000","last_fullsized":"2024-06-02T23:47:27.115880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:44.151097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084595+0000","last_change":"2024-06-02T23:47:26.100032+0000","last_active":"2024-06-02T23:47:28.084595+0000","last_peered":"2024-06-02T23:47:28.084595+0000","last_clean":"2024-06-02T23:47:28.084595+0000","last_became_active":"2024-06-02T23:47:26.099757+0000","last_became_peered":"2024-06-02T23:47:26.099757+0000","last_unstale":"2024-06-02T23:47:28.084595+0000","last_undegraded":"2024-06-02T23:47:28.084595+0000","last_fullsized":"2024-06-02T23:47:28.084595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:41.695067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908160+0000","last_change":"2024-06-02T23:47:27.108928+0000","last_active":"2024-06-02T23:47:28.908160+0000","last_peered":"2024-06-02T23:47:28.908160+0000","last_clean":"2024-06-02T23:47:28.908160+0000","last_became_active":"2024-06-02T23:47:27.108648+0000","last_became_peered":"2024-06-02T23:47:27.108648+0000","last_unstale":"2024-06-02T23:47:28.908160+0000","last_undegraded":"2024-06-02T23:47:28.908160+0000","last_fullsized":"2024-06-02T23:47:28.908160+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:44:53.959179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.103373+0000","last_change":"2024-06-02T23:47:26.097706+0000","last_active":"2024-06-02T23:47:27.103373+0000","last_peered":"2024-06-02T23:47:27.103373+0000","last_clean":"2024-06-02T23:47:27.103373+0000","last_became_active":"2024-06-02T23:47:26.097391+0000","last_became_peered":"2024-06-02T23:47:26.097391+0000","last_unstale":"2024-06-02T23:47:27.103373+0000","last_undegraded":"2024-06-02T23:47:27.103373+0000","last_fullsized":"2024-06-02T23:47:27.103373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:58.442320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121919+0000","last_change":"2024-06-02T23:47:27.120053+0000","last_active":"2024-06-02T23:47:27.121919+0000","last_peered":"2024-06-02T23:47:27.121919+0000","last_clean":"2024-06-02T23:47:27.121919+0000","last_became_active":"2024-06-02T23:47:27.119743+0000","last_became_peered":"2024-06-02T23:47:27.119743+0000","last_unstale":"2024-06-02T23:47:27.121919+0000","last_undegraded":"2024-06-02T23:47:27.121919+0000","last_fullsized":"2024-06-02T23:47:27.121919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:07:24.629557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.086111+0000","last_change":"2024-06-02T23:47:26.089940+0000","last_active":"2024-06-02T23:47:27.086111+0000","last_peered":"2024-06-02T23:47:27.086111+0000","last_clean":"2024-06-02T23:47:27.086111+0000","last_became_active":"2024-06-02T23:47:26.089590+0000","last_became_peered":"2024-06-02T23:47:26.089590+0000","last_unstale":"2024-06-02T23:47:27.086111+0000","last_undegraded":"2024-06-02T23:47:27.086111+0000","last_fullsized":"2024-06-02T23:47:27.086111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:29.310649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627121+0000","last_change":"2024-06-02T23:47:27.093546+0000","last_active":"2024-06-02T23:47:28.627121+0000","last_peered":"2024-06-02T23:47:28.627121+0000","last_clean":"2024-06-02T23:47:28.627121+0000","last_became_active":"2024-06-02T23:47:27.093227+0000","last_became_peered":"2024-06-02T23:47:27.093227+0000","last_unstale":"2024-06-02T23:47:28.627121+0000","last_undegraded":"2024-06-02T23:47:28.627121+0000","last_fullsized":"2024-06-02T23:47:28.627121+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:09:03.165248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908286+0000","last_change":"2024-06-02T23:47:26.105986+0000","last_active":"2024-06-02T23:47:28.908286+0000","last_peered":"2024-06-02T23:47:28.908286+0000","last_clean":"2024-06-02T23:47:28.908286+0000","last_became_active":"2024-06-02T23:47:26.105682+0000","last_became_peered":"2024-06-02T23:47:26.105682+0000","last_unstale":"2024-06-02T23:47:28.908286+0000","last_undegraded":"2024-06-02T23:47:28.908286+0000","last_fullsized":"2024-06-02T23:47:28.908286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:56.538919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114865+0000","last_change":"2024-06-02T23:47:27.104497+0000","last_active":"2024-06-02T23:47:27.114865+0000","last_peered":"2024-06-02T23:47:27.114865+0000","last_clean":"2024-06-02T23:47:27.114865+0000","last_became_active":"2024-06-02T23:47:27.103157+0000","last_became_peered":"2024-06-02T23:47:27.103157+0000","last_unstale":"2024-06-02T23:47:27.114865+0000","last_undegraded":"2024-06-02T23:47:27.114865+0000","last_fullsized":"2024-06-02T23:47:27.114865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:55:39.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.086305+0000","last_change":"2024-06-02T23:47:26.094352+0000","last_active":"2024-06-02T23:47:27.086305+0000","last_peered":"2024-06-02T23:47:27.086305+0000","last_clean":"2024-06-02T23:47:27.086305+0000","last_became_active":"2024-06-02T23:47:26.094056+0000","last_became_peered":"2024-06-02T23:47:26.094056+0000","last_unstale":"2024-06-02T23:47:27.086305+0000","last_undegraded":"2024-06-02T23:47:27.086305+0000","last_fullsized":"2024-06-02T23:47:27.086305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:30:20.065066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084643+0000","last_change":"2024-06-02T23:47:27.104371+0000","last_active":"2024-06-02T23:47:28.084643+0000","last_peered":"2024-06-02T23:47:28.084643+0000","last_clean":"2024-06-02T23:47:28.084643+0000","last_became_active":"2024-06-02T23:47:27.103968+0000","last_became_peered":"2024-06-02T23:47:27.103968+0000","last_unstale":"2024-06-02T23:47:28.084643+0000","last_undegraded":"2024-06-02T23:47:28.084643+0000","last_fullsized":"2024-06-02T23:47:28.084643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:51.155082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627604+0000","last_change":"2024-06-02T23:47:26.101929+0000","last_active":"2024-06-02T23:47:28.627604+0000","last_peered":"2024-06-02T23:47:28.627604+0000","last_clean":"2024-06-02T23:47:28.627604+0000","last_became_active":"2024-06-02T23:47:26.101671+0000","last_became_peered":"2024-06-02T23:47:26.101671+0000","last_unstale":"2024-06-02T23:47:28.627604+0000","last_undegraded":"2024-06-02T23:47:28.627604+0000","last_fullsized":"2024-06-02T23:47:28.627604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:14.013885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908289+0000","last_change":"2024-06-02T23:47:27.111563+0000","last_active":"2024-06-02T23:47:28.908289+0000","last_peered":"2024-06-02T23:47:28.908289+0000","last_clean":"2024-06-02T23:47:28.908289+0000","last_became_active":"2024-06-02T23:47:27.111249+0000","last_became_peered":"2024-06-02T23:47:27.111249+0000","last_unstale":"2024-06-02T23:47:28.908289+0000","last_undegraded":"2024-06-02T23:47:28.908289+0000","last_fullsized":"2024-06-02T23:47:28.908289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:10:04.950476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.086163+0000","last_change":"2024-06-02T23:47:26.092625+0000","last_active":"2024-06-02T23:47:27.086163+0000","last_peered":"2024-06-02T23:47:27.086163+0000","last_clean":"2024-06-02T23:47:27.086163+0000","last_became_active":"2024-06-02T23:47:26.092342+0000","last_became_peered":"2024-06-02T23:47:26.092342+0000","last_unstale":"2024-06-02T23:47:27.086163+0000","last_undegraded":"2024-06-02T23:47:27.086163+0000","last_fullsized":"2024-06-02T23:47:27.086163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:11:40.362705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.115088+0000","last_change":"2024-06-02T23:47:27.109243+0000","last_active":"2024-06-02T23:47:27.115088+0000","last_peered":"2024-06-02T23:47:27.115088+0000","last_clean":"2024-06-02T23:47:27.115088+0000","last_became_active":"2024-06-02T23:47:27.108963+0000","last_became_peered":"2024-06-02T23:47:27.108963+0000","last_unstale":"2024-06-02T23:47:27.115088+0000","last_undegraded":"2024-06-02T23:47:27.115088+0000","last_fullsized":"2024-06-02T23:47:27.115088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:30.729164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.102774+0000","last_change":"2024-06-02T23:47:26.102499+0000","last_active":"2024-06-02T23:47:27.102774+0000","last_peered":"2024-06-02T23:47:27.102774+0000","last_clean":"2024-06-02T23:47:27.102774+0000","last_became_active":"2024-06-02T23:47:26.102197+0000","last_became_peered":"2024-06-02T23:47:26.102197+0000","last_unstale":"2024-06-02T23:47:27.102774+0000","last_undegraded":"2024-06-02T23:47:27.102774+0000","last_fullsized":"2024-06-02T23:47:27.102774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:13.505489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121609+0000","last_change":"2024-06-02T23:47:27.115277+0000","last_active":"2024-06-02T23:47:27.121609+0000","last_peered":"2024-06-02T23:47:27.121609+0000","last_clean":"2024-06-02T23:47:27.121609+0000","last_became_active":"2024-06-02T23:47:27.114856+0000","last_became_peered":"2024-06-02T23:47:27.114856+0000","last_unstale":"2024-06-02T23:47:27.121609+0000","last_undegraded":"2024-06-02T23:47:27.121609+0000","last_fullsized":"2024-06-02T23:47:27.121609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:15.018789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.101353+0000","last_change":"2024-06-02T23:47:26.099179+0000","last_active":"2024-06-02T23:47:27.101353+0000","last_peered":"2024-06-02T23:47:27.101353+0000","last_clean":"2024-06-02T23:47:27.101353+0000","last_became_active":"2024-06-02T23:47:26.098880+0000","last_became_peered":"2024-06-02T23:47:26.098880+0000","last_unstale":"2024-06-02T23:47:27.101353+0000","last_undegraded":"2024-06-02T23:47:27.101353+0000","last_fullsized":"2024-06-02T23:47:27.101353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:32.187736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084710+0000","last_change":"2024-06-02T23:47:27.103736+0000","last_active":"2024-06-02T23:47:28.084710+0000","last_peered":"2024-06-02T23:47:28.084710+0000","last_clean":"2024-06-02T23:47:28.084710+0000","last_became_active":"2024-06-02T23:47:27.103413+0000","last_became_peered":"2024-06-02T23:47:27.103413+0000","last_unstale":"2024-06-02T23:47:28.084710+0000","last_undegraded":"2024-06-02T23:47:28.084710+0000","last_fullsized":"2024-06-02T23:47:28.084710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:44:53.959179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.084685+0000","last_change":"2024-06-02T23:47:26.104081+0000","last_active":"2024-06-02T23:47:27.084685+0000","last_peered":"2024-06-02T23:47:27.084685+0000","last_clean":"2024-06-02T23:47:27.084685+0000","last_became_active":"2024-06-02T23:47:26.103772+0000","last_became_peered":"2024-06-02T23:47:26.103772+0000","last_unstale":"2024-06-02T23:47:27.084685+0000","last_undegraded":"2024-06-02T23:47:27.084685+0000","last_fullsized":"2024-06-02T23:47:27.084685+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:53.310869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084969+0000","last_change":"2024-06-02T23:47:27.109141+0000","last_active":"2024-06-02T23:47:28.084969+0000","last_peered":"2024-06-02T23:47:28.084969+0000","last_clean":"2024-06-02T23:47:28.084969+0000","last_became_active":"2024-06-02T23:47:27.108844+0000","last_became_peered":"2024-06-02T23:47:27.108844+0000","last_unstale":"2024-06-02T23:47:28.084969+0000","last_undegraded":"2024-06-02T23:47:28.084969+0000","last_fullsized":"2024-06-02T23:47:28.084969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:26:19.536776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084937+0000","last_change":"2024-06-02T23:47:26.097127+0000","last_active":"2024-06-02T23:47:28.084937+0000","last_peered":"2024-06-02T23:47:28.084937+0000","last_clean":"2024-06-02T23:47:28.084937+0000","last_became_active":"2024-06-02T23:47:26.096839+0000","last_became_peered":"2024-06-02T23:47:26.096839+0000","last_unstale":"2024-06-02T23:47:28.084937+0000","last_undegraded":"2024-06-02T23:47:28.084937+0000","last_fullsized":"2024-06-02T23:47:28.084937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:02:51.098085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908331+0000","last_change":"2024-06-02T23:47:27.106626+0000","last_active":"2024-06-02T23:47:28.908331+0000","last_peered":"2024-06-02T23:47:28.908331+0000","last_clean":"2024-06-02T23:47:28.908331+0000","last_became_active":"2024-06-02T23:47:27.106311+0000","last_became_peered":"2024-06-02T23:47:27.106311+0000","last_unstale":"2024-06-02T23:47:28.908331+0000","last_undegraded":"2024-06-02T23:47:28.908331+0000","last_fullsized":"2024-06-02T23:47:28.908331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:02.446584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.097554+0000","last_change":"2024-06-02T23:47:26.102120+0000","last_active":"2024-06-02T23:47:27.097554+0000","last_peered":"2024-06-02T23:47:27.097554+0000","last_clean":"2024-06-02T23:47:27.097554+0000","last_became_active":"2024-06-02T23:47:26.101827+0000","last_became_peered":"2024-06-02T23:47:26.101827+0000","last_unstale":"2024-06-02T23:47:27.097554+0000","last_undegraded":"2024-06-02T23:47:27.097554+0000","last_fullsized":"2024-06-02T23:47:27.097554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:16:00.797573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627413+0000","last_change":"2024-06-02T23:47:27.112728+0000","last_active":"2024-06-02T23:47:28.627413+0000","last_peered":"2024-06-02T23:47:28.627413+0000","last_clean":"2024-06-02T23:47:28.627413+0000","last_became_active":"2024-06-02T23:47:27.112083+0000","last_became_peered":"2024-06-02T23:47:27.112083+0000","last_unstale":"2024-06-02T23:47:28.627413+0000","last_undegraded":"2024-06-02T23:47:28.627413+0000","last_fullsized":"2024-06-02T23:47:28.627413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:31:09.121080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908101+0000","last_change":"2024-06-02T23:47:26.104471+0000","last_active":"2024-06-02T23:47:28.908101+0000","last_peered":"2024-06-02T23:47:28.908101+0000","last_clean":"2024-06-02T23:47:28.908101+0000","last_became_active":"2024-06-02T23:47:26.104197+0000","last_became_peered":"2024-06-02T23:47:26.104197+0000","last_unstale":"2024-06-02T23:47:28.908101+0000","last_undegraded":"2024-06-02T23:47:28.908101+0000","last_fullsized":"2024-06-02T23:47:28.908101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:02:51.098085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908220+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:47:28.908220+0000","last_peered":"2024-06-02T23:47:28.908220+0000","last_clean":"2024-06-02T23:47:28.908220+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:47:28.908220+0000","last_undegraded":"2024-06-02T23:47:28.908220+0000","last_fullsized":"2024-06-02T23:47:28.908220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":781085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":189147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":196331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":195817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":779437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:47:30.073 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:47:30.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.204+0000 7ff587b5a640 1 Processor -- start 2024-06-02T23:47:30.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.204+0000 7ff587b5a640 1 -- start start 2024-06-02T23:47:30.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff587b5a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff580155570 0x7ff58006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff587b5a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff58006eb50 0x7ff5800ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff587b5a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff580155950 con 0x7ff5800cab60 2024-06-02T23:47:30.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff587b5a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff58006efb0 con 0x7ff58006eb50 2024-06-02T23:47:30.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff587b5a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff5800cb2e0 con 0x7ff580155570 2024-06-02T23:47:30.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff5860f7640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff5800cab60 0x7ff58015eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:42970/0 (socket says 172.21.15.96:42970) 2024-06-02T23:47:30.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff5860f7640 1 -- 172.21.15.96:0/930202465 learned_addr learned my addr 172.21.15.96:0/930202465 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:30.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611267359 0 0) 0x7ff580155950 con 0x7ff5800cab60 2024-06-02T23:47:30.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff56c003520 con 0x7ff5800cab60 2024-06-02T23:47:30.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff5850f5640 1 --2- 172.21.15.96:0/930202465 >> v2:172.21.15.162:3300/0 conn(0x7ff58006eb50 0x7ff5800ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.205+0000 7ff5858f6640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff580155570 0x7ff58006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3811761312 0 0) 0x7ff56c003520 con 0x7ff5800cab60 2024-06-02T23:47:30.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff580155570 msgr2=0x7ff58006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:30.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff580155570 0x7ff58006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 >> v2:172.21.15.162:3300/0 conn(0x7ff58006eb50 msgr2=0x7ff5800ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:30.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 --2- 172.21.15.96:0/930202465 >> v2:172.21.15.162:3300/0 conn(0x7ff58006eb50 0x7ff5800ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5800cb5c0 con 0x7ff5800cab60 2024-06-02T23:47:30.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7ff5780019f0 con 0x7ff5800cab60 2024-06-02T23:47:30.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5850f5640 1 --2- 172.21.15.96:0/930202465 >> v2:172.21.15.162:3300/0 conn(0x7ff58006eb50 0x7ff5800ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:30.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 >> v1:172.21.15.96:6789/0 conn(0x7ff5800cab60 legacy=0x7ff58015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 0x7ff56c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56c004800 0x7ff56c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff580155570 0x7ff56c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff5800cb2e0 con 0x7ff56c0039b0 2024-06-02T23:47:30.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c00b9f0 con 0x7ff56c004800 2024-06-02T23:47:30.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff56c00bbf0 con 0x7ff580155570 2024-06-02T23:47:30.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5858f6640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 0x7ff56c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5850f5640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56c004800 0x7ff56c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5860f7640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff580155570 0x7ff56c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5858f6640 1 -- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff580155570 msgr2=0x7ff56c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:30.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5858f6640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff580155570 0x7ff56c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5858f6640 1 -- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56c004800 msgr2=0x7ff56c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:30.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5858f6640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff56c004800 0x7ff56c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.206+0000 7ff5858f6640 1 -- 172.21.15.96:0/930202465 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c003520 con 0x7ff56c0039b0 2024-06-02T23:47:30.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.207+0000 7ff5858f6640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 0x7ff56c003dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00ba00 tx=0x7ff56c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a50956cf7c3adce server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:30.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.207+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c030070 con 0x7ff56c0039b0 2024-06-02T23:47:30.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.207+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c02ad80 con 0x7ff56c0039b0 2024-06-02T23:47:30.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.207+0000 7ff5848f4640 1 -- 172.21.15.96:0/930202465 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00b600 con 0x7ff56c0039b0 2024-06-02T23:47:30.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.207+0000 7ff587b5a640 1 -- 172.21.15.96:0/930202465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 msgr2=0x7ff56c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.207+0000 7ff587b5a640 1 --2- 172.21.15.96:0/930202465 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 0x7ff56c003dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00ba00 tx=0x7ff56c005830 comp rx=0 tx=0).stop 2024-06-02T23:47:30.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.207+0000 7ff5860f7640 1 -- 172.21.15.96:0/930202465 reap_dead start 2024-06-02T23:47:30.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.208+0000 7ff587b5a640 1 -- 172.21.15.96:0/930202465 shutdown_connections 2024-06-02T23:47:30.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.208+0000 7ff587b5a640 1 -- 172.21.15.96:0/930202465 >> 172.21.15.96:0/930202465 conn(0x7ff5800cfc30 msgr2=0x7ff5800d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:30.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.208+0000 7ff587b5a640 1 -- 172.21.15.96:0/930202465 shutdown_connections 2024-06-02T23:47:30.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.208+0000 7ff587b5a640 1 -- 172.21.15.96:0/930202465 wait complete. 2024-06-02T23:47:30.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.209+0000 7ff587b5a640 1 Processor -- start 2024-06-02T23:47:30.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.209+0000 7ff587b5a640 1 -- start start 2024-06-02T23:47:30.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.209+0000 7ff587b5a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 0x7ff5800c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.209+0000 7ff587b5a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5800b55f0 0x7ff5800c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.209+0000 7ff587b5a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58014c7b0 0x7ff58014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.209+0000 7ff587b5a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff5800caff0 con 0x7ff56c0039b0 2024-06-02T23:47:30.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.209+0000 7ff587b5a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff580071b00 con 0x7ff58014c7b0 2024-06-02T23:47:30.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.209+0000 7ff587b5a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff5800717d0 con 0x7ff5800b55f0 2024-06-02T23:47:30.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5858f6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 0x7ff5800c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5858f6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 0x7ff5800c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40556/0 (socket says 172.21.15.96:40556) 2024-06-02T23:47:30.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5858f6640 1 -- 172.21.15.96:0/3638835048 learned_addr learned my addr 172.21.15.96:0/3638835048 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:30.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5850f5640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5800b55f0 0x7ff5800c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5860f7640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58014c7b0 0x7ff58014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5858f6640 1 -- 172.21.15.96:0/3638835048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5800b55f0 msgr2=0x7ff5800c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5858f6640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5800b55f0 0x7ff5800c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5858f6640 1 -- 172.21.15.96:0/3638835048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58014c7b0 msgr2=0x7ff58014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5858f6640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58014c7b0 0x7ff58014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5858f6640 1 -- 172.21.15.96:0/3638835048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5800b5a50 con 0x7ff56c0039b0 2024-06-02T23:47:30.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5858f6640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 0x7ff5800c6d00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00bb20 tx=0x7ff57c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:30.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5767fc640 1 -- 172.21.15.96:0/3638835048 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c043020 con 0x7ff56c0039b0 2024-06-02T23:47:30.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5767fc640 1 -- 172.21.15.96:0/3638835048 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c03f680 con 0x7ff56c0039b0 2024-06-02T23:47:30.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff587b5a640 1 -- 172.21.15.96:0/3638835048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5800c7400 con 0x7ff56c0039b0 2024-06-02T23:47:30.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff5767fc640 1 -- 172.21.15.96:0/3638835048 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00b600 con 0x7ff56c0039b0 2024-06-02T23:47:30.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.210+0000 7ff587b5a640 1 -- 172.21.15.96:0/3638835048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5800c79c0 con 0x7ff56c0039b0 2024-06-02T23:47:30.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.211+0000 7ff587b5a640 1 -- 172.21.15.96:0/3638835048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5800683e0 con 0x7ff56c0039b0 2024-06-02T23:47:30.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.212+0000 7ff5767fc640 1 -- 172.21.15.96:0/3638835048 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff57c046020 con 0x7ff56c0039b0 2024-06-02T23:47:30.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.212+0000 7ff5767fc640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff56406be30 0x7ff56406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.212+0000 7ff5767fc640 1 -- 172.21.15.96:0/3638835048 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff57c0abc00 con 0x7ff56c0039b0 2024-06-02T23:47:30.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.212+0000 7ff5850f5640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff56406be30 0x7ff56406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.213+0000 7ff5850f5640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff56406be30 0x7ff56406e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff570006fd0 tx=0x7ff570008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:30.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.216+0000 7ff5767fc640 1 -- 172.21.15.96:0/3638835048 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff57c0b2080 con 0x7ff56c0039b0 2024-06-02T23:47:30.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.389+0000 7ff587b5a640 1 -- 172.21.15.96:0/3638835048 --> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5800cdd10 con 0x7ff56406be30 2024-06-02T23:47:30.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.395+0000 7ff5767fc640 1 -- 172.21.15.96:0/3638835048 <== mgr.4113 v2:172.21.15.96:6832/1776728888 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251941 (secure 0 0 0) 0x7ff5800cdd10 con 0x7ff56406be30 2024-06-02T23:47:30.398 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:30.399 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:47:30.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.398+0000 7ff587b5a640 1 -- 172.21.15.96:0/3638835048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff56406be30 msgr2=0x7ff56406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.398+0000 7ff587b5a640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff56406be30 0x7ff56406e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff570006fd0 tx=0x7ff570008040 comp rx=0 tx=0).stop 2024-06-02T23:47:30.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.398+0000 7ff587b5a640 1 -- 172.21.15.96:0/3638835048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 msgr2=0x7ff5800c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.398+0000 7ff587b5a640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 0x7ff5800c6d00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00bb20 tx=0x7ff57c004730 comp rx=0 tx=0).stop 2024-06-02T23:47:30.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.398+0000 7ff587b5a640 1 -- 172.21.15.96:0/3638835048 shutdown_connections 2024-06-02T23:47:30.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.398+0000 7ff587b5a640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff58014c7b0 0x7ff58014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.398+0000 7ff587b5a640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5800b55f0 0x7ff5800c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.398+0000 7ff587b5a640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7ff56406be30 0x7ff56406e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.398+0000 7ff587b5a640 1 --2- 172.21.15.96:0/3638835048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff56c0039b0 0x7ff5800c6d00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.398+0000 7ff587b5a640 1 -- 172.21.15.96:0/3638835048 >> 172.21.15.96:0/3638835048 conn(0x7ff5800cfc30 msgr2=0x7ff58015a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:30.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.399+0000 7ff587b5a640 1 -- 172.21.15.96:0/3638835048 shutdown_connections 2024-06-02T23:47:30.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.399+0000 7ff587b5a640 1 -- 172.21.15.96:0/3638835048 wait complete. 2024-06-02T23:47:30.410 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-06-02T23:47:30.006967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220848,"kb_used_data":4672,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753872,"statfs":{"total":773094113280,"available":772867964928,"internally_reserved":0,"allocated":4784128,"data_stored":2711220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.934302"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114427+0000","last_change":"2024-06-02T23:47:27.103661+0000","last_active":"2024-06-02T23:47:27.114427+0000","last_peered":"2024-06-02T23:47:27.114427+0000","last_clean":"2024-06-02T23:47:27.114427+0000","last_became_active":"2024-06-02T23:47:27.103265+0000","last_became_peered":"2024-06-02T23:47:27.103265+0000","last_unstale":"2024-06-02T23:47:27.114427+0000","last_undegraded":"2024-06-02T23:47:27.114427+0000","last_fullsized":"2024-06-02T23:47:27.114427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:49.349189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.115065+0000","last_change":"2024-06-02T23:47:27.107634+0000","last_active":"2024-06-02T23:47:27.115065+0000","last_peered":"2024-06-02T23:47:27.115065+0000","last_clean":"2024-06-02T23:47:27.115065+0000","last_became_active":"2024-06-02T23:47:27.107371+0000","last_became_peered":"2024-06-02T23:47:27.107371+0000","last_unstale":"2024-06-02T23:47:27.115065+0000","last_undegraded":"2024-06-02T23:47:27.115065+0000","last_fullsized":"2024-06-02T23:47:27.115065+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:38:12.527231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121510+0000","last_change":"2024-06-02T23:47:27.113670+0000","last_active":"2024-06-02T23:47:27.121510+0000","last_peered":"2024-06-02T23:47:27.121510+0000","last_clean":"2024-06-02T23:47:27.121510+0000","last_became_active":"2024-06-02T23:47:27.113372+0000","last_became_peered":"2024-06-02T23:47:27.113372+0000","last_unstale":"2024-06-02T23:47:27.121510+0000","last_undegraded":"2024-06-02T23:47:27.121510+0000","last_fullsized":"2024-06-02T23:47:27.121510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:46:02.699267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.106587+0000","last_change":"2024-06-02T23:47:27.103269+0000","last_active":"2024-06-02T23:47:27.106587+0000","last_peered":"2024-06-02T23:47:27.106587+0000","last_clean":"2024-06-02T23:47:27.106587+0000","last_became_active":"2024-06-02T23:47:27.102988+0000","last_became_peered":"2024-06-02T23:47:27.102988+0000","last_unstale":"2024-06-02T23:47:27.106587+0000","last_undegraded":"2024-06-02T23:47:27.106587+0000","last_fullsized":"2024-06-02T23:47:27.106587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:49:12.455393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.109988+0000","last_change":"2024-06-02T23:47:27.105071+0000","last_active":"2024-06-02T23:47:27.109988+0000","last_peered":"2024-06-02T23:47:27.109988+0000","last_clean":"2024-06-02T23:47:27.109988+0000","last_became_active":"2024-06-02T23:47:27.104823+0000","last_became_peered":"2024-06-02T23:47:27.104823+0000","last_unstale":"2024-06-02T23:47:27.109988+0000","last_undegraded":"2024-06-02T23:47:27.109988+0000","last_fullsized":"2024-06-02T23:47:27.109988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:57:15.992056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084522+0000","last_change":"2024-06-02T23:47:27.104797+0000","last_active":"2024-06-02T23:47:28.084522+0000","last_peered":"2024-06-02T23:47:28.084522+0000","last_clean":"2024-06-02T23:47:28.084522+0000","last_became_active":"2024-06-02T23:47:27.104533+0000","last_became_peered":"2024-06-02T23:47:27.104533+0000","last_unstale":"2024-06-02T23:47:28.084522+0000","last_undegraded":"2024-06-02T23:47:28.084522+0000","last_fullsized":"2024-06-02T23:47:28.084522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:49.349189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.626948+0000","last_change":"2024-06-02T23:47:27.112961+0000","last_active":"2024-06-02T23:47:28.626948+0000","last_peered":"2024-06-02T23:47:28.626948+0000","last_clean":"2024-06-02T23:47:28.626948+0000","last_became_active":"2024-06-02T23:47:27.112136+0000","last_became_peered":"2024-06-02T23:47:27.112136+0000","last_unstale":"2024-06-02T23:47:28.626948+0000","last_undegraded":"2024-06-02T23:47:28.626948+0000","last_fullsized":"2024-06-02T23:47:28.626948+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:10:04.950476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114262+0000","last_change":"2024-06-02T23:47:27.104020+0000","last_active":"2024-06-02T23:47:27.114262+0000","last_peered":"2024-06-02T23:47:27.114262+0000","last_clean":"2024-06-02T23:47:27.114262+0000","last_became_active":"2024-06-02T23:47:27.103703+0000","last_became_peered":"2024-06-02T23:47:27.103703+0000","last_unstale":"2024-06-02T23:47:27.114262+0000","last_undegraded":"2024-06-02T23:47:27.114262+0000","last_fullsized":"2024-06-02T23:47:27.114262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:51.155082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121537+0000","last_change":"2024-06-02T23:47:27.113712+0000","last_active":"2024-06-02T23:47:27.121537+0000","last_peered":"2024-06-02T23:47:27.121537+0000","last_clean":"2024-06-02T23:47:27.121537+0000","last_became_active":"2024-06-02T23:47:27.113421+0000","last_became_peered":"2024-06-02T23:47:27.113421+0000","last_unstale":"2024-06-02T23:47:27.121537+0000","last_undegraded":"2024-06-02T23:47:27.121537+0000","last_fullsized":"2024-06-02T23:47:27.121537+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:48.217019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627357+0000","last_change":"2024-06-02T23:47:27.106984+0000","last_active":"2024-06-02T23:47:28.627357+0000","last_peered":"2024-06-02T23:47:28.627357+0000","last_clean":"2024-06-02T23:47:28.627357+0000","last_became_active":"2024-06-02T23:47:27.105643+0000","last_became_peered":"2024-06-02T23:47:27.105643+0000","last_unstale":"2024-06-02T23:47:28.627357+0000","last_undegraded":"2024-06-02T23:47:28.627357+0000","last_fullsized":"2024-06-02T23:47:28.627357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:39:48.768088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627368+0000","last_change":"2024-06-02T23:47:27.111940+0000","last_active":"2024-06-02T23:47:28.627368+0000","last_peered":"2024-06-02T23:47:28.627368+0000","last_clean":"2024-06-02T23:47:28.627368+0000","last_became_active":"2024-06-02T23:47:27.106455+0000","last_became_peered":"2024-06-02T23:47:27.106455+0000","last_unstale":"2024-06-02T23:47:28.627368+0000","last_undegraded":"2024-06-02T23:47:28.627368+0000","last_fullsized":"2024-06-02T23:47:28.627368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:40:19.694350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114798+0000","last_change":"2024-06-02T23:47:27.110762+0000","last_active":"2024-06-02T23:47:27.114798+0000","last_peered":"2024-06-02T23:47:27.114798+0000","last_clean":"2024-06-02T23:47:27.114798+0000","last_became_active":"2024-06-02T23:47:27.110474+0000","last_became_peered":"2024-06-02T23:47:27.110474+0000","last_unstale":"2024-06-02T23:47:27.114798+0000","last_undegraded":"2024-06-02T23:47:27.114798+0000","last_fullsized":"2024-06-02T23:47:27.114798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:02:52.102989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627250+0000","last_change":"2024-06-02T23:47:27.099931+0000","last_active":"2024-06-02T23:47:28.627250+0000","last_peered":"2024-06-02T23:47:28.627250+0000","last_clean":"2024-06-02T23:47:28.627250+0000","last_became_active":"2024-06-02T23:47:27.097525+0000","last_became_peered":"2024-06-02T23:47:27.097525+0000","last_unstale":"2024-06-02T23:47:28.627250+0000","last_undegraded":"2024-06-02T23:47:28.627250+0000","last_fullsized":"2024-06-02T23:47:28.627250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:00:12.574393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085100+0000","last_change":"2024-06-02T23:47:27.102154+0000","last_active":"2024-06-02T23:47:28.085100+0000","last_peered":"2024-06-02T23:47:28.085100+0000","last_clean":"2024-06-02T23:47:28.085100+0000","last_became_active":"2024-06-02T23:47:27.101885+0000","last_became_peered":"2024-06-02T23:47:27.101885+0000","last_unstale":"2024-06-02T23:47:28.085100+0000","last_undegraded":"2024-06-02T23:47:28.085100+0000","last_fullsized":"2024-06-02T23:47:28.085100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:46:38.432462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627071+0000","last_change":"2024-06-02T23:47:27.108597+0000","last_active":"2024-06-02T23:47:28.627071+0000","last_peered":"2024-06-02T23:47:28.627071+0000","last_clean":"2024-06-02T23:47:28.627071+0000","last_became_active":"2024-06-02T23:47:27.108107+0000","last_became_peered":"2024-06-02T23:47:27.108107+0000","last_unstale":"2024-06-02T23:47:28.627071+0000","last_undegraded":"2024-06-02T23:47:28.627071+0000","last_fullsized":"2024-06-02T23:47:28.627071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:02.446584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.907871+0000","last_change":"2024-06-02T23:47:27.104535+0000","last_active":"2024-06-02T23:47:28.907871+0000","last_peered":"2024-06-02T23:47:28.907871+0000","last_clean":"2024-06-02T23:47:28.907871+0000","last_became_active":"2024-06-02T23:47:27.104267+0000","last_became_peered":"2024-06-02T23:47:27.104267+0000","last_unstale":"2024-06-02T23:47:28.907871+0000","last_undegraded":"2024-06-02T23:47:28.907871+0000","last_fullsized":"2024-06-02T23:47:28.907871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:49.349189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908377+0000","last_change":"2024-06-02T23:47:27.105241+0000","last_active":"2024-06-02T23:47:28.908377+0000","last_peered":"2024-06-02T23:47:28.908377+0000","last_clean":"2024-06-02T23:47:28.908377+0000","last_became_active":"2024-06-02T23:47:27.104988+0000","last_became_peered":"2024-06-02T23:47:27.104988+0000","last_unstale":"2024-06-02T23:47:28.908377+0000","last_undegraded":"2024-06-02T23:47:28.908377+0000","last_fullsized":"2024-06-02T23:47:28.908377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:09:03.165248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.105494+0000","last_change":"2024-06-02T23:47:27.096712+0000","last_active":"2024-06-02T23:47:27.105494+0000","last_peered":"2024-06-02T23:47:27.105494+0000","last_clean":"2024-06-02T23:47:27.105494+0000","last_became_active":"2024-06-02T23:47:27.096393+0000","last_became_peered":"2024-06-02T23:47:27.096393+0000","last_unstale":"2024-06-02T23:47:27.105494+0000","last_undegraded":"2024-06-02T23:47:27.105494+0000","last_fullsized":"2024-06-02T23:47:27.105494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:14.510393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.110951+0000","last_change":"2024-06-02T23:47:27.106168+0000","last_active":"2024-06-02T23:47:27.110951+0000","last_peered":"2024-06-02T23:47:27.110951+0000","last_clean":"2024-06-02T23:47:27.110951+0000","last_became_active":"2024-06-02T23:47:27.105530+0000","last_became_peered":"2024-06-02T23:47:27.105530+0000","last_unstale":"2024-06-02T23:47:27.110951+0000","last_undegraded":"2024-06-02T23:47:27.110951+0000","last_fullsized":"2024-06-02T23:47:27.110951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:15:05.571681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.110168+0000","last_change":"2024-06-02T23:47:27.103794+0000","last_active":"2024-06-02T23:47:27.110168+0000","last_peered":"2024-06-02T23:47:27.110168+0000","last_clean":"2024-06-02T23:47:27.110168+0000","last_became_active":"2024-06-02T23:47:27.103479+0000","last_became_peered":"2024-06-02T23:47:27.103479+0000","last_unstale":"2024-06-02T23:47:27.110168+0000","last_undegraded":"2024-06-02T23:47:27.110168+0000","last_fullsized":"2024-06-02T23:47:27.110168+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:02:52.102989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627140+0000","last_change":"2024-06-02T23:47:27.111847+0000","last_active":"2024-06-02T23:47:28.627140+0000","last_peered":"2024-06-02T23:47:28.627140+0000","last_clean":"2024-06-02T23:47:28.627140+0000","last_became_active":"2024-06-02T23:47:27.108939+0000","last_became_peered":"2024-06-02T23:47:27.108939+0000","last_unstale":"2024-06-02T23:47:28.627140+0000","last_undegraded":"2024-06-02T23:47:28.627140+0000","last_fullsized":"2024-06-02T23:47:28.627140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:37:44.449453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085316+0000","last_change":"2024-06-02T23:47:27.103043+0000","last_active":"2024-06-02T23:47:28.085316+0000","last_peered":"2024-06-02T23:47:28.085316+0000","last_clean":"2024-06-02T23:47:28.085316+0000","last_became_active":"2024-06-02T23:47:27.102749+0000","last_became_peered":"2024-06-02T23:47:27.102749+0000","last_unstale":"2024-06-02T23:47:28.085316+0000","last_undegraded":"2024-06-02T23:47:28.085316+0000","last_fullsized":"2024-06-02T23:47:28.085316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:46.912233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908233+0000","last_change":"2024-06-02T23:47:27.108573+0000","last_active":"2024-06-02T23:47:28.908233+0000","last_peered":"2024-06-02T23:47:28.908233+0000","last_clean":"2024-06-02T23:47:28.908233+0000","last_became_active":"2024-06-02T23:47:27.108294+0000","last_became_peered":"2024-06-02T23:47:27.108294+0000","last_unstale":"2024-06-02T23:47:28.908233+0000","last_undegraded":"2024-06-02T23:47:28.908233+0000","last_fullsized":"2024-06-02T23:47:28.908233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:30.729164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.109932+0000","last_change":"2024-06-02T23:47:27.106029+0000","last_active":"2024-06-02T23:47:27.109932+0000","last_peered":"2024-06-02T23:47:27.109932+0000","last_clean":"2024-06-02T23:47:27.109932+0000","last_became_active":"2024-06-02T23:47:27.105324+0000","last_became_peered":"2024-06-02T23:47:27.105324+0000","last_unstale":"2024-06-02T23:47:27.109932+0000","last_undegraded":"2024-06-02T23:47:27.109932+0000","last_fullsized":"2024-06-02T23:47:27.109932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:25:58.508787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.113297+0000","last_change":"2024-06-02T23:47:27.106685+0000","last_active":"2024-06-02T23:47:27.113297+0000","last_peered":"2024-06-02T23:47:27.113297+0000","last_clean":"2024-06-02T23:47:27.113297+0000","last_became_active":"2024-06-02T23:47:27.103586+0000","last_became_peered":"2024-06-02T23:47:27.103586+0000","last_unstale":"2024-06-02T23:47:27.113297+0000","last_undegraded":"2024-06-02T23:47:27.113297+0000","last_fullsized":"2024-06-02T23:47:27.113297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:46:02.699267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084678+0000","last_change":"2024-06-02T23:47:27.103645+0000","last_active":"2024-06-02T23:47:28.084678+0000","last_peered":"2024-06-02T23:47:28.084678+0000","last_clean":"2024-06-02T23:47:28.084678+0000","last_became_active":"2024-06-02T23:47:27.103340+0000","last_became_peered":"2024-06-02T23:47:27.103340+0000","last_unstale":"2024-06-02T23:47:28.084678+0000","last_undegraded":"2024-06-02T23:47:28.084678+0000","last_fullsized":"2024-06-02T23:47:28.084678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:44.346475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.092520+0000","last_change":"2024-06-02T23:47:27.089314+0000","last_active":"2024-06-02T23:47:27.092520+0000","last_peered":"2024-06-02T23:47:27.092520+0000","last_clean":"2024-06-02T23:47:27.092520+0000","last_became_active":"2024-06-02T23:47:27.089041+0000","last_became_peered":"2024-06-02T23:47:27.089041+0000","last_unstale":"2024-06-02T23:47:27.092520+0000","last_undegraded":"2024-06-02T23:47:27.092520+0000","last_fullsized":"2024-06-02T23:47:27.092520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:33.192640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627342+0000","last_change":"2024-06-02T23:47:27.106879+0000","last_active":"2024-06-02T23:47:28.627342+0000","last_peered":"2024-06-02T23:47:28.627342+0000","last_clean":"2024-06-02T23:47:28.627342+0000","last_became_active":"2024-06-02T23:47:27.105321+0000","last_became_peered":"2024-06-02T23:47:27.105321+0000","last_unstale":"2024-06-02T23:47:28.627342+0000","last_undegraded":"2024-06-02T23:47:28.627342+0000","last_fullsized":"2024-06-02T23:47:28.627342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:32:01.461806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.096230+0000","last_change":"2024-06-02T23:47:27.095016+0000","last_active":"2024-06-02T23:47:27.096230+0000","last_peered":"2024-06-02T23:47:27.096230+0000","last_clean":"2024-06-02T23:47:27.096230+0000","last_became_active":"2024-06-02T23:47:27.094731+0000","last_became_peered":"2024-06-02T23:47:27.094731+0000","last_unstale":"2024-06-02T23:47:27.096230+0000","last_undegraded":"2024-06-02T23:47:27.096230+0000","last_fullsized":"2024-06-02T23:47:27.096230+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:46:33.731978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.110469+0000","last_change":"2024-06-02T23:47:27.104554+0000","last_active":"2024-06-02T23:47:27.110469+0000","last_peered":"2024-06-02T23:47:27.110469+0000","last_clean":"2024-06-02T23:47:27.110469+0000","last_became_active":"2024-06-02T23:47:27.104274+0000","last_became_peered":"2024-06-02T23:47:27.104274+0000","last_unstale":"2024-06-02T23:47:27.110469+0000","last_undegraded":"2024-06-02T23:47:27.110469+0000","last_fullsized":"2024-06-02T23:47:27.110469+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:57.543823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908148+0000","last_change":"2024-06-02T23:47:27.108704+0000","last_active":"2024-06-02T23:47:28.908148+0000","last_peered":"2024-06-02T23:47:28.908148+0000","last_clean":"2024-06-02T23:47:28.908148+0000","last_became_active":"2024-06-02T23:47:27.108464+0000","last_became_peered":"2024-06-02T23:47:27.108464+0000","last_unstale":"2024-06-02T23:47:28.908148+0000","last_undegraded":"2024-06-02T23:47:28.908148+0000","last_fullsized":"2024-06-02T23:47:28.908148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:51.155082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084648+0000","last_change":"2024-06-02T23:47:27.107150+0000","last_active":"2024-06-02T23:47:28.084648+0000","last_peered":"2024-06-02T23:47:28.084648+0000","last_clean":"2024-06-02T23:47:28.084648+0000","last_became_active":"2024-06-02T23:47:27.106858+0000","last_became_peered":"2024-06-02T23:47:27.106858+0000","last_unstale":"2024-06-02T23:47:28.084648+0000","last_undegraded":"2024-06-02T23:47:28.084648+0000","last_fullsized":"2024-06-02T23:47:28.084648+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:55:39.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908109+0000","last_change":"2024-06-02T23:47:27.103859+0000","last_active":"2024-06-02T23:47:28.908109+0000","last_peered":"2024-06-02T23:47:28.908109+0000","last_clean":"2024-06-02T23:47:28.908109+0000","last_became_active":"2024-06-02T23:47:27.103396+0000","last_became_peered":"2024-06-02T23:47:27.103396+0000","last_unstale":"2024-06-02T23:47:28.908109+0000","last_undegraded":"2024-06-02T23:47:28.908109+0000","last_fullsized":"2024-06-02T23:47:28.908109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:55:39.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.110534+0000","last_change":"2024-06-02T23:47:26.105262+0000","last_active":"2024-06-02T23:47:27.110534+0000","last_peered":"2024-06-02T23:47:27.110534+0000","last_clean":"2024-06-02T23:47:27.110534+0000","last_became_active":"2024-06-02T23:47:26.104994+0000","last_became_peered":"2024-06-02T23:47:26.104994+0000","last_unstale":"2024-06-02T23:47:27.110534+0000","last_undegraded":"2024-06-02T23:47:27.110534+0000","last_fullsized":"2024-06-02T23:47:27.110534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:42.080112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085124+0000","last_change":"2024-06-02T23:47:27.108410+0000","last_active":"2024-06-02T23:47:28.085124+0000","last_peered":"2024-06-02T23:47:28.085124+0000","last_clean":"2024-06-02T23:47:28.085124+0000","last_became_active":"2024-06-02T23:47:27.108100+0000","last_became_peered":"2024-06-02T23:47:27.108100+0000","last_unstale":"2024-06-02T23:47:28.085124+0000","last_undegraded":"2024-06-02T23:47:28.085124+0000","last_fullsized":"2024-06-02T23:47:28.085124+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:38:12.527231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.119467+0000","last_change":"2024-06-02T23:47:26.104535+0000","last_active":"2024-06-02T23:47:27.119467+0000","last_peered":"2024-06-02T23:47:27.119467+0000","last_clean":"2024-06-02T23:47:27.119467+0000","last_became_active":"2024-06-02T23:47:26.104253+0000","last_became_peered":"2024-06-02T23:47:26.104253+0000","last_unstale":"2024-06-02T23:47:27.119467+0000","last_undegraded":"2024-06-02T23:47:27.119467+0000","last_fullsized":"2024-06-02T23:47:27.119467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:46:32.727074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085636+0000","last_change":"2024-06-02T23:47:27.095863+0000","last_active":"2024-06-02T23:47:28.085636+0000","last_peered":"2024-06-02T23:47:28.085636+0000","last_clean":"2024-06-02T23:47:28.085636+0000","last_became_active":"2024-06-02T23:47:27.095592+0000","last_became_peered":"2024-06-02T23:47:27.095592+0000","last_unstale":"2024-06-02T23:47:28.085636+0000","last_undegraded":"2024-06-02T23:47:28.085636+0000","last_fullsized":"2024-06-02T23:47:28.085636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:51.155082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085005+0000","last_change":"2024-06-02T23:47:26.104543+0000","last_active":"2024-06-02T23:47:28.085005+0000","last_peered":"2024-06-02T23:47:28.085005+0000","last_clean":"2024-06-02T23:47:28.085005+0000","last_became_active":"2024-06-02T23:47:26.104238+0000","last_became_peered":"2024-06-02T23:47:26.104238+0000","last_unstale":"2024-06-02T23:47:28.085005+0000","last_undegraded":"2024-06-02T23:47:28.085005+0000","last_fullsized":"2024-06-02T23:47:28.085005+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:14.013885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.117782+0000","last_change":"2024-06-02T23:47:27.111744+0000","last_active":"2024-06-02T23:47:27.117782+0000","last_peered":"2024-06-02T23:47:27.117782+0000","last_clean":"2024-06-02T23:47:27.117782+0000","last_became_active":"2024-06-02T23:47:27.111489+0000","last_became_peered":"2024-06-02T23:47:27.111489+0000","last_unstale":"2024-06-02T23:47:27.117782+0000","last_undegraded":"2024-06-02T23:47:27.117782+0000","last_fullsized":"2024-06-02T23:47:27.117782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:02.446584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085514+0000","last_change":"2024-06-02T23:47:26.101135+0000","last_active":"2024-06-02T23:47:28.085514+0000","last_peered":"2024-06-02T23:47:28.085514+0000","last_clean":"2024-06-02T23:47:28.085514+0000","last_became_active":"2024-06-02T23:47:26.100875+0000","last_became_peered":"2024-06-02T23:47:26.100875+0000","last_unstale":"2024-06-02T23:47:28.085514+0000","last_undegraded":"2024-06-02T23:47:28.085514+0000","last_fullsized":"2024-06-02T23:47:28.085514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:56.538919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121588+0000","last_change":"2024-06-02T23:47:27.114864+0000","last_active":"2024-06-02T23:47:27.121588+0000","last_peered":"2024-06-02T23:47:27.121588+0000","last_clean":"2024-06-02T23:47:27.121588+0000","last_became_active":"2024-06-02T23:47:27.114611+0000","last_became_peered":"2024-06-02T23:47:27.114611+0000","last_unstale":"2024-06-02T23:47:27.121588+0000","last_undegraded":"2024-06-02T23:47:27.121588+0000","last_fullsized":"2024-06-02T23:47:27.121588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:42.699970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627340+0000","last_change":"2024-06-02T23:47:26.101131+0000","last_active":"2024-06-02T23:47:28.627340+0000","last_peered":"2024-06-02T23:47:28.627340+0000","last_clean":"2024-06-02T23:47:28.627340+0000","last_became_active":"2024-06-02T23:47:26.100832+0000","last_became_peered":"2024-06-02T23:47:26.100832+0000","last_unstale":"2024-06-02T23:47:28.627340+0000","last_undegraded":"2024-06-02T23:47:28.627340+0000","last_fullsized":"2024-06-02T23:47:28.627340+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:46:01.694363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627228+0000","last_change":"2024-06-02T23:47:27.108357+0000","last_active":"2024-06-02T23:47:28.627228+0000","last_peered":"2024-06-02T23:47:28.627228+0000","last_clean":"2024-06-02T23:47:28.627228+0000","last_became_active":"2024-06-02T23:47:27.107725+0000","last_became_peered":"2024-06-02T23:47:27.107725+0000","last_unstale":"2024-06-02T23:47:28.627228+0000","last_undegraded":"2024-06-02T23:47:28.627228+0000","last_fullsized":"2024-06-02T23:47:28.627228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:47:20.524998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908006+0000","last_change":"2024-06-02T23:47:26.107071+0000","last_active":"2024-06-02T23:47:28.908006+0000","last_peered":"2024-06-02T23:47:28.908006+0000","last_clean":"2024-06-02T23:47:28.908006+0000","last_became_active":"2024-06-02T23:47:26.106762+0000","last_became_peered":"2024-06-02T23:47:26.106762+0000","last_unstale":"2024-06-02T23:47:28.908006+0000","last_undegraded":"2024-06-02T23:47:28.908006+0000","last_fullsized":"2024-06-02T23:47:28.908006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:13.505489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085304+0000","last_change":"2024-06-02T23:47:27.100462+0000","last_active":"2024-06-02T23:47:28.085304+0000","last_peered":"2024-06-02T23:47:28.085304+0000","last_clean":"2024-06-02T23:47:28.085304+0000","last_became_active":"2024-06-02T23:47:27.100177+0000","last_became_peered":"2024-06-02T23:47:27.100177+0000","last_unstale":"2024-06-02T23:47:28.085304+0000","last_undegraded":"2024-06-02T23:47:28.085304+0000","last_fullsized":"2024-06-02T23:47:28.085304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:31:23.857785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084548+0000","last_change":"2024-06-02T23:47:26.102991+0000","last_active":"2024-06-02T23:47:28.084548+0000","last_peered":"2024-06-02T23:47:28.084548+0000","last_clean":"2024-06-02T23:47:28.084548+0000","last_became_active":"2024-06-02T23:47:26.101182+0000","last_became_peered":"2024-06-02T23:47:26.101182+0000","last_unstale":"2024-06-02T23:47:28.084548+0000","last_undegraded":"2024-06-02T23:47:28.084548+0000","last_fullsized":"2024-06-02T23:47:28.084548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:46:01.694363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114895+0000","last_change":"2024-06-02T23:47:27.106889+0000","last_active":"2024-06-02T23:47:27.114895+0000","last_peered":"2024-06-02T23:47:27.114895+0000","last_clean":"2024-06-02T23:47:27.114895+0000","last_became_active":"2024-06-02T23:47:27.106630+0000","last_became_peered":"2024-06-02T23:47:27.106630+0000","last_unstale":"2024-06-02T23:47:27.114895+0000","last_undegraded":"2024-06-02T23:47:27.114895+0000","last_fullsized":"2024-06-02T23:47:27.114895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:44:53.959179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084924+0000","last_change":"2024-06-02T23:47:26.099887+0000","last_active":"2024-06-02T23:47:28.084924+0000","last_peered":"2024-06-02T23:47:28.084924+0000","last_clean":"2024-06-02T23:47:28.084924+0000","last_became_active":"2024-06-02T23:47:26.099605+0000","last_became_peered":"2024-06-02T23:47:26.099605+0000","last_unstale":"2024-06-02T23:47:28.084924+0000","last_undegraded":"2024-06-02T23:47:28.084924+0000","last_fullsized":"2024-06-02T23:47:28.084924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:46:32.727074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.110039+0000","last_change":"2024-06-02T23:47:27.104441+0000","last_active":"2024-06-02T23:47:27.110039+0000","last_peered":"2024-06-02T23:47:27.110039+0000","last_clean":"2024-06-02T23:47:27.110039+0000","last_became_active":"2024-06-02T23:47:27.104187+0000","last_became_peered":"2024-06-02T23:47:27.104187+0000","last_unstale":"2024-06-02T23:47:27.110039+0000","last_undegraded":"2024-06-02T23:47:27.110039+0000","last_fullsized":"2024-06-02T23:47:27.110039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:12:37.064000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.099411+0000","last_change":"2024-06-02T23:47:26.102150+0000","last_active":"2024-06-02T23:47:27.099411+0000","last_peered":"2024-06-02T23:47:27.099411+0000","last_clean":"2024-06-02T23:47:27.099411+0000","last_became_active":"2024-06-02T23:47:26.101845+0000","last_became_peered":"2024-06-02T23:47:26.101845+0000","last_unstale":"2024-06-02T23:47:27.099411+0000","last_undegraded":"2024-06-02T23:47:27.099411+0000","last_fullsized":"2024-06-02T23:47:27.099411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:41:45.907329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908289+0000","last_change":"2024-06-02T23:47:27.111500+0000","last_active":"2024-06-02T23:47:28.908289+0000","last_peered":"2024-06-02T23:47:28.908289+0000","last_clean":"2024-06-02T23:47:28.908289+0000","last_became_active":"2024-06-02T23:47:27.111205+0000","last_became_peered":"2024-06-02T23:47:27.111205+0000","last_unstale":"2024-06-02T23:47:28.908289+0000","last_undegraded":"2024-06-02T23:47:28.908289+0000","last_fullsized":"2024-06-02T23:47:28.908289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:38:12.527231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627559+0000","last_change":"2024-06-02T23:47:26.101019+0000","last_active":"2024-06-02T23:47:28.627559+0000","last_peered":"2024-06-02T23:47:28.627559+0000","last_clean":"2024-06-02T23:47:28.627559+0000","last_became_active":"2024-06-02T23:47:26.100734+0000","last_became_peered":"2024-06-02T23:47:26.100734+0000","last_unstale":"2024-06-02T23:47:28.627559+0000","last_undegraded":"2024-06-02T23:47:28.627559+0000","last_fullsized":"2024-06-02T23:47:28.627559+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:49:17.869728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121906+0000","last_change":"2024-06-02T23:47:27.119842+0000","last_active":"2024-06-02T23:47:27.121906+0000","last_peered":"2024-06-02T23:47:27.121906+0000","last_clean":"2024-06-02T23:47:27.121906+0000","last_became_active":"2024-06-02T23:47:27.119568+0000","last_became_peered":"2024-06-02T23:47:27.119568+0000","last_unstale":"2024-06-02T23:47:27.121906+0000","last_undegraded":"2024-06-02T23:47:27.121906+0000","last_fullsized":"2024-06-02T23:47:27.121906+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:49:18.874631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627482+0000","last_change":"2024-06-02T23:47:26.101962+0000","last_active":"2024-06-02T23:47:28.627482+0000","last_peered":"2024-06-02T23:47:28.627482+0000","last_clean":"2024-06-02T23:47:28.627482+0000","last_became_active":"2024-06-02T23:47:26.101650+0000","last_became_peered":"2024-06-02T23:47:26.101650+0000","last_unstale":"2024-06-02T23:47:28.627482+0000","last_undegraded":"2024-06-02T23:47:28.627482+0000","last_fullsized":"2024-06-02T23:47:28.627482+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:47.212115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085717+0000","last_change":"2024-06-02T23:47:27.103825+0000","last_active":"2024-06-02T23:47:28.085717+0000","last_peered":"2024-06-02T23:47:28.085717+0000","last_clean":"2024-06-02T23:47:28.085717+0000","last_became_active":"2024-06-02T23:47:27.102734+0000","last_became_peered":"2024-06-02T23:47:27.102734+0000","last_unstale":"2024-06-02T23:47:28.085717+0000","last_undegraded":"2024-06-02T23:47:28.085717+0000","last_fullsized":"2024-06-02T23:47:28.085717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:55:39.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121823+0000","last_change":"2024-06-02T23:47:26.105353+0000","last_active":"2024-06-02T23:47:27.121823+0000","last_peered":"2024-06-02T23:47:27.121823+0000","last_clean":"2024-06-02T23:47:27.121823+0000","last_became_active":"2024-06-02T23:47:26.105129+0000","last_became_peered":"2024-06-02T23:47:26.105129+0000","last_unstale":"2024-06-02T23:47:27.121823+0000","last_undegraded":"2024-06-02T23:47:27.121823+0000","last_fullsized":"2024-06-02T23:47:27.121823+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:46:37.427558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.118165+0000","last_change":"2024-06-02T23:47:27.112862+0000","last_active":"2024-06-02T23:47:27.118165+0000","last_peered":"2024-06-02T23:47:27.118165+0000","last_clean":"2024-06-02T23:47:27.118165+0000","last_became_active":"2024-06-02T23:47:27.112555+0000","last_became_peered":"2024-06-02T23:47:27.112555+0000","last_unstale":"2024-06-02T23:47:27.118165+0000","last_undegraded":"2024-06-02T23:47:27.118165+0000","last_fullsized":"2024-06-02T23:47:27.118165+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:57.543823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.109339+0000","last_change":"2024-06-02T23:47:26.104279+0000","last_active":"2024-06-02T23:47:27.109339+0000","last_peered":"2024-06-02T23:47:27.109339+0000","last_clean":"2024-06-02T23:47:27.109339+0000","last_became_active":"2024-06-02T23:47:26.103868+0000","last_became_peered":"2024-06-02T23:47:26.103868+0000","last_unstale":"2024-06-02T23:47:27.109339+0000","last_undegraded":"2024-06-02T23:47:27.109339+0000","last_fullsized":"2024-06-02T23:47:27.109339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:26:18.531872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114395+0000","last_change":"2024-06-02T23:47:27.103209+0000","last_active":"2024-06-02T23:47:27.114395+0000","last_peered":"2024-06-02T23:47:27.114395+0000","last_clean":"2024-06-02T23:47:27.114395+0000","last_became_active":"2024-06-02T23:47:27.102927+0000","last_became_peered":"2024-06-02T23:47:27.102927+0000","last_unstale":"2024-06-02T23:47:27.114395+0000","last_undegraded":"2024-06-02T23:47:27.114395+0000","last_fullsized":"2024-06-02T23:47:27.114395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:31:23.857785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084582+0000","last_change":"2024-06-02T23:47:26.101124+0000","last_active":"2024-06-02T23:47:28.084582+0000","last_peered":"2024-06-02T23:47:28.084582+0000","last_clean":"2024-06-02T23:47:28.084582+0000","last_became_active":"2024-06-02T23:47:26.100832+0000","last_became_peered":"2024-06-02T23:47:26.100832+0000","last_unstale":"2024-06-02T23:47:28.084582+0000","last_undegraded":"2024-06-02T23:47:28.084582+0000","last_fullsized":"2024-06-02T23:47:28.084582+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:34:47.212115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908136+0000","last_change":"2024-06-02T23:47:27.108483+0000","last_active":"2024-06-02T23:47:28.908136+0000","last_peered":"2024-06-02T23:47:28.908136+0000","last_clean":"2024-06-02T23:47:28.908136+0000","last_became_active":"2024-06-02T23:47:27.108190+0000","last_became_peered":"2024-06-02T23:47:27.108190+0000","last_unstale":"2024-06-02T23:47:28.908136+0000","last_undegraded":"2024-06-02T23:47:28.908136+0000","last_fullsized":"2024-06-02T23:47:28.908136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:44.346475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.084209+0000","last_change":"2024-06-02T23:47:26.104414+0000","last_active":"2024-06-02T23:47:27.084209+0000","last_peered":"2024-06-02T23:47:27.084209+0000","last_clean":"2024-06-02T23:47:27.084209+0000","last_became_active":"2024-06-02T23:47:26.104113+0000","last_became_peered":"2024-06-02T23:47:26.104113+0000","last_unstale":"2024-06-02T23:47:27.084209+0000","last_undegraded":"2024-06-02T23:47:27.084209+0000","last_fullsized":"2024-06-02T23:47:27.084209+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:38:34.476925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114884+0000","last_change":"2024-06-02T23:47:27.104713+0000","last_active":"2024-06-02T23:47:27.114884+0000","last_peered":"2024-06-02T23:47:27.114884+0000","last_clean":"2024-06-02T23:47:27.114884+0000","last_became_active":"2024-06-02T23:47:27.104082+0000","last_became_peered":"2024-06-02T23:47:27.104082+0000","last_unstale":"2024-06-02T23:47:27.114884+0000","last_undegraded":"2024-06-02T23:47:27.114884+0000","last_fullsized":"2024-06-02T23:47:27.114884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:28:44.346475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.907833+0000","last_change":"2024-06-02T23:47:26.107095+0000","last_active":"2024-06-02T23:47:28.907833+0000","last_peered":"2024-06-02T23:47:28.907833+0000","last_clean":"2024-06-02T23:47:28.907833+0000","last_became_active":"2024-06-02T23:47:26.106787+0000","last_became_peered":"2024-06-02T23:47:26.106787+0000","last_unstale":"2024-06-02T23:47:28.907833+0000","last_undegraded":"2024-06-02T23:47:28.907833+0000","last_fullsized":"2024-06-02T23:47:28.907833+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:46:32.727074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.117722+0000","last_change":"2024-06-02T23:47:27.110988+0000","last_active":"2024-06-02T23:47:27.117722+0000","last_peered":"2024-06-02T23:47:27.117722+0000","last_clean":"2024-06-02T23:47:27.117722+0000","last_became_active":"2024-06-02T23:47:27.110714+0000","last_became_peered":"2024-06-02T23:47:27.110714+0000","last_unstale":"2024-06-02T23:47:27.117722+0000","last_undegraded":"2024-06-02T23:47:27.117722+0000","last_fullsized":"2024-06-02T23:47:27.117722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:10:04.950476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627542+0000","last_change":"2024-06-02T23:47:26.098262+0000","last_active":"2024-06-02T23:47:28.627542+0000","last_peered":"2024-06-02T23:47:28.627542+0000","last_clean":"2024-06-02T23:47:28.627542+0000","last_became_active":"2024-06-02T23:47:26.097963+0000","last_became_peered":"2024-06-02T23:47:26.097963+0000","last_unstale":"2024-06-02T23:47:28.627542+0000","last_undegraded":"2024-06-02T23:47:28.627542+0000","last_fullsized":"2024-06-02T23:47:28.627542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:41.695067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627450+0000","last_change":"2024-06-02T23:47:27.108890+0000","last_active":"2024-06-02T23:47:28.627450+0000","last_peered":"2024-06-02T23:47:28.627450+0000","last_clean":"2024-06-02T23:47:28.627450+0000","last_became_active":"2024-06-02T23:47:27.107299+0000","last_became_peered":"2024-06-02T23:47:27.107299+0000","last_unstale":"2024-06-02T23:47:28.627450+0000","last_undegraded":"2024-06-02T23:47:28.627450+0000","last_fullsized":"2024-06-02T23:47:28.627450+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:57:37.205777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085694+0000","last_change":"2024-06-02T23:47:26.098338+0000","last_active":"2024-06-02T23:47:28.085694+0000","last_peered":"2024-06-02T23:47:28.085694+0000","last_clean":"2024-06-02T23:47:28.085694+0000","last_became_active":"2024-06-02T23:47:26.097963+0000","last_became_peered":"2024-06-02T23:47:26.097963+0000","last_unstale":"2024-06-02T23:47:28.085694+0000","last_undegraded":"2024-06-02T23:47:28.085694+0000","last_fullsized":"2024-06-02T23:47:28.085694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:13.505489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.085570+0000","last_change":"2024-06-02T23:47:27.106404+0000","last_active":"2024-06-02T23:47:28.085570+0000","last_peered":"2024-06-02T23:47:28.085570+0000","last_clean":"2024-06-02T23:47:28.085570+0000","last_became_active":"2024-06-02T23:47:27.103771+0000","last_became_peered":"2024-06-02T23:47:27.103771+0000","last_unstale":"2024-06-02T23:47:28.085570+0000","last_undegraded":"2024-06-02T23:47:28.085570+0000","last_fullsized":"2024-06-02T23:47:28.085570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:45:49.349189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.105186+0000","last_change":"2024-06-02T23:47:26.102295+0000","last_active":"2024-06-02T23:47:27.105186+0000","last_peered":"2024-06-02T23:47:27.105186+0000","last_clean":"2024-06-02T23:47:27.105186+0000","last_became_active":"2024-06-02T23:47:26.102029+0000","last_became_peered":"2024-06-02T23:47:26.102029+0000","last_unstale":"2024-06-02T23:47:27.105186+0000","last_undegraded":"2024-06-02T23:47:27.105186+0000","last_fullsized":"2024-06-02T23:47:27.105186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:33:27.871876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.115880+0000","last_change":"2024-06-02T23:47:27.108959+0000","last_active":"2024-06-02T23:47:27.115880+0000","last_peered":"2024-06-02T23:47:27.115880+0000","last_clean":"2024-06-02T23:47:27.115880+0000","last_became_active":"2024-06-02T23:47:27.108701+0000","last_became_peered":"2024-06-02T23:47:27.108701+0000","last_unstale":"2024-06-02T23:47:27.115880+0000","last_undegraded":"2024-06-02T23:47:27.115880+0000","last_fullsized":"2024-06-02T23:47:27.115880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:46:44.151097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084595+0000","last_change":"2024-06-02T23:47:26.100032+0000","last_active":"2024-06-02T23:47:28.084595+0000","last_peered":"2024-06-02T23:47:28.084595+0000","last_clean":"2024-06-02T23:47:28.084595+0000","last_became_active":"2024-06-02T23:47:26.099757+0000","last_became_peered":"2024-06-02T23:47:26.099757+0000","last_unstale":"2024-06-02T23:47:28.084595+0000","last_undegraded":"2024-06-02T23:47:28.084595+0000","last_fullsized":"2024-06-02T23:47:28.084595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:21:41.695067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908160+0000","last_change":"2024-06-02T23:47:27.108928+0000","last_active":"2024-06-02T23:47:28.908160+0000","last_peered":"2024-06-02T23:47:28.908160+0000","last_clean":"2024-06-02T23:47:28.908160+0000","last_became_active":"2024-06-02T23:47:27.108648+0000","last_became_peered":"2024-06-02T23:47:27.108648+0000","last_unstale":"2024-06-02T23:47:28.908160+0000","last_undegraded":"2024-06-02T23:47:28.908160+0000","last_fullsized":"2024-06-02T23:47:28.908160+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:44:53.959179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.103373+0000","last_change":"2024-06-02T23:47:26.097706+0000","last_active":"2024-06-02T23:47:27.103373+0000","last_peered":"2024-06-02T23:47:27.103373+0000","last_clean":"2024-06-02T23:47:27.103373+0000","last_became_active":"2024-06-02T23:47:26.097391+0000","last_became_peered":"2024-06-02T23:47:26.097391+0000","last_unstale":"2024-06-02T23:47:27.103373+0000","last_undegraded":"2024-06-02T23:47:27.103373+0000","last_fullsized":"2024-06-02T23:47:27.103373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:58.442320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121919+0000","last_change":"2024-06-02T23:47:27.120053+0000","last_active":"2024-06-02T23:47:27.121919+0000","last_peered":"2024-06-02T23:47:27.121919+0000","last_clean":"2024-06-02T23:47:27.121919+0000","last_became_active":"2024-06-02T23:47:27.119743+0000","last_became_peered":"2024-06-02T23:47:27.119743+0000","last_unstale":"2024-06-02T23:47:27.121919+0000","last_undegraded":"2024-06-02T23:47:27.121919+0000","last_fullsized":"2024-06-02T23:47:27.121919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:07:24.629557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.086111+0000","last_change":"2024-06-02T23:47:26.089940+0000","last_active":"2024-06-02T23:47:27.086111+0000","last_peered":"2024-06-02T23:47:27.086111+0000","last_clean":"2024-06-02T23:47:27.086111+0000","last_became_active":"2024-06-02T23:47:26.089590+0000","last_became_peered":"2024-06-02T23:47:26.089590+0000","last_unstale":"2024-06-02T23:47:27.086111+0000","last_undegraded":"2024-06-02T23:47:27.086111+0000","last_fullsized":"2024-06-02T23:47:27.086111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:29.310649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627121+0000","last_change":"2024-06-02T23:47:27.093546+0000","last_active":"2024-06-02T23:47:28.627121+0000","last_peered":"2024-06-02T23:47:28.627121+0000","last_clean":"2024-06-02T23:47:28.627121+0000","last_became_active":"2024-06-02T23:47:27.093227+0000","last_became_peered":"2024-06-02T23:47:27.093227+0000","last_unstale":"2024-06-02T23:47:28.627121+0000","last_undegraded":"2024-06-02T23:47:28.627121+0000","last_fullsized":"2024-06-02T23:47:28.627121+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:09:03.165248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908286+0000","last_change":"2024-06-02T23:47:26.105986+0000","last_active":"2024-06-02T23:47:28.908286+0000","last_peered":"2024-06-02T23:47:28.908286+0000","last_clean":"2024-06-02T23:47:28.908286+0000","last_became_active":"2024-06-02T23:47:26.105682+0000","last_became_peered":"2024-06-02T23:47:26.105682+0000","last_unstale":"2024-06-02T23:47:28.908286+0000","last_undegraded":"2024-06-02T23:47:28.908286+0000","last_fullsized":"2024-06-02T23:47:28.908286+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:37:56.538919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.114865+0000","last_change":"2024-06-02T23:47:27.104497+0000","last_active":"2024-06-02T23:47:27.114865+0000","last_peered":"2024-06-02T23:47:27.114865+0000","last_clean":"2024-06-02T23:47:27.114865+0000","last_became_active":"2024-06-02T23:47:27.103157+0000","last_became_peered":"2024-06-02T23:47:27.103157+0000","last_unstale":"2024-06-02T23:47:27.114865+0000","last_undegraded":"2024-06-02T23:47:27.114865+0000","last_fullsized":"2024-06-02T23:47:27.114865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:55:39.152690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.086305+0000","last_change":"2024-06-02T23:47:26.094352+0000","last_active":"2024-06-02T23:47:27.086305+0000","last_peered":"2024-06-02T23:47:27.086305+0000","last_clean":"2024-06-02T23:47:27.086305+0000","last_became_active":"2024-06-02T23:47:26.094056+0000","last_became_peered":"2024-06-02T23:47:26.094056+0000","last_unstale":"2024-06-02T23:47:27.086305+0000","last_undegraded":"2024-06-02T23:47:27.086305+0000","last_fullsized":"2024-06-02T23:47:27.086305+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:30:20.065066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084643+0000","last_change":"2024-06-02T23:47:27.104371+0000","last_active":"2024-06-02T23:47:28.084643+0000","last_peered":"2024-06-02T23:47:28.084643+0000","last_clean":"2024-06-02T23:47:28.084643+0000","last_became_active":"2024-06-02T23:47:27.103968+0000","last_became_peered":"2024-06-02T23:47:27.103968+0000","last_unstale":"2024-06-02T23:47:28.084643+0000","last_undegraded":"2024-06-02T23:47:28.084643+0000","last_fullsized":"2024-06-02T23:47:28.084643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:58:51.155082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627604+0000","last_change":"2024-06-02T23:47:26.101929+0000","last_active":"2024-06-02T23:47:28.627604+0000","last_peered":"2024-06-02T23:47:28.627604+0000","last_clean":"2024-06-02T23:47:28.627604+0000","last_became_active":"2024-06-02T23:47:26.101671+0000","last_became_peered":"2024-06-02T23:47:26.101671+0000","last_unstale":"2024-06-02T23:47:28.627604+0000","last_undegraded":"2024-06-02T23:47:28.627604+0000","last_fullsized":"2024-06-02T23:47:28.627604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:14.013885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908289+0000","last_change":"2024-06-02T23:47:27.111563+0000","last_active":"2024-06-02T23:47:28.908289+0000","last_peered":"2024-06-02T23:47:28.908289+0000","last_clean":"2024-06-02T23:47:28.908289+0000","last_became_active":"2024-06-02T23:47:27.111249+0000","last_became_peered":"2024-06-02T23:47:27.111249+0000","last_unstale":"2024-06-02T23:47:28.908289+0000","last_undegraded":"2024-06-02T23:47:28.908289+0000","last_fullsized":"2024-06-02T23:47:28.908289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:10:04.950476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.086163+0000","last_change":"2024-06-02T23:47:26.092625+0000","last_active":"2024-06-02T23:47:27.086163+0000","last_peered":"2024-06-02T23:47:27.086163+0000","last_clean":"2024-06-02T23:47:27.086163+0000","last_became_active":"2024-06-02T23:47:26.092342+0000","last_became_peered":"2024-06-02T23:47:26.092342+0000","last_unstale":"2024-06-02T23:47:27.086163+0000","last_undegraded":"2024-06-02T23:47:27.086163+0000","last_fullsized":"2024-06-02T23:47:27.086163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:11:40.362705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.115088+0000","last_change":"2024-06-02T23:47:27.109243+0000","last_active":"2024-06-02T23:47:27.115088+0000","last_peered":"2024-06-02T23:47:27.115088+0000","last_clean":"2024-06-02T23:47:27.115088+0000","last_became_active":"2024-06-02T23:47:27.108963+0000","last_became_peered":"2024-06-02T23:47:27.108963+0000","last_unstale":"2024-06-02T23:47:27.115088+0000","last_undegraded":"2024-06-02T23:47:27.115088+0000","last_fullsized":"2024-06-02T23:47:27.115088+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:30:30.729164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.102774+0000","last_change":"2024-06-02T23:47:26.102499+0000","last_active":"2024-06-02T23:47:27.102774+0000","last_peered":"2024-06-02T23:47:27.102774+0000","last_clean":"2024-06-02T23:47:27.102774+0000","last_became_active":"2024-06-02T23:47:26.102197+0000","last_became_peered":"2024-06-02T23:47:26.102197+0000","last_unstale":"2024-06-02T23:47:27.102774+0000","last_undegraded":"2024-06-02T23:47:27.102774+0000","last_fullsized":"2024-06-02T23:47:27.102774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:13.505489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.121609+0000","last_change":"2024-06-02T23:47:27.115277+0000","last_active":"2024-06-02T23:47:27.121609+0000","last_peered":"2024-06-02T23:47:27.121609+0000","last_clean":"2024-06-02T23:47:27.121609+0000","last_became_active":"2024-06-02T23:47:27.114856+0000","last_became_peered":"2024-06-02T23:47:27.114856+0000","last_unstale":"2024-06-02T23:47:27.121609+0000","last_undegraded":"2024-06-02T23:47:27.121609+0000","last_fullsized":"2024-06-02T23:47:27.121609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:45:15.018789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.101353+0000","last_change":"2024-06-02T23:47:26.099179+0000","last_active":"2024-06-02T23:47:27.101353+0000","last_peered":"2024-06-02T23:47:27.101353+0000","last_clean":"2024-06-02T23:47:27.101353+0000","last_became_active":"2024-06-02T23:47:26.098880+0000","last_became_peered":"2024-06-02T23:47:26.098880+0000","last_unstale":"2024-06-02T23:47:27.101353+0000","last_undegraded":"2024-06-02T23:47:27.101353+0000","last_fullsized":"2024-06-02T23:47:27.101353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:27:32.187736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084710+0000","last_change":"2024-06-02T23:47:27.103736+0000","last_active":"2024-06-02T23:47:28.084710+0000","last_peered":"2024-06-02T23:47:28.084710+0000","last_clean":"2024-06-02T23:47:28.084710+0000","last_became_active":"2024-06-02T23:47:27.103413+0000","last_became_peered":"2024-06-02T23:47:27.103413+0000","last_unstale":"2024-06-02T23:47:28.084710+0000","last_undegraded":"2024-06-02T23:47:28.084710+0000","last_fullsized":"2024-06-02T23:47:28.084710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:44:53.959179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.084685+0000","last_change":"2024-06-02T23:47:26.104081+0000","last_active":"2024-06-02T23:47:27.084685+0000","last_peered":"2024-06-02T23:47:27.084685+0000","last_clean":"2024-06-02T23:47:27.084685+0000","last_became_active":"2024-06-02T23:47:26.103772+0000","last_became_peered":"2024-06-02T23:47:26.103772+0000","last_unstale":"2024-06-02T23:47:27.084685+0000","last_undegraded":"2024-06-02T23:47:27.084685+0000","last_fullsized":"2024-06-02T23:47:27.084685+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:39:53.310869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084969+0000","last_change":"2024-06-02T23:47:27.109141+0000","last_active":"2024-06-02T23:47:28.084969+0000","last_peered":"2024-06-02T23:47:28.084969+0000","last_clean":"2024-06-02T23:47:28.084969+0000","last_became_active":"2024-06-02T23:47:27.108844+0000","last_became_peered":"2024-06-02T23:47:27.108844+0000","last_unstale":"2024-06-02T23:47:28.084969+0000","last_undegraded":"2024-06-02T23:47:28.084969+0000","last_fullsized":"2024-06-02T23:47:28.084969+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:26:19.536776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.084937+0000","last_change":"2024-06-02T23:47:26.097127+0000","last_active":"2024-06-02T23:47:28.084937+0000","last_peered":"2024-06-02T23:47:28.084937+0000","last_clean":"2024-06-02T23:47:28.084937+0000","last_became_active":"2024-06-02T23:47:26.096839+0000","last_became_peered":"2024-06-02T23:47:26.096839+0000","last_unstale":"2024-06-02T23:47:28.084937+0000","last_undegraded":"2024-06-02T23:47:28.084937+0000","last_fullsized":"2024-06-02T23:47:28.084937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:02:51.098085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908331+0000","last_change":"2024-06-02T23:47:27.106626+0000","last_active":"2024-06-02T23:47:28.908331+0000","last_peered":"2024-06-02T23:47:28.908331+0000","last_clean":"2024-06-02T23:47:28.908331+0000","last_became_active":"2024-06-02T23:47:27.106311+0000","last_became_peered":"2024-06-02T23:47:27.106311+0000","last_unstale":"2024-06-02T23:47:28.908331+0000","last_undegraded":"2024-06-02T23:47:28.908331+0000","last_fullsized":"2024-06-02T23:47:28.908331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:02.446584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-06-02T23:47:27.097554+0000","last_change":"2024-06-02T23:47:26.102120+0000","last_active":"2024-06-02T23:47:27.097554+0000","last_peered":"2024-06-02T23:47:27.097554+0000","last_clean":"2024-06-02T23:47:27.097554+0000","last_became_active":"2024-06-02T23:47:26.101827+0000","last_became_peered":"2024-06-02T23:47:26.101827+0000","last_unstale":"2024-06-02T23:47:27.097554+0000","last_undegraded":"2024-06-02T23:47:27.097554+0000","last_fullsized":"2024-06-02T23:47:27.097554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:16:00.797573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.627413+0000","last_change":"2024-06-02T23:47:27.112728+0000","last_active":"2024-06-02T23:47:28.627413+0000","last_peered":"2024-06-02T23:47:28.627413+0000","last_clean":"2024-06-02T23:47:28.627413+0000","last_became_active":"2024-06-02T23:47:27.112083+0000","last_became_peered":"2024-06-02T23:47:27.112083+0000","last_unstale":"2024-06-02T23:47:28.627413+0000","last_undegraded":"2024-06-02T23:47:28.627413+0000","last_fullsized":"2024-06-02T23:47:28.627413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:26.072683+0000","last_clean_scrub_stamp":"2024-06-02T23:47:26.072683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:31:09.121080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908101+0000","last_change":"2024-06-02T23:47:26.104471+0000","last_active":"2024-06-02T23:47:28.908101+0000","last_peered":"2024-06-02T23:47:28.908101+0000","last_clean":"2024-06-02T23:47:28.908101+0000","last_became_active":"2024-06-02T23:47:26.104197+0000","last_became_peered":"2024-06-02T23:47:26.104197+0000","last_unstale":"2024-06-02T23:47:28.908101+0000","last_undegraded":"2024-06-02T23:47:28.908101+0000","last_fullsized":"2024-06-02T23:47:28.908101+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:47:25.067780+0000","last_clean_scrub_stamp":"2024-06-02T23:47:25.067780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:02:51.098085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-06-02T23:47:28.908220+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:47:28.908220+0000","last_peered":"2024-06-02T23:47:28.908220+0000","last_clean":"2024-06-02T23:47:28.908220+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:47:28.908220+0000","last_undegraded":"2024-06-02T23:47:28.908220+0000","last_fullsized":"2024-06-02T23:47:28.908220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":781085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":189147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":196331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":190681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":189105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":195817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":779437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:47:30.414 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T23:47:30.414 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-02T23:47:30.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.557+0000 7f526981b640 1 Processor -- start 2024-06-02T23:47:30.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.557+0000 7f526981b640 1 -- start start 2024-06-02T23:47:30.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.557+0000 7f526981b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f526415e5c0 0x7f52640d2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.557+0000 7f526981b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52640cf6e0 0x7f52640d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.557+0000 7f526981b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52640cff20 con 0x7f52640d2c10 2024-06-02T23:47:30.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.557+0000 7f526981b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f52640b0d20 con 0x7f526415e5c0 2024-06-02T23:47:30.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.558+0000 7f526981b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f52640b0f70 con 0x7f52640cf6e0 2024-06-02T23:47:30.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.558+0000 7f5262ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f526415e5c0 0x7f52640d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.558+0000 7f5262ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f526415e5c0 0x7f52640d2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40568/0 (socket says 172.21.15.96:40568) 2024-06-02T23:47:30.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.558+0000 7f5262ffd640 1 -- 172.21.15.96:0/69971438 learned_addr learned my addr 172.21.15.96:0/69971438 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:30.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.558+0000 7f52627fc640 1 --2- 172.21.15.96:0/69971438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52640cf6e0 0x7f52640d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.558+0000 7f5262ffd640 1 -- 172.21.15.96:0/69971438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52640cf6e0 msgr2=0x7f52640d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:30.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.558+0000 7f5262ffd640 1 --2- 172.21.15.96:0/69971438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52640cf6e0 0x7f52640d26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.558+0000 7f5262ffd640 1 -- 172.21.15.96:0/69971438 >> v1:172.21.15.162:6789/0 conn(0x7f52640d2c10 legacy=0x7f52640d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.558+0000 7f5262ffd640 1 -- 172.21.15.96:0/69971438 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52640b1250 con 0x7f526415e5c0 2024-06-02T23:47:30.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f5262ffd640 1 --2- 172.21.15.96:0/69971438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526415e5c0 0x7f52640d2110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5254009870 tx=0x7f525402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d8f644a0bd9cfb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:30.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f5261ffb640 1 -- 172.21.15.96:0/69971438 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254037070 con 0x7f526415e5c0 2024-06-02T23:47:30.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f5261ffb640 1 -- 172.21.15.96:0/69971438 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5254032440 con 0x7f526415e5c0 2024-06-02T23:47:30.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f5261ffb640 1 -- 172.21.15.96:0/69971438 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254032810 con 0x7f526415e5c0 2024-06-02T23:47:30.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f526981b640 1 -- 172.21.15.96:0/69971438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526415e5c0 msgr2=0x7f52640d2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f526981b640 1 --2- 172.21.15.96:0/69971438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526415e5c0 0x7f52640d2110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5254009870 tx=0x7f525402a270 comp rx=0 tx=0).stop 2024-06-02T23:47:30.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f526981b640 1 -- 172.21.15.96:0/69971438 shutdown_connections 2024-06-02T23:47:30.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f526981b640 1 --2- 172.21.15.96:0/69971438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52640cf6e0 0x7f52640d26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f526981b640 1 --2- 172.21.15.96:0/69971438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f526415e5c0 0x7f52640d2110 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f526981b640 1 -- 172.21.15.96:0/69971438 >> 172.21.15.96:0/69971438 conn(0x7f52640d40f0 msgr2=0x7f52640d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:30.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f526981b640 1 -- 172.21.15.96:0/69971438 shutdown_connections 2024-06-02T23:47:30.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.559+0000 7f526981b640 1 -- 172.21.15.96:0/69971438 wait complete. 2024-06-02T23:47:30.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.560+0000 7f526981b640 1 Processor -- start 2024-06-02T23:47:30.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.561+0000 7f526981b640 1 -- start start 2024-06-02T23:47:30.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.561+0000 7f526981b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52640cf6e0 0x7f52640ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.561+0000 7f526981b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52640d2c10 0x7f52641576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.561+0000 7f526981b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f526415e5c0 0x7f52640cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.561+0000 7f526981b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f52640b2be0 con 0x7f52640d2c10 2024-06-02T23:47:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.561+0000 7f526981b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52640b2a60 con 0x7f526415e5c0 2024-06-02T23:47:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.561+0000 7f526981b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f52640b2d60 con 0x7f52640cf6e0 2024-06-02T23:47:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.561+0000 7f52627fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52640d2c10 0x7f52641576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f52627fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52640d2c10 0x7f52641576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40570/0 (socket says 172.21.15.96:40570) 2024-06-02T23:47:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f52627fc640 1 -- 172.21.15.96:0/1407637759 learned_addr learned my addr 172.21.15.96:0/1407637759 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f5262ffd640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52640cf6e0 0x7f52640ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f52637fe640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f526415e5c0 0x7f52640cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f52627fc640 1 -- 172.21.15.96:0/1407637759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52640cf6e0 msgr2=0x7f52640ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f52627fc640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52640cf6e0 0x7f52640ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f52627fc640 1 -- 172.21.15.96:0/1407637759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f526415e5c0 msgr2=0x7f52640cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f52627fc640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f526415e5c0 0x7f52640cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f52627fc640 1 -- 172.21.15.96:0/1407637759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52640cdbf0 con 0x7f52640d2c10 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f52627fc640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52640d2c10 0x7f52641576c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f525800d5f0 tx=0x7f525800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f524bfff640 1 -- 172.21.15.96:0/1407637759 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52580125f0 con 0x7f52640d2c10 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f524bfff640 1 -- 172.21.15.96:0/1407637759 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5258019070 con 0x7f52640d2c10 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f526981b640 1 -- 172.21.15.96:0/1407637759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52640b7ff0 con 0x7f52640d2c10 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f524bfff640 1 -- 172.21.15.96:0/1407637759 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52580129d0 con 0x7f52640d2c10 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.562+0000 7f526981b640 1 -- 172.21.15.96:0/1407637759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52640c7a50 con 0x7f52640d2c10 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.563+0000 7f526981b640 1 -- 172.21.15.96:0/1407637759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52640683e0 con 0x7f52640d2c10 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.564+0000 7f524bfff640 1 -- 172.21.15.96:0/1407637759 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5258012b70 con 0x7f52640d2c10 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.564+0000 7f524bfff640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f525006be30 0x7f525006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.564+0000 7f5262ffd640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f525006be30 0x7f525006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.564+0000 7f524bfff640 1 -- 172.21.15.96:0/1407637759 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f525808b370 con 0x7f52640d2c10 2024-06-02T23:47:30.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.564+0000 7f5262ffd640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f525006be30 0x7f525006e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5254034000 tx=0x7f525402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:30.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.568+0000 7f524bfff640 1 -- 172.21.15.96:0/1407637759 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5258059c20 con 0x7f52640d2c10 2024-06-02T23:47:30.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.808+0000 7f526981b640 1 -- 172.21.15.96:0/1407637759 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5264161a60 con 0x7f52640d2c10 2024-06-02T23:47:30.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.810+0000 7f524bfff640 1 -- 172.21.15.96:0/1407637759 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f5258059520 con 0x7f52640d2c10 2024-06-02T23:47:30.811 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-06-02T23:47:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1mSH5jKRAAiBQXUb900fop4NegNAGVlQ== 2024-06-02T23:47:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: caps mds = "allow" 2024-06-02T23:47:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: caps mon = "allow r" 2024-06-02T23:47:30.811 INFO:teuthology.orchestra.run.smithi096.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-02T23:47:30.811 INFO:teuthology.orchestra.run.smithi096.stderr:updated caps for client.0 2024-06-02T23:47:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 -- 172.21.15.96:0/1407637759 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f525006be30 msgr2=0x7f525006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f525006be30 0x7f525006e2f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5254034000 tx=0x7f525402e000 comp rx=0 tx=0).stop 2024-06-02T23:47:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 -- 172.21.15.96:0/1407637759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52640d2c10 msgr2=0x7f52641576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52640d2c10 0x7f52641576c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f525800d5f0 tx=0x7f525800dab0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 -- 172.21.15.96:0/1407637759 shutdown_connections 2024-06-02T23:47:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f526415e5c0 0x7f52640cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f525006be30 0x7f525006e2f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52640d2c10 0x7f52641576c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 --2- 172.21.15.96:0/1407637759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52640cf6e0 0x7f52640ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 -- 172.21.15.96:0/1407637759 >> 172.21.15.96:0/1407637759 conn(0x7f52640d40f0 msgr2=0x7f526415d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:30.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 -- 172.21.15.96:0/1407637759 shutdown_connections 2024-06-02T23:47:30.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.813+0000 7f526981b640 1 -- 172.21.15.96:0/1407637759 wait complete. 2024-06-02T23:47:30.824 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:47:30.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.922+0000 7f1466bd5640 1 Processor -- start 2024-06-02T23:47:30.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.923+0000 7f1466bd5640 1 -- start start 2024-06-02T23:47:30.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.923+0000 7f1466bd5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f146015e280 0x7f14600d4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.923+0000 7f1466bd5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f14600d17a0 0x7f14600d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.923+0000 7f1466bd5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d0f10 0x7f14600d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.923+0000 7f1466bd5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f14600d1360 con 0x7f14600d17a0 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.923+0000 7f1466bd5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f14600cf690 con 0x7f146015e280 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.923+0000 7f1466bd5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14600b3910 con 0x7f14600d0f10 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.923+0000 7f145ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f14600d17a0 0x7f14600d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.923+0000 7f145ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f14600d17a0 0x7f14600d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40574/0 (socket says 172.21.15.96:40574) 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.923+0000 7f145ffff640 1 -- 172.21.15.96:0/2535806569 learned_addr learned my addr 172.21.15.96:0/2535806569 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.924+0000 7f1464971640 1 --2- 172.21.15.96:0/2535806569 >> v2:172.21.15.162:3300/0 conn(0x7f146015e280 0x7f14600d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.924+0000 7f1465172640 1 --2- 172.21.15.96:0/2535806569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d0f10 0x7f14600d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.924+0000 7f145ffff640 1 -- 172.21.15.96:0/2535806569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d0f10 msgr2=0x7f14600d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.924+0000 7f145ffff640 1 --2- 172.21.15.96:0/2535806569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d0f10 0x7f14600d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.924+0000 7f145ffff640 1 -- 172.21.15.96:0/2535806569 >> v2:172.21.15.162:3300/0 conn(0x7f146015e280 msgr2=0x7f14600d4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.924+0000 7f145ffff640 1 --2- 172.21.15.96:0/2535806569 >> v2:172.21.15.162:3300/0 conn(0x7f146015e280 0x7f14600d4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.924+0000 7f145ffff640 1 -- 172.21.15.96:0/2535806569 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14600cf8e0 con 0x7f14600d17a0 2024-06-02T23:47:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.924+0000 7f1465172640 1 --2- 172.21.15.96:0/2535806569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d0f10 0x7f14600d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.924+0000 7f145ffff640 1 --2- 172.21.15.96:0/2535806569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14600d17a0 0x7f14600d09d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f146008cbb0 tx=0x7f144c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11175fea66d70c78 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f145f7fe640 1 -- 172.21.15.96:0/2535806569 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c037070 con 0x7f14600d17a0 2024-06-02T23:47:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f145f7fe640 1 -- 172.21.15.96:0/2535806569 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144c032440 con 0x7f14600d17a0 2024-06-02T23:47:30.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f145f7fe640 1 -- 172.21.15.96:0/2535806569 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c032810 con 0x7f14600d17a0 2024-06-02T23:47:30.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f1466bd5640 1 -- 172.21.15.96:0/2535806569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14600d17a0 msgr2=0x7f14600d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f1466bd5640 1 --2- 172.21.15.96:0/2535806569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14600d17a0 0x7f14600d09d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f146008cbb0 tx=0x7f144c02a1e0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f1466bd5640 1 -- 172.21.15.96:0/2535806569 shutdown_connections 2024-06-02T23:47:30.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f1466bd5640 1 --2- 172.21.15.96:0/2535806569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d0f10 0x7f14600d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f1466bd5640 1 --2- 172.21.15.96:0/2535806569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f14600d17a0 0x7f14600d09d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f1466bd5640 1 --2- 172.21.15.96:0/2535806569 >> v2:172.21.15.162:3300/0 conn(0x7f146015e280 0x7f14600d4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f1466bd5640 1 -- 172.21.15.96:0/2535806569 >> 172.21.15.96:0/2535806569 conn(0x7f146009d3b0 msgr2=0x7f14600d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f1466bd5640 1 -- 172.21.15.96:0/2535806569 shutdown_connections 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.925+0000 7f1466bd5640 1 -- 172.21.15.96:0/2535806569 wait complete. 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.926+0000 7f1466bd5640 1 Processor -- start 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.926+0000 7f1466bd5640 1 -- start start 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1466bd5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14600d0f10 0x7f14600cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1466bd5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d17a0 0x7f1460152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1466bd5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015e280 0x7f1460160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1466bd5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f14600d4cc0 con 0x7f146015e280 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1466bd5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14600cfea0 con 0x7f14600d0f10 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1466bd5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14600d4e40 con 0x7f14600d17a0 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1465172640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015e280 0x7f1460160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1465172640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015e280 0x7f1460160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40578/0 (socket says 172.21.15.96:40578) 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1465172640 1 -- 172.21.15.96:0/2849089737 learned_addr learned my addr 172.21.15.96:0/2849089737 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1464971640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14600d0f10 0x7f14600cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f145ffff640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d17a0 0x7f1460152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.927+0000 7f1465172640 1 -- 172.21.15.96:0/2849089737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d17a0 msgr2=0x7f1460152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.928+0000 7f1465172640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d17a0 0x7f1460152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.928+0000 7f1465172640 1 -- 172.21.15.96:0/2849089737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14600d0f10 msgr2=0x7f14600cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.928+0000 7f1465172640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14600d0f10 0x7f14600cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.928+0000 7f1465172640 1 -- 172.21.15.96:0/2849089737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14601612f0 con 0x7f146015e280 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.928+0000 7f1465172640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015e280 0x7f1460160910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1458007ea0 tx=0x7f1458007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.928+0000 7f145d7fa640 1 -- 172.21.15.96:0/2849089737 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145801a070 con 0x7f146015e280 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.928+0000 7f145d7fa640 1 -- 172.21.15.96:0/2849089737 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1458003bb0 con 0x7f146015e280 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.928+0000 7f1466bd5640 1 -- 172.21.15.96:0/2849089737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14601615d0 con 0x7f146015e280 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.928+0000 7f145d7fa640 1 -- 172.21.15.96:0/2849089737 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145800de70 con 0x7f146015e280 2024-06-02T23:47:30.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.928+0000 7f1466bd5640 1 -- 172.21.15.96:0/2849089737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14600b7bc0 con 0x7f146015e280 2024-06-02T23:47:30.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.929+0000 7f1466bd5640 1 -- 172.21.15.96:0/2849089737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14600b7710 con 0x7f146015e280 2024-06-02T23:47:30.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.929+0000 7f145d7fa640 1 -- 172.21.15.96:0/2849089737 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f145801d070 con 0x7f146015e280 2024-06-02T23:47:30.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.930+0000 7f145d7fa640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f144406be30 0x7f144406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:30.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.930+0000 7f145d7fa640 1 -- 172.21.15.96:0/2849089737 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f145808b1f0 con 0x7f146015e280 2024-06-02T23:47:30.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.930+0000 7f1464971640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f144406be30 0x7f144406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:30.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.930+0000 7f1464971640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f144406be30 0x7f144406e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1454009a50 tx=0x7f1454008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:30.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:30.934+0000 7f145d7fa640 1 -- 172.21.15.96:0/2849089737 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1458010070 con 0x7f146015e280 2024-06-02T23:47:30.958 INFO:tasks.ceph.mds.c.smithi096.stderr:2024-06-02T23:47:30.958+0000 7fb9cf318640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T23:47:31.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.148+0000 7f1466bd5640 1 -- 172.21.15.96:0/2849089737 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14600d14e0 con 0x7f146015e280 2024-06-02T23:47:31.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.149+0000 7f145d7fa640 1 -- 172.21.15.96:0/2849089737 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5181 (secure 0 0 0) 0x7f14600d14e0 con 0x7f146015e280 2024-06-02T23:47:31.149 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:47:31.149 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/980156426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":980156426},{"type":"v1","addr":"172.21.15.162:6833","nonce":980156426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1567915962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1567915962},{"type":"v1","addr":"172.21.15.162:6835","nonce":1567915962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2700846904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2700846904},{"type":"v1","addr":"172.21.15.96:6835","nonce":2700846904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:47:26.438755+0000","modified":"2024-06-02T23:47:28.444285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.96:6837/593845400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":593845400},{"type":"v1","addr":"172.21.15.96:6837","nonce":593845400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-06-02T23:47:31.149 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2024-06-02T23:47:31.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 -- 172.21.15.96:0/2849089737 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f144406be30 msgr2=0x7f144406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f144406be30 0x7f144406e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1454009a50 tx=0x7f1454008040 comp rx=0 tx=0).stop 2024-06-02T23:47:31.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 -- 172.21.15.96:0/2849089737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015e280 msgr2=0x7f1460160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015e280 0x7f1460160910 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1458007ea0 tx=0x7f1458007f90 comp rx=0 tx=0).stop 2024-06-02T23:47:31.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 -- 172.21.15.96:0/2849089737 shutdown_connections 2024-06-02T23:47:31.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f144406be30 0x7f144406e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015e280 0x7f1460160910 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600d17a0 0x7f1460152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 --2- 172.21.15.96:0/2849089737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14600d0f10 0x7f14600cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 -- 172.21.15.96:0/2849089737 >> 172.21.15.96:0/2849089737 conn(0x7f146009d3b0 msgr2=0x7f146006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:31.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 -- 172.21.15.96:0/2849089737 shutdown_connections 2024-06-02T23:47:31.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.151+0000 7f1466bd5640 1 -- 172.21.15.96:0/2849089737 wait complete. 2024-06-02T23:47:31.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T23:47:26.438755+0000', 'modified': '2024-06-02T23:47:28.444285+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4932}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4932': {'gid': 4932, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.96:6837/593845400', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6836', 'nonce': 593845400}, {'type': 'v1', 'addr': '172.21.15.96:6837', 'nonce': 593845400}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4932, 'qdb_cluster': [4932]} 2024-06-02T23:47:31.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T23:47:31.565 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-06-02T23:47:31.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.672+0000 7fbc7464d640 1 Processor -- start 2024-06-02T23:47:31.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.673+0000 7fbc7464d640 1 -- start start 2024-06-02T23:47:31.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.673+0000 7fbc7464d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc6c0d1120 0x7fbc6c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.673+0000 7fbc7464d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbc6c0b5510 0x7fbc6c0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.673+0000 7fbc7464d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc6c0d4a90 con 0x7fbc6c161900 2024-06-02T23:47:31.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.673+0000 7fbc7464d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbc6c0cf5c0 con 0x7fbc6c0b5510 2024-06-02T23:47:31.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.673+0000 7fbc7464d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6c0caf70 con 0x7fbc6c0d1120 2024-06-02T23:47:31.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc723e9640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbc6c161900 0x7fbc6c0d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:42972/0 (socket says 172.21.15.96:42972) 2024-06-02T23:47:31.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc723e9640 1 -- 172.21.15.96:0/3684286817 learned_addr learned my addr 172.21.15.96:0/3684286817 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:31.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc72bea640 1 --2- 172.21.15.96:0/3684286817 >> v2:172.21.15.162:3300/0 conn(0x7fbc6c0b5510 0x7fbc6c0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3948286854 0 0) 0x7fbc6c0d4a90 con 0x7fbc6c161900 2024-06-02T23:47:31.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc71be8640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc6c0d1120 0x7fbc6c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc54003520 con 0x7fbc6c161900 2024-06-02T23:47:31.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4209271423 0 0) 0x7fbc54003520 con 0x7fbc6c161900 2024-06-02T23:47:31.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc6c0d1120 msgr2=0x7fbc6c0c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc6c0d1120 0x7fbc6c0c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 >> v2:172.21.15.162:3300/0 conn(0x7fbc6c0b5510 msgr2=0x7fbc6c0c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 --2- 172.21.15.96:0/3684286817 >> v2:172.21.15.162:3300/0 conn(0x7fbc6c0b5510 0x7fbc6c0c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6c0d4d70 con 0x7fbc6c161900 2024-06-02T23:47:31.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fbc64001670 con 0x7fbc6c161900 2024-06-02T23:47:31.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 >> v1:172.21.15.96:6789/0 conn(0x7fbc6c161900 legacy=0x7fbc6c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc6c0d1120 0x7fbc540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc54003f30 0x7fbc54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc54004d40 0x7fbc540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c0cf5c0 con 0x7fbc54003f30 2024-06-02T23:47:31.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c0caf70 con 0x7fbc54004d40 2024-06-02T23:47:31.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5400ba10 con 0x7fbc6c0d1120 2024-06-02T23:47:31.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc71be8640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc54003f30 0x7fbc54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc723e9640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc6c0d1120 0x7fbc540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.674+0000 7fbc72bea640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc54004d40 0x7fbc540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc71be8640 1 -- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc6c0d1120 msgr2=0x7fbc540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc71be8640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc6c0d1120 0x7fbc540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc71be8640 1 -- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc54004d40 msgr2=0x7fbc540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc71be8640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc54004d40 0x7fbc540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc71be8640 1 -- 172.21.15.96:0/3684286817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc54003520 con 0x7fbc54003f30 2024-06-02T23:47:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc723e9640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc6c0d1120 0x7fbc540039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc72bea640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc54004d40 0x7fbc540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:31.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc71be8640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc54003f30 0x7fbc54004800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009af0 tx=0x7fbc54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c0f4e0dd1759fc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60036070 con 0x7fbc54003f30 2024-06-02T23:47:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc60031400 con 0x7fbc54003f30 2024-06-02T23:47:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.675+0000 7fbc713e7640 1 -- 172.21.15.96:0/3684286817 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60009690 con 0x7fbc54003f30 2024-06-02T23:47:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.676+0000 7fbc7464d640 1 -- 172.21.15.96:0/3684286817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc54003f30 msgr2=0x7fbc54004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.676+0000 7fbc7464d640 1 --2- 172.21.15.96:0/3684286817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc54003f30 0x7fbc54004800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009af0 tx=0x7fbc54005830 comp rx=0 tx=0).stop 2024-06-02T23:47:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.676+0000 7fbc72bea640 1 -- 172.21.15.96:0/3684286817 reap_dead start 2024-06-02T23:47:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.676+0000 7fbc7464d640 1 -- 172.21.15.96:0/3684286817 shutdown_connections 2024-06-02T23:47:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.676+0000 7fbc7464d640 1 -- 172.21.15.96:0/3684286817 >> 172.21.15.96:0/3684286817 conn(0x7fbc6c09d3b0 msgr2=0x7fbc6c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:31.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.676+0000 7fbc7464d640 1 -- 172.21.15.96:0/3684286817 shutdown_connections 2024-06-02T23:47:31.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.676+0000 7fbc7464d640 1 -- 172.21.15.96:0/3684286817 wait complete. 2024-06-02T23:47:31.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.677+0000 7fbc7464d640 1 Processor -- start 2024-06-02T23:47:31.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.677+0000 7fbc7464d640 1 -- start start 2024-06-02T23:47:31.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc7464d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc54003f30 0x7fbc6c15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc7464d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c159cc0 0x7fbc6c1f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc7464d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc6c14b350 0x7fbc6c15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc7464d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c0d4780 con 0x7fbc6c14b350 2024-06-02T23:47:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc7464d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c0cfae0 con 0x7fbc6c159cc0 2024-06-02T23:47:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc7464d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6c161ce0 con 0x7fbc54003f30 2024-06-02T23:47:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc72bea640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc6c14b350 0x7fbc6c15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc72bea640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc6c14b350 0x7fbc6c15efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40584/0 (socket says 172.21.15.96:40584) 2024-06-02T23:47:31.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc72bea640 1 -- 172.21.15.96:0/3998926369 learned_addr learned my addr 172.21.15.96:0/3998926369 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc723e9640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc54003f30 0x7fbc6c15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc71be8640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c159cc0 0x7fbc6c1f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc72bea640 1 -- 172.21.15.96:0/3998926369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc54003f30 msgr2=0x7fbc6c15b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc72bea640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc54003f30 0x7fbc6c15b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc72bea640 1 -- 172.21.15.96:0/3998926369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c159cc0 msgr2=0x7fbc6c1f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc72bea640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c159cc0 0x7fbc6c1f41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc72bea640 1 -- 172.21.15.96:0/3998926369 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6c15bb90 con 0x7fbc6c14b350 2024-06-02T23:47:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.678+0000 7fbc72bea640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc6c14b350 0x7fbc6c15efb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c08e7e0 tx=0x7fbc5c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:31.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.679+0000 7fbc6affd640 1 -- 172.21.15.96:0/3998926369 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c01a030 con 0x7fbc6c14b350 2024-06-02T23:47:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.679+0000 7fbc6affd640 1 -- 172.21.15.96:0/3998926369 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c010d50 con 0x7fbc6c14b350 2024-06-02T23:47:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.679+0000 7fbc7464d640 1 -- 172.21.15.96:0/3998926369 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6c156bf0 con 0x7fbc6c14b350 2024-06-02T23:47:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.679+0000 7fbc6affd640 1 -- 172.21.15.96:0/3998926369 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c003bd0 con 0x7fbc6c14b350 2024-06-02T23:47:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.679+0000 7fbc7464d640 1 -- 172.21.15.96:0/3998926369 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6c1571b0 con 0x7fbc6c14b350 2024-06-02T23:47:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.680+0000 7fbc6affd640 1 -- 172.21.15.96:0/3998926369 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc5c01d070 con 0x7fbc6c14b350 2024-06-02T23:47:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.680+0000 7fbc6affd640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbc5806be30 0x7fbc5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.681+0000 7fbc6affd640 1 -- 172.21.15.96:0/3998926369 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fbc5c08b9b0 con 0x7fbc6c14b350 2024-06-02T23:47:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.681+0000 7fbc723e9640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbc5806be30 0x7fbc5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.681+0000 7fbc723e9640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbc5806be30 0x7fbc5806e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbc64001eb0 tx=0x7fbc64009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.682+0000 7fbc76ffd740 1 Processor -- start 2024-06-02T23:47:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.682+0000 7fbc76ffd740 1 -- start start 2024-06-02T23:47:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 0x564b74ac4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac20e0 0x564b74ac4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74a94960 0x564b74a98170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x564b749fd740 con 0x564b74ac20e0 2024-06-02T23:47:31.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564b7499ba80 con 0x564b74ac1d00 2024-06-02T23:47:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564b749f9700 con 0x564b74a94960 2024-06-02T23:47:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc71be8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac20e0 0x564b74ac4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc71be8640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac20e0 0x564b74ac4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40586/0 (socket says 172.21.15.96:40586) 2024-06-02T23:47:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc71be8640 1 -- 172.21.15.96:0/766277935 learned_addr learned my addr 172.21.15.96:0/766277935 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc723e9640 1 --2- 172.21.15.96:0/766277935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 0x564b74ac4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc72bea640 1 --2- 172.21.15.96:0/766277935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74a94960 0x564b74a98170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc71be8640 1 -- 172.21.15.96:0/766277935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74a94960 msgr2=0x564b74a98170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc71be8640 1 --2- 172.21.15.96:0/766277935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74a94960 0x564b74a98170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc71be8640 1 -- 172.21.15.96:0/766277935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 msgr2=0x564b74ac4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc71be8640 1 --2- 172.21.15.96:0/766277935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 0x564b74ac4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc71be8640 1 -- 172.21.15.96:0/766277935 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b749c6fb0 con 0x564b74ac20e0 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc723e9640 1 --2- 172.21.15.96:0/766277935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 0x564b74ac4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc71be8640 1 --2- 172.21.15.96:0/766277935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac20e0 0x564b74ac4a50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbc60034040 tx=0x7fbc6002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d583e1cfb4b021a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc53fff640 1 -- 172.21.15.96:0/766277935 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60040070 con 0x564b74ac20e0 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc53fff640 1 -- 172.21.15.96:0/766277935 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc60004040 con 0x564b74ac20e0 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.683+0000 7fbc53fff640 1 -- 172.21.15.96:0/766277935 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60036040 con 0x564b74ac20e0 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.684+0000 7fbc76ffd740 1 -- 172.21.15.96:0/766277935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac20e0 msgr2=0x564b74ac4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.684+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/766277935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac20e0 0x564b74ac4a50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbc60034040 tx=0x7fbc6002e000 comp rx=0 tx=0).stop 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.684+0000 7fbc76ffd740 1 -- 172.21.15.96:0/766277935 shutdown_connections 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.684+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/766277935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74a94960 0x564b74a98170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.684+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/766277935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac20e0 0x564b74ac4a50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.684+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/766277935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 0x564b74ac4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.684+0000 7fbc76ffd740 1 -- 172.21.15.96:0/766277935 >> 172.21.15.96:0/766277935 conn(0x564b74a96bd0 msgr2=0x564b74adf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.684+0000 7fbc76ffd740 1 -- 172.21.15.96:0/766277935 shutdown_connections 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.684+0000 7fbc76ffd740 1 -- 172.21.15.96:0/766277935 wait complete. 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.685+0000 7fbc76ffd740 1 -- start start 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.685+0000 7fbc76ffd740 1 Processor -- start 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac1d00 0x564b74adebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac20e0 0x564b74ab7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74abc2f0 0x564b74ab7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x564b74a99d80 con 0x564b74ac1d00 2024-06-02T23:47:31.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564b74986c30 con 0x564b74abc2f0 2024-06-02T23:47:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564b74a9a060 con 0x564b74ac20e0 2024-06-02T23:47:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc76ffd740 10 client.0 _ll_register_callbacks cb 0x564b749b87f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:47:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc723e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac1d00 0x564b74adebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc723e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac1d00 0x564b74adebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40600/0 (socket says 172.21.15.96:40600) 2024-06-02T23:47:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc723e9640 1 -- 172.21.15.96:0/1518441283 learned_addr learned my addr 172.21.15.96:0/1518441283 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc71be8640 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac20e0 0x564b74ab7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc72bea640 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74abc2f0 0x564b74ab7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc723e9640 1 -- 172.21.15.96:0/1518441283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac20e0 msgr2=0x564b74ab7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc723e9640 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac20e0 0x564b74ab7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc723e9640 1 -- 172.21.15.96:0/1518441283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74abc2f0 msgr2=0x564b74ab7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc723e9640 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74abc2f0 0x564b74ab7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc723e9640 1 -- 172.21.15.96:0/1518441283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b747112d0 con 0x564b74ac1d00 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc72bea640 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74abc2f0 0x564b74ab7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc723e9640 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac1d00 0x564b74adebb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbc64014680 tx=0x7fbc64000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7089b8348113d85b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc517fa640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc517fa640 1 -- 172.21.15.96:0/1518441283 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6401a030 con 0x564b74ac1d00 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc517fa640 1 -- 172.21.15.96:0/1518441283 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fbc64013830 con 0x564b74ac1d00 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.686+0000 7fbc76ffd740 1 -- 172.21.15.96:0/1518441283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc60004040 con 0x564b74ac1d00 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc517fa640 1 -- 172.21.15.96:0/1518441283 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fbc6402f050 con 0x564b74ac1d00 2024-06-02T23:47:31.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc76ffd740 10 client.5091 fetch_fsmap learned FSMap version 16 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc76ffd740 1 -- 172.21.15.96:0/1518441283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x564b747db6b0 con 0x564b74ac1d00 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc517fa640 1 -- 172.21.15.96:0/1518441283 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc60004040 con 0x564b74ac1d00 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc517fa640 1 -- 172.21.15.96:0/1518441283 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7fbc64032020 con 0x564b74ac1d00 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc76ffd740 10 client.5091 fetch_fsmap finished waiting for FSMap version 16 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc76ffd740 10 client.5091 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc76ffd740 20 client.5091 populate_metadata read hostname 'smithi096' 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.96:6836/593845400,v1:172.21.15.96:6837/593845400] conn(0x564b74ae1d60 0x564b74afe620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc76ffd740 4 client.5091 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc76ffd740 1 -- 172.21.15.96:0/1518441283 --> [v2:172.21.15.96:6836/593845400,v1:172.21.15.96:6837/593845400] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b74a0ae70 con 0x564b74ae1d60 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc71be8640 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.96:6836/593845400,v1:172.21.15.96:6837/593845400] conn(0x564b74ae1d60 0x564b74afe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc71be8640 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.96:6836/593845400,v1:172.21.15.96:6837/593845400] conn(0x564b74ae1d60 0x564b74afe620 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=491dd5cb670840ec server_cookie=862526cf499b79fa in_seq=0 out_seq=0 2024-06-02T23:47:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.687+0000 7fbc517fa640 10 client.5091 ms_handle_connect on v2:172.21.15.96:6836/593845400 2024-06-02T23:47:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc517fa640 1 -- 172.21.15.96:0/1518441283 <== mds.0 v2:172.21.15.96:6836/593845400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564b74a0ae70 con 0x564b74ae1d60 2024-06-02T23:47:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc517fa640 10 client.5091 handle_command_reply: tid=0 2024-06-02T23:47:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 client.5091 shutdown 2024-06-02T23:47:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 -- 172.21.15.96:0/1518441283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac1d00 msgr2=0x564b74adebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac1d00 0x564b74adebb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbc64014680 tx=0x7fbc64000fe0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 -- 172.21.15.96:0/1518441283 shutdown_connections 2024-06-02T23:47:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74abc2f0 0x564b74ab7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.96:6836/593845400,v1:172.21.15.96:6837/593845400] conn(0x564b74ae1d60 0x564b74afe620 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac20e0 0x564b74ab7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/1518441283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74ac1d00 0x564b74adebb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc517fa640 0 client.5091 ms_handle_reset on v2:172.21.15.96:6836/593845400 2024-06-02T23:47:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 -- 172.21.15.96:0/1518441283 >> 172.21.15.96:0/1518441283 conn(0x564b74a94960 msgr2=0x564b74a95610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 -- 172.21.15.96:0/1518441283 shutdown_connections 2024-06-02T23:47:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 1 -- 172.21.15.96:0/1518441283 wait complete. 2024-06-02T23:47:31.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.688+0000 7fbc76ffd740 20 client.5091 trim_cache size 0 max 16384 2024-06-02T23:47:31.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.707+0000 7fbc76ffd740 1 Processor -- start 2024-06-02T23:47:31.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.707+0000 7fbc76ffd740 1 -- start start 2024-06-02T23:47:31.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74a98300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac1d00 0x564b74ae2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac20e0 0x564b74ab9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c200620 con 0x564b74abc2f0 2024-06-02T23:47:31.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1ff9b0 con 0x564b74ac20e0 2024-06-02T23:47:31.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6c200000 con 0x564b74ac1d00 2024-06-02T23:47:31.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc723e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74a98300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc723e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74a98300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40616/0 (socket says 172.21.15.96:40616) 2024-06-02T23:47:31.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc723e9640 1 -- 172.21.15.96:0/161075731 learned_addr learned my addr 172.21.15.96:0/161075731 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:31.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc723e9640 1 -- 172.21.15.96:0/161075731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac1d00 msgr2=0x564b74ae2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc723e9640 1 --2- 172.21.15.96:0/161075731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac1d00 0x564b74ae2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc723e9640 1 -- 172.21.15.96:0/161075731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac20e0 msgr2=0x564b74ab9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc723e9640 1 --2- 172.21.15.96:0/161075731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac20e0 0x564b74ab9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc723e9640 1 -- 172.21.15.96:0/161075731 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b74ae7be0 con 0x564b74abc2f0 2024-06-02T23:47:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc723e9640 1 --2- 172.21.15.96:0/161075731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74a98300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbc64005980 tx=0x7fbc64021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e064e80bffecefc7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc537fe640 1 -- 172.21.15.96:0/161075731 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64038070 con 0x564b74abc2f0 2024-06-02T23:47:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc537fe640 1 -- 172.21.15.96:0/161075731 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc64027070 con 0x564b74abc2f0 2024-06-02T23:47:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.708+0000 7fbc537fe640 1 -- 172.21.15.96:0/161075731 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6401a070 con 0x564b74abc2f0 2024-06-02T23:47:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 -- 172.21.15.96:0/161075731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 msgr2=0x564b74a98300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/161075731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74a98300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbc64005980 tx=0x7fbc64021000 comp rx=0 tx=0).stop 2024-06-02T23:47:31.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 -- 172.21.15.96:0/161075731 shutdown_connections 2024-06-02T23:47:31.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/161075731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac20e0 0x564b74ab9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/161075731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac1d00 0x564b74ae2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/161075731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74a98300 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 -- 172.21.15.96:0/161075731 >> 172.21.15.96:0/161075731 conn(0x564b74a94960 msgr2=0x564b74adf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:31.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 -- 172.21.15.96:0/161075731 shutdown_connections 2024-06-02T23:47:31.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 -- 172.21.15.96:0/161075731 wait complete. 2024-06-02T23:47:31.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 -- start start 2024-06-02T23:47:31.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.709+0000 7fbc76ffd740 1 Processor -- start 2024-06-02T23:47:31.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.710+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74abaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.710+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 0x564b74ac0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.710+0000 7fbc76ffd740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac20e0 0x564b74ac1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.710+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x564b74ac85a0 con 0x564b74abc2f0 2024-06-02T23:47:31.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.710+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564b74abbbb0 con 0x564b74ac1d00 2024-06-02T23:47:31.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.710+0000 7fbc76ffd740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564b74ac5780 con 0x564b74ac20e0 2024-06-02T23:47:31.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.710+0000 7fbc76ffd740 10 client.0 _ll_register_callbacks cb 0x7fbc64010f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:47:31.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.710+0000 7fbc723e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74abaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.710+0000 7fbc723e9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74abaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40630/0 (socket says 172.21.15.96:40630) 2024-06-02T23:47:31.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.710+0000 7fbc723e9640 1 -- 172.21.15.96:0/3955726927 learned_addr learned my addr 172.21.15.96:0/3955726927 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc72bea640 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac20e0 0x564b74ac1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc71be8640 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 0x564b74ac0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc723e9640 1 -- 172.21.15.96:0/3955726927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac20e0 msgr2=0x564b74ac1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc723e9640 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac20e0 0x564b74ac1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc723e9640 1 -- 172.21.15.96:0/3955726927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 msgr2=0x564b74ac0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc723e9640 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 0x564b74ac0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc723e9640 1 -- 172.21.15.96:0/3955726927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b74adb640 con 0x564b74abc2f0 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc723e9640 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74abaf80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbc64001970 tx=0x7fbc64014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ff4bb0f389cb35 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc517fa640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc517fa640 1 -- 172.21.15.96:0/3955726927 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6401a050 con 0x564b74abc2f0 2024-06-02T23:47:31.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc517fa640 1 -- 172.21.15.96:0/3955726927 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fbc6403dc70 con 0x564b74abc2f0 2024-06-02T23:47:31.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc76ffd740 1 -- 172.21.15.96:0/3955726927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc64027070 con 0x564b74abc2f0 2024-06-02T23:47:31.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc517fa640 1 -- 172.21.15.96:0/3955726927 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fbc64038040 con 0x564b74abc2f0 2024-06-02T23:47:31.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc76ffd740 10 client.5097 fetch_fsmap learned FSMap version 16 2024-06-02T23:47:31.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc76ffd740 1 -- 172.21.15.96:0/3955726927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x564b74abb520 con 0x564b74abc2f0 2024-06-02T23:47:31.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc517fa640 1 -- 172.21.15.96:0/3955726927 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc64027070 con 0x564b74abc2f0 2024-06-02T23:47:31.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc517fa640 1 -- 172.21.15.96:0/3955726927 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 16) ==== 3494+0+0 (secure 0 0 0) 0x7fbc6403b070 con 0x564b74abc2f0 2024-06-02T23:47:31.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc76ffd740 10 client.5097 fetch_fsmap finished waiting for FSMap version 16 2024-06-02T23:47:31.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc76ffd740 10 client.5097 resolve_mds: resolved name 'c' to daemon mds.c 2024-06-02T23:47:31.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc76ffd740 20 client.5097 populate_metadata read hostname 'smithi096' 2024-06-02T23:47:31.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.96:6836/593845400,v1:172.21.15.96:6837/593845400] conn(0x564b74aae370 0x564b74aae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc76ffd740 4 client.5097 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T23:47:31.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.711+0000 7fbc76ffd740 1 -- 172.21.15.96:0/3955726927 --> [v2:172.21.15.96:6836/593845400,v1:172.21.15.96:6837/593845400] -- command(tid 0: {"prefix": "status"}) -- 0x564b74a051c0 con 0x564b74aae370 2024-06-02T23:47:31.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc71be8640 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.96:6836/593845400,v1:172.21.15.96:6837/593845400] conn(0x564b74aae370 0x564b74aae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc517fa640 10 client.5097 ms_handle_connect on v2:172.21.15.96:6836/593845400 2024-06-02T23:47:31.724 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc71be8640 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.96:6836/593845400,v1:172.21.15.96:6837/593845400] conn(0x564b74aae370 0x564b74aae750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=943378abada307a2 server_cookie=816931cbbce5d79c in_seq=0 out_seq=0 2024-06-02T23:47:31.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc517fa640 1 -- 172.21.15.96:0/3955726927 <== mds.0 v2:172.21.15.96:6836/593845400 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564b74a051c0 con 0x564b74aae370 2024-06-02T23:47:31.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc517fa640 10 client.5097 handle_command_reply: tid=0 2024-06-02T23:47:31.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 client.5097 shutdown 2024-06-02T23:47:31.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 -- 172.21.15.96:0/3955726927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 msgr2=0x564b74abaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74abaf80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbc64001970 tx=0x7fbc64014000 comp rx=0 tx=0).stop 2024-06-02T23:47:31.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 -- 172.21.15.96:0/3955726927 shutdown_connections 2024-06-02T23:47:31.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.96:6836/593845400,v1:172.21.15.96:6837/593845400] conn(0x564b74aae370 0x564b74aae750 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x564b74ac20e0 0x564b74ac1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b74ac1d00 0x564b74ac0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 --2- 172.21.15.96:0/3955726927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x564b74abc2f0 0x564b74abaf80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc517fa640 0 client.5097 ms_handle_reset on v2:172.21.15.96:6836/593845400 2024-06-02T23:47:31.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 -- 172.21.15.96:0/3955726927 >> 172.21.15.96:0/3955726927 conn(0x564b74a94960 msgr2=0x564b74a9b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:31.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 -- 172.21.15.96:0/3955726927 shutdown_connections 2024-06-02T23:47:31.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 1 -- 172.21.15.96:0/3955726927 wait complete. 2024-06-02T23:47:31.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.712+0000 7fbc76ffd740 20 client.5097 trim_cache size 0 max 16384 2024-06-02T23:47:31.726 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:47:31.726 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "83723afd-2657-4b93-818a-1e4b19cab42f", 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4932, 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 4.6315605670000002, 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 16, 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 39, 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 39, 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 17.631284521000001 2024-06-02T23:47:31.727 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:47:31.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 -- 172.21.15.96:0/3998926369 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbc5806be30 msgr2=0x7fbc5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbc5806be30 0x7fbc5806e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbc64001eb0 tx=0x7fbc64009040 comp rx=0 tx=0).stop 2024-06-02T23:47:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 -- 172.21.15.96:0/3998926369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc6c14b350 msgr2=0x7fbc6c15efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc6c14b350 0x7fbc6c15efb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c08e7e0 tx=0x7fbc5c010590 comp rx=0 tx=0).stop 2024-06-02T23:47:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 -- 172.21.15.96:0/3998926369 shutdown_connections 2024-06-02T23:47:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fbc5806be30 0x7fbc5806e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc6c14b350 0x7fbc6c15efb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6c159cc0 0x7fbc6c1f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 --2- 172.21.15.96:0/3998926369 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc54003f30 0x7fbc6c15b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 -- 172.21.15.96:0/3998926369 >> 172.21.15.96:0/3998926369 conn(0x7fbc6c09d3b0 msgr2=0x7fbc6c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:31.730 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 -- 172.21.15.96:0/3998926369 shutdown_connections 2024-06-02T23:47:31.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.713+0000 7fbc7464d640 1 -- 172.21.15.96:0/3998926369 wait complete. 2024-06-02T23:47:31.731 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T23:47:31.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.845+0000 7f004b3e7640 1 Processor -- start 2024-06-02T23:47:31.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.845+0000 7f004b3e7640 1 -- start start 2024-06-02T23:47:31.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.846+0000 7f004b3e7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f004406ed20 0x7f00440ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.846+0000 7f004b3e7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0044155950 con 0x7f00440cab60 2024-06-02T23:47:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.846+0000 7f004b3e7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00440cb2e0 con 0x7f0044155570 2024-06-02T23:47:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.846+0000 7f004b3e7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f00440cb5c0 con 0x7f004406ed20 2024-06-02T23:47:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.846+0000 7f0049984640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f00440cab60 0x7f0044072020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:42974/0 (socket says 172.21.15.96:42974) 2024-06-02T23:47:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.846+0000 7f0049984640 1 -- 172.21.15.96:0/2324107780 learned_addr learned my addr 172.21.15.96:0/2324107780 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f0048982640 1 --2- 172.21.15.96:0/2324107780 >> v2:172.21.15.162:3300/0 conn(0x7f004406ed20 0x7f00440ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638777132 0 0) 0x7f0044155950 con 0x7f00440cab60 2024-06-02T23:47:31.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0030003520 con 0x7f00440cab60 2024-06-02T23:47:31.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2919298229 0 0) 0x7f0030003520 con 0x7f00440cab60 2024-06-02T23:47:31.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 >> v2:172.21.15.162:3300/0 conn(0x7f004406ed20 msgr2=0x7f00440ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 --2- 172.21.15.96:0/2324107780 >> v2:172.21.15.162:3300/0 conn(0x7f004406ed20 0x7f00440ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 >> v1:172.21.15.162:6789/0 conn(0x7f0044155570 legacy=0x7f004406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00440cb8a0 con 0x7f00440cab60 2024-06-02T23:47:31.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f003c0019f0 con 0x7f00440cab60 2024-06-02T23:47:31.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 >> v1:172.21.15.96:6789/0 conn(0x7f00440cab60 legacy=0x7f0044072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00300039b0 0x7f0030003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0030004800 0x7f0030004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00300051c0 0x7f003000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f00440cb5c0 con 0x7f00300039b0 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f003000c060 con 0x7f0030004800 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f003000c260 con 0x7f00300051c0 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f0049183640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00300039b0 0x7f0030003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f0048982640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0030004800 0x7f0030004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f0049984640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00300051c0 0x7f003000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f0049183640 1 -- 172.21.15.96:0/2324107780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00300051c0 msgr2=0x7f003000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f0049183640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00300051c0 0x7f003000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f0049183640 1 -- 172.21.15.96:0/2324107780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0030004800 msgr2=0x7f0030004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f0049183640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0030004800 0x7f0030004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f0049183640 1 -- 172.21.15.96:0/2324107780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0030003520 con 0x7f00300039b0 2024-06-02T23:47:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.847+0000 7f0049984640 1 -- 172.21.15.96:0/2324107780 reap_dead start 2024-06-02T23:47:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.848+0000 7f0049183640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00300039b0 0x7f0030003dd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0040001750 tx=0x7f0030005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3feb3cebdcf275 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.848+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0040001370 con 0x7f00300039b0 2024-06-02T23:47:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.848+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00400052d0 con 0x7f00300039b0 2024-06-02T23:47:31.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.848+0000 7f003bfff640 1 -- 172.21.15.96:0/2324107780 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004002abe0 con 0x7f00300039b0 2024-06-02T23:47:31.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.849+0000 7f004b3e7640 1 -- 172.21.15.96:0/2324107780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00300039b0 msgr2=0x7f0030003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.849+0000 7f004b3e7640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00300039b0 0x7f0030003dd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0040001750 tx=0x7f0030005830 comp rx=0 tx=0).stop 2024-06-02T23:47:31.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.849+0000 7f004b3e7640 1 -- 172.21.15.96:0/2324107780 shutdown_connections 2024-06-02T23:47:31.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.849+0000 7f004b3e7640 1 --2- 172.21.15.96:0/2324107780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00300039b0 0x7f0030003dd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.849+0000 7f004b3e7640 1 -- 172.21.15.96:0/2324107780 >> 172.21.15.96:0/2324107780 conn(0x7f00440cfc30 msgr2=0x7f00440d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:31.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.849+0000 7f004b3e7640 1 -- 172.21.15.96:0/2324107780 shutdown_connections 2024-06-02T23:47:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.849+0000 7f004b3e7640 1 -- 172.21.15.96:0/2324107780 wait complete. 2024-06-02T23:47:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.850+0000 7f004b3e7640 1 Processor -- start 2024-06-02T23:47:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.850+0000 7f004b3e7640 1 -- start start 2024-06-02T23:47:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f004b3e7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00300039b0 0x7f00440c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f004b3e7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0044153f30 0x7f0044159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f004b3e7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0044159590 0x7f00440c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f004b3e7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f00440caf70 con 0x7f0044153f30 2024-06-02T23:47:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f004b3e7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00440717d0 con 0x7f00300039b0 2024-06-02T23:47:31.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f004b3e7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00440ca620 con 0x7f0044159590 2024-06-02T23:47:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0048982640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0044153f30 0x7f0044159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0048982640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0044153f30 0x7f0044159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40648/0 (socket says 172.21.15.96:40648) 2024-06-02T23:47:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0048982640 1 -- 172.21.15.96:0/787761823 learned_addr learned my addr 172.21.15.96:0/787761823 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0049183640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00300039b0 0x7f00440c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0048982640 1 -- 172.21.15.96:0/787761823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0044159590 msgr2=0x7f00440c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0048982640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0044159590 0x7f00440c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0048982640 1 -- 172.21.15.96:0/787761823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00300039b0 msgr2=0x7f00440c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0048982640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00300039b0 0x7f00440c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0048982640 1 -- 172.21.15.96:0/787761823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0044159df0 con 0x7f0044153f30 2024-06-02T23:47:31.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0048982640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0044153f30 0x7f0044159050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0034011a70 tx=0x7f0034011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:31.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0039ffb640 1 -- 172.21.15.96:0/787761823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003400fad0 con 0x7f0044153f30 2024-06-02T23:47:31.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0039ffb640 1 -- 172.21.15.96:0/787761823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f003400fc70 con 0x7f0044153f30 2024-06-02T23:47:31.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f0039ffb640 1 -- 172.21.15.96:0/787761823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0034014440 con 0x7f0044153f30 2024-06-02T23:47:31.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.851+0000 7f004b3e7640 1 -- 172.21.15.96:0/787761823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00440c6e30 con 0x7f0044153f30 2024-06-02T23:47:31.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.852+0000 7f004b3e7640 1 -- 172.21.15.96:0/787761823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00440c70d0 con 0x7f0044153f30 2024-06-02T23:47:31.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.853+0000 7f004b3e7640 1 -- 172.21.15.96:0/787761823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00440683e0 con 0x7f0044153f30 2024-06-02T23:47:31.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.853+0000 7f0039ffb640 1 -- 172.21.15.96:0/787761823 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0034012040 con 0x7f0044153f30 2024-06-02T23:47:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.853+0000 7f0039ffb640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f002806be60 0x7f002806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.854+0000 7f0039ffb640 1 -- 172.21.15.96:0/787761823 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f003408b490 con 0x7f0044153f30 2024-06-02T23:47:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.854+0000 7f0049183640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f002806be60 0x7f002806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.854+0000 7f0049183640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f002806be60 0x7f002806e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0040032000 tx=0x7f004002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:31.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:31.858+0000 7f0039ffb640 1 -- 172.21.15.96:0/787761823 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0034019030 con 0x7f0044153f30 2024-06-02T23:47:32.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.070+0000 7f004b3e7640 1 -- 172.21.15.96:0/787761823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f004406cc90 con 0x7f0044153f30 2024-06-02T23:47:32.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.070+0000 7f0039ffb640 1 -- 172.21.15.96:0/787761823 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f0034059d40 con 0x7f0044153f30 2024-06-02T23:47:32.071 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 -- 172.21.15.96:0/787761823 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f002806be60 msgr2=0x7f002806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f002806be60 0x7f002806e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0040032000 tx=0x7f004002e000 comp rx=0 tx=0).stop 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 -- 172.21.15.96:0/787761823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0044153f30 msgr2=0x7f0044159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0044153f30 0x7f0044159050 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0034011a70 tx=0x7f0034011f30 comp rx=0 tx=0).stop 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 -- 172.21.15.96:0/787761823 shutdown_connections 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0044159590 0x7f00440c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f002806be60 0x7f002806e320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0044153f30 0x7f0044159050 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 --2- 172.21.15.96:0/787761823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00300039b0 0x7f00440c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 -- 172.21.15.96:0/787761823 >> 172.21.15.96:0/787761823 conn(0x7f00440cfc30 msgr2=0x7f00440723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:32.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 -- 172.21.15.96:0/787761823 shutdown_connections 2024-06-02T23:47:32.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32.072+0000 7f004b3e7640 1 -- 172.21.15.96:0/787761823 wait complete. 2024-06-02T23:47:32.083 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T23:47:32.083 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T23:47:32.083 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-06-02T23:47:32.083 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T23:47:32.083 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T23:47:32.084 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T23:47:32.084 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T23:47:32.084 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T23:47:32.084 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T23:47:32.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:32.084 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-06-02T23:47:32.101 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-06-02T23:47:32.102 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42708sec preferred_lft 42708sec 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether d2:8f:fd:4a:d7:e3 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::fc2d:2aff:fe99:fd88/64 scope link 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:47:32.103 INFO:teuthology.orchestra.run.smithi096.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T23:47:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether da:61:41:8f:5f:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:47:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::d861:41ff:fe8f:5f36/64 scope link 2024-06-02T23:47:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:47:32.104 INFO:teuthology.orchestra.run.smithi096.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T23:47:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether d2:8f:fd:4a:d7:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:47:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::d08f:fdff:fe4a:d7e3/64 scope link 2024-06-02T23:47:32.104 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:47:32.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:32.104 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T23:47:32.168 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-06-02T23:47:32.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:32.169 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-06-02T23:47:32.229 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-06-02T23:47:32.230 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T23:47:32.230 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T23:47:32.230 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T23:47:32.230 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T23:47:32.230 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:47:32.230 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:47:32.230 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T23:47:32.230 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T23:47:32.231 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T23:47:32.231 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:47:32.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:47:32.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:47:32.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:32.358 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-06-02T23:47:32.373 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T23:47:32.373 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T23:47:32.374 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T23:47:32.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:32.374 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2024-06-02T23:47:32.440 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T23:47:32.440 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:47:32.440 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T23:47:32.496 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T23:47:32.497 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:47:32.497 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T23:47:32.552 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-06-02T23:47:32.618 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:47:32.674 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:47:32.675 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-06-02T23:47:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T23:47:32.677 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T23:47:32.677 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T23:47:32.677 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T23:47:32.677 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-06-02T23:47:32.677 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:47:32.677 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:47:32.677 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:47:32.677 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:47:32.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:32.678 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-06-02T23:47:32.730 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T23:47:32.730 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T23:47:32.772 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-06-02T23:47:32.798 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:47:32.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:2024-06-02T23:47:32.854+0000 7f93eae73480 -1 init, newargv = 0x559e1cd803d0 newargc=15 2024-06-02T23:47:32.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[51215]: starting ceph client 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-06-02T23:47:32.855 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-06-02T23:47:32.856 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-06-02T23:47:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T23:47:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T23:47:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T23:47:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T23:47:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-06-02T23:47:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:47:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:47:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:47:32.857 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:47:32.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:32.858 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-06-02T23:47:32.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[51215]: starting fuse 2024-06-02T23:47:32.874 INFO:teuthology.orchestra.run.smithi096.stdout:40 2024-06-02T23:47:32.874 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T23:47:32.874 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> import re 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> import os 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2024-06-02T23:47:32.875 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> return f 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.0")) 2024-06-02T23:47:32.876 DEBUG:teuthology.orchestra.run.smithi096:> ' 2024-06-02T23:47:32.991 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.0.51215.asok 2024-06-02T23:47:32.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:47:33.002 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51215.asok 2024-06-02T23:47:33.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:33.002 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51215.asok status 2024-06-02T23:47:33.138 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:47:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2024-06-02T23:47:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T23:47:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T23:47:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "0", 2024-06-02T23:47:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2024-06-02T23:47:33.138 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "51215", 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 5106, 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5106 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:47:33.139 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 3089969473 2024-06-02T23:47:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-06-02T23:47:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-06-02T23:47:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:47:33.140 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 3089969473 2024-06-02T23:47:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:47:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.5106 192.168.0.1:0/3089969473", 2024-06-02T23:47:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.1:0/3089969473", 2024-06-02T23:47:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2024-06-02T23:47:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 16, 2024-06-02T23:47:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 39, 2024-06-02T23:47:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2024-06-02T23:47:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2024-06-02T23:47:33.141 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2024-06-02T23:47:33.141 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:47:33.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:33.147 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2024-06-02T23:47:33.147 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T23:47:33.163 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2024-06-02T23:47:33.163 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T23:47:33.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:33.163 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T23:47:33.228 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-06-02T23:47:33.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.368+0000 7f8205309640 1 Processor -- start 2024-06-02T23:47:33.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.368+0000 7f8205309640 1 -- start start 2024-06-02T23:47:33.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.368+0000 7f8205309640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82000b4e80 0x7f82000b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.368+0000 7f8205309640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f82000d08d0 0x7f82000d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.368+0000 7f8205309640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82000d1de0 con 0x7f82001617e0 2024-06-02T23:47:33.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.368+0000 7f8205309640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f82000d0060 con 0x7f82000d08d0 2024-06-02T23:47:33.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.368+0000 7f8205309640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82000cf7c0 con 0x7f82000b4e80 2024-06-02T23:47:33.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.369+0000 7f81ff7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f82000d08d0 0x7f82000d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.369+0000 7f81ff7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f82000d08d0 0x7f82000d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46104/0 (socket says 172.21.15.96:46104) 2024-06-02T23:47:33.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.369+0000 7f81ff7fe640 1 -- 172.21.15.96:0/1279052627 learned_addr learned my addr 172.21.15.96:0/1279052627 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:33.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.369+0000 7f81fe7fc640 1 --2- 172.21.15.96:0/1279052627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82000b4e80 0x7f82000b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.369+0000 7f81ff7fe640 1 -- 172.21.15.96:0/1279052627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82000b4e80 msgr2=0x7f82000b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:33.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.369+0000 7f81ff7fe640 1 --2- 172.21.15.96:0/1279052627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82000b4e80 0x7f82000b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.369+0000 7f81ff7fe640 1 -- 172.21.15.96:0/1279052627 >> v1:172.21.15.162:6789/0 conn(0x7f82001617e0 legacy=0x7f82000d4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:33.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.369+0000 7f81ff7fe640 1 -- 172.21.15.96:0/1279052627 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82000cfaa0 con 0x7f82000d08d0 2024-06-02T23:47:33.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f81ff7fe640 1 --2- 172.21.15.96:0/1279052627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000d08d0 0x7f82000d0d60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009870 tx=0x7f81f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c73ee710c882518 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:33.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f81fdffb640 1 -- 172.21.15.96:0/1279052627 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0037070 con 0x7f82000d08d0 2024-06-02T23:47:33.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f81fdffb640 1 -- 172.21.15.96:0/1279052627 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f0032440 con 0x7f82000d08d0 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f81fdffb640 1 -- 172.21.15.96:0/1279052627 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0032810 con 0x7f82000d08d0 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f8205309640 1 -- 172.21.15.96:0/1279052627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000d08d0 msgr2=0x7f82000d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f8205309640 1 --2- 172.21.15.96:0/1279052627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000d08d0 0x7f82000d0d60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009870 tx=0x7f81f002a270 comp rx=0 tx=0).stop 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f8205309640 1 -- 172.21.15.96:0/1279052627 shutdown_connections 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f8205309640 1 --2- 172.21.15.96:0/1279052627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000d08d0 0x7f82000d0d60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f8205309640 1 --2- 172.21.15.96:0/1279052627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82000b4e80 0x7f82000b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f8205309640 1 -- 172.21.15.96:0/1279052627 >> 172.21.15.96:0/1279052627 conn(0x7f820009d340 msgr2=0x7f82000d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f8205309640 1 -- 172.21.15.96:0/1279052627 shutdown_connections 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.370+0000 7f8205309640 1 -- 172.21.15.96:0/1279052627 wait complete. 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f8205309640 1 Processor -- start 2024-06-02T23:47:33.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f8205309640 1 -- start start 2024-06-02T23:47:33.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f8205309640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000b4e80 0x7f8200154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f8205309640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82000d08d0 0x7f82000cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f8205309640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82001617e0 0x7f82001565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f8205309640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8200161d40 con 0x7f82000b4e80 2024-06-02T23:47:33.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f8205309640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8200161bc0 con 0x7f82000d08d0 2024-06-02T23:47:33.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f8205309640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82000d22c0 con 0x7f82001617e0 2024-06-02T23:47:33.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f81feffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000b4e80 0x7f8200154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f81feffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000b4e80 0x7f8200154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46106/0 (socket says 172.21.15.96:46106) 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.372+0000 7f81feffd640 1 -- 172.21.15.96:0/3758663640 learned_addr learned my addr 172.21.15.96:0/3758663640 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f81feffd640 1 -- 172.21.15.96:0/3758663640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82001617e0 msgr2=0x7f82001565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f81feffd640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82001617e0 0x7f82001565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f81feffd640 1 -- 172.21.15.96:0/3758663640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82000d08d0 msgr2=0x7f82000cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f81feffd640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82000d08d0 0x7f82000cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f81feffd640 1 -- 172.21.15.96:0/3758663640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82000cb4b0 con 0x7f82000b4e80 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f81feffd640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000b4e80 0x7f8200154250 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f81f800c760 tx=0x7f81f800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f81f77fe640 1 -- 172.21.15.96:0/3758663640 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8016020 con 0x7f82000b4e80 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f81f77fe640 1 -- 172.21.15.96:0/3758663640 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f8006d50 con 0x7f82000b4e80 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f8205309640 1 -- 172.21.15.96:0/3758663640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82000cb790 con 0x7f82000b4e80 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f81f77fe640 1 -- 172.21.15.96:0/3758663640 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8003bb0 con 0x7f82000b4e80 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.373+0000 7f8205309640 1 -- 172.21.15.96:0/3758663640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82000cbd50 con 0x7f82000b4e80 2024-06-02T23:47:33.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.374+0000 7f8205309640 1 -- 172.21.15.96:0/3758663640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82000d4d50 con 0x7f82000b4e80 2024-06-02T23:47:33.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.374+0000 7f81f77fe640 1 -- 172.21.15.96:0/3758663640 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81f800a850 con 0x7f82000b4e80 2024-06-02T23:47:33.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.375+0000 7f81f77fe640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f81e006be30 0x7f81e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.375+0000 7f81f77fe640 1 -- 172.21.15.96:0/3758663640 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f81f808acc0 con 0x7f82000b4e80 2024-06-02T23:47:33.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.375+0000 7f81fe7fc640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f81e006be30 0x7f81e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.375+0000 7f81fe7fc640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f81e006be30 0x7f81e006e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f820015f320 tx=0x7f81e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:33.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.379+0000 7f81f77fe640 1 -- 172.21.15.96:0/3758663640 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f82000d4d50 con 0x7f82000b4e80 2024-06-02T23:47:33.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.574+0000 7f8205309640 1 -- 172.21.15.96:0/3758663640 --> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f82000d16f0 con 0x7f81e006be30 2024-06-02T23:47:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.575+0000 7f81f77fe640 1 -- 172.21.15.96:0/3758663640 <== mgr.4113 v2:172.21.15.96:6832/1776728888 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f82000d16f0 con 0x7f81e006be30 2024-06-02T23:47:33.575 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-06-02T23:47:33.575 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:47:33.576 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "cephfs" 2024-06-02T23:47:33.576 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:47:33.576 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 -- 172.21.15.96:0/3758663640 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f81e006be30 msgr2=0x7f81e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f81e006be30 0x7f81e006e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f820015f320 tx=0x7f81e8008040 comp rx=0 tx=0).stop 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 -- 172.21.15.96:0/3758663640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000b4e80 msgr2=0x7f8200154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000b4e80 0x7f8200154250 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f81f800c760 tx=0x7f81f800cc20 comp rx=0 tx=0).stop 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 -- 172.21.15.96:0/3758663640 shutdown_connections 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82001617e0 0x7f82001565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82000d08d0 0x7f82000cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f81e006be30 0x7f81e006e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 --2- 172.21.15.96:0/3758663640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82000b4e80 0x7f8200154250 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 -- 172.21.15.96:0/3758663640 >> 172.21.15.96:0/3758663640 conn(0x7f820009d340 msgr2=0x7f82000cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 -- 172.21.15.96:0/3758663640 shutdown_connections 2024-06-02T23:47:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.577+0000 7f8205309640 1 -- 172.21.15.96:0/3758663640 wait complete. 2024-06-02T23:47:33.588 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-06-02T23:47:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.690+0000 7f0c2687d640 1 Processor -- start 2024-06-02T23:47:33.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.690+0000 7f0c2687d640 1 -- start start 2024-06-02T23:47:33.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.690+0000 7f0c2687d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0c200b4b50 0x7f0c200b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.690+0000 7f0c2687d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c200d2630 0x7f0c200d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.690+0000 7f0c2687d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c200cec60 con 0x7f0c200b4640 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.690+0000 7f0c2687d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0c200d4ff0 con 0x7f0c200b4b50 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.690+0000 7f0c2687d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c200d1fd0 con 0x7f0c200d2630 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1ffff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f0c200b4640 0x7f0c200b6ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48246/0 (socket says 172.21.15.96:48246) 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1ffff640 1 -- 172.21.15.96:0/794493859 learned_addr learned my addr 172.21.15.96:0/794493859 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1f7fe640 1 --2- 172.21.15.96:0/794493859 >> v2:172.21.15.162:3300/0 conn(0x7f0c200b4b50 0x7f0c200b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c24e1a640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c200d2630 0x7f0c200d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2713115784 0 0) 0x7f0c200cec60 con 0x7f0c200b4640 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c08003520 con 0x7f0c200b4640 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2374662646 0 0) 0x7f0c08003520 con 0x7f0c200b4640 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c200d2630 msgr2=0x7f0c200d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c200d2630 0x7f0c200d2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 >> v2:172.21.15.162:3300/0 conn(0x7f0c200b4b50 msgr2=0x7f0c200b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 --2- 172.21.15.96:0/794493859 >> v2:172.21.15.162:3300/0 conn(0x7f0c200b4b50 0x7f0c200b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c200d4d10 con 0x7f0c200b4640 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f0c10001670 con 0x7f0c200b4640 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 >> v1:172.21.15.96:6789/0 conn(0x7f0c200b4640 legacy=0x7f0c200b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c080039b0 0x7f0c08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c08004800 0x7f0c08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c200d2630 0x7f0c080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0c200d1fd0 con 0x7f0c08004800 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0800b9c0 con 0x7f0c080039b0 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c0800bbc0 con 0x7f0c200d2630 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1f7fe640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c08004800 0x7f0c08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1ffff640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c080039b0 0x7f0c08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c24e1a640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c200d2630 0x7f0c080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1f7fe640 1 -- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c200d2630 msgr2=0x7f0c080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.691+0000 7f0c1f7fe640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c200d2630 0x7f0c080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.692+0000 7f0c1f7fe640 1 -- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c080039b0 msgr2=0x7f0c08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.692+0000 7f0c1f7fe640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c080039b0 0x7f0c08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.692+0000 7f0c1f7fe640 1 -- 172.21.15.96:0/794493859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c08003520 con 0x7f0c08004800 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.692+0000 7f0c1f7fe640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c08004800 0x7f0c08004c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009ac0 tx=0x7f0c08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adff44e5ec0e5c27 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.692+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c14036070 con 0x7f0c08004800 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.692+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c14031400 con 0x7f0c08004800 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.692+0000 7f0c1effd640 1 -- 172.21.15.96:0/794493859 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c14009690 con 0x7f0c08004800 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.693+0000 7f0c2687d640 1 -- 172.21.15.96:0/794493859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c08004800 msgr2=0x7f0c08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.693+0000 7f0c2687d640 1 --2- 172.21.15.96:0/794493859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c08004800 0x7f0c08004c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0c14009ac0 tx=0x7f0c08005830 comp rx=0 tx=0).stop 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.693+0000 7f0c24e1a640 1 -- 172.21.15.96:0/794493859 reap_dead start 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.693+0000 7f0c2687d640 1 -- 172.21.15.96:0/794493859 shutdown_connections 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.693+0000 7f0c2687d640 1 -- 172.21.15.96:0/794493859 >> 172.21.15.96:0/794493859 conn(0x7f0c200d4050 msgr2=0x7f0c200d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:33.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.693+0000 7f0c2687d640 1 -- 172.21.15.96:0/794493859 shutdown_connections 2024-06-02T23:47:33.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.693+0000 7f0c2687d640 1 -- 172.21.15.96:0/794493859 wait complete. 2024-06-02T23:47:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.694+0000 7f0c2687d640 1 Processor -- start 2024-06-02T23:47:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.694+0000 7f0c2687d640 1 -- start start 2024-06-02T23:47:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c2687d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c08004800 0x7f0c2014b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c2687d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2015a0c0 0x7f0c2015a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c2687d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2015d4e0 0x7f0c2015d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c2687d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0c200d2ac0 con 0x7f0c2015d4e0 2024-06-02T23:47:33.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c2687d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c200d13b0 con 0x7f0c2015a0c0 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c2687d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c200d2c40 con 0x7f0c08004800 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c24e1a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2015d4e0 0x7f0c2015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c24e1a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2015d4e0 0x7f0c2015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46114/0 (socket says 172.21.15.96:46114) 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c24e1a640 1 -- 172.21.15.96:0/3245325396 learned_addr learned my addr 172.21.15.96:0/3245325396 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c1f7fe640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2015a0c0 0x7f0c2015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c1ffff640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c08004800 0x7f0c2014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c24e1a640 1 -- 172.21.15.96:0/3245325396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c08004800 msgr2=0x7f0c2014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c24e1a640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c08004800 0x7f0c2014b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c24e1a640 1 -- 172.21.15.96:0/3245325396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2015a0c0 msgr2=0x7f0c2015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c24e1a640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2015a0c0 0x7f0c2015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c24e1a640 1 -- 172.21.15.96:0/3245325396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2015e210 con 0x7f0c2015d4e0 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c1f7fe640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2015a0c0 0x7f0c2015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:33.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.695+0000 7f0c24e1a640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2015d4e0 0x7f0c2015d960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009e90 tx=0x7f0c180115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.696+0000 7f0c1cff9640 1 -- 172.21.15.96:0/3245325396 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18011e80 con 0x7f0c2015d4e0 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.696+0000 7f0c1cff9640 1 -- 172.21.15.96:0/3245325396 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1801b070 con 0x7f0c2015d4e0 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.696+0000 7f0c2687d640 1 -- 172.21.15.96:0/3245325396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2015e4f0 con 0x7f0c2015d4e0 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.696+0000 7f0c1cff9640 1 -- 172.21.15.96:0/3245325396 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18003990 con 0x7f0c2015d4e0 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.696+0000 7f0c2687d640 1 -- 172.21.15.96:0/3245325396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c20148a10 con 0x7f0c2015d4e0 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.697+0000 7f0c2687d640 1 -- 172.21.15.96:0/3245325396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c200683e0 con 0x7f0c2015d4e0 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.697+0000 7f0c1cff9640 1 -- 172.21.15.96:0/3245325396 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c18005d10 con 0x7f0c2015d4e0 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.697+0000 7f0c1cff9640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c0c06be30 0x7f0c0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.698+0000 7f0c1cff9640 1 -- 172.21.15.96:0/3245325396 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0c1808b3d0 con 0x7f0c2015d4e0 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.698+0000 7f0c1ffff640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c0c06be30 0x7f0c0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:33.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.698+0000 7f0c1ffff640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c0c06be30 0x7f0c0c06e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0c10001050 tx=0x7f0c10009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:33.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.702+0000 7f0c1cff9640 1 -- 172.21.15.96:0/3245325396 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0c18014350 con 0x7f0c2015d4e0 2024-06-02T23:47:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:33.922+0000 7f0c2687d640 1 -- 172.21.15.96:0/3245325396 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f0c200d2410 con 0x7f0c2015d4e0 2024-06-02T23:47:34.130 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.130+0000 7f0c1cff9640 1 -- 172.21.15.96:0/3245325396 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) ==== 92+0+0 (secure 0 0 0) 0x7f0c18059bf0 con 0x7f0c2015d4e0 2024-06-02T23:47:34.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.133+0000 7f0c2687d640 1 -- 172.21.15.96:0/3245325396 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c0c06be30 msgr2=0x7f0c0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.133+0000 7f0c2687d640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c0c06be30 0x7f0c0c06e2f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0c10001050 tx=0x7f0c10009040 comp rx=0 tx=0).stop 2024-06-02T23:47:34.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.133+0000 7f0c2687d640 1 -- 172.21.15.96:0/3245325396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2015d4e0 msgr2=0x7f0c2015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.133+0000 7f0c2687d640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2015d4e0 0x7f0c2015d960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009e90 tx=0x7f0c180115a0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.133+0000 7f0c2687d640 1 -- 172.21.15.96:0/3245325396 shutdown_connections 2024-06-02T23:47:34.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.133+0000 7f0c2687d640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f0c0c06be30 0x7f0c0c06e2f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.133+0000 7f0c2687d640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2015d4e0 0x7f0c2015d960 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.133+0000 7f0c2687d640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2015a0c0 0x7f0c2015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.133+0000 7f0c2687d640 1 --2- 172.21.15.96:0/3245325396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c08004800 0x7f0c2014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.133+0000 7f0c2687d640 1 -- 172.21.15.96:0/3245325396 >> 172.21.15.96:0/3245325396 conn(0x7f0c200d4050 msgr2=0x7f0c200cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:34.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.134+0000 7f0c2687d640 1 -- 172.21.15.96:0/3245325396 shutdown_connections 2024-06-02T23:47:34.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.134+0000 7f0c2687d640 1 -- 172.21.15.96:0/3245325396 wait complete. 2024-06-02T23:47:34.147 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-06-02T23:47:34.252 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:34.252+0000 7fd6ca642040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:47:34.256 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:34.256+0000 7fca91621040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:47:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.261+0000 7fb441c37640 1 Processor -- start 2024-06-02T23:47:34.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.261+0000 7fb441c37640 1 -- start start 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb441c37640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb43c0ce890 0x7fb43c15bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb441c37640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb43c0cec70 0x7fb43c0cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb441c37640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c0d2a00 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb441c37640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb43c0aea50 con 0x7fb43c0cec70 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb441c37640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c0d2ce0 con 0x7fb43c0ce890 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb43bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb43c0cec70 0x7fb43c0cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb433fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb43c0b0ec0 0x7fb43c0aeee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48258/0 (socket says 172.21.15.96:48258) 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb433fff640 1 -- 172.21.15.96:0/987872080 learned_addr learned my addr 172.21.15.96:0/987872080 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb43b7fe640 1 --2- 172.21.15.96:0/987872080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb43c0ce890 0x7fb43c15bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb43bfff640 1 -- 172.21.15.96:0/987872080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb43c0ce890 msgr2=0x7fb43c15bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb43bfff640 1 --2- 172.21.15.96:0/987872080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb43c0ce890 0x7fb43c15bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb43bfff640 1 -- 172.21.15.96:0/987872080 >> v1:172.21.15.96:6789/0 conn(0x7fb43c0b0ec0 legacy=0x7fb43c0aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb43bfff640 1 -- 172.21.15.96:0/987872080 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c0cfcc0 con 0x7fb43c0cec70 2024-06-02T23:47:34.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.262+0000 7fb43affd640 1 -- 172.21.15.96:0/987872080 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2002523516 0 0) 0x7fb43c0d2a00 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.263+0000 7fb43bfff640 1 --2- 172.21.15.96:0/987872080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0cec70 0x7fb43c0cdb10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb434009d90 tx=0x7fb43402a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196fbe8008c8ecbe server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:34.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.263+0000 7fb43affd640 1 -- 172.21.15.96:0/987872080 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434007740 con 0x7fb43c0cec70 2024-06-02T23:47:34.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.263+0000 7fb43affd640 1 -- 172.21.15.96:0/987872080 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4340078e0 con 0x7fb43c0cec70 2024-06-02T23:47:34.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.263+0000 7fb43affd640 1 -- 172.21.15.96:0/987872080 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434007cb0 con 0x7fb43c0cec70 2024-06-02T23:47:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.264+0000 7fb441c37640 1 -- 172.21.15.96:0/987872080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0cec70 msgr2=0x7fb43c0cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.264+0000 7fb441c37640 1 --2- 172.21.15.96:0/987872080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0cec70 0x7fb43c0cdb10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb434009d90 tx=0x7fb43402a530 comp rx=0 tx=0).stop 2024-06-02T23:47:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.264+0000 7fb441c37640 1 -- 172.21.15.96:0/987872080 shutdown_connections 2024-06-02T23:47:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.264+0000 7fb441c37640 1 --2- 172.21.15.96:0/987872080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0cec70 0x7fb43c0cdb10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.264+0000 7fb441c37640 1 --2- 172.21.15.96:0/987872080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb43c0ce890 0x7fb43c15bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.264+0000 7fb441c37640 1 -- 172.21.15.96:0/987872080 >> 172.21.15.96:0/987872080 conn(0x7fb43c0d1e40 msgr2=0x7fb43c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.264+0000 7fb441c37640 1 -- 172.21.15.96:0/987872080 shutdown_connections 2024-06-02T23:47:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.264+0000 7fb441c37640 1 -- 172.21.15.96:0/987872080 wait complete. 2024-06-02T23:47:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.265+0000 7fb441c37640 1 Processor -- start 2024-06-02T23:47:34.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.265+0000 7fb441c37640 1 -- start start 2024-06-02T23:47:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb441c37640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0b0ec0 0x7fb43c14d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb441c37640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb43c0ce890 0x7fb43c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb441c37640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb43c0cec70 0x7fb43c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb441c37640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0d0fd0 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb441c37640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0d0e50 con 0x7fb43c0ce890 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb441c37640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c15c320 con 0x7fb43c0cec70 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb43b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0b0ec0 0x7fb43c14d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb43b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0b0ec0 0x7fb43c14d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46138/0 (socket says 172.21.15.96:46138) 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb43b7fe640 1 -- 172.21.15.96:0/3736244489 learned_addr learned my addr 172.21.15.96:0/3736244489 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb433fff640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb43c0ce890 0x7fb43c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb43bfff640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb43c0cec70 0x7fb43c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb43b7fe640 1 -- 172.21.15.96:0/3736244489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb43c0cec70 msgr2=0x7fb43c0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb43b7fe640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb43c0cec70 0x7fb43c0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb43b7fe640 1 -- 172.21.15.96:0/3736244489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb43c0ce890 msgr2=0x7fb43c0b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb43b7fe640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb43c0ce890 0x7fb43c0b71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb43b7fe640 1 -- 172.21.15.96:0/3736244489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c14d7d0 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.266+0000 7fb43b7fe640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0b0ec0 0x7fb43c14d290 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00d830 tx=0x7fb42c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.267+0000 7fb438ff9640 1 -- 172.21.15.96:0/3736244489 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00b6c0 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.267+0000 7fb438ff9640 1 -- 172.21.15.96:0/3736244489 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c019070 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.267+0000 7fb441c37640 1 -- 172.21.15.96:0/3736244489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c0cbef0 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.267+0000 7fb438ff9640 1 -- 172.21.15.96:0/3736244489 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00ba80 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.267+0000 7fb441c37640 1 -- 172.21.15.96:0/3736244489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c0b3dd0 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.268+0000 7fb441c37640 1 -- 172.21.15.96:0/3736244489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43c0b38f0 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.268+0000 7fb438ff9640 1 -- 172.21.15.96:0/3736244489 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 6) ==== 90515+0+0 (secure 0 0 0) 0x7fb42c01e460 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.269+0000 7fb438ff9640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb41c06be80 0x7fb41c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.269+0000 7fb433fff640 1 -- 172.21.15.96:0/3736244489 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb41c06be80 msgr2=0x7fb41c06e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/1776728888 2024-06-02T23:47:34.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.269+0000 7fb438ff9640 1 -- 172.21.15.96:0/3736244489 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb42c08b530 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.269+0000 7fb433fff640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb41c06be80 0x7fb41c06e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:47:34.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.273+0000 7fb438ff9640 1 -- 172.21.15.96:0/3736244489 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb43c14d7d0 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.367 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:34.367+0000 7fd6ca642040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:47:34.372 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:34.372+0000 7fca91621040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:47:34.413 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:34.413+0000 7fd6ca642040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:47:34.418 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:34.418+0000 7fca91621040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:47:34.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.451+0000 7fb441c37640 1 -- 172.21.15.96:0/3736244489 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fb43c0b3440 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.454+0000 7fb438ff9640 1 -- 172.21.15.96:0/3736244489 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) ==== 138+0+0 (secure 0 0 0) 0x7fb42c059790 con 0x7fb43c0b0ec0 2024-06-02T23:47:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 -- 172.21.15.96:0/3736244489 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb41c06be80 msgr2=0x7fb41c06e340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:47:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb41c06be80 0x7fb41c06e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 -- 172.21.15.96:0/3736244489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0b0ec0 msgr2=0x7fb43c14d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0b0ec0 0x7fb43c14d290 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00d830 tx=0x7fb42c00dcf0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 -- 172.21.15.96:0/3736244489 shutdown_connections 2024-06-02T23:47:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb43c0cec70 0x7fb43c0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb43c0ce890 0x7fb43c0b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7fb41c06be80 0x7fb41c06e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 --2- 172.21.15.96:0/3736244489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb43c0b0ec0 0x7fb43c14d290 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 -- 172.21.15.96:0/3736244489 >> 172.21.15.96:0/3736244489 conn(0x7fb43c0d1e40 msgr2=0x7fb43c0b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 -- 172.21.15.96:0/3736244489 shutdown_connections 2024-06-02T23:47:34.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.457+0000 7fb441c37640 1 -- 172.21.15.96:0/3736244489 wait complete. 2024-06-02T23:47:34.468 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-06-02T23:47:34.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.573+0000 7f82fcb90640 1 Processor -- start 2024-06-02T23:47:34.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.573+0000 7f82fcb90640 1 -- start start 2024-06-02T23:47:34.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82fcb90640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f80b4b50 0x7f82f80b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82fcb90640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f82f80d2630 0x7f82f80d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82fcb90640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f80cec60 con 0x7f82f80b4640 2024-06-02T23:47:34.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82fcb90640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f82f80d4ff0 con 0x7f82f80d2630 2024-06-02T23:47:34.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82fcb90640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82f80d1fd0 con 0x7f82f80b4b50 2024-06-02T23:47:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82f6d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f82f80d2630 0x7f82f80d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82f659c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f82f80b4640 0x7f82f80b6ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48260/0 (socket says 172.21.15.96:48260) 2024-06-02T23:47:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82f6d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f82f80d2630 0x7f82f80d2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46150/0 (socket says 172.21.15.96:46150) 2024-06-02T23:47:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82f659c640 1 -- 172.21.15.96:0/2695388027 learned_addr learned my addr 172.21.15.96:0/2695388027 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82effff640 1 --2- 172.21.15.96:0/2695388027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f80b4b50 0x7f82f80b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82f6d9d640 1 -- 172.21.15.96:0/2695388027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f80b4b50 msgr2=0x7f82f80b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82f6d9d640 1 --2- 172.21.15.96:0/2695388027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f80b4b50 0x7f82f80b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82f6d9d640 1 -- 172.21.15.96:0/2695388027 >> v1:172.21.15.96:6789/0 conn(0x7f82f80b4640 legacy=0x7f82f80b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82f6d9d640 1 -- 172.21.15.96:0/2695388027 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f80d4d10 con 0x7f82f80d2630 2024-06-02T23:47:34.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.574+0000 7f82f5d9b640 1 -- 172.21.15.96:0/2695388027 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 95215481 0 0) 0x7f82f80cec60 con 0x7f82f80b4640 2024-06-02T23:47:34.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.575+0000 7f82f6d9d640 1 --2- 172.21.15.96:0/2695388027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 0x7f82f80d2ac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009d90 tx=0x7f82f002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c5b1a6d30f30ee server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.575+0000 7f82f5d9b640 1 -- 172.21.15.96:0/2695388027 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0031600 con 0x7f82f80d2630 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.575+0000 7f82f5d9b640 1 -- 172.21.15.96:0/2695388027 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f00317a0 con 0x7f82f80d2630 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.575+0000 7f82f5d9b640 1 -- 172.21.15.96:0/2695388027 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0031b70 con 0x7f82f80d2630 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.576+0000 7f82fcb90640 1 -- 172.21.15.96:0/2695388027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 msgr2=0x7f82f80d2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.576+0000 7f82fcb90640 1 --2- 172.21.15.96:0/2695388027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 0x7f82f80d2ac0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009d90 tx=0x7f82f002a5d0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.576+0000 7f82fcb90640 1 -- 172.21.15.96:0/2695388027 shutdown_connections 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.576+0000 7f82fcb90640 1 --2- 172.21.15.96:0/2695388027 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 0x7f82f80d2ac0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.576+0000 7f82fcb90640 1 --2- 172.21.15.96:0/2695388027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f80b4b50 0x7f82f80b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.576+0000 7f82fcb90640 1 -- 172.21.15.96:0/2695388027 >> 172.21.15.96:0/2695388027 conn(0x7f82f80d4050 msgr2=0x7f82f80d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.576+0000 7f82fcb90640 1 -- 172.21.15.96:0/2695388027 shutdown_connections 2024-06-02T23:47:34.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.576+0000 7f82fcb90640 1 -- 172.21.15.96:0/2695388027 wait complete. 2024-06-02T23:47:34.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.578+0000 7f82fcb90640 1 Processor -- start 2024-06-02T23:47:34.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.578+0000 7f82fcb90640 1 -- start start 2024-06-02T23:47:34.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82fcb90640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f80b4640 0x7f82f80b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82fcb90640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f80b4b50 0x7f82f81f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82fcb90640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 0x7f82f81f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82fcb90640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f82f80cf420 con 0x7f82f80d2630 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82fcb90640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82f80d13b0 con 0x7f82f80b4640 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82fcb90640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82f80cf5a0 con 0x7f82f80b4b50 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82f6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 0x7f82f81f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82f6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 0x7f82f81f3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46154/0 (socket says 172.21.15.96:46154) 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82f6d9d640 1 -- 172.21.15.96:0/1948022835 learned_addr learned my addr 172.21.15.96:0/1948022835 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82f659c640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f80b4640 0x7f82f80b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82effff640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f80b4b50 0x7f82f81f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82f6d9d640 1 -- 172.21.15.96:0/1948022835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f80b4b50 msgr2=0x7f82f81f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82f6d9d640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f80b4b50 0x7f82f81f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82f6d9d640 1 -- 172.21.15.96:0/1948022835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f80b4640 msgr2=0x7f82f80b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82f6d9d640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f80b4640 0x7f82f80b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.579+0000 7f82f6d9d640 1 -- 172.21.15.96:0/1948022835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f81f42d0 con 0x7f82f80d2630 2024-06-02T23:47:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.580+0000 7f82f6d9d640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 0x7f82f81f3d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009d90 tx=0x7f82f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.580+0000 7f82eeffd640 1 -- 172.21.15.96:0/1948022835 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0040070 con 0x7f82f80d2630 2024-06-02T23:47:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.580+0000 7f82eeffd640 1 -- 172.21.15.96:0/1948022835 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f0030b60 con 0x7f82f80d2630 2024-06-02T23:47:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.580+0000 7f82fcb90640 1 -- 172.21.15.96:0/1948022835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f80c8b40 con 0x7f82f80d2630 2024-06-02T23:47:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.580+0000 7f82eeffd640 1 -- 172.21.15.96:0/1948022835 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0009450 con 0x7f82f80d2630 2024-06-02T23:47:34.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.580+0000 7f82fcb90640 1 -- 172.21.15.96:0/1948022835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f80c9100 con 0x7f82f80d2630 2024-06-02T23:47:34.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.581+0000 7f82fcb90640 1 -- 172.21.15.96:0/1948022835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f80683e0 con 0x7f82f80d2630 2024-06-02T23:47:34.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.581+0000 7f82eeffd640 1 -- 172.21.15.96:0/1948022835 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 6) ==== 90515+0+0 (secure 0 0 0) 0x7f82f0039040 con 0x7f82f80d2630 2024-06-02T23:47:34.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.582+0000 7f82eeffd640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f82d806be80 0x7f82d806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:34.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.582+0000 7f82f659c640 1 -- 172.21.15.96:0/1948022835 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f82d806be80 msgr2=0x7f82d806e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/1776728888 2024-06-02T23:47:34.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.582+0000 7f82eeffd640 1 -- 172.21.15.96:0/1948022835 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f82f00ac0e0 con 0x7f82f80d2630 2024-06-02T23:47:34.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.582+0000 7f82f659c640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f82d806be80 0x7f82d806e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:47:34.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.586+0000 7f82eeffd640 1 -- 172.21.15.96:0/1948022835 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f82f007a2b0 con 0x7f82f80d2630 2024-06-02T23:47:34.619 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:34.619+0000 7fd6ca642040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:47:34.633 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:34.633+0000 7fca91621040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:47:34.662 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:34.662+0000 7fd6ca642040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:47:34.677 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:34.677+0000 7fca91621040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:47:34.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.769+0000 7f82fcb90640 1 -- 172.21.15.96:0/1948022835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f82f8074ea0 con 0x7f82f80d2630 2024-06-02T23:47:34.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.773+0000 7f82eeffd640 1 -- 172.21.15.96:0/1948022835 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) ==== 133+0+0 (secure 0 0 0) 0x7f82f007e5b0 con 0x7f82f80d2630 2024-06-02T23:47:34.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 -- 172.21.15.96:0/1948022835 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f82d806be80 msgr2=0x7f82d806e340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:47:34.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f82d806be80 0x7f82d806e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 -- 172.21.15.96:0/1948022835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 msgr2=0x7f82f81f3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 0x7f82f81f3d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009d90 tx=0x7f82f0004a40 comp rx=0 tx=0).stop 2024-06-02T23:47:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 -- 172.21.15.96:0/1948022835 shutdown_connections 2024-06-02T23:47:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f82d806be80 0x7f82d806e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82f80d2630 0x7f82f81f3d90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82f80b4b50 0x7f82f81f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 --2- 172.21.15.96:0/1948022835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82f80b4640 0x7f82f80b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 -- 172.21.15.96:0/1948022835 >> 172.21.15.96:0/1948022835 conn(0x7f82f80d4050 msgr2=0x7f82f80d45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 -- 172.21.15.96:0/1948022835 shutdown_connections 2024-06-02T23:47:34.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:34.775+0000 7f82fcb90640 1 -- 172.21.15.96:0/1948022835 wait complete. 2024-06-02T23:47:34.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:34.786 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-06-02T23:47:34.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:34.805 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2024-06-02T23:47:34.864 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir0 1m 2024-06-02T23:47:35.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.008+0000 7f9cec942640 1 Processor -- start 2024-06-02T23:47:35.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.008+0000 7f9cec942640 1 -- start start 2024-06-02T23:47:35.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.009+0000 7f9cec942640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9ce80d2d40 0x7f9ce80b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.009+0000 7f9cec942640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce80cec60 con 0x7f9ce80b4b50 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.009+0000 7f9cec942640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce80d1fd0 con 0x7f9ce80b4640 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.009+0000 7f9cec942640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce80d4ff0 con 0x7f9ce80d2d40 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.009+0000 7f9ce5d9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9ce80b4b50 0x7f9ce80d2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48266/0 (socket says 172.21.15.96:48266) 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.009+0000 7f9ce5d9b640 1 -- 172.21.15.96:0/3455579056 learned_addr learned my addr 172.21.15.96:0/3455579056 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.009+0000 7f9ce6d9d640 1 --2- 172.21.15.96:0/3455579056 >> v2:172.21.15.162:3300/0 conn(0x7f9ce80d2d40 0x7f9ce80b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.009+0000 7f9ce559a640 1 -- 172.21.15.96:0/3455579056 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414295693 0 0) 0x7f9ce80cec60 con 0x7f9ce80b4b50 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.009+0000 7f9ce559a640 1 -- 172.21.15.96:0/3455579056 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd4003520 con 0x7f9ce80b4b50 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.010+0000 7f9ce559a640 1 -- 172.21.15.96:0/3455579056 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878399154 0 0) 0x7f9ce80d1fd0 con 0x7f9ce80b4640 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.010+0000 7f9ce6d9d640 1 -- 172.21.15.96:0/3455579056 >> v1:172.21.15.162:6789/0 conn(0x7f9ce80b4640 legacy=0x7f9ce80b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.010+0000 7f9ce6d9d640 1 -- 172.21.15.96:0/3455579056 >> v1:172.21.15.96:6789/0 conn(0x7f9ce80b4b50 legacy=0x7f9ce80d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.010+0000 7f9ce6d9d640 1 -- 172.21.15.96:0/3455579056 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce80d4d10 con 0x7f9ce80d2d40 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.010+0000 7f9ce6d9d640 1 --2- 172.21.15.96:0/3455579056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce80d2d40 0x7f9ce80b5000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009d90 tx=0x7f9ce002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbaa696af3380e36 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.010+0000 7f9ce559a640 1 -- 172.21.15.96:0/3455579056 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0031600 con 0x7f9ce80d2d40 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.011+0000 7f9ce559a640 1 -- 172.21.15.96:0/3455579056 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce00317a0 con 0x7f9ce80d2d40 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.011+0000 7f9ce559a640 1 -- 172.21.15.96:0/3455579056 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0031b70 con 0x7f9ce80d2d40 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.011+0000 7f9cec942640 1 -- 172.21.15.96:0/3455579056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce80d2d40 msgr2=0x7f9ce80b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.011+0000 7f9cec942640 1 --2- 172.21.15.96:0/3455579056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce80d2d40 0x7f9ce80b5000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009d90 tx=0x7f9ce002a5d0 comp rx=0 tx=0).stop 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.011+0000 7f9cec942640 1 -- 172.21.15.96:0/3455579056 shutdown_connections 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.011+0000 7f9cec942640 1 --2- 172.21.15.96:0/3455579056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce80d2d40 0x7f9ce80b5000 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.011+0000 7f9cec942640 1 -- 172.21.15.96:0/3455579056 >> 172.21.15.96:0/3455579056 conn(0x7f9ce80d4050 msgr2=0x7f9ce80d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.011+0000 7f9cec942640 1 -- 172.21.15.96:0/3455579056 shutdown_connections 2024-06-02T23:47:35.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.011+0000 7f9cec942640 1 -- 172.21.15.96:0/3455579056 wait complete. 2024-06-02T23:47:35.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.013+0000 7f9cec942640 1 Processor -- start 2024-06-02T23:47:35.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.013+0000 7f9cec942640 1 -- start start 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.013+0000 7f9cec942640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ce80b4640 0x7f9ce8152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.013+0000 7f9cec942640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ce80b4b50 0x7f9ce80b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.013+0000 7f9cec942640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce80d2d40 0x7f9ce80c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.013+0000 7f9cec942640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce80cf420 con 0x7f9ce80b4b50 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.013+0000 7f9cec942640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce80d13b0 con 0x7f9ce80d2d40 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.013+0000 7f9cec942640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce80cf5a0 con 0x7f9ce80b4640 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.013+0000 7f9ce5d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ce80b4b50 0x7f9ce80b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9ce5d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ce80b4b50 0x7f9ce80b6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46164/0 (socket says 172.21.15.96:46164) 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9ce5d9b640 1 -- 172.21.15.96:0/1958558575 learned_addr learned my addr 172.21.15.96:0/1958558575 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9ce6d9d640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce80d2d40 0x7f9ce80c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9ce659c640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ce80b4640 0x7f9ce8152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:35.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9ce5d9b640 1 -- 172.21.15.96:0/1958558575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ce80b4640 msgr2=0x7f9ce8152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9ce5d9b640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ce80b4640 0x7f9ce8152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9ce5d9b640 1 -- 172.21.15.96:0/1958558575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce80d2d40 msgr2=0x7f9ce80c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9ce5d9b640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce80d2d40 0x7f9ce80c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9ce5d9b640 1 -- 172.21.15.96:0/1958558575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce80b3aa0 con 0x7f9ce80b4b50 2024-06-02T23:47:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9ce5d9b640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ce80b4b50 0x7f9ce80b6c70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000c430 tx=0x7f9cd000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0017070 con 0x7f9ce80b4b50 2024-06-02T23:47:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd0005ce0 con 0x7f9ce80b4b50 2024-06-02T23:47:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9cec942640 1 -- 172.21.15.96:0/1958558575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce80c8df0 con 0x7f9ce80b4b50 2024-06-02T23:47:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00072f0 con 0x7f9ce80b4b50 2024-06-02T23:47:35.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.014+0000 7f9cec942640 1 -- 172.21.15.96:0/1958558575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce80c93b0 con 0x7f9ce80b4b50 2024-06-02T23:47:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.016+0000 7f9cec942640 1 -- 172.21.15.96:0/1958558575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce80d0780 con 0x7f9ce80b4b50 2024-06-02T23:47:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.016+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 6) ==== 90515+0+0 (secure 0 0 0) 0x7f9cd001a070 con 0x7f9ce80b4b50 2024-06-02T23:47:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.017+0000 7f9cdeffd640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 0x7f9cc806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.017+0000 7f9ce659c640 1 -- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 msgr2=0x7f9cc806e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/1776728888 2024-06-02T23:47:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.017+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9cd008a730 con 0x7f9ce80b4b50 2024-06-02T23:47:35.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.017+0000 7f9ce659c640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 0x7f9cc806e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:47:35.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.020+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9ce80d0780 con 0x7f9ce80b4b50 2024-06-02T23:47:35.153 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:35.154+0000 7fd6ca642040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:47:35.184 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:35.184+0000 7fca91621040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:47:35.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.218+0000 7f9ce659c640 1 -- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 msgr2=0x7f9cc806e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/1776728888 2024-06-02T23:47:35.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.218+0000 7f9ce659c640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 0x7f9cc806e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:47:35.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.226+0000 7f9cec942640 1 -- 172.21.15.96:0/1958558575 --> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir0", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9ce80d2410 con 0x7f9cc806be80 2024-06-02T23:47:35.237 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:35.237+0000 7fd6ca642040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:47:35.268 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:35.268+0000 7fca91621040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:47:35.279 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:35.279+0000 7fd6ca642040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:47:35.309 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:35.309+0000 7fca91621040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:47:35.441 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:35.441+0000 7fd6ca642040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:47:35.468 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:35.468+0000 7fca91621040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:47:35.485 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:35.485+0000 7fd6ca642040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:47:35.512 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:35.512+0000 7fca91621040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:47:35.534 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:35.534+0000 7fd6ca642040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:47:35.559 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:35.559+0000 7fca91621040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:47:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.619+0000 7f9ce659c640 1 -- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 msgr2=0x7f9cc806e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/1776728888 2024-06-02T23:47:35.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:35.619+0000 7f9ce659c640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 0x7f9cc806e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T23:47:35.645 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:35.646+0000 7fd6ca642040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:47:35.668 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:35.668+0000 7fca91621040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:47:35.962 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:35.962+0000 7fd6ca642040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:47:35.981 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:35.981+0000 7fca91621040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:47:36.169 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:36.169+0000 7fd6ca642040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:47:36.191 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:36.191+0000 7fca91621040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:47:36.218 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:36.218+0000 7fd6ca642040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:47:36.240 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:36.240+0000 7fca91621040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:47:36.332 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:36.332+0000 7fd6ca642040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:47:36.351 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:36.351+0000 7fca91621040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:47:36.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:36.420+0000 7f9ce659c640 1 -- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 msgr2=0x7f9cc806e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/1776728888 2024-06-02T23:47:36.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:36.420+0000 7f9ce659c640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 0x7f9cc806e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T23:47:36.599 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:36.599+0000 7fd6ca642040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:47:36.619 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:36.619+0000 7fca91621040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:47:36.642 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:36.642+0000 7fd6ca642040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:47:36.662 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:36.662+0000 7fca91621040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:47:36.783 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:36.784+0000 7fd6ca642040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:47:36.804 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:36.804+0000 7fca91621040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:47:36.914 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:36.914+0000 7fd6ca642040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:47:36.938 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:36.938+0000 7fca91621040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:47:36.962 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:36.962+0000 7fd6ca642040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:47:36.986 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:36.986+0000 7fca91621040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:47:37.014 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:37.014+0000 7fd6ca642040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:47:37.039 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.039+0000 7fca91621040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:47:37.056 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:37.056+0000 7fd6ca642040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:47:37.081 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.081+0000 7fca91621040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:47:37.441 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:37.441+0000 7fd6ca642040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:47:37.468 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.468+0000 7fca91621040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:47:37.556 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:47:37.556+0000 7fd6ca642040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:47:37.582 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.582+0000 7fca91621040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:47:37.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:37.590+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 7) ==== 90226+0+0 (secure 0 0 0) 0x7f9cd00550e0 con 0x7f9ce80b4b50 2024-06-02T23:47:37.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:37.590+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 msgr2=0x7f9cc806e340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:47:37.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:37.590+0000 7f9cdeffd640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/1776728888,v1:172.21.15.96:6833/1776728888] conn(0x7f9cc806be80 0x7f9cc806e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:37.762 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.762+0000 7fca104ac640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:47:37.762 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.762+0000 7fca104ac640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:47:37.762 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.762+0000 7fca104ac640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:47:37.763 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.762+0000 7fca104ac640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:47:37.763 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.762+0000 7fca104ac640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:47:37.763 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.762+0000 7fca0d4a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:47:37.763 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.762+0000 7fca0d4a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:47:37.763 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.762+0000 7fca0d4a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:47:37.763 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.762+0000 7fca0d4a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:47:37.763 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:47:37.762+0000 7fca0d4a6640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:47:38.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.594+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mgrmap(e 8) ==== 90353+0+0 (secure 0 0 0) 0x7f9cd0077d60 con 0x7f9ce80b4b50 2024-06-02T23:47:38.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.594+0000 7f9cdeffd640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9cc8074370 0x7f9cc8076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:38.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.594+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir0", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9cd001ae50 con 0x7f9cc8074370 2024-06-02T23:47:38.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.596+0000 7f9ce659c640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9cc8074370 0x7f9cc8076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:38.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.598+0000 7f9ce659c640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9cc8074370 0x7f9cc8076760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8000f60 tx=0x7f9cd8007d30 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:38.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.678+0000 7f9cdeffd640 1 -- 172.21.15.96:0/1958558575 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9cd001ae50 con 0x7f9cc8074370 2024-06-02T23:47:38.679 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path /snap_test_dir1/dir0 2024-06-02T23:47:38.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.680+0000 7f9cec942640 1 -- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9cc8074370 msgr2=0x7f9cc8076760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:38.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.680+0000 7f9cec942640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9cc8074370 0x7f9cc8076760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8000f60 tx=0x7f9cd8007d30 comp rx=0 tx=0).stop 2024-06-02T23:47:38.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.680+0000 7f9cec942640 1 -- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ce80b4b50 msgr2=0x7f9ce80b6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:38.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.680+0000 7f9cec942640 1 --2- 172.21.15.96:0/1958558575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ce80b4b50 0x7f9ce80b6c70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000c430 tx=0x7f9cd000c8f0 comp rx=0 tx=0).stop 2024-06-02T23:47:38.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.680+0000 7f9ce6d9d640 1 -- 172.21.15.96:0/1958558575 reap_dead start 2024-06-02T23:47:38.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.680+0000 7f9cec942640 1 -- 172.21.15.96:0/1958558575 shutdown_connections 2024-06-02T23:47:38.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.680+0000 7f9cec942640 1 -- 172.21.15.96:0/1958558575 >> 172.21.15.96:0/1958558575 conn(0x7f9ce80d4050 msgr2=0x7f9ce806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:38.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.681+0000 7f9cec942640 1 -- 172.21.15.96:0/1958558575 shutdown_connections 2024-06-02T23:47:38.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.681+0000 7f9cec942640 1 -- 172.21.15.96:0/1958558575 wait complete. 2024-06-02T23:47:38.693 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2024-06-02T23:47:38.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:38.693 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2024-06-02T23:47:38.711 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir1 1m 2024-06-02T23:47:38.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.852+0000 7f9124cae640 1 Processor -- start 2024-06-02T23:47:38.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.852+0000 7f9124cae640 1 -- start start 2024-06-02T23:47:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.853+0000 7f9124cae640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f91200b4b50 0x7f91200b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.853+0000 7f9124cae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 0x7f91200d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.853+0000 7f9124cae640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91200cec60 con 0x7f91200b4640 2024-06-02T23:47:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.853+0000 7f9124cae640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f91200d4ff0 con 0x7f91200b4b50 2024-06-02T23:47:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.853+0000 7f9124cae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f91200d1fd0 con 0x7f91200d2630 2024-06-02T23:47:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.853+0000 7f911dd9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f91200b4b50 0x7f91200b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.853+0000 7f911dd9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f91200b4b50 0x7f91200b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46284/0 (socket says 172.21.15.96:46284) 2024-06-02T23:47:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.853+0000 7f911dd9b640 1 -- 172.21.15.96:0/2669588542 learned_addr learned my addr 172.21.15.96:0/2669588542 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.854+0000 7f911ed9d640 1 --2- 172.21.15.96:0/2669588542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 0x7f91200d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.854+0000 7f911dd9b640 1 -- 172.21.15.96:0/2669588542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 msgr2=0x7f91200d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.854+0000 7f911dd9b640 1 --2- 172.21.15.96:0/2669588542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 0x7f91200d2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.854+0000 7f911dd9b640 1 -- 172.21.15.96:0/2669588542 >> v1:172.21.15.96:6789/0 conn(0x7f91200b4640 legacy=0x7f91200b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.854+0000 7f911dd9b640 1 -- 172.21.15.96:0/2669588542 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91200d4d10 con 0x7f91200b4b50 2024-06-02T23:47:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.854+0000 7f911dd9b640 1 --2- 172.21.15.96:0/2669588542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 0x7f91200b5000 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9108009870 tx=0x7f910802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa2dddbea9f15f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f911d59a640 1 -- 172.21.15.96:0/2669588542 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108037070 con 0x7f91200b4b50 2024-06-02T23:47:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f911d59a640 1 -- 172.21.15.96:0/2669588542 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9108032440 con 0x7f91200b4b50 2024-06-02T23:47:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f911d59a640 1 -- 172.21.15.96:0/2669588542 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108032810 con 0x7f91200b4b50 2024-06-02T23:47:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f9124cae640 1 -- 172.21.15.96:0/2669588542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 msgr2=0x7f91200b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f9124cae640 1 --2- 172.21.15.96:0/2669588542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 0x7f91200b5000 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9108009870 tx=0x7f910802a130 comp rx=0 tx=0).stop 2024-06-02T23:47:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f9124cae640 1 -- 172.21.15.96:0/2669588542 shutdown_connections 2024-06-02T23:47:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f9124cae640 1 --2- 172.21.15.96:0/2669588542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 0x7f91200d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f9124cae640 1 --2- 172.21.15.96:0/2669588542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 0x7f91200b5000 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f9124cae640 1 -- 172.21.15.96:0/2669588542 >> 172.21.15.96:0/2669588542 conn(0x7f91200d4050 msgr2=0x7f91200d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f9124cae640 1 -- 172.21.15.96:0/2669588542 shutdown_connections 2024-06-02T23:47:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.855+0000 7f9124cae640 1 -- 172.21.15.96:0/2669588542 wait complete. 2024-06-02T23:47:38.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.857+0000 7f9124cae640 1 Processor -- start 2024-06-02T23:47:38.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.857+0000 7f9124cae640 1 -- start start 2024-06-02T23:47:38.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.857+0000 7f9124cae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200b4640 0x7f91200b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:38.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.857+0000 7f9124cae640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 0x7f91200ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:38.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.857+0000 7f9124cae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 0x7f9120151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:38.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.857+0000 7f9124cae640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f91200cf420 con 0x7f91200b4b50 2024-06-02T23:47:38.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.857+0000 7f9124cae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91200d13b0 con 0x7f91200b4640 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.857+0000 7f9124cae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f91200cf5a0 con 0x7f91200d2630 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.857+0000 7f911dd9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 0x7f91200ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.857+0000 7f911dd9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 0x7f91200ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46288/0 (socket says 172.21.15.96:46288) 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911dd9b640 1 -- 172.21.15.96:0/2875083601 learned_addr learned my addr 172.21.15.96:0/2875083601 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911ed9d640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 0x7f9120151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911e59c640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200b4640 0x7f91200b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911dd9b640 1 -- 172.21.15.96:0/2875083601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 msgr2=0x7f9120151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911dd9b640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 0x7f9120151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911dd9b640 1 -- 172.21.15.96:0/2875083601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200b4640 msgr2=0x7f91200b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911dd9b640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200b4640 0x7f91200b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911dd9b640 1 -- 172.21.15.96:0/2875083601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912014ed50 con 0x7f91200b4b50 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911ed9d640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 0x7f9120151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911e59c640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200b4640 0x7f91200b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:38.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f911dd9b640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 0x7f91200ca660 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9108000c00 tx=0x7f91080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f9116ffd640 1 -- 172.21.15.96:0/2875083601 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108037040 con 0x7f91200b4b50 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f9116ffd640 1 -- 172.21.15.96:0/2875083601 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9108042070 con 0x7f91200b4b50 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f9124cae640 1 -- 172.21.15.96:0/2875083601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9120151c40 con 0x7f91200b4b50 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f9116ffd640 1 -- 172.21.15.96:0/2875083601 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91080309a0 con 0x7f91200b4b50 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.858+0000 7f9124cae640 1 -- 172.21.15.96:0/2875083601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f912014f2a0 con 0x7f91200b4b50 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.859+0000 7f9124cae640 1 -- 172.21.15.96:0/2875083601 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91200683e0 con 0x7f91200b4b50 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.860+0000 7f9116ffd640 1 -- 172.21.15.96:0/2875083601 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) ==== 90353+0+0 (secure 0 0 0) 0x7f9108030b40 con 0x7f91200b4b50 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.860+0000 7f9116ffd640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f910006bd00 0x7f910006e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.860+0000 7f9116ffd640 1 -- 172.21.15.96:0/2875083601 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f91080ab820 con 0x7f91200b4b50 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.860+0000 7f911e59c640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f910006bd00 0x7f910006e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.860+0000 7f911e59c640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f910006bd00 0x7f910006e1c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9110001d70 tx=0x7f9110009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:38.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:38.864+0000 7f9116ffd640 1 -- 172.21.15.96:0/2875083601 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9108045360 con 0x7f91200b4b50 2024-06-02T23:47:39.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.056+0000 7f9124cae640 1 -- 172.21.15.96:0/2875083601 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir1", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9120073790 con 0x7f910006bd00 2024-06-02T23:47:39.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.116+0000 7f9116ffd640 1 -- 172.21.15.96:0/2875083601 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9120073790 con 0x7f910006bd00 2024-06-02T23:47:39.117 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path /snap_test_dir1/dir1 2024-06-02T23:47:39.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 -- 172.21.15.96:0/2875083601 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f910006bd00 msgr2=0x7f910006e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f910006bd00 0x7f910006e1c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9110001d70 tx=0x7f9110009040 comp rx=0 tx=0).stop 2024-06-02T23:47:39.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 -- 172.21.15.96:0/2875083601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 msgr2=0x7f91200ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 0x7f91200ca660 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9108000c00 tx=0x7f91080046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 -- 172.21.15.96:0/2875083601 shutdown_connections 2024-06-02T23:47:39.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f910006bd00 0x7f910006e1c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91200d2630 0x7f9120151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91200b4b50 0x7f91200ca660 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 --2- 172.21.15.96:0/2875083601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200b4640 0x7f91200b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 -- 172.21.15.96:0/2875083601 >> 172.21.15.96:0/2875083601 conn(0x7f91200d4050 msgr2=0x7f91200d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:39.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 -- 172.21.15.96:0/2875083601 shutdown_connections 2024-06-02T23:47:39.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.118+0000 7f9124cae640 1 -- 172.21.15.96:0/2875083601 wait complete. 2024-06-02T23:47:39.130 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2024-06-02T23:47:39.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:39.130 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2024-06-02T23:47:39.147 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir2 1m 2024-06-02T23:47:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.290+0000 7f0bc4f90640 1 Processor -- start 2024-06-02T23:47:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.290+0000 7f0bc4f90640 1 -- start start 2024-06-02T23:47:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0bc015e530 0x7f0bc00cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0bc006ed20 0x7f0bc00cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc00723e0 con 0x7f0bc00cb2a0 2024-06-02T23:47:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc00cb7b0 con 0x7f0bc015e530 2024-06-02T23:47:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc0072680 con 0x7f0bc006ed20 2024-06-02T23:47:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbe59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0bc015e530 0x7f0bc00cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbe59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0bc015e530 0x7f0bc00cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46300/0 (socket says 172.21.15.96:46300) 2024-06-02T23:47:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbe59c640 1 -- 172.21.15.96:0/2727979144 learned_addr learned my addr 172.21.15.96:0/2727979144 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbed9d640 1 --2- 172.21.15.96:0/2727979144 >> v2:172.21.15.162:3300/0 conn(0x7f0bc006ed20 0x7f0bc00cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbe59c640 1 -- 172.21.15.96:0/2727979144 >> v2:172.21.15.162:3300/0 conn(0x7f0bc006ed20 msgr2=0x7f0bc00cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbe59c640 1 --2- 172.21.15.96:0/2727979144 >> v2:172.21.15.162:3300/0 conn(0x7f0bc006ed20 0x7f0bc00cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbe59c640 1 -- 172.21.15.96:0/2727979144 >> v1:172.21.15.162:6789/0 conn(0x7f0bc00cb2a0 legacy=0x7f0bc006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbe59c640 1 -- 172.21.15.96:0/2727979144 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc0072960 con 0x7f0bc015e530 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbe59c640 1 --2- 172.21.15.96:0/2727979144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc015e530 0x7f0bc00cad60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0bc006c940 tx=0x7f0bb002c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0ff6c571e5bb3c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbdd9b640 1 -- 172.21.15.96:0/2727979144 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0031710 con 0x7f0bc015e530 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbdd9b640 1 -- 172.21.15.96:0/2727979144 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb00318b0 con 0x7f0bc015e530 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bbdd9b640 1 -- 172.21.15.96:0/2727979144 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0031c80 con 0x7f0bc015e530 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 -- 172.21.15.96:0/2727979144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc015e530 msgr2=0x7f0bc00cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 --2- 172.21.15.96:0/2727979144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc015e530 0x7f0bc00cad60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0bc006c940 tx=0x7f0bb002c7a0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 -- 172.21.15.96:0/2727979144 shutdown_connections 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 --2- 172.21.15.96:0/2727979144 >> v2:172.21.15.162:3300/0 conn(0x7f0bc006ed20 0x7f0bc00cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 --2- 172.21.15.96:0/2727979144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc015e530 0x7f0bc00cad60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 -- 172.21.15.96:0/2727979144 >> 172.21.15.96:0/2727979144 conn(0x7f0bc00cfcb0 msgr2=0x7f0bc00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 -- 172.21.15.96:0/2727979144 shutdown_connections 2024-06-02T23:47:39.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.292+0000 7f0bc4f90640 1 -- 172.21.15.96:0/2727979144 wait complete. 2024-06-02T23:47:39.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.294+0000 7f0bc4f90640 1 Processor -- start 2024-06-02T23:47:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.294+0000 7f0bc4f90640 1 -- start start 2024-06-02T23:47:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.294+0000 7f0bc4f90640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc006ed20 0x7f0bc014dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bc4f90640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bc00cb2a0 0x7f0bc00b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bc4f90640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bc015e530 0x7f0bc00c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bc4f90640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc0073160 con 0x7f0bc006ed20 2024-06-02T23:47:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bc4f90640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc015e910 con 0x7f0bc015e530 2024-06-02T23:47:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bc4f90640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc006d120 con 0x7f0bc00cb2a0 2024-06-02T23:47:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bbe59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc006ed20 0x7f0bc014dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bbe59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc006ed20 0x7f0bc014dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46316/0 (socket says 172.21.15.96:46316) 2024-06-02T23:47:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bbe59c640 1 -- 172.21.15.96:0/3815294564 learned_addr learned my addr 172.21.15.96:0/3815294564 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bb5d9b640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bc00cb2a0 0x7f0bc00b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bbed9d640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bc015e530 0x7f0bc00c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bbe59c640 1 -- 172.21.15.96:0/3815294564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bc00cb2a0 msgr2=0x7f0bc00b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bbe59c640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bc00cb2a0 0x7f0bc00b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bbe59c640 1 -- 172.21.15.96:0/3815294564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bc015e530 msgr2=0x7f0bc00c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bbe59c640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bc015e530 0x7f0bc00c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bbe59c640 1 -- 172.21.15.96:0/3815294564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc00c6520 con 0x7f0bc006ed20 2024-06-02T23:47:39.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bbe59c640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc006ed20 0x7f0bc014dce0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000bbd0 tx=0x7f0bb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:39.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bb77fe640 1 -- 172.21.15.96:0/3815294564 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0040070 con 0x7f0bc006ed20 2024-06-02T23:47:39.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bb77fe640 1 -- 172.21.15.96:0/3815294564 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb0033bc0 con 0x7f0bc006ed20 2024-06-02T23:47:39.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bc4f90640 1 -- 172.21.15.96:0/3815294564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc01e3940 con 0x7f0bc006ed20 2024-06-02T23:47:39.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bb77fe640 1 -- 172.21.15.96:0/3815294564 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb003c440 con 0x7f0bc006ed20 2024-06-02T23:47:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bc4f90640 1 -- 172.21.15.96:0/3815294564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc01e3f00 con 0x7f0bc006ed20 2024-06-02T23:47:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.296+0000 7f0bc4f90640 1 -- 172.21.15.96:0/3815294564 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc00683e0 con 0x7f0bc006ed20 2024-06-02T23:47:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.297+0000 7f0bb77fe640 1 -- 172.21.15.96:0/3815294564 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) ==== 90353+0+0 (secure 0 0 0) 0x7f0bb0043070 con 0x7f0bc006ed20 2024-06-02T23:47:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.297+0000 7f0bb77fe640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0ba006bcd0 0x7f0ba006e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.297+0000 7f0bb77fe640 1 -- 172.21.15.96:0/3815294564 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f0bb00ab860 con 0x7f0bc006ed20 2024-06-02T23:47:39.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.297+0000 7f0bb5d9b640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0ba006bcd0 0x7f0ba006e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.298+0000 7f0bb5d9b640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0ba006bcd0 0x7f0ba006e190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00af0c0 tx=0x7f0ba8007e30 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:39.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.301+0000 7f0bb77fe640 1 -- 172.21.15.96:0/3815294564 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0bb0079c70 con 0x7f0bc006ed20 2024-06-02T23:47:39.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.497+0000 7f0bc4f90640 1 -- 172.21.15.96:0/3815294564 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir2", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f0bc006cd40 con 0x7f0ba006bcd0 2024-06-02T23:47:39.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.555+0000 7f0bb77fe640 1 -- 172.21.15.96:0/3815294564 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f0bc006cd40 con 0x7f0ba006bcd0 2024-06-02T23:47:39.555 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path /snap_test_dir1/dir2 2024-06-02T23:47:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 -- 172.21.15.96:0/3815294564 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0ba006bcd0 msgr2=0x7f0ba006e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0ba006bcd0 0x7f0ba006e190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00af0c0 tx=0x7f0ba8007e30 comp rx=0 tx=0).stop 2024-06-02T23:47:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 -- 172.21.15.96:0/3815294564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc006ed20 msgr2=0x7f0bc014dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc006ed20 0x7f0bc014dce0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000bbd0 tx=0x7f0bb00046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 -- 172.21.15.96:0/3815294564 shutdown_connections 2024-06-02T23:47:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0ba006bcd0 0x7f0ba006e190 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0bc015e530 0x7f0bc00c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bc00cb2a0 0x7f0bc00b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 --2- 172.21.15.96:0/3815294564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bc006ed20 0x7f0bc014dce0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 -- 172.21.15.96:0/3815294564 >> 172.21.15.96:0/3815294564 conn(0x7f0bc00cfcb0 msgr2=0x7f0bc00b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 -- 172.21.15.96:0/3815294564 shutdown_connections 2024-06-02T23:47:39.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.557+0000 7f0bc4f90640 1 -- 172.21.15.96:0/3815294564 wait complete. 2024-06-02T23:47:39.568 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2024-06-02T23:47:39.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:39.568 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2024-06-02T23:47:39.585 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir3 1m 2024-06-02T23:47:39.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.730+0000 7f83fc9f9640 1 Processor -- start 2024-06-02T23:47:39.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.730+0000 7f83fc9f9640 1 -- start start 2024-06-02T23:47:39.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.731+0000 7f83fc9f9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f83f80b4640 0x7f83f80b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.731+0000 7f83fc9f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80d2d40 0x7f83f80b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.731+0000 7f83fc9f9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83f80b73e0 con 0x7f83f80b4b50 2024-06-02T23:47:39.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.731+0000 7f83fc9f9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f83f80d4ff0 con 0x7f83f80b4640 2024-06-02T23:47:39.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.731+0000 7f83fc9f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f83f80cec60 con 0x7f83f80d2d40 2024-06-02T23:47:39.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.732+0000 7f83f5d9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f83f80b4b50 0x7f83f80d2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48290/0 (socket says 172.21.15.96:48290) 2024-06-02T23:47:39.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.732+0000 7f83f5d9b640 1 -- 172.21.15.96:0/1213631358 learned_addr learned my addr 172.21.15.96:0/1213631358 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:39.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.732+0000 7f83f659c640 1 --2- 172.21.15.96:0/1213631358 >> v2:172.21.15.162:3300/0 conn(0x7f83f80b4640 0x7f83f80b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.732+0000 7f83f6d9d640 1 --2- 172.21.15.96:0/1213631358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80d2d40 0x7f83f80b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.732+0000 7f83f559a640 1 -- 172.21.15.96:0/1213631358 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1401022055 0 0) 0x7f83f80b73e0 con 0x7f83f80b4b50 2024-06-02T23:47:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.732+0000 7f83f559a640 1 -- 172.21.15.96:0/1213631358 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83e0003520 con 0x7f83f80b4b50 2024-06-02T23:47:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.732+0000 7f83f659c640 1 -- 172.21.15.96:0/1213631358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80d2d40 msgr2=0x7f83f80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.732+0000 7f83f659c640 1 --2- 172.21.15.96:0/1213631358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80d2d40 0x7f83f80b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.732+0000 7f83f659c640 1 -- 172.21.15.96:0/1213631358 >> v1:172.21.15.96:6789/0 conn(0x7f83f80b4b50 legacy=0x7f83f80d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.732+0000 7f83f659c640 1 -- 172.21.15.96:0/1213631358 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f80d1fd0 con 0x7f83f80b4640 2024-06-02T23:47:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.733+0000 7f83f659c640 1 --2- 172.21.15.96:0/1213631358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80b4640 0x7f83f80b6ea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83e80097a0 tx=0x7f83e802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a340f7136fda68 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:39.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.733+0000 7f83f559a640 1 -- 172.21.15.96:0/1213631358 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8037070 con 0x7f83f80b4640 2024-06-02T23:47:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.733+0000 7f83f559a640 1 -- 172.21.15.96:0/1213631358 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e802adb0 con 0x7f83f80b4640 2024-06-02T23:47:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.733+0000 7f83f559a640 1 -- 172.21.15.96:0/1213631358 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8032640 con 0x7f83f80b4640 2024-06-02T23:47:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.733+0000 7f83fc9f9640 1 -- 172.21.15.96:0/1213631358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80b4640 msgr2=0x7f83f80b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.733+0000 7f83fc9f9640 1 --2- 172.21.15.96:0/1213631358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80b4640 0x7f83f80b6ea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83e80097a0 tx=0x7f83e802a060 comp rx=0 tx=0).stop 2024-06-02T23:47:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.733+0000 7f83fc9f9640 1 -- 172.21.15.96:0/1213631358 shutdown_connections 2024-06-02T23:47:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.734+0000 7f83fc9f9640 1 --2- 172.21.15.96:0/1213631358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80d2d40 0x7f83f80b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.734+0000 7f83fc9f9640 1 --2- 172.21.15.96:0/1213631358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80b4640 0x7f83f80b6ea0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.734+0000 7f83fc9f9640 1 -- 172.21.15.96:0/1213631358 >> 172.21.15.96:0/1213631358 conn(0x7f83f80d4050 msgr2=0x7f83f80d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:39.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.734+0000 7f83fc9f9640 1 -- 172.21.15.96:0/1213631358 shutdown_connections 2024-06-02T23:47:39.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.734+0000 7f83fc9f9640 1 -- 172.21.15.96:0/1213631358 wait complete. 2024-06-02T23:47:39.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.735+0000 7f83fc9f9640 1 Processor -- start 2024-06-02T23:47:39.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.735+0000 7f83fc9f9640 1 -- start start 2024-06-02T23:47:39.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83fc9f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80b4640 0x7f83f8157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83fc9f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80b4b50 0x7f83f80b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83fc9f9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f80d2d40 0x7f83f80d3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83fc9f9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f83f80d13b0 con 0x7f83f80d2d40 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83fc9f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f83f80cef00 con 0x7f83f80b4640 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83fc9f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f83f80cf420 con 0x7f83f80b4b50 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f80d2d40 0x7f83f80d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f80d2d40 0x7f83f80d3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46344/0 (socket says 172.21.15.96:46344) 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f6d9d640 1 -- 172.21.15.96:0/3814736433 learned_addr learned my addr 172.21.15.96:0/3814736433 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f5d9b640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80b4b50 0x7f83f80b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f659c640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80b4640 0x7f83f8157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f6d9d640 1 -- 172.21.15.96:0/3814736433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80b4b50 msgr2=0x7f83f80b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f6d9d640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80b4b50 0x7f83f80b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f6d9d640 1 -- 172.21.15.96:0/3814736433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80b4640 msgr2=0x7f83f8157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f6d9d640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80b4640 0x7f83f8157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:39.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f6d9d640 1 -- 172.21.15.96:0/3814736433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f80b1fd0 con 0x7f83f80d2d40 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f659c640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80b4640 0x7f83f8157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83f6d9d640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f80d2d40 0x7f83f80d3160 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f83f000efc0 tx=0x7f83f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83e6ffd640 1 -- 172.21.15.96:0/3814736433 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0018020 con 0x7f83f80d2d40 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83e6ffd640 1 -- 172.21.15.96:0/3814736433 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f0014480 con 0x7f83f80d2d40 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83fc9f9640 1 -- 172.21.15.96:0/3814736433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f80b8190 con 0x7f83f80d2d40 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83e6ffd640 1 -- 172.21.15.96:0/3814736433 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0009e60 con 0x7f83f80d2d40 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.736+0000 7f83fc9f9640 1 -- 172.21.15.96:0/3814736433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f80b2270 con 0x7f83f80d2d40 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.737+0000 7f83fc9f9640 1 -- 172.21.15.96:0/3814736433 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f80683e0 con 0x7f83f80d2d40 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.738+0000 7f83e6ffd640 1 -- 172.21.15.96:0/3814736433 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 9) ==== 90618+0+0 (secure 0 0 0) 0x7f83f0005d10 con 0x7f83f80d2d40 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.738+0000 7f83e6ffd640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f83d806bfa0 0x7f83d806e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.738+0000 7f83e6ffd640 1 -- 172.21.15.96:0/3814736433 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f83f008c0c0 con 0x7f83f80d2d40 2024-06-02T23:47:39.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.738+0000 7f83f659c640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f83d806bfa0 0x7f83d806e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:39.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.739+0000 7f83f659c640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f83d806bfa0 0x7f83d806e460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f83e8034000 tx=0x7f83e802e000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:39.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.743+0000 7f83e6ffd640 1 -- 172.21.15.96:0/3814736433 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f83f0022030 con 0x7f83f80d2d40 2024-06-02T23:47:39.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:39.936+0000 7f83fc9f9640 1 -- 172.21.15.96:0/3814736433 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir3", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f83f80b9ee0 con 0x7f83d806bfa0 2024-06-02T23:47:40.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.000+0000 7f83e6ffd640 1 -- 172.21.15.96:0/3814736433 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f83f80b9ee0 con 0x7f83d806bfa0 2024-06-02T23:47:40.000 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path /snap_test_dir1/dir3 2024-06-02T23:47:40.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 -- 172.21.15.96:0/3814736433 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f83d806bfa0 msgr2=0x7f83d806e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f83d806bfa0 0x7f83d806e460 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f83e8034000 tx=0x7f83e802e000 comp rx=0 tx=0).stop 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 -- 172.21.15.96:0/3814736433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f80d2d40 msgr2=0x7f83f80d3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f80d2d40 0x7f83f80d3160 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f83f000efc0 tx=0x7f83f000c490 comp rx=0 tx=0).stop 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 -- 172.21.15.96:0/3814736433 shutdown_connections 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f83d806bfa0 0x7f83d806e460 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f80d2d40 0x7f83f80d3160 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83f80b4b50 0x7f83f80b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 --2- 172.21.15.96:0/3814736433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83f80b4640 0x7f83f8157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 -- 172.21.15.96:0/3814736433 >> 172.21.15.96:0/3814736433 conn(0x7f83f80d4050 msgr2=0x7f83f806d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 -- 172.21.15.96:0/3814736433 shutdown_connections 2024-06-02T23:47:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.002+0000 7f83fc9f9640 1 -- 172.21.15.96:0/3814736433 wait complete. 2024-06-02T23:47:40.013 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2024-06-02T23:47:40.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:40.013 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2024-06-02T23:47:40.030 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir4 1m 2024-06-02T23:47:40.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.172+0000 7f4969e4d640 1 Processor -- start 2024-06-02T23:47:40.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.172+0000 7f4969e4d640 1 -- start start 2024-06-02T23:47:40.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.173+0000 7f4969e4d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640d0690 0x7f49640cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.173+0000 7f4969e4d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f49640cda70 0x7f49640b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.173+0000 7f4969e4d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49640738a0 con 0x7f49640af430 2024-06-02T23:47:40.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.173+0000 7f4969e4d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4964073670 con 0x7f49640cda70 2024-06-02T23:47:40.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.173+0000 7f4969e4d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f49640af980 con 0x7f49640d0690 2024-06-02T23:47:40.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.174+0000 7f49637fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640d0690 0x7f49640cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.174+0000 7f4962ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f49640cda70 0x7f49640b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.174+0000 7f4963fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f49640af430 0x7f496415bcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:34518/0 (socket says 172.21.15.96:34518) 2024-06-02T23:47:40.174 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.174+0000 7f4963fff640 1 -- 172.21.15.96:0/3622357189 learned_addr learned my addr 172.21.15.96:0/3622357189 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:40.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.174+0000 7f4962ffd640 1 -- 172.21.15.96:0/3622357189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640d0690 msgr2=0x7f49640cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:40.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.174+0000 7f4962ffd640 1 --2- 172.21.15.96:0/3622357189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640d0690 0x7f49640cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.174+0000 7f4962ffd640 1 -- 172.21.15.96:0/3622357189 >> v1:172.21.15.162:6789/0 conn(0x7f49640af430 legacy=0x7f496415bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.174+0000 7f49627fc640 1 -- 172.21.15.96:0/3622357189 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050620551 0 0) 0x7f49640738a0 con 0x7f49640af430 2024-06-02T23:47:40.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.174+0000 7f4962ffd640 1 -- 172.21.15.96:0/3622357189 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49640afc60 con 0x7f49640cda70 2024-06-02T23:47:40.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.174+0000 7f49637fe640 1 --2- 172.21.15.96:0/3622357189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640d0690 0x7f49640cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:47:40.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f4962ffd640 1 --2- 172.21.15.96:0/3622357189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49640cda70 0x7f49640b0180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f49580097a0 tx=0x7f495802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff9bd2611fb68d03 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:40.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f49627fc640 1 -- 172.21.15.96:0/3622357189 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4958037070 con 0x7f49640cda70 2024-06-02T23:47:40.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f49627fc640 1 -- 172.21.15.96:0/3622357189 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4958032440 con 0x7f49640cda70 2024-06-02T23:47:40.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f49627fc640 1 -- 172.21.15.96:0/3622357189 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4958032810 con 0x7f49640cda70 2024-06-02T23:47:40.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f4969e4d640 1 -- 172.21.15.96:0/3622357189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49640cda70 msgr2=0x7f49640b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f4969e4d640 1 --2- 172.21.15.96:0/3622357189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49640cda70 0x7f49640b0180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f49580097a0 tx=0x7f495802a180 comp rx=0 tx=0).stop 2024-06-02T23:47:40.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f4969e4d640 1 -- 172.21.15.96:0/3622357189 shutdown_connections 2024-06-02T23:47:40.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f4969e4d640 1 --2- 172.21.15.96:0/3622357189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49640cda70 0x7f49640b0180 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f4969e4d640 1 --2- 172.21.15.96:0/3622357189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640d0690 0x7f49640cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f4969e4d640 1 -- 172.21.15.96:0/3622357189 >> 172.21.15.96:0/3622357189 conn(0x7f4964072b50 msgr2=0x7f4964072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:40.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f4969e4d640 1 -- 172.21.15.96:0/3622357189 shutdown_connections 2024-06-02T23:47:40.177 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.175+0000 7f4969e4d640 1 -- 172.21.15.96:0/3622357189 wait complete. 2024-06-02T23:47:40.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.176+0000 7f4969e4d640 1 Processor -- start 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.177+0000 7f4969e4d640 1 -- start start 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.177+0000 7f4969e4d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49640af430 0x7f496415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.177+0000 7f4969e4d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640cda70 0x7f49640cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.177+0000 7f4969e4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49640d0690 0x7f49640cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.177+0000 7f4969e4d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f49640d12d0 con 0x7f49640af430 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.177+0000 7f4969e4d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f49640cd010 con 0x7f49640d0690 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.177+0000 7f4969e4d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f49640b1c00 con 0x7f49640cda70 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.177+0000 7f49637fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49640af430 0x7f496415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f49637fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49640af430 0x7f496415ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46346/0 (socket says 172.21.15.96:46346) 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f49637fe640 1 -- 172.21.15.96:0/2837610508 learned_addr learned my addr 172.21.15.96:0/2837610508 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f4963fff640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49640d0690 0x7f49640cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f4962ffd640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640cda70 0x7f49640cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f49637fe640 1 -- 172.21.15.96:0/2837610508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640cda70 msgr2=0x7f49640cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f49637fe640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640cda70 0x7f49640cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f49637fe640 1 -- 172.21.15.96:0/2837610508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49640d0690 msgr2=0x7f49640cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f49637fe640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49640d0690 0x7f49640cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f49637fe640 1 -- 172.21.15.96:0/2837610508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49641f8550 con 0x7f49640af430 2024-06-02T23:47:40.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f49637fe640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49640af430 0x7f496415ded0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f495400e960 tx=0x7f495400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:40.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f494bfff640 1 -- 172.21.15.96:0/2837610508 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4954017070 con 0x7f49640af430 2024-06-02T23:47:40.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f494bfff640 1 -- 172.21.15.96:0/2837610508 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495400ca00 con 0x7f49640af430 2024-06-02T23:47:40.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f494bfff640 1 -- 172.21.15.96:0/2837610508 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495400cdd0 con 0x7f49640af430 2024-06-02T23:47:40.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f4969e4d640 1 -- 172.21.15.96:0/2837610508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49641f7790 con 0x7f49640af430 2024-06-02T23:47:40.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.178+0000 7f4969e4d640 1 -- 172.21.15.96:0/2837610508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49641f7d50 con 0x7f49640af430 2024-06-02T23:47:40.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.180+0000 7f4969e4d640 1 -- 172.21.15.96:0/2837610508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49640683e0 con 0x7f49640af430 2024-06-02T23:47:40.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.180+0000 7f494bfff640 1 -- 172.21.15.96:0/2837610508 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 9) ==== 90618+0+0 (secure 0 0 0) 0x7f495401a070 con 0x7f49640af430 2024-06-02T23:47:40.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.180+0000 7f494bfff640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f495006bfa0 0x7f495006e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.180+0000 7f494bfff640 1 -- 172.21.15.96:0/2837610508 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f495408b480 con 0x7f49640af430 2024-06-02T23:47:40.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.180+0000 7f4962ffd640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f495006bfa0 0x7f495006e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.181+0000 7f4962ffd640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f495006bfa0 0x7f495006e460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4958034000 tx=0x7f495802e000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:40.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.185+0000 7f494bfff640 1 -- 172.21.15.96:0/2837610508 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4954059440 con 0x7f49640af430 2024-06-02T23:47:40.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.378+0000 7f4969e4d640 1 -- 172.21.15.96:0/2837610508 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir4", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f4964067270 con 0x7f495006bfa0 2024-06-02T23:47:40.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.446+0000 7f494bfff640 1 -- 172.21.15.96:0/2837610508 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f4964067270 con 0x7f495006bfa0 2024-06-02T23:47:40.447 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path /snap_test_dir1/dir4 2024-06-02T23:47:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.448+0000 7f4969e4d640 1 -- 172.21.15.96:0/2837610508 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f495006bfa0 msgr2=0x7f495006e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.448+0000 7f4969e4d640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f495006bfa0 0x7f495006e460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4958034000 tx=0x7f495802e000 comp rx=0 tx=0).stop 2024-06-02T23:47:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.448+0000 7f4969e4d640 1 -- 172.21.15.96:0/2837610508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49640af430 msgr2=0x7f496415ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.448+0000 7f4969e4d640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49640af430 0x7f496415ded0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f495400e960 tx=0x7f495400ee20 comp rx=0 tx=0).stop 2024-06-02T23:47:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.448+0000 7f4969e4d640 1 -- 172.21.15.96:0/2837610508 shutdown_connections 2024-06-02T23:47:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.448+0000 7f4969e4d640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f495006bfa0 0x7f495006e460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.448+0000 7f4969e4d640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49640d0690 0x7f49640cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.448+0000 7f4969e4d640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49640cda70 0x7f49640cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.448+0000 7f4969e4d640 1 --2- 172.21.15.96:0/2837610508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49640af430 0x7f496415ded0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.448+0000 7f4969e4d640 1 -- 172.21.15.96:0/2837610508 >> 172.21.15.96:0/2837610508 conn(0x7f4964072b50 msgr2=0x7f496415f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:40.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.449+0000 7f4969e4d640 1 -- 172.21.15.96:0/2837610508 shutdown_connections 2024-06-02T23:47:40.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.449+0000 7f4969e4d640 1 -- 172.21.15.96:0/2837610508 wait complete. 2024-06-02T23:47:40.459 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2024-06-02T23:47:40.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:40.460 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2024-06-02T23:47:40.477 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir5 1m 2024-06-02T23:47:40.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.620+0000 7f9d33314640 1 Processor -- start 2024-06-02T23:47:40.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.620+0000 7f9d33314640 1 -- start start 2024-06-02T23:47:40.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d33314640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9d2c0b4b50 0x7f9d2c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d33314640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9d2c0d2630 0x7f9d2c0d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d33314640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2c0cec60 con 0x7f9d2c0b4640 2024-06-02T23:47:40.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d33314640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2c0d2fe0 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d33314640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2c0d4ff0 con 0x7f9d2c0d2630 2024-06-02T23:47:40.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d308af640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9d2c0b4b50 0x7f9d2c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d308af640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9d2c0b4b50 0x7f9d2c0b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46350/0 (socket says 172.21.15.96:46350) 2024-06-02T23:47:40.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d308af640 1 -- 172.21.15.96:0/1287722385 learned_addr learned my addr 172.21.15.96:0/1287722385 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:40.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d318b1640 1 --2- 172.21.15.96:0/1287722385 >> v2:172.21.15.162:3300/0 conn(0x7f9d2c0d2630 0x7f9d2c0d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d308af640 1 -- 172.21.15.96:0/1287722385 >> v2:172.21.15.162:3300/0 conn(0x7f9d2c0d2630 msgr2=0x7f9d2c0d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:40.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d308af640 1 --2- 172.21.15.96:0/1287722385 >> v2:172.21.15.162:3300/0 conn(0x7f9d2c0d2630 0x7f9d2c0d2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d308af640 1 -- 172.21.15.96:0/1287722385 >> v1:172.21.15.162:6789/0 conn(0x7f9d2c0b4640 legacy=0x7f9d2c0b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.621+0000 7f9d308af640 1 -- 172.21.15.96:0/1287722385 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c0d1fd0 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.622+0000 7f9d308af640 1 --2- 172.21.15.96:0/1287722385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 0x7f9d2c0b5000 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c08c6a0 tx=0x7f9d1c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75af4114b32eef3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:40.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.622+0000 7f9d23fff640 1 -- 172.21.15.96:0/1287722385 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c037070 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.622+0000 7f9d23fff640 1 -- 172.21.15.96:0/1287722385 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c032440 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.622+0000 7f9d23fff640 1 -- 172.21.15.96:0/1287722385 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c032810 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.623+0000 7f9d33314640 1 -- 172.21.15.96:0/1287722385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 msgr2=0x7f9d2c0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.623+0000 7f9d33314640 1 --2- 172.21.15.96:0/1287722385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 0x7f9d2c0b5000 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c08c6a0 tx=0x7f9d1c02a150 comp rx=0 tx=0).stop 2024-06-02T23:47:40.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.623+0000 7f9d33314640 1 -- 172.21.15.96:0/1287722385 shutdown_connections 2024-06-02T23:47:40.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.623+0000 7f9d33314640 1 --2- 172.21.15.96:0/1287722385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 0x7f9d2c0b5000 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.623+0000 7f9d33314640 1 --2- 172.21.15.96:0/1287722385 >> v2:172.21.15.162:3300/0 conn(0x7f9d2c0d2630 0x7f9d2c0d2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.623+0000 7f9d33314640 1 -- 172.21.15.96:0/1287722385 >> 172.21.15.96:0/1287722385 conn(0x7f9d2c0d4050 msgr2=0x7f9d2c0d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:40.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.623+0000 7f9d33314640 1 -- 172.21.15.96:0/1287722385 shutdown_connections 2024-06-02T23:47:40.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.623+0000 7f9d33314640 1 -- 172.21.15.96:0/1287722385 wait complete. 2024-06-02T23:47:40.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.624+0000 7f9d33314640 1 Processor -- start 2024-06-02T23:47:40.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.624+0000 7f9d33314640 1 -- start start 2024-06-02T23:47:40.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d33314640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b4640 0x7f9d2c1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d33314640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 0x7f9d2c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d33314640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0d2630 0x7f9d2c0b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d33314640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c0d13b0 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d33314640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c0cef00 con 0x7f9d2c0b4640 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d33314640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2c0cf420 con 0x7f9d2c0d2630 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d308af640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 0x7f9d2c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d308af640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 0x7f9d2c0b8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46360/0 (socket says 172.21.15.96:46360) 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d308af640 1 -- 172.21.15.96:0/79901678 learned_addr learned my addr 172.21.15.96:0/79901678 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d310b0640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b4640 0x7f9d2c1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d318b1640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0d2630 0x7f9d2c0b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d308af640 1 -- 172.21.15.96:0/79901678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0d2630 msgr2=0x7f9d2c0b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d308af640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0d2630 0x7f9d2c0b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d308af640 1 -- 172.21.15.96:0/79901678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b4640 msgr2=0x7f9d2c1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d308af640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b4640 0x7f9d2c1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d308af640 1 -- 172.21.15.96:0/79901678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c0b7cb0 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d318b1640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0d2630 0x7f9d2c0b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d310b0640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b4640 0x7f9d2c1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.625+0000 7f9d308af640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 0x7f9d2c0b8a70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c02a190 tx=0x7f9d1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.626+0000 7f9d21ffb640 1 -- 172.21.15.96:0/79901678 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c037040 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.626+0000 7f9d21ffb640 1 -- 172.21.15.96:0/79901678 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c042070 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.626+0000 7f9d33314640 1 -- 172.21.15.96:0/79901678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c0b7f90 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.626+0000 7f9d21ffb640 1 -- 172.21.15.96:0/79901678 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c030920 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.626+0000 7f9d33314640 1 -- 172.21.15.96:0/79901678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c0b8550 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.627+0000 7f9d33314640 1 -- 172.21.15.96:0/79901678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d2c0683e0 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.627+0000 7f9d21ffb640 1 -- 172.21.15.96:0/79901678 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 9) ==== 90618+0+0 (secure 0 0 0) 0x7f9d1c030ac0 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.628+0000 7f9d21ffb640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9d1006bfa0 0x7f9d1006e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:40.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.628+0000 7f9d21ffb640 1 -- 172.21.15.96:0/79901678 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f9d1c0abc70 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.628+0000 7f9d310b0640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9d1006bfa0 0x7f9d1006e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:40.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.628+0000 7f9d310b0640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9d1006bfa0 0x7f9d1006e460 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9d28001700 tx=0x7f9d28009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:40.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.632+0000 7f9d21ffb640 1 -- 172.21.15.96:0/79901678 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9d1c079c30 con 0x7f9d2c0b4b50 2024-06-02T23:47:40.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.826+0000 7f9d33314640 1 -- 172.21.15.96:0/79901678 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir5", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9d2c0d2410 con 0x7f9d1006bfa0 2024-06-02T23:47:40.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.899+0000 7f9d21ffb640 1 -- 172.21.15.96:0/79901678 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9d2c0d2410 con 0x7f9d1006bfa0 2024-06-02T23:47:40.899 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path /snap_test_dir1/dir5 2024-06-02T23:47:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 -- 172.21.15.96:0/79901678 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9d1006bfa0 msgr2=0x7f9d1006e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9d1006bfa0 0x7f9d1006e460 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9d28001700 tx=0x7f9d28009040 comp rx=0 tx=0).stop 2024-06-02T23:47:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 -- 172.21.15.96:0/79901678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 msgr2=0x7f9d2c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 0x7f9d2c0b8a70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c02a190 tx=0x7f9d1c0046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 -- 172.21.15.96:0/79901678 shutdown_connections 2024-06-02T23:47:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9d1006bfa0 0x7f9d1006e460 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0d2630 0x7f9d2c0b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d2c0b4b50 0x7f9d2c0b8a70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 --2- 172.21.15.96:0/79901678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b4640 0x7f9d2c1595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 -- 172.21.15.96:0/79901678 >> 172.21.15.96:0/79901678 conn(0x7f9d2c0d4050 msgr2=0x7f9d2c0d3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 -- 172.21.15.96:0/79901678 shutdown_connections 2024-06-02T23:47:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:40.901+0000 7f9d33314640 1 -- 172.21.15.96:0/79901678 wait complete. 2024-06-02T23:47:40.912 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2024-06-02T23:47:40.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:40.912 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2024-06-02T23:47:40.929 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir6 1m 2024-06-02T23:47:41.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.072+0000 7f3b74ed4640 1 Processor -- start 2024-06-02T23:47:41.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.072+0000 7f3b74ed4640 1 -- start start 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.073+0000 7f3b74ed4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 0x7f3b70071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.073+0000 7f3b74ed4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3b7006ec50 0x7f3b700ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.073+0000 7f3b74ed4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b70072fa0 con 0x7f3b7015fc40 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.073+0000 7f3b74ed4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f3b700718f0 con 0x7f3b7006ec50 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.073+0000 7f3b74ed4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b700712a0 con 0x7f3b700729e0 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.073+0000 7f3b6ed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3b7006ec50 0x7f3b700ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.073+0000 7f3b6e59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3b7015fc40 0x7f3b70160020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48300/0 (socket says 172.21.15.96:48300) 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.073+0000 7f3b6e59c640 1 -- 172.21.15.96:0/587836409 learned_addr learned my addr 172.21.15.96:0/587836409 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6dd9b640 1 --2- 172.21.15.96:0/587836409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 0x7f3b70071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6ed9d640 1 -- 172.21.15.96:0/587836409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 msgr2=0x7f3b70071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:41.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6ed9d640 1 --2- 172.21.15.96:0/587836409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 0x7f3b70071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6ed9d640 1 -- 172.21.15.96:0/587836409 >> v1:172.21.15.96:6789/0 conn(0x7f3b7015fc40 legacy=0x7f3b70160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6ed9d640 1 -- 172.21.15.96:0/587836409 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b70071580 con 0x7f3b7006ec50 2024-06-02T23:47:41.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6d59a640 1 -- 172.21.15.96:0/587836409 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334810434 0 0) 0x7f3b70072fa0 con 0x7f3b7015fc40 2024-06-02T23:47:41.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6dd9b640 1 --2- 172.21.15.96:0/587836409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 0x7f3b70071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6ed9d640 1 --2- 172.21.15.96:0/587836409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 0x7f3b700ca300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3b680097a0 tx=0x7f3b6802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557a0f63ab29fd2f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6d59a640 1 -- 172.21.15.96:0/587836409 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68037070 con 0x7f3b7006ec50 2024-06-02T23:47:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6d59a640 1 -- 172.21.15.96:0/587836409 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b68032440 con 0x7f3b7006ec50 2024-06-02T23:47:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.074+0000 7f3b6d59a640 1 -- 172.21.15.96:0/587836409 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68032810 con 0x7f3b7006ec50 2024-06-02T23:47:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.075+0000 7f3b74ed4640 1 -- 172.21.15.96:0/587836409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 msgr2=0x7f3b700ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.075+0000 7f3b74ed4640 1 --2- 172.21.15.96:0/587836409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 0x7f3b700ca300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3b680097a0 tx=0x7f3b6802a180 comp rx=0 tx=0).stop 2024-06-02T23:47:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.075+0000 7f3b74ed4640 1 -- 172.21.15.96:0/587836409 shutdown_connections 2024-06-02T23:47:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.075+0000 7f3b74ed4640 1 --2- 172.21.15.96:0/587836409 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 0x7f3b700ca300 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.075+0000 7f3b74ed4640 1 --2- 172.21.15.96:0/587836409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 0x7f3b70071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.075+0000 7f3b74ed4640 1 -- 172.21.15.96:0/587836409 >> 172.21.15.96:0/587836409 conn(0x7f3b700cfcb0 msgr2=0x7f3b700d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:41.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.075+0000 7f3b74ed4640 1 -- 172.21.15.96:0/587836409 shutdown_connections 2024-06-02T23:47:41.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.075+0000 7f3b74ed4640 1 -- 172.21.15.96:0/587836409 wait complete. 2024-06-02T23:47:41.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.076+0000 7f3b74ed4640 1 Processor -- start 2024-06-02T23:47:41.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.076+0000 7f3b74ed4640 1 -- start start 2024-06-02T23:47:41.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b74ed4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 0x7f3b701577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b74ed4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 0x7f3b70159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b74ed4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7015fc40 0x7f3b7014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b74ed4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3b700ca9c0 con 0x7f3b7006ec50 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b74ed4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b700ca840 con 0x7f3b7015fc40 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b74ed4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b700cab40 con 0x7f3b700729e0 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b6e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 0x7f3b701577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b6e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 0x7f3b701577e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46378/0 (socket says 172.21.15.96:46378) 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b6e59c640 1 -- 172.21.15.96:0/853725995 learned_addr learned my addr 172.21.15.96:0/853725995 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b6ed9d640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7015fc40 0x7f3b7014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.077+0000 7f3b6dd9b640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 0x7f3b70159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b6e59c640 1 -- 172.21.15.96:0/853725995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 msgr2=0x7f3b70159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b6e59c640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 0x7f3b70159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b6e59c640 1 -- 172.21.15.96:0/853725995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7015fc40 msgr2=0x7f3b7014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b6e59c640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7015fc40 0x7f3b7014fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b6e59c640 1 -- 172.21.15.96:0/853725995 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b701596d0 con 0x7f3b7006ec50 2024-06-02T23:47:41.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b6ed9d640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7015fc40 0x7f3b7014fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:41.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b6dd9b640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 0x7f3b70159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:41.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b6e59c640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 0x7f3b701577e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000c890 tx=0x7f3b6000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:41.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b5effd640 1 -- 172.21.15.96:0/853725995 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60018070 con 0x7f3b7006ec50 2024-06-02T23:47:41.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b5effd640 1 -- 172.21.15.96:0/853725995 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b6000a640 con 0x7f3b7006ec50 2024-06-02T23:47:41.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b74ed4640 1 -- 172.21.15.96:0/853725995 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7014ffd0 con 0x7f3b7006ec50 2024-06-02T23:47:41.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b5effd640 1 -- 172.21.15.96:0/853725995 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000aa30 con 0x7f3b7006ec50 2024-06-02T23:47:41.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.078+0000 7f3b74ed4640 1 -- 172.21.15.96:0/853725995 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b70150550 con 0x7f3b7006ec50 2024-06-02T23:47:41.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.079+0000 7f3b74ed4640 1 -- 172.21.15.96:0/853725995 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b700683e0 con 0x7f3b7006ec50 2024-06-02T23:47:41.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.079+0000 7f3b5effd640 1 -- 172.21.15.96:0/853725995 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 9) ==== 90618+0+0 (secure 0 0 0) 0x7f3b6001b070 con 0x7f3b7006ec50 2024-06-02T23:47:41.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.080+0000 7f3b5effd640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3b5006bfd0 0x7f3b5006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.080+0000 7f3b5effd640 1 -- 172.21.15.96:0/853725995 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f3b6008a890 con 0x7f3b7006ec50 2024-06-02T23:47:41.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.080+0000 7f3b6dd9b640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3b5006bfd0 0x7f3b5006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.080+0000 7f3b6dd9b640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3b5006bfd0 0x7f3b5006e490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3b7014f6e0 tx=0x7f3b64008040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:41.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.084+0000 7f3b5effd640 1 -- 172.21.15.96:0/853725995 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3b60058f30 con 0x7f3b7006ec50 2024-06-02T23:47:41.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.281+0000 7f3b74ed4640 1 -- 172.21.15.96:0/853725995 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir6", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f3b701566e0 con 0x7f3b5006bfd0 2024-06-02T23:47:41.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.340+0000 7f3b5effd640 1 -- 172.21.15.96:0/853725995 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f3b701566e0 con 0x7f3b5006bfd0 2024-06-02T23:47:41.340 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path /snap_test_dir1/dir6 2024-06-02T23:47:41.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 -- 172.21.15.96:0/853725995 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3b5006bfd0 msgr2=0x7f3b5006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3b5006bfd0 0x7f3b5006e490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3b7014f6e0 tx=0x7f3b64008040 comp rx=0 tx=0).stop 2024-06-02T23:47:41.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 -- 172.21.15.96:0/853725995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 msgr2=0x7f3b701577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 0x7f3b701577e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000c890 tx=0x7f3b6000cd50 comp rx=0 tx=0).stop 2024-06-02T23:47:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 -- 172.21.15.96:0/853725995 shutdown_connections 2024-06-02T23:47:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3b5006bfd0 0x7f3b5006e490 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7015fc40 0x7f3b7014fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700729e0 0x7f3b70159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 --2- 172.21.15.96:0/853725995 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b7006ec50 0x7f3b701577e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 -- 172.21.15.96:0/853725995 >> 172.21.15.96:0/853725995 conn(0x7f3b700cfcb0 msgr2=0x7f3b700cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 -- 172.21.15.96:0/853725995 shutdown_connections 2024-06-02T23:47:41.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.342+0000 7f3b74ed4640 1 -- 172.21.15.96:0/853725995 wait complete. 2024-06-02T23:47:41.353 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2024-06-02T23:47:41.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:41.353 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2024-06-02T23:47:41.370 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir7 1m 2024-06-02T23:47:41.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.512+0000 7fcc37f63640 1 Processor -- start 2024-06-02T23:47:41.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.513+0000 7fcc37f63640 1 -- start start 2024-06-02T23:47:41.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.513+0000 7fcc37f63640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300b4640 0x7fcc300b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.513+0000 7fcc37f63640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcc300d2d40 0x7fcc300b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.513+0000 7fcc37f63640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc300b73e0 con 0x7fcc300b4b50 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.513+0000 7fcc37f63640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fcc300d4ff0 con 0x7fcc300d2d40 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.513+0000 7fcc37f63640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc300cec60 con 0x7fcc300b4640 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.514+0000 7fcc36500640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcc300d2d40 0x7fcc300b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.514+0000 7fcc354fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fcc300b4b50 0x7fcc300d2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48314/0 (socket says 172.21.15.96:48314) 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.514+0000 7fcc354fe640 1 -- 172.21.15.96:0/1339851925 learned_addr learned my addr 172.21.15.96:0/1339851925 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.514+0000 7fcc35cff640 1 --2- 172.21.15.96:0/1339851925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300b4640 0x7fcc300b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.514+0000 7fcc36500640 1 -- 172.21.15.96:0/1339851925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300b4640 msgr2=0x7fcc300b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.514+0000 7fcc36500640 1 --2- 172.21.15.96:0/1339851925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300b4640 0x7fcc300b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.514+0000 7fcc36500640 1 -- 172.21.15.96:0/1339851925 >> v1:172.21.15.96:6789/0 conn(0x7fcc300b4b50 legacy=0x7fcc300d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.514+0000 7fcc36500640 1 -- 172.21.15.96:0/1339851925 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc300d1fd0 con 0x7fcc300d2d40 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.514+0000 7fcc34cfd640 1 -- 172.21.15.96:0/1339851925 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677566513 0 0) 0x7fcc300b73e0 con 0x7fcc300b4b50 2024-06-02T23:47:41.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc36500640 1 --2- 172.21.15.96:0/1339851925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300d2d40 0x7fcc300b4fd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009d90 tx=0x7fcc2802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cc601bee444e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc34cfd640 1 -- 172.21.15.96:0/1339851925 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28031600 con 0x7fcc300d2d40 2024-06-02T23:47:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc34cfd640 1 -- 172.21.15.96:0/1339851925 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc280317a0 con 0x7fcc300d2d40 2024-06-02T23:47:41.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc34cfd640 1 -- 172.21.15.96:0/1339851925 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28031b70 con 0x7fcc300d2d40 2024-06-02T23:47:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc37f63640 1 -- 172.21.15.96:0/1339851925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300d2d40 msgr2=0x7fcc300b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc37f63640 1 --2- 172.21.15.96:0/1339851925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300d2d40 0x7fcc300b4fd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009d90 tx=0x7fcc2802a5d0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc37f63640 1 -- 172.21.15.96:0/1339851925 shutdown_connections 2024-06-02T23:47:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc37f63640 1 --2- 172.21.15.96:0/1339851925 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300d2d40 0x7fcc300b4fd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc37f63640 1 --2- 172.21.15.96:0/1339851925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300b4640 0x7fcc300b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc37f63640 1 -- 172.21.15.96:0/1339851925 >> 172.21.15.96:0/1339851925 conn(0x7fcc300d4050 msgr2=0x7fcc300d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc37f63640 1 -- 172.21.15.96:0/1339851925 shutdown_connections 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.515+0000 7fcc37f63640 1 -- 172.21.15.96:0/1339851925 wait complete. 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.516+0000 7fcc37f63640 1 Processor -- start 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.516+0000 7fcc37f63640 1 -- start start 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc37f63640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc300b4640 0x7fcc301f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc37f63640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300b4b50 0x7fcc300b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc37f63640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d2d40 0x7fcc300b8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc37f63640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcc300d13b0 con 0x7fcc300b4b50 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc37f63640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc300cef00 con 0x7fcc300b4640 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc37f63640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc300cf420 con 0x7fcc300d2d40 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc354fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300b4b50 0x7fcc300b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc354fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300b4b50 0x7fcc300b7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46392/0 (socket says 172.21.15.96:46392) 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc354fe640 1 -- 172.21.15.96:0/4234944817 learned_addr learned my addr 172.21.15.96:0/4234944817 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc35cff640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc300b4640 0x7fcc301f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.517+0000 7fcc36500640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d2d40 0x7fcc300b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc354fe640 1 -- 172.21.15.96:0/4234944817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d2d40 msgr2=0x7fcc300b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc354fe640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d2d40 0x7fcc300b8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc354fe640 1 -- 172.21.15.96:0/4234944817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc300b4640 msgr2=0x7fcc301f41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc354fe640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc300b4640 0x7fcc301f41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc354fe640 1 -- 172.21.15.96:0/4234944817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc300b6c70 con 0x7fcc300b4b50 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc35cff640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc300b4640 0x7fcc301f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc354fe640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300b4b50 0x7fcc300b7430 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000c4d0 tx=0x7fcc2000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc267fc640 1 -- 172.21.15.96:0/4234944817 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20018070 con 0x7fcc300b4b50 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc267fc640 1 -- 172.21.15.96:0/4234944817 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc20007500 con 0x7fcc300b4b50 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc37f63640 1 -- 172.21.15.96:0/4234944817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc301f4af0 con 0x7fcc300b4b50 2024-06-02T23:47:41.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc267fc640 1 -- 172.21.15.96:0/4234944817 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20004a20 con 0x7fcc300b4b50 2024-06-02T23:47:41.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.518+0000 7fcc37f63640 1 -- 172.21.15.96:0/4234944817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc301f50b0 con 0x7fcc300b4b50 2024-06-02T23:47:41.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.519+0000 7fcc37f63640 1 -- 172.21.15.96:0/4234944817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc300683e0 con 0x7fcc300b4b50 2024-06-02T23:47:41.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.519+0000 7fcc267fc640 1 -- 172.21.15.96:0/4234944817 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 9) ==== 90618+0+0 (secure 0 0 0) 0x7fcc2001b070 con 0x7fcc300b4b50 2024-06-02T23:47:41.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.520+0000 7fcc267fc640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fcc1406bfa0 0x7fcc1406e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.520+0000 7fcc267fc640 1 -- 172.21.15.96:0/4234944817 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7fcc2008a560 con 0x7fcc300b4b50 2024-06-02T23:47:41.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.520+0000 7fcc35cff640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fcc1406bfa0 0x7fcc1406e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.520+0000 7fcc35cff640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fcc1406bfa0 0x7fcc1406e460 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c006fd0 tx=0x7fcc2c008040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:41.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.524+0000 7fcc267fc640 1 -- 172.21.15.96:0/4234944817 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fcc20058c00 con 0x7fcc300b4b50 2024-06-02T23:47:41.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.632+0000 7fcc267fc640 1 -- 172.21.15.96:0/4234944817 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7fcc20054b70 con 0x7fcc300b4b50 2024-06-02T23:47:41.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.722+0000 7fcc37f63640 1 -- 172.21.15.96:0/4234944817 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir7", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fcc300d2410 con 0x7fcc1406bfa0 2024-06-02T23:47:41.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.777+0000 7fcc267fc640 1 -- 172.21.15.96:0/4234944817 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fcc300d2410 con 0x7fcc1406bfa0 2024-06-02T23:47:41.777 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path /snap_test_dir1/dir7 2024-06-02T23:47:41.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 -- 172.21.15.96:0/4234944817 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fcc1406bfa0 msgr2=0x7fcc1406e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fcc1406bfa0 0x7fcc1406e460 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c006fd0 tx=0x7fcc2c008040 comp rx=0 tx=0).stop 2024-06-02T23:47:41.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 -- 172.21.15.96:0/4234944817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300b4b50 msgr2=0x7fcc300b7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300b4b50 0x7fcc300b7430 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000c4d0 tx=0x7fcc2000c990 comp rx=0 tx=0).stop 2024-06-02T23:47:41.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 -- 172.21.15.96:0/4234944817 shutdown_connections 2024-06-02T23:47:41.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fcc1406bfa0 0x7fcc1406e460 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d2d40 0x7fcc300b8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcc300b4b50 0x7fcc300b7430 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 --2- 172.21.15.96:0/4234944817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc300b4640 0x7fcc301f41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 -- 172.21.15.96:0/4234944817 >> 172.21.15.96:0/4234944817 conn(0x7fcc300d4050 msgr2=0x7fcc3006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:41.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 -- 172.21.15.96:0/4234944817 shutdown_connections 2024-06-02T23:47:41.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.779+0000 7fcc37f63640 1 -- 172.21.15.96:0/4234944817 wait complete. 2024-06-02T23:47:41.790 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2024-06-02T23:47:41.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:41.790 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2024-06-02T23:47:41.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir8 1m 2024-06-02T23:47:41.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.950+0000 7f04eaa7d640 1 Processor -- start 2024-06-02T23:47:41.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.950+0000 7f04eaa7d640 1 -- start start 2024-06-02T23:47:41.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.951+0000 7f04eaa7d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f04e415a510 0x7f04e40cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.951+0000 7f04eaa7d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e4073200 con 0x7f04e4072070 2024-06-02T23:47:41.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.951+0000 7f04eaa7d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e4072bf0 con 0x7f04e415a8f0 2024-06-02T23:47:41.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.951+0000 7f04eaa7d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f04e4071030 con 0x7f04e415a510 2024-06-02T23:47:41.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.951+0000 7f04e901a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f04e4072070 0x7f04e40724e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48330/0 (socket says 172.21.15.96:48330) 2024-06-02T23:47:41.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.951+0000 7f04e901a640 1 -- 172.21.15.96:0/958752208 learned_addr learned my addr 172.21.15.96:0/958752208 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.951+0000 7f04e8819640 1 --2- 172.21.15.96:0/958752208 >> v2:172.21.15.162:3300/0 conn(0x7f04e415a510 0x7f04e40cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.951+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077765521 0 0) 0x7f04e4073200 con 0x7f04e4072070 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04cc003520 con 0x7f04e4072070 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2716885657 0 0) 0x7f04cc003520 con 0x7f04e4072070 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 >> v2:172.21.15.162:3300/0 conn(0x7f04e415a510 msgr2=0x7f04e40cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 --2- 172.21.15.96:0/958752208 >> v2:172.21.15.162:3300/0 conn(0x7f04e415a510 0x7f04e40cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 >> v1:172.21.15.162:6789/0 conn(0x7f04e415a8f0 legacy=0x7f04e40cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e40712b0 con 0x7f04e4072070 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f04dc001a10 con 0x7f04e4072070 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 >> v1:172.21.15.96:6789/0 conn(0x7f04e4072070 legacy=0x7f04e40724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04cc004800 0x7f04cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04cc0051c0 0x7f04cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f04e4071030 con 0x7f04cc0039b0 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc00c160 con 0x7f04cc004800 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc00d470 con 0x7f04cc0051c0 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e8819640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e901a640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04cc0051c0 0x7f04cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e3fff640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04cc004800 0x7f04cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e8819640 1 -- 172.21.15.96:0/958752208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04cc0051c0 msgr2=0x7f04cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e8819640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04cc0051c0 0x7f04cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e8819640 1 -- 172.21.15.96:0/958752208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04cc004800 msgr2=0x7f04cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e8819640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04cc004800 0x7f04cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e901a640 1 -- 172.21.15.96:0/958752208 reap_dead start 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.952+0000 7f04e8819640 1 -- 172.21.15.96:0/958752208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc003520 con 0x7f04cc0039b0 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.953+0000 7f04e8819640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04cc003dd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009ac0 tx=0x7f04cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba3be4f47b91614 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.953+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4036070 con 0x7f04cc0039b0 2024-06-02T23:47:41.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.953+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d4031400 con 0x7f04cc0039b0 2024-06-02T23:47:41.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.953+0000 7f04e37fe640 1 -- 172.21.15.96:0/958752208 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4009690 con 0x7f04cc0039b0 2024-06-02T23:47:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.954+0000 7f04eaa7d640 1 -- 172.21.15.96:0/958752208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 msgr2=0x7f04cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.954+0000 7f04eaa7d640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04cc003dd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009ac0 tx=0x7f04cc005830 comp rx=0 tx=0).stop 2024-06-02T23:47:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.954+0000 7f04eaa7d640 1 -- 172.21.15.96:0/958752208 shutdown_connections 2024-06-02T23:47:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.954+0000 7f04eaa7d640 1 --2- 172.21.15.96:0/958752208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04cc003dd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.954+0000 7f04eaa7d640 1 -- 172.21.15.96:0/958752208 >> 172.21.15.96:0/958752208 conn(0x7f04e40cfcb0 msgr2=0x7f04e40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.954+0000 7f04eaa7d640 1 -- 172.21.15.96:0/958752208 shutdown_connections 2024-06-02T23:47:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.954+0000 7f04eaa7d640 1 -- 172.21.15.96:0/958752208 wait complete. 2024-06-02T23:47:41.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.955+0000 7f04eaa7d640 1 Processor -- start 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.955+0000 7f04eaa7d640 1 -- start start 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04eaa7d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04e40b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04eaa7d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04e40c5ba0 0x7f04e40c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04eaa7d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04e40c4d70 0x7f04e413e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04eaa7d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f04e4071b50 con 0x7f04cc0039b0 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04eaa7d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f04e4071870 con 0x7f04e40c4d70 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04eaa7d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f04e40cad10 con 0x7f04e40c5ba0 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e8819640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04e40b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e8819640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04e40b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46420/0 (socket says 172.21.15.96:46420) 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e8819640 1 -- 172.21.15.96:0/24753079 learned_addr learned my addr 172.21.15.96:0/24753079 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e901a640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04e40c4d70 0x7f04e413e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e3fff640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04e40c5ba0 0x7f04e40c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e8819640 1 -- 172.21.15.96:0/24753079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04e40c5ba0 msgr2=0x7f04e40c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e8819640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04e40c5ba0 0x7f04e40c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e8819640 1 -- 172.21.15.96:0/24753079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04e40c4d70 msgr2=0x7f04e413e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e8819640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04e40c4d70 0x7f04e413e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e8819640 1 -- 172.21.15.96:0/24753079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e40c53e0 con 0x7f04cc0039b0 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e901a640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04e40c4d70 0x7f04e413e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e8819640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04e40b5540 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04d4034040 tx=0x7f04d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e17fa640 1 -- 172.21.15.96:0/24753079 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d403f020 con 0x7f04cc0039b0 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e17fa640 1 -- 172.21.15.96:0/24753079 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d4037040 con 0x7f04cc0039b0 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04eaa7d640 1 -- 172.21.15.96:0/24753079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e40c7550 con 0x7f04cc0039b0 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.956+0000 7f04e17fa640 1 -- 172.21.15.96:0/24753079 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4036070 con 0x7f04cc0039b0 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.957+0000 7f04eaa7d640 1 -- 172.21.15.96:0/24753079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e40c7270 con 0x7f04cc0039b0 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.958+0000 7f04eaa7d640 1 -- 172.21.15.96:0/24753079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e40683e0 con 0x7f04cc0039b0 2024-06-02T23:47:41.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.958+0000 7f04e17fa640 1 -- 172.21.15.96:0/24753079 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7f04d4042020 con 0x7f04cc0039b0 2024-06-02T23:47:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.958+0000 7f04e17fa640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f04d006c060 0x7f04d006e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.959+0000 7f04e3fff640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f04d006c060 0x7f04d006e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.959+0000 7f04e17fa640 1 -- 172.21.15.96:0/24753079 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f04d40ab4f0 con 0x7f04cc0039b0 2024-06-02T23:47:41.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.959+0000 7f04e3fff640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f04d006c060 0x7f04d006e520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f04d8000c00 tx=0x7f04d8009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:41.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:41.963+0000 7f04e17fa640 1 -- 172.21.15.96:0/24753079 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f04d4049030 con 0x7f04cc0039b0 2024-06-02T23:47:42.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.159+0000 7f04eaa7d640 1 -- 172.21.15.96:0/24753079 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir8", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f04e406d6b0 con 0x7f04d006c060 2024-06-02T23:47:42.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.210+0000 7f04e17fa640 1 -- 172.21.15.96:0/24753079 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f04e406d6b0 con 0x7f04d006c060 2024-06-02T23:47:42.211 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path /snap_test_dir1/dir8 2024-06-02T23:47:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 -- 172.21.15.96:0/24753079 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f04d006c060 msgr2=0x7f04d006e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f04d006c060 0x7f04d006e520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f04d8000c00 tx=0x7f04d8009040 comp rx=0 tx=0).stop 2024-06-02T23:47:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 -- 172.21.15.96:0/24753079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 msgr2=0x7f04e40b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04e40b5540 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f04d4034040 tx=0x7f04d4004730 comp rx=0 tx=0).stop 2024-06-02T23:47:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 -- 172.21.15.96:0/24753079 shutdown_connections 2024-06-02T23:47:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f04d006c060 0x7f04d006e520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04e40c4d70 0x7f04e413e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04e40c5ba0 0x7f04e40c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 --2- 172.21.15.96:0/24753079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04cc0039b0 0x7f04e40b5540 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 -- 172.21.15.96:0/24753079 >> 172.21.15.96:0/24753079 conn(0x7f04e40cfcb0 msgr2=0x7f04e406cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:42.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 -- 172.21.15.96:0/24753079 shutdown_connections 2024-06-02T23:47:42.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.213+0000 7f04eaa7d640 1 -- 172.21.15.96:0/24753079 wait complete. 2024-06-02T23:47:42.223 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2024-06-02T23:47:42.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:47:42.224 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2024-06-02T23:47:42.240 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir9 1m 2024-06-02T23:47:42.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.382+0000 7f20e09c1640 1 Processor -- start 2024-06-02T23:47:42.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.382+0000 7f20e09c1640 1 -- start start 2024-06-02T23:47:42.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20e09c1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20dc15fc40 0x7f20dc071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20e09c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc0729e0 0x7f20dc160020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20e09c1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f20dc06ec50 0x7f20dc0ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20e09c1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f20dc0718f0 con 0x7f20dc15fc40 2024-06-02T23:47:42.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20e09c1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f20dc160560 con 0x7f20dc06ec50 2024-06-02T23:47:42.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20e09c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20dc072fa0 con 0x7f20dc0729e0 2024-06-02T23:47:42.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20da59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20dc15fc40 0x7f20dc071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20da59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20dc15fc40 0x7f20dc071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46428/0 (socket says 172.21.15.96:46428) 2024-06-02T23:47:42.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20da59c640 1 -- 172.21.15.96:0/1682990676 learned_addr learned my addr 172.21.15.96:0/1682990676 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:42.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20dad9d640 1 --2- 172.21.15.96:0/1682990676 >> v2:172.21.15.162:3300/0 conn(0x7f20dc06ec50 0x7f20dc0ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20d1d9b640 1 --2- 172.21.15.96:0/1682990676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc0729e0 0x7f20dc160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20da59c640 1 -- 172.21.15.96:0/1682990676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc0729e0 msgr2=0x7f20dc160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:42.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20da59c640 1 --2- 172.21.15.96:0/1682990676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc0729e0 0x7f20dc160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20da59c640 1 -- 172.21.15.96:0/1682990676 >> v2:172.21.15.162:3300/0 conn(0x7f20dc06ec50 msgr2=0x7f20dc0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:42.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20da59c640 1 --2- 172.21.15.96:0/1682990676 >> v2:172.21.15.162:3300/0 conn(0x7f20dc06ec50 0x7f20dc0ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.383+0000 7f20da59c640 1 -- 172.21.15.96:0/1682990676 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc0712a0 con 0x7f20dc15fc40 2024-06-02T23:47:42.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20da59c640 1 --2- 172.21.15.96:0/1682990676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc15fc40 0x7f20dc071d80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0ca290 tx=0x7f20cc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef63d6d349d8e09 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:42.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20d9d9b640 1 -- 172.21.15.96:0/1682990676 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc037070 con 0x7f20dc15fc40 2024-06-02T23:47:42.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20d9d9b640 1 -- 172.21.15.96:0/1682990676 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc032440 con 0x7f20dc15fc40 2024-06-02T23:47:42.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20d9d9b640 1 -- 172.21.15.96:0/1682990676 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc032810 con 0x7f20dc15fc40 2024-06-02T23:47:42.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20e09c1640 1 -- 172.21.15.96:0/1682990676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc15fc40 msgr2=0x7f20dc071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:42.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20e09c1640 1 --2- 172.21.15.96:0/1682990676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc15fc40 0x7f20dc071d80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0ca290 tx=0x7f20cc02a140 comp rx=0 tx=0).stop 2024-06-02T23:47:42.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20e09c1640 1 -- 172.21.15.96:0/1682990676 shutdown_connections 2024-06-02T23:47:42.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20e09c1640 1 --2- 172.21.15.96:0/1682990676 >> v2:172.21.15.162:3300/0 conn(0x7f20dc06ec50 0x7f20dc0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20e09c1640 1 --2- 172.21.15.96:0/1682990676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc0729e0 0x7f20dc160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20e09c1640 1 --2- 172.21.15.96:0/1682990676 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc15fc40 0x7f20dc071d80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20e09c1640 1 -- 172.21.15.96:0/1682990676 >> 172.21.15.96:0/1682990676 conn(0x7f20dc0cfcb0 msgr2=0x7f20dc0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20e09c1640 1 -- 172.21.15.96:0/1682990676 shutdown_connections 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.384+0000 7f20e09c1640 1 -- 172.21.15.96:0/1682990676 wait complete. 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.386+0000 7f20e09c1640 1 Processor -- start 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.386+0000 7f20e09c1640 1 -- start start 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20e09c1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc06ec50 0x7f20dc0c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20e09c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20dc0729e0 0x7f20dc0c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20e09c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc15fc40 0x7f20dc153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20e09c1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc06f240 con 0x7f20dc06ec50 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20e09c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc06f0c0 con 0x7f20dc0729e0 2024-06-02T23:47:42.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20e09c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20dc0ca840 con 0x7f20dc15fc40 2024-06-02T23:47:42.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20da59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc06ec50 0x7f20dc0c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20da59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc06ec50 0x7f20dc0c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46440/0 (socket says 172.21.15.96:46440) 2024-06-02T23:47:42.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20da59c640 1 -- 172.21.15.96:0/980508483 learned_addr learned my addr 172.21.15.96:0/980508483 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:42.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20dad9d640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc15fc40 0x7f20dc153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20d1d9b640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20dc0729e0 0x7f20dc0c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20da59c640 1 -- 172.21.15.96:0/980508483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc15fc40 msgr2=0x7f20dc153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:42.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20da59c640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc15fc40 0x7f20dc153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20da59c640 1 -- 172.21.15.96:0/980508483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20dc0729e0 msgr2=0x7f20dc0c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:42.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20da59c640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20dc0729e0 0x7f20dc0c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20da59c640 1 -- 172.21.15.96:0/980508483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc152390 con 0x7f20dc06ec50 2024-06-02T23:47:42.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20da59c640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc06ec50 0x7f20dc0c61b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f20cc02a180 tx=0x7f20cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:42.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20d37fe640 1 -- 172.21.15.96:0/980508483 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc041020 con 0x7f20dc06ec50 2024-06-02T23:47:42.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20d37fe640 1 -- 172.21.15.96:0/980508483 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc0306c0 con 0x7f20dc06ec50 2024-06-02T23:47:42.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20d37fe640 1 -- 172.21.15.96:0/980508483 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc037040 con 0x7f20dc06ec50 2024-06-02T23:47:42.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20e09c1640 1 -- 172.21.15.96:0/980508483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc152670 con 0x7f20dc06ec50 2024-06-02T23:47:42.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.387+0000 7f20e09c1640 1 -- 172.21.15.96:0/980508483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc152c30 con 0x7f20dc06ec50 2024-06-02T23:47:42.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.389+0000 7f20e09c1640 1 -- 172.21.15.96:0/980508483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc152e30 con 0x7f20dc06ec50 2024-06-02T23:47:42.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.389+0000 7f20d37fe640 1 -- 172.21.15.96:0/980508483 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7f20cc044020 con 0x7f20dc06ec50 2024-06-02T23:47:42.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.389+0000 7f20d37fe640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20bc06c030 0x7f20bc06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.389+0000 7f20d37fe640 1 -- 172.21.15.96:0/980508483 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f20cc0aba60 con 0x7f20dc06ec50 2024-06-02T23:47:42.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.389+0000 7f20d1d9b640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20bc06c030 0x7f20bc06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.390+0000 7f20d1d9b640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20bc06c030 0x7f20bc06e4f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f20dc1449a0 tx=0x7f20c4008040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:42.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.394+0000 7f20d37fe640 1 -- 172.21.15.96:0/980508483 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f20cc04b030 con 0x7f20dc06ec50 2024-06-02T23:47:42.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.589+0000 7f20e09c1640 1 -- 172.21.15.96:0/980508483 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir9", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f20dc0683e0 con 0x7f20bc06c030 2024-06-02T23:47:42.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.654+0000 7f20d37fe640 1 -- 172.21.15.96:0/980508483 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f20dc0683e0 con 0x7f20bc06c030 2024-06-02T23:47:42.654 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule set for path /snap_test_dir1/dir9 2024-06-02T23:47:42.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 -- 172.21.15.96:0/980508483 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20bc06c030 msgr2=0x7f20bc06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:42.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20bc06c030 0x7f20bc06e4f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f20dc1449a0 tx=0x7f20c4008040 comp rx=0 tx=0).stop 2024-06-02T23:47:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 -- 172.21.15.96:0/980508483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc06ec50 msgr2=0x7f20dc0c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc06ec50 0x7f20dc0c61b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f20cc02a180 tx=0x7f20cc0046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 -- 172.21.15.96:0/980508483 shutdown_connections 2024-06-02T23:47:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20bc06c030 0x7f20bc06e4f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc15fc40 0x7f20dc153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20dc0729e0 0x7f20dc0c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 --2- 172.21.15.96:0/980508483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20dc06ec50 0x7f20dc0c61b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 -- 172.21.15.96:0/980508483 >> 172.21.15.96:0/980508483 conn(0x7f20dc0cfcb0 msgr2=0x7f20dc15c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 -- 172.21.15.96:0/980508483 shutdown_connections 2024-06-02T23:47:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.656+0000 7f20e09c1640 1 -- 172.21.15.96:0/980508483 wait complete. 2024-06-02T23:47:42.667 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2024-06-02T23:47:42.667 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir0 1m 2024-06-02T23:47:42.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.769+0000 7f91954da640 1 Processor -- start 2024-06-02T23:47:42.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.769+0000 7f91954da640 1 -- start start 2024-06-02T23:47:42.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f91954da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 0x7f91900d4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f91954da640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f91900b13b0 0x7f91900b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f91954da640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91900b1e50 con 0x7f91900b2c10 2024-06-02T23:47:42.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f91954da640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f91900b5990 con 0x7f91900b13b0 2024-06-02T23:47:42.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f91954da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f91900b2780 con 0x7f9190161ba0 2024-06-02T23:47:42.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f918f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f91900b13b0 0x7f91900b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f918f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f91900b13b0 0x7f91900b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46452/0 (socket says 172.21.15.96:46452) 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f918f7fe640 1 -- 172.21.15.96:0/3590605344 learned_addr learned my addr 172.21.15.96:0/3590605344 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f918effd640 1 --2- 172.21.15.96:0/3590605344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 0x7f91900d4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f918f7fe640 1 -- 172.21.15.96:0/3590605344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 msgr2=0x7f91900d4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f918f7fe640 1 --2- 172.21.15.96:0/3590605344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 0x7f91900d4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f918f7fe640 1 -- 172.21.15.96:0/3590605344 >> v1:172.21.15.162:6789/0 conn(0x7f91900b2c10 legacy=0x7f91900b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f918f7fe640 1 -- 172.21.15.96:0/3590605344 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91900b2130 con 0x7f91900b13b0 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.770+0000 7f918effd640 1 --2- 172.21.15.96:0/3590605344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 0x7f91900d4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.771+0000 7f918f7fe640 1 --2- 172.21.15.96:0/3590605344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b13b0 0x7f91900b1840 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9188009e50 tx=0x7f918802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b2fb037231ad2c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.771+0000 7f918dffb640 1 -- 172.21.15.96:0/3590605344 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188036070 con 0x7f91900b13b0 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.771+0000 7f918dffb640 1 -- 172.21.15.96:0/3590605344 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9188031600 con 0x7f91900b13b0 2024-06-02T23:47:42.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.771+0000 7f918dffb640 1 -- 172.21.15.96:0/3590605344 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91880319d0 con 0x7f91900b13b0 2024-06-02T23:47:42.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.772+0000 7f91954da640 1 -- 172.21.15.96:0/3590605344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b13b0 msgr2=0x7f91900b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:42.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.772+0000 7f91954da640 1 --2- 172.21.15.96:0/3590605344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b13b0 0x7f91900b1840 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9188009e50 tx=0x7f918802a630 comp rx=0 tx=0).stop 2024-06-02T23:47:42.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.772+0000 7f91954da640 1 -- 172.21.15.96:0/3590605344 shutdown_connections 2024-06-02T23:47:42.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.772+0000 7f91954da640 1 --2- 172.21.15.96:0/3590605344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b13b0 0x7f91900b1840 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.772+0000 7f91954da640 1 --2- 172.21.15.96:0/3590605344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 0x7f91900d4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.772+0000 7f91954da640 1 -- 172.21.15.96:0/3590605344 >> 172.21.15.96:0/3590605344 conn(0x7f919009d3b0 msgr2=0x7f91900d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.772+0000 7f91954da640 1 -- 172.21.15.96:0/3590605344 shutdown_connections 2024-06-02T23:47:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.772+0000 7f91954da640 1 -- 172.21.15.96:0/3590605344 wait complete. 2024-06-02T23:47:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.773+0000 7f91954da640 1 Processor -- start 2024-06-02T23:47:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.773+0000 7f91954da640 1 -- start start 2024-06-02T23:47:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f91954da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91900b13b0 0x7f91901543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f91954da640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b2c10 0x7f91900b9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f91954da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 0x7f9190155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f91954da640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f91900b3090 con 0x7f91900b2c10 2024-06-02T23:47:42.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f91954da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91900b4920 con 0x7f91900b13b0 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f91954da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f91900b80c0 con 0x7f9190161ba0 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918e7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b2c10 0x7f91900b9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918e7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b2c10 0x7f91900b9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46454/0 (socket says 172.21.15.96:46454) 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918e7fc640 1 -- 172.21.15.96:0/3208873767 learned_addr learned my addr 172.21.15.96:0/3208873767 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918effd640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91900b13b0 0x7f91901543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918f7fe640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 0x7f9190155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918e7fc640 1 -- 172.21.15.96:0/3208873767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 msgr2=0x7f9190155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918e7fc640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 0x7f9190155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918e7fc640 1 -- 172.21.15.96:0/3208873767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91900b13b0 msgr2=0x7f91901543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918e7fc640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91900b13b0 0x7f91901543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918e7fc640 1 -- 172.21.15.96:0/3208873767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91900b8360 con 0x7f91900b2c10 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f918e7fc640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b2c10 0x7f91900b9120 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f918400c430 tx=0x7f918400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:42.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.774+0000 7f91777fe640 1 -- 172.21.15.96:0/3208873767 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184011790 con 0x7f91900b2c10 2024-06-02T23:47:42.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.775+0000 7f91777fe640 1 -- 172.21.15.96:0/3208873767 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9184017070 con 0x7f91900b2c10 2024-06-02T23:47:42.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.775+0000 7f91954da640 1 -- 172.21.15.96:0/3208873767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91900b8640 con 0x7f91900b2c10 2024-06-02T23:47:42.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.775+0000 7f91777fe640 1 -- 172.21.15.96:0/3208873767 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184011bb0 con 0x7f91900b2c10 2024-06-02T23:47:42.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.775+0000 7f91954da640 1 -- 172.21.15.96:0/3208873767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91900b8c00 con 0x7f91900b2c10 2024-06-02T23:47:42.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.775+0000 7f91954da640 1 -- 172.21.15.96:0/3208873767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91900675f0 con 0x7f91900b2c10 2024-06-02T23:47:42.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.776+0000 7f91777fe640 1 -- 172.21.15.96:0/3208873767 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7f918401c460 con 0x7f91900b2c10 2024-06-02T23:47:42.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.776+0000 7f91777fe640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f917c06c060 0x7f917c06e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:42.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.776+0000 7f91777fe640 1 -- 172.21.15.96:0/3208873767 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f918408b150 con 0x7f91900b2c10 2024-06-02T23:47:42.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.776+0000 7f918effd640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f917c06c060 0x7f917c06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:42.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.777+0000 7f918effd640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f917c06c060 0x7f917c06e520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f918000aac0 tx=0x7f9180008040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:42.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.781+0000 7f91777fe640 1 -- 172.21.15.96:0/3208873767 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f91900675f0 con 0x7f91900b2c10 2024-06-02T23:47:42.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:42.977+0000 7f91954da640 1 -- 172.21.15.96:0/3208873767 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir0", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f91900b8e00 con 0x7f917c06c060 2024-06-02T23:47:43.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.020+0000 7f91777fe640 1 -- 172.21.15.96:0/3208873767 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f91900b8e00 con 0x7f917c06c060 2024-06-02T23:47:43.020 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule activated for path /snap_test_dir1/dir0 2024-06-02T23:47:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.022+0000 7f91954da640 1 -- 172.21.15.96:0/3208873767 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f917c06c060 msgr2=0x7f917c06e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.022+0000 7f91954da640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f917c06c060 0x7f917c06e520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f918000aac0 tx=0x7f9180008040 comp rx=0 tx=0).stop 2024-06-02T23:47:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.022+0000 7f91954da640 1 -- 172.21.15.96:0/3208873767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b2c10 msgr2=0x7f91900b9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.022+0000 7f91954da640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b2c10 0x7f91900b9120 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f918400c430 tx=0x7f918400c8f0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.022+0000 7f91954da640 1 -- 172.21.15.96:0/3208873767 shutdown_connections 2024-06-02T23:47:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.022+0000 7f91954da640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f917c06c060 0x7f917c06e520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.022+0000 7f91954da640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190161ba0 0x7f9190155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.022+0000 7f91954da640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91900b2c10 0x7f91900b9120 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.022+0000 7f91954da640 1 --2- 172.21.15.96:0/3208873767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91900b13b0 0x7f91901543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.022+0000 7f91954da640 1 -- 172.21.15.96:0/3208873767 >> 172.21.15.96:0/3208873767 conn(0x7f919009d3b0 msgr2=0x7f91900d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:43.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.023+0000 7f91954da640 1 -- 172.21.15.96:0/3208873767 shutdown_connections 2024-06-02T23:47:43.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.023+0000 7f91954da640 1 -- 172.21.15.96:0/3208873767 wait complete. 2024-06-02T23:47:43.035 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2024-06-02T23:47:43.035 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir1 1m 2024-06-02T23:47:43.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.140+0000 7f3339dc1640 1 Processor -- start 2024-06-02T23:47:43.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.140+0000 7f3339dc1640 1 -- start start 2024-06-02T23:47:43.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3339dc1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3334143d70 0x7f333406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3339dc1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f333406e380 0x7f3334144570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3339dc1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333406d2e0 con 0x7f33340ced40 2024-06-02T23:47:43.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3339dc1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f333406d5c0 con 0x7f333406e380 2024-06-02T23:47:43.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3339dc1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f333406d8a0 con 0x7f3334143d70 2024-06-02T23:47:43.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3332ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f333406e380 0x7f3334144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3333fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f33340ced40 0x7f333415eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50450/0 (socket says 172.21.15.96:50450) 2024-06-02T23:47:43.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3333fff640 1 -- 172.21.15.96:0/2364730444 learned_addr learned my addr 172.21.15.96:0/2364730444 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:43.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3332ffd640 1 -- 172.21.15.96:0/2364730444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3334143d70 msgr2=0x7f333406cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:43.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3332ffd640 1 --2- 172.21.15.96:0/2364730444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3334143d70 0x7f333406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3332ffd640 1 -- 172.21.15.96:0/2364730444 >> v1:172.21.15.96:6789/0 conn(0x7f33340ced40 legacy=0x7f333415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f3332ffd640 1 -- 172.21.15.96:0/2364730444 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333406db80 con 0x7f333406e380 2024-06-02T23:47:43.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.141+0000 7f33327fc640 1 -- 172.21.15.96:0/2364730444 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672973883 0 0) 0x7f333406d2e0 con 0x7f33340ced40 2024-06-02T23:47:43.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.142+0000 7f3332ffd640 1 --2- 172.21.15.96:0/2364730444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 0x7f3334144570 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f33280097a0 tx=0x7f332802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e9273c8e7d0bfb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:43.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.142+0000 7f33327fc640 1 -- 172.21.15.96:0/2364730444 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328037070 con 0x7f333406e380 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.142+0000 7f33327fc640 1 -- 172.21.15.96:0/2364730444 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332802ae50 con 0x7f333406e380 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.142+0000 7f33327fc640 1 -- 172.21.15.96:0/2364730444 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328032660 con 0x7f333406e380 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.142+0000 7f3339dc1640 1 -- 172.21.15.96:0/2364730444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 msgr2=0x7f3334144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.143+0000 7f3339dc1640 1 --2- 172.21.15.96:0/2364730444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 0x7f3334144570 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f33280097a0 tx=0x7f332802a100 comp rx=0 tx=0).stop 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.143+0000 7f3339dc1640 1 -- 172.21.15.96:0/2364730444 shutdown_connections 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.143+0000 7f3339dc1640 1 --2- 172.21.15.96:0/2364730444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 0x7f3334144570 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.143+0000 7f3339dc1640 1 --2- 172.21.15.96:0/2364730444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3334143d70 0x7f333406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.143+0000 7f3339dc1640 1 -- 172.21.15.96:0/2364730444 >> 172.21.15.96:0/2364730444 conn(0x7f33340b18a0 msgr2=0x7f33340b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.143+0000 7f3339dc1640 1 -- 172.21.15.96:0/2364730444 shutdown_connections 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.143+0000 7f3339dc1640 1 -- 172.21.15.96:0/2364730444 wait complete. 2024-06-02T23:47:43.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.144+0000 7f3339dc1640 1 Processor -- start 2024-06-02T23:47:43.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.144+0000 7f3339dc1640 1 -- start start 2024-06-02T23:47:43.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f3339dc1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 0x7f3334156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f3339dc1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33340ced40 0x7f333413dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f3339dc1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3334143d70 0x7f3334156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f3339dc1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f33340cf190 con 0x7f333406e380 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f3339dc1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3334144ab0 con 0x7f3334143d70 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f3339dc1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f33340cf310 con 0x7f33340ced40 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f33337fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 0x7f3334156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f33337fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 0x7f3334156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37604/0 (socket says 172.21.15.96:37604) 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f33337fe640 1 -- 172.21.15.96:0/1264120649 learned_addr learned my addr 172.21.15.96:0/1264120649 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f3333fff640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3334143d70 0x7f3334156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f3332ffd640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33340ced40 0x7f333413dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f33337fe640 1 -- 172.21.15.96:0/1264120649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33340ced40 msgr2=0x7f333413dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f33337fe640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33340ced40 0x7f333413dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f33337fe640 1 -- 172.21.15.96:0/1264120649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3334143d70 msgr2=0x7f3334156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f33337fe640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3334143d70 0x7f3334156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f33337fe640 1 -- 172.21.15.96:0/1264120649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3334157180 con 0x7f333406e380 2024-06-02T23:47:43.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f33337fe640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 0x7f3334156020 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f332400b410 tx=0x7f332400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:43.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f331bfff640 1 -- 172.21.15.96:0/1264120649 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324015020 con 0x7f333406e380 2024-06-02T23:47:43.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f331bfff640 1 -- 172.21.15.96:0/1264120649 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3324011850 con 0x7f333406e380 2024-06-02T23:47:43.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f3339dc1640 1 -- 172.21.15.96:0/1264120649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3334155260 con 0x7f333406e380 2024-06-02T23:47:43.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f331bfff640 1 -- 172.21.15.96:0/1264120649 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324011c40 con 0x7f333406e380 2024-06-02T23:47:43.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.145+0000 7f3339dc1640 1 -- 172.21.15.96:0/1264120649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3334155820 con 0x7f333406e380 2024-06-02T23:47:43.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.146+0000 7f3339dc1640 1 -- 172.21.15.96:0/1264120649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33340683e0 con 0x7f333406e380 2024-06-02T23:47:43.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.147+0000 7f331bfff640 1 -- 172.21.15.96:0/1264120649 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7f3324018020 con 0x7f333406e380 2024-06-02T23:47:43.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.147+0000 7f331bfff640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f332006c060 0x7f332006e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.147+0000 7f331bfff640 1 -- 172.21.15.96:0/1264120649 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f332408b290 con 0x7f333406e380 2024-06-02T23:47:43.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.147+0000 7f3332ffd640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f332006c060 0x7f332006e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.148+0000 7f3332ffd640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f332006c060 0x7f332006e520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3328034000 tx=0x7f332802e000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:43.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.151+0000 7f331bfff640 1 -- 172.21.15.96:0/1264120649 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f332401f020 con 0x7f333406e380 2024-06-02T23:47:43.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.346+0000 7f3339dc1640 1 -- 172.21.15.96:0/1264120649 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir1", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f33340b0fb0 con 0x7f332006c060 2024-06-02T23:47:43.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.392+0000 7f331bfff640 1 -- 172.21.15.96:0/1264120649 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f33340b0fb0 con 0x7f332006c060 2024-06-02T23:47:43.392 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule activated for path /snap_test_dir1/dir1 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 -- 172.21.15.96:0/1264120649 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f332006c060 msgr2=0x7f332006e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f332006c060 0x7f332006e520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3328034000 tx=0x7f332802e000 comp rx=0 tx=0).stop 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 -- 172.21.15.96:0/1264120649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 msgr2=0x7f3334156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 0x7f3334156020 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f332400b410 tx=0x7f332400b8d0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 -- 172.21.15.96:0/1264120649 shutdown_connections 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f332006c060 0x7f332006e520 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3334143d70 0x7f3334156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33340ced40 0x7f333413dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 --2- 172.21.15.96:0/1264120649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f333406e380 0x7f3334156020 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 -- 172.21.15.96:0/1264120649 >> 172.21.15.96:0/1264120649 conn(0x7f33340b18a0 msgr2=0x7f33340712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:43.395 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 -- 172.21.15.96:0/1264120649 shutdown_connections 2024-06-02T23:47:43.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.394+0000 7f3339dc1640 1 -- 172.21.15.96:0/1264120649 wait complete. 2024-06-02T23:47:43.405 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2024-06-02T23:47:43.406 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir2 1m 2024-06-02T23:47:43.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.508+0000 7fc2eac88640 1 Processor -- start 2024-06-02T23:47:43.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.508+0000 7fc2eac88640 1 -- start start 2024-06-02T23:47:43.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2eac88640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc2e4143d70 0x7fc2e406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2eac88640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e406e380 0x7fc2e4144570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2eac88640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc2e40ced40 0x7fc2e40cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2eac88640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e40cf6d0 con 0x7fc2e4143d70 2024-06-02T23:47:43.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2eac88640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e406d2e0 con 0x7fc2e40ced40 2024-06-02T23:47:43.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2eac88640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e406d5c0 con 0x7fc2e406e380 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2e8a24640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc2e4143d70 0x7fc2e406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2e8a24640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc2e4143d70 0x7fc2e406cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37606/0 (socket says 172.21.15.96:37606) 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2e8a24640 1 -- 172.21.15.96:0/2569163887 learned_addr learned my addr 172.21.15.96:0/2569163887 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2e3fff640 1 --2- 172.21.15.96:0/2569163887 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e406e380 0x7fc2e4144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2e9225640 1 --2- 172.21.15.96:0/2569163887 >> v2:172.21.15.162:3300/0 conn(0x7fc2e40ced40 0x7fc2e40cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.509+0000 7fc2e8a24640 1 -- 172.21.15.96:0/2569163887 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e406e380 msgr2=0x7fc2e4144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.510+0000 7fc2e8a24640 1 --2- 172.21.15.96:0/2569163887 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e406e380 0x7fc2e4144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.510+0000 7fc2e8a24640 1 -- 172.21.15.96:0/2569163887 >> v2:172.21.15.162:3300/0 conn(0x7fc2e40ced40 msgr2=0x7fc2e40cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.510+0000 7fc2e8a24640 1 --2- 172.21.15.96:0/2569163887 >> v2:172.21.15.162:3300/0 conn(0x7fc2e40ced40 0x7fc2e40cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.510+0000 7fc2e8a24640 1 -- 172.21.15.96:0/2569163887 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e406d8a0 con 0x7fc2e4143d70 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.510+0000 7fc2e9225640 1 --2- 172.21.15.96:0/2569163887 >> v2:172.21.15.162:3300/0 conn(0x7fc2e40ced40 0x7fc2e40cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.510+0000 7fc2e8a24640 1 --2- 172.21.15.96:0/2569163887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e4143d70 0x7fc2e406cd00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4075200 tx=0x7fc2d402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efab99541718725 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.510+0000 7fc2e37fe640 1 -- 172.21.15.96:0/2569163887 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4037070 con 0x7fc2e4143d70 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.510+0000 7fc2e37fe640 1 -- 172.21.15.96:0/2569163887 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d4032440 con 0x7fc2e4143d70 2024-06-02T23:47:43.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.510+0000 7fc2e37fe640 1 -- 172.21.15.96:0/2569163887 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4032810 con 0x7fc2e4143d70 2024-06-02T23:47:43.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.511+0000 7fc2eac88640 1 -- 172.21.15.96:0/2569163887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e4143d70 msgr2=0x7fc2e406cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.511+0000 7fc2eac88640 1 --2- 172.21.15.96:0/2569163887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e4143d70 0x7fc2e406cd00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4075200 tx=0x7fc2d402a140 comp rx=0 tx=0).stop 2024-06-02T23:47:43.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.511+0000 7fc2eac88640 1 -- 172.21.15.96:0/2569163887 shutdown_connections 2024-06-02T23:47:43.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.511+0000 7fc2eac88640 1 --2- 172.21.15.96:0/2569163887 >> v2:172.21.15.162:3300/0 conn(0x7fc2e40ced40 0x7fc2e40cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.511+0000 7fc2eac88640 1 --2- 172.21.15.96:0/2569163887 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e406e380 0x7fc2e4144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.511+0000 7fc2eac88640 1 --2- 172.21.15.96:0/2569163887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e4143d70 0x7fc2e406cd00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.511+0000 7fc2eac88640 1 -- 172.21.15.96:0/2569163887 >> 172.21.15.96:0/2569163887 conn(0x7fc2e40b18a0 msgr2=0x7fc2e40b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:43.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.511+0000 7fc2eac88640 1 -- 172.21.15.96:0/2569163887 shutdown_connections 2024-06-02T23:47:43.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.511+0000 7fc2eac88640 1 -- 172.21.15.96:0/2569163887 wait complete. 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.512+0000 7fc2eac88640 1 Processor -- start 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.512+0000 7fc2eac88640 1 -- start start 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2eac88640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e406e380 0x7fc2e41f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2eac88640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e40ced40 0x7fc2e41e9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2eac88640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e4143d70 0x7fc2e40b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2eac88640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4144ab0 con 0x7fc2e406e380 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2eac88640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e406de60 con 0x7fc2e4143d70 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2eac88640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e415eb10 con 0x7fc2e40ced40 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e8a24640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e406e380 0x7fc2e41f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e8a24640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e406e380 0x7fc2e41f24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37608/0 (socket says 172.21.15.96:37608) 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e8a24640 1 -- 172.21.15.96:0/1162250521 learned_addr learned my addr 172.21.15.96:0/1162250521 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:43.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e9225640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e4143d70 0x7fc2e40b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e3fff640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e40ced40 0x7fc2e41e9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e8a24640 1 -- 172.21.15.96:0/1162250521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e40ced40 msgr2=0x7fc2e41e9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e8a24640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e40ced40 0x7fc2e41e9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e8a24640 1 -- 172.21.15.96:0/1162250521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e4143d70 msgr2=0x7fc2e40b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e8a24640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e4143d70 0x7fc2e40b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e8a24640 1 -- 172.21.15.96:0/1162250521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e41e97d0 con 0x7fc2e406e380 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.513+0000 7fc2e9225640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e4143d70 0x7fc2e40b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.514+0000 7fc2e8a24640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e406e380 0x7fc2e41f24c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4000c00 tx=0x7fc2d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.514+0000 7fc2e17fa640 1 -- 172.21.15.96:0/1162250521 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4041020 con 0x7fc2e406e380 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.514+0000 7fc2e17fa640 1 -- 172.21.15.96:0/1162250521 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d40306c0 con 0x7fc2e406e380 2024-06-02T23:47:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.514+0000 7fc2e17fa640 1 -- 172.21.15.96:0/1162250521 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4037040 con 0x7fc2e406e380 2024-06-02T23:47:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.514+0000 7fc2eac88640 1 -- 172.21.15.96:0/1162250521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e41e5640 con 0x7fc2e406e380 2024-06-02T23:47:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.514+0000 7fc2eac88640 1 -- 172.21.15.96:0/1162250521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e41e6120 con 0x7fc2e406e380 2024-06-02T23:47:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.515+0000 7fc2eac88640 1 -- 172.21.15.96:0/1162250521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e40683e0 con 0x7fc2e406e380 2024-06-02T23:47:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.515+0000 7fc2e17fa640 1 -- 172.21.15.96:0/1162250521 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7fc2d4044020 con 0x7fc2e406e380 2024-06-02T23:47:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.516+0000 7fc2e17fa640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc2d006c030 0x7fc2d006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.516+0000 7fc2e17fa640 1 -- 172.21.15.96:0/1162250521 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7fc2d40abcb0 con 0x7fc2e406e380 2024-06-02T23:47:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.516+0000 7fc2e3fff640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc2d006c030 0x7fc2d006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.516+0000 7fc2e3fff640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc2d006c030 0x7fc2d006e4f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4141f30 tx=0x7fc2d80039f0 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:43.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.520+0000 7fc2e17fa640 1 -- 172.21.15.96:0/1162250521 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc2d404b030 con 0x7fc2e406e380 2024-06-02T23:47:43.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.716+0000 7fc2eac88640 1 -- 172.21.15.96:0/1162250521 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir2", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc2e40cfa70 con 0x7fc2d006c030 2024-06-02T23:47:43.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.759+0000 7fc2e17fa640 1 -- 172.21.15.96:0/1162250521 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc2e40cfa70 con 0x7fc2d006c030 2024-06-02T23:47:43.760 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule activated for path /snap_test_dir1/dir2 2024-06-02T23:47:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 -- 172.21.15.96:0/1162250521 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc2d006c030 msgr2=0x7fc2d006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc2d006c030 0x7fc2d006e4f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4141f30 tx=0x7fc2d80039f0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 -- 172.21.15.96:0/1162250521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e406e380 msgr2=0x7fc2e41f24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e406e380 0x7fc2e41f24c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4000c00 tx=0x7fc2d40046c0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 -- 172.21.15.96:0/1162250521 shutdown_connections 2024-06-02T23:47:43.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc2d006c030 0x7fc2d006e4f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2e4143d70 0x7fc2e40b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2e40ced40 0x7fc2e41e9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 --2- 172.21.15.96:0/1162250521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2e406e380 0x7fc2e41f24c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 -- 172.21.15.96:0/1162250521 >> 172.21.15.96:0/1162250521 conn(0x7fc2e40b18a0 msgr2=0x7fc2e40b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 -- 172.21.15.96:0/1162250521 shutdown_connections 2024-06-02T23:47:43.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.762+0000 7fc2eac88640 1 -- 172.21.15.96:0/1162250521 wait complete. 2024-06-02T23:47:43.772 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2024-06-02T23:47:43.773 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir3 1m 2024-06-02T23:47:43.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.874+0000 7f02b0cee640 1 Processor -- start 2024-06-02T23:47:43.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.874+0000 7f02b0cee640 1 -- start start 2024-06-02T23:47:43.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.875+0000 7f02b0cee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cf110 0x7f02ac0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.875+0000 7f02b0cee640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02ac0b33d0 0x7f02ac0cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.875+0000 7f02b0cee640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02ac0b2c40 con 0x7f02ac0cc6f0 2024-06-02T23:47:43.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.875+0000 7f02b0cee640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f02ac0b2f40 con 0x7f02ac0b33d0 2024-06-02T23:47:43.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.875+0000 7f02b0cee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f02ac0cfa30 con 0x7f02ac0cf110 2024-06-02T23:47:43.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.875+0000 7f02aad9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02ac0b33d0 0x7f02ac0cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.875+0000 7f02aa59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cf110 0x7f02ac0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.875+0000 7f02aad9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02ac0b33d0 0x7f02ac0cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:38754/0 (socket says 172.21.15.96:38754) 2024-06-02T23:47:43.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.876+0000 7f02aad9d640 1 -- 172.21.15.96:0/136731744 learned_addr learned my addr 172.21.15.96:0/136731744 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:43.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.876+0000 7f02aa59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cf110 0x7f02ac0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:60674/0 (socket says 172.21.15.96:60674) 2024-06-02T23:47:43.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.876+0000 7f02aa59c640 1 -- 172.21.15.96:0/136731744 >> v2:172.21.15.162:3300/0 conn(0x7f02ac0b33d0 msgr2=0x7f02ac0cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:43.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.876+0000 7f02aa59c640 1 --2- 172.21.15.96:0/136731744 >> v2:172.21.15.162:3300/0 conn(0x7f02ac0b33d0 0x7f02ac0cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.876+0000 7f02aa59c640 1 -- 172.21.15.96:0/136731744 >> v1:172.21.15.162:6789/0 conn(0x7f02ac0cc6f0 legacy=0x7f02ac15fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.876+0000 7f02aa59c640 1 -- 172.21.15.96:0/136731744 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac160580 con 0x7f02ac0cf110 2024-06-02T23:47:43.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.876+0000 7f02aad9d640 1 --2- 172.21.15.96:0/136731744 >> v2:172.21.15.162:3300/0 conn(0x7f02ac0b33d0 0x7f02ac0cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:47:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02aa59c640 1 --2- 172.21.15.96:0/136731744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cf110 0x7f02ac0cf4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f029c0097a0 tx=0x7f029c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5e9bacbd0297cd2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02a9d9b640 1 -- 172.21.15.96:0/136731744 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c037070 con 0x7f02ac0cf110 2024-06-02T23:47:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02a9d9b640 1 -- 172.21.15.96:0/136731744 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029c032440 con 0x7f02ac0cf110 2024-06-02T23:47:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02a9d9b640 1 -- 172.21.15.96:0/136731744 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c032810 con 0x7f02ac0cf110 2024-06-02T23:47:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02b0cee640 1 -- 172.21.15.96:0/136731744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cf110 msgr2=0x7f02ac0cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02b0cee640 1 --2- 172.21.15.96:0/136731744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cf110 0x7f02ac0cf4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f029c0097a0 tx=0x7f029c02a180 comp rx=0 tx=0).stop 2024-06-02T23:47:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02b0cee640 1 -- 172.21.15.96:0/136731744 shutdown_connections 2024-06-02T23:47:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02b0cee640 1 --2- 172.21.15.96:0/136731744 >> v2:172.21.15.162:3300/0 conn(0x7f02ac0b33d0 0x7f02ac0cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02b0cee640 1 --2- 172.21.15.96:0/136731744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cf110 0x7f02ac0cf4f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02b0cee640 1 -- 172.21.15.96:0/136731744 >> 172.21.15.96:0/136731744 conn(0x7f02ac0b18a0 msgr2=0x7f02ac0b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:43.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02b0cee640 1 -- 172.21.15.96:0/136731744 shutdown_connections 2024-06-02T23:47:43.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.877+0000 7f02b0cee640 1 -- 172.21.15.96:0/136731744 wait complete. 2024-06-02T23:47:43.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.879+0000 7f02b0cee640 1 Processor -- start 2024-06-02T23:47:43.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.879+0000 7f02b0cee640 1 -- start start 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.879+0000 7f02b0cee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ac0b33d0 0x7f02ac13bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.879+0000 7f02b0cee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cc6f0 0x7f02ac1e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.879+0000 7f02b0cee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0cf110 0x7f02ac1e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.879+0000 7f02b0cee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac145d00 con 0x7f02ac0cf110 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02b0cee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac160b40 con 0x7f02ac0b33d0 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02b0cee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f02ac145e80 con 0x7f02ac0cc6f0 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02aad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0cf110 0x7f02ac1e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02aad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0cf110 0x7f02ac1e6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37610/0 (socket says 172.21.15.96:37610) 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02aad9d640 1 -- 172.21.15.96:0/4226673363 learned_addr learned my addr 172.21.15.96:0/4226673363 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02aa59c640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ac0b33d0 0x7f02ac13bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02a1d9b640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cc6f0 0x7f02ac1e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02aad9d640 1 -- 172.21.15.96:0/4226673363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cc6f0 msgr2=0x7f02ac1e7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02aad9d640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cc6f0 0x7f02ac1e7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02aad9d640 1 -- 172.21.15.96:0/4226673363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ac0b33d0 msgr2=0x7f02ac13bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02aad9d640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ac0b33d0 0x7f02ac13bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02aad9d640 1 -- 172.21.15.96:0/4226673363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac15bb30 con 0x7f02ac0cf110 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02aad9d640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0cf110 0x7f02ac1e6e10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009f10 tx=0x7f02a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02a37fe640 1 -- 172.21.15.96:0/4226673363 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a400cc40 con 0x7f02ac0cf110 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02a37fe640 1 -- 172.21.15.96:0/4226673363 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a400cde0 con 0x7f02ac0cf110 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02b0cee640 1 -- 172.21.15.96:0/4226673363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02ac0c92b0 con 0x7f02ac0cf110 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02a37fe640 1 -- 172.21.15.96:0/4226673363 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4003bb0 con 0x7f02ac0cf110 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.880+0000 7f02b0cee640 1 -- 172.21.15.96:0/4226673363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02ac0c9870 con 0x7f02ac0cf110 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.881+0000 7f02b0cee640 1 -- 172.21.15.96:0/4226673363 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02ac0cc130 con 0x7f02ac0cf110 2024-06-02T23:47:43.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.882+0000 7f02a37fe640 1 -- 172.21.15.96:0/4226673363 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7f02a401b030 con 0x7f02ac0cf110 2024-06-02T23:47:43.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.882+0000 7f02a37fe640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f028c06c060 0x7f028c06e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:43.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.882+0000 7f02a37fe640 1 -- 172.21.15.96:0/4226673363 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f02a408b760 con 0x7f02ac0cf110 2024-06-02T23:47:43.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.882+0000 7f02aa59c640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f028c06c060 0x7f028c06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:43.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.883+0000 7f02aa59c640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f028c06c060 0x7f028c06e520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f029c034000 tx=0x7f029c02e000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:43.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:43.887+0000 7f02a37fe640 1 -- 172.21.15.96:0/4226673363 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f02ac0cc130 con 0x7f02ac0cf110 2024-06-02T23:47:44.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.085+0000 7f02b0cee640 1 -- 172.21.15.96:0/4226673363 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir3", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f02ac0683e0 con 0x7f028c06c060 2024-06-02T23:47:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.135+0000 7f02a37fe640 1 -- 172.21.15.96:0/4226673363 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f02ac0683e0 con 0x7f028c06c060 2024-06-02T23:47:44.136 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule activated for path /snap_test_dir1/dir3 2024-06-02T23:47:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.137+0000 7f02b0cee640 1 -- 172.21.15.96:0/4226673363 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f028c06c060 msgr2=0x7f028c06e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.137+0000 7f02b0cee640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f028c06c060 0x7f028c06e520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f029c034000 tx=0x7f029c02e000 comp rx=0 tx=0).stop 2024-06-02T23:47:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.137+0000 7f02b0cee640 1 -- 172.21.15.96:0/4226673363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0cf110 msgr2=0x7f02ac1e6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.137+0000 7f02b0cee640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0cf110 0x7f02ac1e6e10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009f10 tx=0x7f02a400c490 comp rx=0 tx=0).stop 2024-06-02T23:47:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.138+0000 7f02b0cee640 1 -- 172.21.15.96:0/4226673363 shutdown_connections 2024-06-02T23:47:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.138+0000 7f02b0cee640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f028c06c060 0x7f028c06e520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.138+0000 7f02b0cee640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02ac0cf110 0x7f02ac1e6e10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.138+0000 7f02b0cee640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02ac0cc6f0 0x7f02ac1e7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.138+0000 7f02b0cee640 1 --2- 172.21.15.96:0/4226673363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02ac0b33d0 0x7f02ac13bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.138+0000 7f02b0cee640 1 -- 172.21.15.96:0/4226673363 >> 172.21.15.96:0/4226673363 conn(0x7f02ac0b18a0 msgr2=0x7f02ac0cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:44.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.138+0000 7f02b0cee640 1 -- 172.21.15.96:0/4226673363 shutdown_connections 2024-06-02T23:47:44.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.138+0000 7f02b0cee640 1 -- 172.21.15.96:0/4226673363 wait complete. 2024-06-02T23:47:44.148 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2024-06-02T23:47:44.149 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir4 1m 2024-06-02T23:47:44.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.251+0000 7f752abee640 1 Processor -- start 2024-06-02T23:47:44.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.251+0000 7f752abee640 1 -- start start 2024-06-02T23:47:44.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.252+0000 7f752abee640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f75240cf110 0x7f75240cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.252+0000 7f752abee640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f75240cc6f0 0x7f752415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.252+0000 7f752abee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 0x7f75240cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.252+0000 7f752abee640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f75240b2f40 con 0x7f75240cf110 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.252+0000 7f752abee640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f75240b2c40 con 0x7f75240cc6f0 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.252+0000 7f752abee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75240cfa30 con 0x7f75240b33d0 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.252+0000 7f752898a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f75240cf110 0x7f75240cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.252+0000 7f752898a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f75240cf110 0x7f75240cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37622/0 (socket says 172.21.15.96:37622) 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.252+0000 7f752898a640 1 -- 172.21.15.96:0/3398387139 learned_addr learned my addr 172.21.15.96:0/3398387139 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.252+0000 7f7523fff640 1 --2- 172.21.15.96:0/3398387139 >> v2:172.21.15.162:3300/0 conn(0x7f75240cc6f0 0x7f752415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f752918b640 1 --2- 172.21.15.96:0/3398387139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 0x7f75240cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f752898a640 1 -- 172.21.15.96:0/3398387139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 msgr2=0x7f75240cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f752898a640 1 --2- 172.21.15.96:0/3398387139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 0x7f75240cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f752898a640 1 -- 172.21.15.96:0/3398387139 >> v2:172.21.15.162:3300/0 conn(0x7f75240cc6f0 msgr2=0x7f752415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f752898a640 1 --2- 172.21.15.96:0/3398387139 >> v2:172.21.15.162:3300/0 conn(0x7f75240cc6f0 0x7f752415fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f752898a640 1 -- 172.21.15.96:0/3398387139 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7524160580 con 0x7f75240cf110 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f7523fff640 1 --2- 172.21.15.96:0/3398387139 >> v2:172.21.15.162:3300/0 conn(0x7f75240cc6f0 0x7f752415fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:44.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f752918b640 1 --2- 172.21.15.96:0/3398387139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 0x7f75240cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f752898a640 1 --2- 172.21.15.96:0/3398387139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cf110 0x7f75240cf4f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f752406efa0 tx=0x7f751402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50af8ea128f0c3f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f75237fe640 1 -- 172.21.15.96:0/3398387139 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514036070 con 0x7f75240cf110 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f75237fe640 1 -- 172.21.15.96:0/3398387139 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7514031600 con 0x7f75240cf110 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.253+0000 7f75237fe640 1 -- 172.21.15.96:0/3398387139 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75140319d0 con 0x7f75240cf110 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.254+0000 7f752abee640 1 -- 172.21.15.96:0/3398387139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cf110 msgr2=0x7f75240cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.254+0000 7f752abee640 1 --2- 172.21.15.96:0/3398387139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cf110 0x7f75240cf4f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f752406efa0 tx=0x7f751402a6a0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.254+0000 7f752abee640 1 -- 172.21.15.96:0/3398387139 shutdown_connections 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.254+0000 7f752abee640 1 --2- 172.21.15.96:0/3398387139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 0x7f75240cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.254+0000 7f752abee640 1 --2- 172.21.15.96:0/3398387139 >> v2:172.21.15.162:3300/0 conn(0x7f75240cc6f0 0x7f752415fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.254+0000 7f752abee640 1 --2- 172.21.15.96:0/3398387139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cf110 0x7f75240cf4f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.254+0000 7f752abee640 1 -- 172.21.15.96:0/3398387139 >> 172.21.15.96:0/3398387139 conn(0x7f75240b18a0 msgr2=0x7f75240b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.254+0000 7f752abee640 1 -- 172.21.15.96:0/3398387139 shutdown_connections 2024-06-02T23:47:44.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.254+0000 7f752abee640 1 -- 172.21.15.96:0/3398387139 wait complete. 2024-06-02T23:47:44.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.255+0000 7f752abee640 1 Processor -- start 2024-06-02T23:47:44.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.255+0000 7f752abee640 1 -- start start 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f752abee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 0x7f752413a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f752abee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cc6f0 0x7f7524156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f752abee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75240cf110 0x7f75241392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f752abee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7524160b40 con 0x7f75240cc6f0 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f752abee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7524160290 con 0x7f75240cf110 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f752abee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7524145d00 con 0x7f75240b33d0 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f7523fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cc6f0 0x7f7524156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f7523fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cc6f0 0x7f7524156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37636/0 (socket says 172.21.15.96:37636) 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f7523fff640 1 -- 172.21.15.96:0/3952950903 learned_addr learned my addr 172.21.15.96:0/3952950903 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f752898a640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 0x7f752413a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f752918b640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75240cf110 0x7f75241392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f7523fff640 1 -- 172.21.15.96:0/3952950903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 msgr2=0x7f752413a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f7523fff640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 0x7f752413a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f7523fff640 1 -- 172.21.15.96:0/3952950903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75240cf110 msgr2=0x7f75241392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f7523fff640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75240cf110 0x7f75241392a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.256+0000 7f7523fff640 1 -- 172.21.15.96:0/3952950903 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75241578d0 con 0x7f75240cc6f0 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.257+0000 7f7523fff640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cc6f0 0x7f7524156570 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c7f0 tx=0x7f750c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.257+0000 7f75217fa640 1 -- 172.21.15.96:0/3952950903 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c015070 con 0x7f75240cc6f0 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.257+0000 7f75217fa640 1 -- 172.21.15.96:0/3952950903 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c007a30 con 0x7f75240cc6f0 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.257+0000 7f752abee640 1 -- 172.21.15.96:0/3952950903 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75241397e0 con 0x7f75240cc6f0 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.257+0000 7f75217fa640 1 -- 172.21.15.96:0/3952950903 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c007e00 con 0x7f75240cc6f0 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.257+0000 7f752abee640 1 -- 172.21.15.96:0/3952950903 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7524156fa0 con 0x7f75240cc6f0 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.258+0000 7f752abee640 1 -- 172.21.15.96:0/3952950903 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75240683e0 con 0x7f75240cc6f0 2024-06-02T23:47:44.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.258+0000 7f75217fa640 1 -- 172.21.15.96:0/3952950903 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7f750c018070 con 0x7f75240cc6f0 2024-06-02T23:47:44.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.259+0000 7f75217fa640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f750406c030 0x7f750406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.259+0000 7f752898a640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f750406c030 0x7f750406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.259+0000 7f75217fa640 1 -- 172.21.15.96:0/3952950903 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f750c08b4d0 con 0x7f75240cc6f0 2024-06-02T23:47:44.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.259+0000 7f752898a640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f750406c030 0x7f750406e4f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7514033000 tx=0x7f7514009000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:44.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.263+0000 7f75217fa640 1 -- 172.21.15.96:0/3952950903 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f750c059860 con 0x7f75240cc6f0 2024-06-02T23:47:44.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.459+0000 7f752abee640 1 -- 172.21.15.96:0/3952950903 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir4", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f75240cc080 con 0x7f750406c030 2024-06-02T23:47:44.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.510+0000 7f75217fa640 1 -- 172.21.15.96:0/3952950903 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f75240cc080 con 0x7f750406c030 2024-06-02T23:47:44.510 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule activated for path /snap_test_dir1/dir4 2024-06-02T23:47:44.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 -- 172.21.15.96:0/3952950903 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f750406c030 msgr2=0x7f750406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f750406c030 0x7f750406e4f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7514033000 tx=0x7f7514009000 comp rx=0 tx=0).stop 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 -- 172.21.15.96:0/3952950903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cc6f0 msgr2=0x7f7524156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cc6f0 0x7f7524156570 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f750c00c7f0 tx=0x7f750c00cbf0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 -- 172.21.15.96:0/3952950903 shutdown_connections 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f750406c030 0x7f750406e4f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75240cf110 0x7f75241392a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75240cc6f0 0x7f7524156570 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 --2- 172.21.15.96:0/3952950903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75240b33d0 0x7f752413a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 -- 172.21.15.96:0/3952950903 >> 172.21.15.96:0/3952950903 conn(0x7f75240b18a0 msgr2=0x7f75240cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 -- 172.21.15.96:0/3952950903 shutdown_connections 2024-06-02T23:47:44.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.512+0000 7f752abee640 1 -- 172.21.15.96:0/3952950903 wait complete. 2024-06-02T23:47:44.523 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2024-06-02T23:47:44.523 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir5 1m 2024-06-02T23:47:44.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.625+0000 7fc8447c1640 1 Processor -- start 2024-06-02T23:47:44.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.625+0000 7fc8447c1640 1 -- start start 2024-06-02T23:47:44.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.626+0000 7fc8447c1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc83c0cf6f0 0x7fc83c0d4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.626+0000 7fc8447c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c161f40 0x7fc83c1623d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.626+0000 7fc8447c1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc83c0cfd80 con 0x7fc83c15e3e0 2024-06-02T23:47:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.626+0000 7fc8447c1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc83c0cfb50 con 0x7fc83c0cf6f0 2024-06-02T23:47:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.626+0000 7fc8447c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc83c0d1e40 con 0x7fc83c161f40 2024-06-02T23:47:44.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc841d5c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc83c0cf6f0 0x7fc83c0d4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc842d5e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c161f40 0x7fc83c1623d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc842d5e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c161f40 0x7fc83c1623d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:60716/0 (socket says 172.21.15.96:60716) 2024-06-02T23:47:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc842d5e640 1 -- 172.21.15.96:0/2488161234 learned_addr learned my addr 172.21.15.96:0/2488161234 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc841d5c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc83c0cf6f0 0x7fc83c0d4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:38784/0 (socket says 172.21.15.96:38784) 2024-06-02T23:47:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc84255d640 1 --1- 172.21.15.96:0/2488161234 >> v1:172.21.15.162:6789/0 conn(0x7fc83c15e3e0 0x7fc83c0d2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:34418/0 (socket says 172.21.15.96:34418) 2024-06-02T23:47:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc842d5e640 1 -- 172.21.15.96:0/2488161234 >> v2:172.21.15.162:3300/0 conn(0x7fc83c0cf6f0 msgr2=0x7fc83c0d4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc842d5e640 1 --2- 172.21.15.96:0/2488161234 >> v2:172.21.15.162:3300/0 conn(0x7fc83c0cf6f0 0x7fc83c0d4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc842d5e640 1 -- 172.21.15.96:0/2488161234 >> v1:172.21.15.162:6789/0 conn(0x7fc83c15e3e0 legacy=0x7fc83c0d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc842d5e640 1 -- 172.21.15.96:0/2488161234 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c0d2120 con 0x7fc83c161f40 2024-06-02T23:47:44.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.627+0000 7fc841d5c640 1 --2- 172.21.15.96:0/2488161234 >> v2:172.21.15.162:3300/0 conn(0x7fc83c0cf6f0 0x7fc83c0d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:47:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.628+0000 7fc842d5e640 1 --2- 172.21.15.96:0/2488161234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c161f40 0x7fc83c1623d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc834009e50 tx=0x7fc83402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=962ed73fe1b25e18 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.628+0000 7fc84155b640 1 -- 172.21.15.96:0/2488161234 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834036070 con 0x7fc83c161f40 2024-06-02T23:47:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.628+0000 7fc84155b640 1 -- 172.21.15.96:0/2488161234 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc834031600 con 0x7fc83c161f40 2024-06-02T23:47:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.628+0000 7fc84155b640 1 -- 172.21.15.96:0/2488161234 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8340319d0 con 0x7fc83c161f40 2024-06-02T23:47:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.629+0000 7fc8447c1640 1 -- 172.21.15.96:0/2488161234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c161f40 msgr2=0x7fc83c1623d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.629+0000 7fc8447c1640 1 --2- 172.21.15.96:0/2488161234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c161f40 0x7fc83c1623d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc834009e50 tx=0x7fc83402a680 comp rx=0 tx=0).stop 2024-06-02T23:47:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.629+0000 7fc8447c1640 1 -- 172.21.15.96:0/2488161234 shutdown_connections 2024-06-02T23:47:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.629+0000 7fc8447c1640 1 --2- 172.21.15.96:0/2488161234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c161f40 0x7fc83c1623d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.629+0000 7fc8447c1640 1 --2- 172.21.15.96:0/2488161234 >> v2:172.21.15.162:3300/0 conn(0x7fc83c0cf6f0 0x7fc83c0d4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.629+0000 7fc8447c1640 1 -- 172.21.15.96:0/2488161234 >> 172.21.15.96:0/2488161234 conn(0x7fc83c0d40d0 msgr2=0x7fc83c0d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.629+0000 7fc8447c1640 1 -- 172.21.15.96:0/2488161234 shutdown_connections 2024-06-02T23:47:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.629+0000 7fc8447c1640 1 -- 172.21.15.96:0/2488161234 wait complete. 2024-06-02T23:47:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.630+0000 7fc8447c1640 1 Processor -- start 2024-06-02T23:47:44.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.630+0000 7fc8447c1640 1 -- start start 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.630+0000 7fc8447c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0cf6f0 0x7fc83c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc8447c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c15a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc8447c1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc83c161f40 0x7fc83c06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc8447c1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c0c7c20 con 0x7fc83c161f40 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc8447c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c15e7c0 con 0x7fc83c15e3e0 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc8447c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc83c0c7da0 con 0x7fc83c0cf6f0 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc842d5e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc83c161f40 0x7fc83c06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc842d5e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc83c161f40 0x7fc83c06cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37640/0 (socket says 172.21.15.96:37640) 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc842d5e640 1 -- 172.21.15.96:0/812931694 learned_addr learned my addr 172.21.15.96:0/812931694 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc841d5c640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc84255d640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0cf6f0 0x7fc83c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc842d5e640 1 -- 172.21.15.96:0/812931694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0cf6f0 msgr2=0x7fc83c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc842d5e640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0cf6f0 0x7fc83c0cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc842d5e640 1 -- 172.21.15.96:0/812931694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 msgr2=0x7fc83c15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc842d5e640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c15a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc842d5e640 1 -- 172.21.15.96:0/812931694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c1f8350 con 0x7fc83c161f40 2024-06-02T23:47:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc84255d640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0cf6f0 0x7fc83c0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc841d5c640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc842d5e640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc83c161f40 0x7fc83c06cf00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc834034040 tx=0x7fc834004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc832ffd640 1 -- 172.21.15.96:0/812931694 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834041020 con 0x7fc83c161f40 2024-06-02T23:47:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc832ffd640 1 -- 172.21.15.96:0/812931694 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8340077a0 con 0x7fc83c161f40 2024-06-02T23:47:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc8447c1640 1 -- 172.21.15.96:0/812931694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc83c1f8630 con 0x7fc83c161f40 2024-06-02T23:47:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc832ffd640 1 -- 172.21.15.96:0/812931694 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834036040 con 0x7fc83c161f40 2024-06-02T23:47:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.631+0000 7fc8447c1640 1 -- 172.21.15.96:0/812931694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83c0cd780 con 0x7fc83c161f40 2024-06-02T23:47:44.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.632+0000 7fc8447c1640 1 -- 172.21.15.96:0/812931694 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83c0c9ae0 con 0x7fc83c161f40 2024-06-02T23:47:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.633+0000 7fc832ffd640 1 -- 172.21.15.96:0/812931694 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7fc834044020 con 0x7fc83c161f40 2024-06-02T23:47:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.634+0000 7fc832ffd640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc82006c030 0x7fc82006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.634+0000 7fc832ffd640 1 -- 172.21.15.96:0/812931694 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7fc8340ac1a0 con 0x7fc83c161f40 2024-06-02T23:47:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.634+0000 7fc84255d640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc82006c030 0x7fc82006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:44.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.634+0000 7fc84255d640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc82006c030 0x7fc82006e4f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc838000f60 tx=0x7fc838009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:44.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.642+0000 7fc832ffd640 1 -- 172.21.15.96:0/812931694 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc83c0c9ae0 con 0x7fc83c161f40 2024-06-02T23:47:44.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.838+0000 7fc8447c1640 1 -- 172.21.15.96:0/812931694 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir5", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc83c0cd290 con 0x7fc82006c030 2024-06-02T23:47:44.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.884+0000 7fc832ffd640 1 -- 172.21.15.96:0/812931694 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc83c0cd290 con 0x7fc82006c030 2024-06-02T23:47:44.885 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule activated for path /snap_test_dir1/dir5 2024-06-02T23:47:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.886+0000 7fc8447c1640 1 -- 172.21.15.96:0/812931694 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc82006c030 msgr2=0x7fc82006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.886+0000 7fc8447c1640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc82006c030 0x7fc82006e4f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc838000f60 tx=0x7fc838009040 comp rx=0 tx=0).stop 2024-06-02T23:47:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.886+0000 7fc8447c1640 1 -- 172.21.15.96:0/812931694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc83c161f40 msgr2=0x7fc83c06cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.886+0000 7fc8447c1640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc83c161f40 0x7fc83c06cf00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc834034040 tx=0x7fc834004a40 comp rx=0 tx=0).stop 2024-06-02T23:47:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.886+0000 7fc8447c1640 1 -- 172.21.15.96:0/812931694 shutdown_connections 2024-06-02T23:47:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.886+0000 7fc8447c1640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc82006c030 0x7fc82006e4f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.886+0000 7fc8447c1640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc83c161f40 0x7fc83c06cf00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.886+0000 7fc8447c1640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc83c15e3e0 0x7fc83c15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.886+0000 7fc8447c1640 1 --2- 172.21.15.96:0/812931694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc83c0cf6f0 0x7fc83c0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.886+0000 7fc8447c1640 1 -- 172.21.15.96:0/812931694 >> 172.21.15.96:0/812931694 conn(0x7fc83c0d40d0 msgr2=0x7fc83c0c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.887+0000 7fc8447c1640 1 -- 172.21.15.96:0/812931694 shutdown_connections 2024-06-02T23:47:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:44.887+0000 7fc8447c1640 1 -- 172.21.15.96:0/812931694 wait complete. 2024-06-02T23:47:44.897 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2024-06-02T23:47:44.898 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir6 1m 2024-06-02T23:47:45.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.000+0000 7f98684fc640 1 Processor -- start 2024-06-02T23:47:45.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.000+0000 7f98684fc640 1 -- start start 2024-06-02T23:47:45.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.001+0000 7f98684fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9860143d70 0x7f986006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.001+0000 7f98684fc640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986006d2e0 con 0x7f98600ced40 2024-06-02T23:47:45.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.001+0000 7f98684fc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986006d5c0 con 0x7f986006e380 2024-06-02T23:47:45.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.001+0000 7f98684fc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f986006d8a0 con 0x7f9860143d70 2024-06-02T23:47:45.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.001+0000 7f9866a99640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f98600ced40 0x7f9860070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50452/0 (socket says 172.21.15.96:50452) 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.001+0000 7f9866a99640 1 -- 172.21.15.96:0/3443662836 learned_addr learned my addr 172.21.15.96:0/3443662836 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.001+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1780710284 0 0) 0x7f986006d2e0 con 0x7f98600ced40 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.001+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9848003520 con 0x7f98600ced40 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.001+0000 7f9866298640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9860143d70 0x7f986006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3440652346 0 0) 0x7f9848003520 con 0x7f98600ced40 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9860143d70 msgr2=0x7f986006cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9860143d70 0x7f986006cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 >> v1:172.21.15.162:6789/0 conn(0x7f986006e380 legacy=0x7f9860144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986006db80 con 0x7f98600ced40 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f9858001670 con 0x7f98600ced40 2024-06-02T23:47:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 >> v1:172.21.15.96:6789/0 conn(0x7f98600ced40 legacy=0x7f9860070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9860143d70 0x7f98480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9848003f60 0x7f9848004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9848004d40 0x7f98480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f986006d8a0 con 0x7f9848003f60 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f984800bb50 con 0x7f9848004d40 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f984800df60 con 0x7f9860143d70 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865a97640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9848003f60 0x7f9848004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9866298640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9860143d70 0x7f98480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9866a99640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9848004d40 0x7f98480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865a97640 1 -- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9860143d70 msgr2=0x7f98480039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865a97640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9860143d70 0x7f98480039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865a97640 1 -- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9848004d40 msgr2=0x7f98480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865a97640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9848004d40 0x7f98480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.002+0000 7f9865a97640 1 -- 172.21.15.96:0/3443662836 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9848003520 con 0x7f9848003f60 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.003+0000 7f9865a97640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9848003f60 0x7f9848004800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9854001720 tx=0x7f9848005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec8cd22e704f8d1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.003+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9854001370 con 0x7f9848003f60 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.003+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98540052d0 con 0x7f9848003f60 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.003+0000 7f9865296640 1 -- 172.21.15.96:0/3443662836 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985402abc0 con 0x7f9848003f60 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.004+0000 7f98684fc640 1 -- 172.21.15.96:0/3443662836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9848003f60 msgr2=0x7f9848004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.004+0000 7f98684fc640 1 --2- 172.21.15.96:0/3443662836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9848003f60 0x7f9848004800 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9854001720 tx=0x7f9848005830 comp rx=0 tx=0).stop 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.004+0000 7f9866a99640 1 -- 172.21.15.96:0/3443662836 reap_dead start 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.004+0000 7f98684fc640 1 -- 172.21.15.96:0/3443662836 shutdown_connections 2024-06-02T23:47:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.004+0000 7f98684fc640 1 -- 172.21.15.96:0/3443662836 >> 172.21.15.96:0/3443662836 conn(0x7f98600b18a0 msgr2=0x7f98600b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:45.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.004+0000 7f98684fc640 1 -- 172.21.15.96:0/3443662836 shutdown_connections 2024-06-02T23:47:45.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.004+0000 7f98684fc640 1 -- 172.21.15.96:0/3443662836 wait complete. 2024-06-02T23:47:45.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.005+0000 7f98684fc640 1 Processor -- start 2024-06-02T23:47:45.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.005+0000 7f98684fc640 1 -- start start 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f98684fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9848003f60 0x7f986015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f98684fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986013a1c0 0x7f9860137a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f98684fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9860137fc0 0x7f9860138440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f98684fc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f986006ce80 con 0x7f9860137fc0 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f98684fc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f986006cd00 con 0x7f9848003f60 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f98684fc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f986006d000 con 0x7f986013a1c0 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866a99640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9860137fc0 0x7f9860138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866a99640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9860137fc0 0x7f9860138440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37652/0 (socket says 172.21.15.96:37652) 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866a99640 1 -- 172.21.15.96:0/2397395453 learned_addr learned my addr 172.21.15.96:0/2397395453 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866298640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9848003f60 0x7f986015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9865a97640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986013a1c0 0x7f9860137a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866a99640 1 -- 172.21.15.96:0/2397395453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986013a1c0 msgr2=0x7f9860137a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866a99640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986013a1c0 0x7f9860137a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866a99640 1 -- 172.21.15.96:0/2397395453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9848003f60 msgr2=0x7f986015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866a99640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9848003f60 0x7f986015a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866a99640 1 -- 172.21.15.96:0/2397395453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9860134750 con 0x7f9860137fc0 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866298640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9848003f60 0x7f986015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f9866a99640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9860137fc0 0x7f9860138440 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9860070c30 tx=0x7f9858007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f985effd640 1 -- 172.21.15.96:0/2397395453 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985800f680 con 0x7f9860137fc0 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f985effd640 1 -- 172.21.15.96:0/2397395453 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9858018070 con 0x7f9860137fc0 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f98684fc640 1 -- 172.21.15.96:0/2397395453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9860134a30 con 0x7f9860137fc0 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f985effd640 1 -- 172.21.15.96:0/2397395453 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985800faa0 con 0x7f9860137fc0 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.006+0000 7f98684fc640 1 -- 172.21.15.96:0/2397395453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9860134ff0 con 0x7f9860137fc0 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.007+0000 7f98684fc640 1 -- 172.21.15.96:0/2397395453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98600683e0 con 0x7f9860137fc0 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.008+0000 7f985effd640 1 -- 172.21.15.96:0/2397395453 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7f985800fc40 con 0x7f9860137fc0 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.008+0000 7f985effd640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f984c06c030 0x7f984c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.008+0000 7f985effd640 1 -- 172.21.15.96:0/2397395453 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f985808b220 con 0x7f9860137fc0 2024-06-02T23:47:45.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.008+0000 7f9866298640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f984c06c030 0x7f984c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.009+0000 7f9866298640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f984c06c030 0x7f984c06e4f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98500074d0 tx=0x7f985000b040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:45.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.013+0000 7f985effd640 1 -- 172.21.15.96:0/2397395453 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f98580596c0 con 0x7f9860137fc0 2024-06-02T23:47:45.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.207+0000 7f98684fc640 1 -- 172.21.15.96:0/2397395453 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir6", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f98600b2490 con 0x7f984c06c030 2024-06-02T23:47:45.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.260+0000 7f985effd640 1 -- 172.21.15.96:0/2397395453 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f98600b2490 con 0x7f984c06c030 2024-06-02T23:47:45.261 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule activated for path /snap_test_dir1/dir6 2024-06-02T23:47:45.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.262+0000 7f98684fc640 1 -- 172.21.15.96:0/2397395453 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f984c06c030 msgr2=0x7f984c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.262+0000 7f98684fc640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f984c06c030 0x7f984c06e4f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98500074d0 tx=0x7f985000b040 comp rx=0 tx=0).stop 2024-06-02T23:47:45.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.262+0000 7f98684fc640 1 -- 172.21.15.96:0/2397395453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9860137fc0 msgr2=0x7f9860138440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.262+0000 7f98684fc640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9860137fc0 0x7f9860138440 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9860070c30 tx=0x7f9858007430 comp rx=0 tx=0).stop 2024-06-02T23:47:45.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.263+0000 7f98684fc640 1 -- 172.21.15.96:0/2397395453 shutdown_connections 2024-06-02T23:47:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.263+0000 7f98684fc640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f984c06c030 0x7f984c06e4f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.263+0000 7f98684fc640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9860137fc0 0x7f9860138440 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.263+0000 7f98684fc640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986013a1c0 0x7f9860137a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.263+0000 7f98684fc640 1 --2- 172.21.15.96:0/2397395453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9848003f60 0x7f986015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.263+0000 7f98684fc640 1 -- 172.21.15.96:0/2397395453 >> 172.21.15.96:0/2397395453 conn(0x7f98600b18a0 msgr2=0x7f9860072cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.263+0000 7f98684fc640 1 -- 172.21.15.96:0/2397395453 shutdown_connections 2024-06-02T23:47:45.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.263+0000 7f98684fc640 1 -- 172.21.15.96:0/2397395453 wait complete. 2024-06-02T23:47:45.273 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2024-06-02T23:47:45.274 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir7 1m 2024-06-02T23:47:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.376+0000 7f541d2e1640 1 Processor -- start 2024-06-02T23:47:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.376+0000 7f541d2e1640 1 -- start start 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f541d2e1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54180d0940 0x7f54180d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f541d2e1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f54180ced30 0x7f541815f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f541d2e1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54180d1260 con 0x7f5418161e50 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f541d2e1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f54180cfed0 con 0x7f54180ced30 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f541d2e1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54180cf2c0 con 0x7f54180d0940 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54177fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5418161e50 0x7f54181622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50458/0 (socket says 172.21.15.96:50458) 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54177fe640 1 -- 172.21.15.96:0/2167164556 learned_addr learned my addr 172.21.15.96:0/2167164556 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f540ffff640 1 --2- 172.21.15.96:0/2167164556 >> v2:172.21.15.162:3300/0 conn(0x7f54180ced30 0x7f541815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f5416ffd640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54180d0940 0x7f54180d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528494939 0 0) 0x7f54180d1260 con 0x7f5418161e50 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5404003520 con 0x7f5418161e50 2024-06-02T23:47:45.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2598132591 0 0) 0x7f5404003520 con 0x7f5418161e50 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54180d0940 msgr2=0x7f54180d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54180d0940 0x7f54180d0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 >> v2:172.21.15.162:3300/0 conn(0x7f54180ced30 msgr2=0x7f541815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 --2- 172.21.15.96:0/2167164556 >> v2:172.21.15.162:3300/0 conn(0x7f54180ced30 0x7f541815f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54180cf5a0 con 0x7f5418161e50 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f54100019f0 con 0x7f5418161e50 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 >> v1:172.21.15.96:6789/0 conn(0x7f5418161e50 legacy=0x7f54181622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 0x7f5404003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54180d0940 0x7f5404004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.377+0000 7f54167fc640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5404004d40 0x7f54040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f54180cfed0 con 0x7f54040039b0 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54180cf2c0 con 0x7f5404004d40 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f540400b9c0 con 0x7f54180d0940 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f5416ffd640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 0x7f5404003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f540ffff640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54180d0940 0x7f5404004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f54177fe640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5404004d40 0x7f54040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f5416ffd640 1 -- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54180d0940 msgr2=0x7f5404004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f5416ffd640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54180d0940 0x7f5404004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f5416ffd640 1 -- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5404004d40 msgr2=0x7f54040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f5416ffd640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5404004d40 0x7f54040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f5416ffd640 1 -- 172.21.15.96:0/2167164556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5404003520 con 0x7f54040039b0 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f54177fe640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5404004d40 0x7f54040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.378+0000 7f540ffff640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54180d0940 0x7f5404004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:45.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f5416ffd640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 0x7f5404003dd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5408009ac0 tx=0x7f5404005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96128385daa9fc37 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408036070 con 0x7f54040039b0 2024-06-02T23:47:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5408031400 con 0x7f54040039b0 2024-06-02T23:47:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f54167fc640 1 -- 172.21.15.96:0/2167164556 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408009690 con 0x7f54040039b0 2024-06-02T23:47:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f541d2e1640 1 -- 172.21.15.96:0/2167164556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 msgr2=0x7f5404003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f541d2e1640 1 --2- 172.21.15.96:0/2167164556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 0x7f5404003dd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5408009ac0 tx=0x7f5404005830 comp rx=0 tx=0).stop 2024-06-02T23:47:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f54177fe640 1 -- 172.21.15.96:0/2167164556 reap_dead start 2024-06-02T23:47:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f541d2e1640 1 -- 172.21.15.96:0/2167164556 shutdown_connections 2024-06-02T23:47:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f541d2e1640 1 -- 172.21.15.96:0/2167164556 >> 172.21.15.96:0/2167164556 conn(0x7f541809d3d0 msgr2=0x7f54180d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f541d2e1640 1 -- 172.21.15.96:0/2167164556 shutdown_connections 2024-06-02T23:47:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.379+0000 7f541d2e1640 1 -- 172.21.15.96:0/2167164556 wait complete. 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.380+0000 7f541d2e1640 1 Processor -- start 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.380+0000 7f541d2e1640 1 -- start start 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f541d2e1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 0x7f54180b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f541d2e1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f541815b4f0 0x7f54180ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f541d2e1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54181f3e30 0x7f54181f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f541d2e1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f541815e6d0 con 0x7f54040039b0 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f541d2e1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54180cfb60 con 0x7f54181f3e30 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f541d2e1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f541815f8a0 con 0x7f541815b4f0 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f5416ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 0x7f54180b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f5416ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 0x7f54180b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37670/0 (socket says 172.21.15.96:37670) 2024-06-02T23:47:45.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f5416ffd640 1 -- 172.21.15.96:0/1437790518 learned_addr learned my addr 172.21.15.96:0/1437790518 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f540ffff640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f541815b4f0 0x7f54180ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.381+0000 7f54177fe640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54181f3e30 0x7f54181f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f5416ffd640 1 -- 172.21.15.96:0/1437790518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f541815b4f0 msgr2=0x7f54180ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f5416ffd640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f541815b4f0 0x7f54180ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f5416ffd640 1 -- 172.21.15.96:0/1437790518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54181f3e30 msgr2=0x7f54181f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f5416ffd640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54181f3e30 0x7f54181f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f5416ffd640 1 -- 172.21.15.96:0/1437790518 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54181f47f0 con 0x7f54040039b0 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f5416ffd640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 0x7f54180b6d70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5408009ac0 tx=0x7f5408004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f540f7fe640 1 -- 172.21.15.96:0/1437790518 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408040020 con 0x7f54040039b0 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f540f7fe640 1 -- 172.21.15.96:0/1437790518 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5408003940 con 0x7f54040039b0 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f541d2e1640 1 -- 172.21.15.96:0/1437790518 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54180b9110 con 0x7f54040039b0 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f540f7fe640 1 -- 172.21.15.96:0/1437790518 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5408036040 con 0x7f54040039b0 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.382+0000 7f541d2e1640 1 -- 172.21.15.96:0/1437790518 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54180b96d0 con 0x7f54040039b0 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.383+0000 7f541d2e1640 1 -- 172.21.15.96:0/1437790518 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54180683e0 con 0x7f54040039b0 2024-06-02T23:47:45.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.383+0000 7f540f7fe640 1 -- 172.21.15.96:0/1437790518 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7f5408043020 con 0x7f54040039b0 2024-06-02T23:47:45.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.384+0000 7f540f7fe640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f53f806c030 0x7f53f806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.384+0000 7f540f7fe640 1 -- 172.21.15.96:0/1437790518 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f54080ab950 con 0x7f54040039b0 2024-06-02T23:47:45.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.384+0000 7f540ffff640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f53f806c030 0x7f53f806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.384+0000 7f540ffff640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f53f806c030 0x7f53f806e4f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f54180ca550 tx=0x7f5400008040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:45.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.388+0000 7f540f7fe640 1 -- 172.21.15.96:0/1437790518 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f540804a030 con 0x7f54040039b0 2024-06-02T23:47:45.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.584+0000 7f541d2e1640 1 -- 172.21.15.96:0/1437790518 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir7", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f54180d16f0 con 0x7f53f806c030 2024-06-02T23:47:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.629+0000 7f540f7fe640 1 -- 172.21.15.96:0/1437790518 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f54180d16f0 con 0x7f53f806c030 2024-06-02T23:47:45.629 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule activated for path /snap_test_dir1/dir7 2024-06-02T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 -- 172.21.15.96:0/1437790518 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f53f806c030 msgr2=0x7f53f806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f53f806c030 0x7f53f806e4f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f54180ca550 tx=0x7f5400008040 comp rx=0 tx=0).stop 2024-06-02T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 -- 172.21.15.96:0/1437790518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 msgr2=0x7f54180b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 0x7f54180b6d70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5408009ac0 tx=0x7f5408004730 comp rx=0 tx=0).stop 2024-06-02T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 -- 172.21.15.96:0/1437790518 shutdown_connections 2024-06-02T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f53f806c030 0x7f53f806e4f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54181f3e30 0x7f54181f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f541815b4f0 0x7f54180ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 --2- 172.21.15.96:0/1437790518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54040039b0 0x7f54180b6d70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 -- 172.21.15.96:0/1437790518 >> 172.21.15.96:0/1437790518 conn(0x7f541809d3d0 msgr2=0x7f541806d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 -- 172.21.15.96:0/1437790518 shutdown_connections 2024-06-02T23:47:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.631+0000 7f541d2e1640 1 -- 172.21.15.96:0/1437790518 wait complete. 2024-06-02T23:47:45.642 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2024-06-02T23:47:45.642 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir8 1m 2024-06-02T23:47:45.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.745+0000 7f0ce8f90640 1 Processor -- start 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.745+0000 7f0ce8f90640 1 -- start start 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0ce8f90640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce4143d70 0x7f0ce406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0ce8f90640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0ce406e380 0x7f0ce4144570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0ce8f90640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ce406d2e0 con 0x7f0ce40ced40 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0ce8f90640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0ce406d5c0 con 0x7f0ce406e380 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0ce8f90640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce406d8a0 con 0x7f0ce4143d70 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0cdbfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0ce406e380 0x7f0ce4144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0ce2d9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f0ce40ced40 0x7f0ce415eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50470/0 (socket says 172.21.15.96:50470) 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0ce2d9d640 1 -- 172.21.15.96:0/1048557157 learned_addr learned my addr 172.21.15.96:0/1048557157 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0ce259c640 1 --2- 172.21.15.96:0/1048557157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce4143d70 0x7f0ce406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0cdbfff640 1 -- 172.21.15.96:0/1048557157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce4143d70 msgr2=0x7f0ce406cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0cdbfff640 1 --2- 172.21.15.96:0/1048557157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce4143d70 0x7f0ce406cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0cdbfff640 1 -- 172.21.15.96:0/1048557157 >> v1:172.21.15.96:6789/0 conn(0x7f0ce40ced40 legacy=0x7f0ce415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0ce1d9b640 1 -- 172.21.15.96:0/1048557157 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491930859 0 0) 0x7f0ce406d2e0 con 0x7f0ce40ced40 2024-06-02T23:47:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0cdbfff640 1 -- 172.21.15.96:0/1048557157 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce406db80 con 0x7f0ce406e380 2024-06-02T23:47:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.746+0000 7f0ce259c640 1 --2- 172.21.15.96:0/1048557157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce4143d70 0x7f0ce406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.747+0000 7f0cdbfff640 1 --2- 172.21.15.96:0/1048557157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce406e380 0x7f0ce4144570 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0097a0 tx=0x7f0ccc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727a5afc33eefe83 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.747+0000 7f0ce1d9b640 1 -- 172.21.15.96:0/1048557157 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc037070 con 0x7f0ce406e380 2024-06-02T23:47:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.747+0000 7f0ce1d9b640 1 -- 172.21.15.96:0/1048557157 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ccc02ae50 con 0x7f0ce406e380 2024-06-02T23:47:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.747+0000 7f0ce1d9b640 1 -- 172.21.15.96:0/1048557157 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc032660 con 0x7f0ce406e380 2024-06-02T23:47:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.748+0000 7f0ce8f90640 1 -- 172.21.15.96:0/1048557157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce406e380 msgr2=0x7f0ce4144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.748+0000 7f0ce8f90640 1 --2- 172.21.15.96:0/1048557157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce406e380 0x7f0ce4144570 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc0097a0 tx=0x7f0ccc02a100 comp rx=0 tx=0).stop 2024-06-02T23:47:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.748+0000 7f0ce8f90640 1 -- 172.21.15.96:0/1048557157 shutdown_connections 2024-06-02T23:47:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.748+0000 7f0ce8f90640 1 --2- 172.21.15.96:0/1048557157 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce406e380 0x7f0ce4144570 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.748+0000 7f0ce8f90640 1 --2- 172.21.15.96:0/1048557157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce4143d70 0x7f0ce406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.748+0000 7f0ce8f90640 1 -- 172.21.15.96:0/1048557157 >> 172.21.15.96:0/1048557157 conn(0x7f0ce40b18a0 msgr2=0x7f0ce40b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:45.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.748+0000 7f0ce8f90640 1 -- 172.21.15.96:0/1048557157 shutdown_connections 2024-06-02T23:47:45.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.748+0000 7f0ce8f90640 1 -- 172.21.15.96:0/1048557157 wait complete. 2024-06-02T23:47:45.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.749+0000 7f0ce8f90640 1 Processor -- start 2024-06-02T23:47:45.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.749+0000 7f0ce8f90640 1 -- start start 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce8f90640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce406e380 0x7f0ce413d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce8f90640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ce40ced40 0x7f0ce415bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce8f90640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce4143d70 0x7f0ce413ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce8f90640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce40cf190 con 0x7f0ce4143d70 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce8f90640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce4144ab0 con 0x7f0ce40ced40 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce8f90640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce40cf310 con 0x7f0ce406e380 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce2d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce4143d70 0x7f0ce413ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce2d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce4143d70 0x7f0ce413ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37690/0 (socket says 172.21.15.96:37690) 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce2d9d640 1 -- 172.21.15.96:0/3732570807 learned_addr learned my addr 172.21.15.96:0/3732570807 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce259c640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce406e380 0x7f0ce413d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0cdbfff640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ce40ced40 0x7f0ce415bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce2d9d640 1 -- 172.21.15.96:0/3732570807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce406e380 msgr2=0x7f0ce413d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce2d9d640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce406e380 0x7f0ce413d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce2d9d640 1 -- 172.21.15.96:0/3732570807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ce40ced40 msgr2=0x7f0ce415bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce2d9d640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ce40ced40 0x7f0ce415bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce2d9d640 1 -- 172.21.15.96:0/3732570807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce413e630 con 0x7f0ce4143d70 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0cdbfff640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ce40ced40 0x7f0ce415bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce2d9d640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce4143d70 0x7f0ce413ca40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00c7d0 tx=0x7f0cdc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0cdaffd640 1 -- 172.21.15.96:0/3732570807 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc018070 con 0x7f0ce4143d70 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0cdaffd640 1 -- 172.21.15.96:0/3732570807 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00a640 con 0x7f0ce4143d70 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce8f90640 1 -- 172.21.15.96:0/3732570807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce413dab0 con 0x7f0ce4143d70 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0cdaffd640 1 -- 172.21.15.96:0/3732570807 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00aa70 con 0x7f0ce4143d70 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.750+0000 7f0ce8f90640 1 -- 172.21.15.96:0/3732570807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce413e070 con 0x7f0ce4143d70 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.752+0000 7f0ce8f90640 1 -- 172.21.15.96:0/3732570807 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce40683e0 con 0x7f0ce4143d70 2024-06-02T23:47:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.752+0000 7f0cdaffd640 1 -- 172.21.15.96:0/3732570807 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7f0cdc01b070 con 0x7f0ce4143d70 2024-06-02T23:47:45.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.752+0000 7f0cdaffd640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0cc406c030 0x7f0cc406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:45.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.752+0000 7f0cdaffd640 1 -- 172.21.15.96:0/3732570807 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f0cdc08a9d0 con 0x7f0ce4143d70 2024-06-02T23:47:45.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.752+0000 7f0ce259c640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0cc406c030 0x7f0cc406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:45.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.753+0000 7f0ce259c640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0cc406c030 0x7f0cc406e4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4159750 tx=0x7f0cd4008040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:45.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.757+0000 7f0cdaffd640 1 -- 172.21.15.96:0/3732570807 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0cdc058820 con 0x7f0ce4143d70 2024-06-02T23:47:45.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:45.953+0000 7f0ce8f90640 1 -- 172.21.15.96:0/3732570807 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir8", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f0ce40b2490 con 0x7f0cc406c030 2024-06-02T23:47:46.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.004+0000 7f0cdaffd640 1 -- 172.21.15.96:0/3732570807 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f0ce40b2490 con 0x7f0cc406c030 2024-06-02T23:47:46.004 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule activated for path /snap_test_dir1/dir8 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 -- 172.21.15.96:0/3732570807 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0cc406c030 msgr2=0x7f0cc406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0cc406c030 0x7f0cc406e4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4159750 tx=0x7f0cd4008040 comp rx=0 tx=0).stop 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 -- 172.21.15.96:0/3732570807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce4143d70 msgr2=0x7f0ce413ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce4143d70 0x7f0ce413ca40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00c7d0 tx=0x7f0cdc00cc90 comp rx=0 tx=0).stop 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 -- 172.21.15.96:0/3732570807 shutdown_connections 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0cc406c030 0x7f0cc406e4f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ce4143d70 0x7f0ce413ca40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ce40ced40 0x7f0ce415bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 --2- 172.21.15.96:0/3732570807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ce406e380 0x7f0ce413d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 -- 172.21.15.96:0/3732570807 >> 172.21.15.96:0/3732570807 conn(0x7f0ce40b18a0 msgr2=0x7f0ce415e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 -- 172.21.15.96:0/3732570807 shutdown_connections 2024-06-02T23:47:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.006+0000 7f0ce8f90640 1 -- 172.21.15.96:0/3732570807 wait complete. 2024-06-02T23:47:46.017 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2024-06-02T23:47:46.017 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir9 1m 2024-06-02T23:47:46.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.119+0000 7f037cb8b640 1 Processor -- start 2024-06-02T23:47:46.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.119+0000 7f037cb8b640 1 -- start start 2024-06-02T23:47:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.120+0000 7f037cb8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f037815e340 0x7f03780cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.120+0000 7f037cb8b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f03780b2f40 0x7f03780d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.120+0000 7f037cb8b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03780d4f30 con 0x7f03780d1070 2024-06-02T23:47:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.120+0000 7f037cb8b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f03780cf710 con 0x7f03780b2f40 2024-06-02T23:47:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.120+0000 7f037cb8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03780cede0 con 0x7f037815e340 2024-06-02T23:47:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.121+0000 7f037659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f037815e340 0x7f03780cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.121+0000 7f0375d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f03780b2f40 0x7f03780d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.121+0000 7f037659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f037815e340 0x7f03780cfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:60816/0 (socket says 172.21.15.96:60816) 2024-06-02T23:47:46.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.121+0000 7f037659c640 1 -- 172.21.15.96:0/598743735 learned_addr learned my addr 172.21.15.96:0/598743735 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:46.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.121+0000 7f0376d9d640 1 --1- 172.21.15.96:0/598743735 >> v1:172.21.15.162:6789/0 conn(0x7f03780d1070 0x7f03780b0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:34430/0 (socket says 172.21.15.96:34430) 2024-06-02T23:47:46.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.121+0000 7f037659c640 1 -- 172.21.15.96:0/598743735 >> v2:172.21.15.162:3300/0 conn(0x7f03780b2f40 msgr2=0x7f03780d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:47:46.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.121+0000 7f037659c640 1 --2- 172.21.15.96:0/598743735 >> v2:172.21.15.162:3300/0 conn(0x7f03780b2f40 0x7f03780d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.121+0000 7f037659c640 1 -- 172.21.15.96:0/598743735 >> v1:172.21.15.162:6789/0 conn(0x7f03780d1070 legacy=0x7f03780b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:46.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.121+0000 7f037659c640 1 -- 172.21.15.96:0/598743735 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03780cf0c0 con 0x7f037815e340 2024-06-02T23:47:46.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.121+0000 7f0375d9b640 1 --2- 172.21.15.96:0/598743735 >> v2:172.21.15.162:3300/0 conn(0x7f03780b2f40 0x7f03780d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:47:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.122+0000 7f037659c640 1 --2- 172.21.15.96:0/598743735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f037815e340 0x7f03780cfba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0368009e50 tx=0x7f036802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19d8ec5779e1f90 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.122+0000 7f037559a640 1 -- 172.21.15.96:0/598743735 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368036070 con 0x7f037815e340 2024-06-02T23:47:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.122+0000 7f037559a640 1 -- 172.21.15.96:0/598743735 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0368031600 con 0x7f037815e340 2024-06-02T23:47:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.122+0000 7f037559a640 1 -- 172.21.15.96:0/598743735 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03680319d0 con 0x7f037815e340 2024-06-02T23:47:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.122+0000 7f037cb8b640 1 -- 172.21.15.96:0/598743735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f037815e340 msgr2=0x7f03780cfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.122+0000 7f037cb8b640 1 --2- 172.21.15.96:0/598743735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f037815e340 0x7f03780cfba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0368009e50 tx=0x7f036802a680 comp rx=0 tx=0).stop 2024-06-02T23:47:46.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.123+0000 7f037cb8b640 1 -- 172.21.15.96:0/598743735 shutdown_connections 2024-06-02T23:47:46.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.123+0000 7f037cb8b640 1 --2- 172.21.15.96:0/598743735 >> v2:172.21.15.162:3300/0 conn(0x7f03780b2f40 0x7f03780d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.123+0000 7f037cb8b640 1 --2- 172.21.15.96:0/598743735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f037815e340 0x7f03780cfba0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.123+0000 7f037cb8b640 1 -- 172.21.15.96:0/598743735 >> 172.21.15.96:0/598743735 conn(0x7f03780d4030 msgr2=0x7f03780d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:46.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.123+0000 7f037cb8b640 1 -- 172.21.15.96:0/598743735 shutdown_connections 2024-06-02T23:47:46.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.123+0000 7f037cb8b640 1 -- 172.21.15.96:0/598743735 wait complete. 2024-06-02T23:47:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.124+0000 7f037cb8b640 1 Processor -- start 2024-06-02T23:47:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.124+0000 7f037cb8b640 1 -- start start 2024-06-02T23:47:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f037cb8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03780b2f40 0x7f03780cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f037cb8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03780d1070 0x7f0378161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f037cb8b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f037815e340 0x7f0378160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f037cb8b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f037815e720 con 0x7f037815e340 2024-06-02T23:47:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f037cb8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03780d00e0 con 0x7f03780d1070 2024-06-02T23:47:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f037cb8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03780d4b50 con 0x7f03780b2f40 2024-06-02T23:47:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0376d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f037815e340 0x7f0378160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:46.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0376d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f037815e340 0x7f0378160500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37702/0 (socket says 172.21.15.96:37702) 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0376d9d640 1 -- 172.21.15.96:0/3237751088 learned_addr learned my addr 172.21.15.96:0/3237751088 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f037659c640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03780b2f40 0x7f03780cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0375d9b640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03780d1070 0x7f0378161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0376d9d640 1 -- 172.21.15.96:0/3237751088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03780b2f40 msgr2=0x7f03780cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0376d9d640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03780b2f40 0x7f03780cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0376d9d640 1 -- 172.21.15.96:0/3237751088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03780d1070 msgr2=0x7f0378161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0376d9d640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03780d1070 0x7f0378161520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0376d9d640 1 -- 172.21.15.96:0/3237751088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037814cf40 con 0x7f037815e340 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0375d9b640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03780d1070 0x7f0378161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0376d9d640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f037815e340 0x7f0378160500 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0370001eb0 tx=0x7f037000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0366ffd640 1 -- 172.21.15.96:0/3237751088 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03700074e0 con 0x7f037815e340 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0366ffd640 1 -- 172.21.15.96:0/3237751088 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0370007680 con 0x7f037815e340 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f0366ffd640 1 -- 172.21.15.96:0/3237751088 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03700049e0 con 0x7f037815e340 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.125+0000 7f037cb8b640 1 -- 172.21.15.96:0/3237751088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03780cb7e0 con 0x7f037815e340 2024-06-02T23:47:46.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.126+0000 7f037cb8b640 1 -- 172.21.15.96:0/3237751088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03780cbda0 con 0x7f037815e340 2024-06-02T23:47:46.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.127+0000 7f037cb8b640 1 -- 172.21.15.96:0/3237751088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03780683e0 con 0x7f037815e340 2024-06-02T23:47:46.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.127+0000 7f0366ffd640 1 -- 172.21.15.96:0/3237751088 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 10) ==== 90674+0+0 (secure 0 0 0) 0x7f037001a020 con 0x7f037815e340 2024-06-02T23:47:46.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.127+0000 7f0366ffd640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f035806c030 0x7f035806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:47:46.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.128+0000 7f0366ffd640 1 -- 172.21.15.96:0/3237751088 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6359+0+0 (secure 0 0 0) 0x7f037008aba0 con 0x7f037815e340 2024-06-02T23:47:46.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.128+0000 7f037659c640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f035806c030 0x7f035806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:47:46.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.128+0000 7f037659c640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f035806c030 0x7f035806e4f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0368033000 tx=0x7f0368009000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:47:46.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.132+0000 7f0366ffd640 1 -- 172.21.15.96:0/3237751088 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0370059050 con 0x7f037815e340 2024-06-02T23:47:46.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.326+0000 7f037cb8b640 1 -- 172.21.15.96:0/3237751088 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir9", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f0378073790 con 0x7f035806c030 2024-06-02T23:47:46.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.377+0000 7f0366ffd640 1 -- 172.21.15.96:0/3237751088 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f0378073790 con 0x7f035806c030 2024-06-02T23:47:46.378 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule activated for path /snap_test_dir1/dir9 2024-06-02T23:47:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.379+0000 7f037cb8b640 1 -- 172.21.15.96:0/3237751088 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f035806c030 msgr2=0x7f035806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.379+0000 7f037cb8b640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f035806c030 0x7f035806e4f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0368033000 tx=0x7f0368009000 comp rx=0 tx=0).stop 2024-06-02T23:47:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.379+0000 7f037cb8b640 1 -- 172.21.15.96:0/3237751088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f037815e340 msgr2=0x7f0378160500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:47:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.379+0000 7f037cb8b640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f037815e340 0x7f0378160500 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0370001eb0 tx=0x7f037000c820 comp rx=0 tx=0).stop 2024-06-02T23:47:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.379+0000 7f037cb8b640 1 -- 172.21.15.96:0/3237751088 shutdown_connections 2024-06-02T23:47:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.379+0000 7f037cb8b640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f035806c030 0x7f035806e4f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.379+0000 7f037cb8b640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f037815e340 0x7f0378160500 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.379+0000 7f037cb8b640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03780d1070 0x7f0378161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.379+0000 7f037cb8b640 1 --2- 172.21.15.96:0/3237751088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03780b2f40 0x7f03780cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:47:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.379+0000 7f037cb8b640 1 -- 172.21.15.96:0/3237751088 >> 172.21.15.96:0/3237751088 conn(0x7f03780d4030 msgr2=0x7f037815c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:47:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.380+0000 7f037cb8b640 1 -- 172.21.15.96:0/3237751088 shutdown_connections 2024-06-02T23:47:46.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:47:46.380+0000 7f037cb8b640 1 -- 172.21.15.96:0/3237751088 wait complete. 2024-06-02T23:47:46.390 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2024-06-02T23:47:56.322 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:47:56.325 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:48:00.015 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:48:00.014+0000 7fc9f83fc640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:48:00.015 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:48:00.014+0000 7fc9f83fc640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:48:00.015 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:48:00.014+0000 7fc9f83fc640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:48:00.015 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:48:00.014+0000 7fc9f83fc640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:48:00.015 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:48:00.014+0000 7fc9f83fc640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:48:26.458 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:48:26.462 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:48:56.606 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:48:56.609 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:49:26.759 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:49:26.762 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:49:56.851 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:49:56.855 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:50:27.001 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:50:27.004 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:50:57.159 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:50:57.162 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:51:27.286 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:51:27.289 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:51:57.424 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:51:57.427 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:52:27.485 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:52:27.488 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:52:57.622 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:52:57.626 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:53:00.599 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:53:00.599+0000 7fc9f9bff640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:53:00.600 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:53:00.599+0000 7fc9f9bff640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:53:00.600 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:53:00.599+0000 7fc9f9bff640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:53:00.600 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:53:00.599+0000 7fc9f9bff640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:53:00.600 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:53:00.599+0000 7fc9f9bff640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:53:27.917 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:53:27.921 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:53:58.056 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:53:58.060 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:54:28.162 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:54:28.166 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:54:58.283 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:54:58.287 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:55:28.418 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:55:28.421 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:55:58.523 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:55:58.527 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:56:28.653 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:56:28.656 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:56:58.712 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:56:58.715 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:57:28.868 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:57:28.872 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:57:59.014 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:57:59.017 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:58:19.392 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir0 1m 2024-06-02T23:58:19.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.506+0000 7f000842a640 1 Processor -- start 2024-06-02T23:58:19.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.506+0000 7f000842a640 1 -- start start 2024-06-02T23:58:19.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.507+0000 7f000842a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f000015fc40 0x7f0000071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.507+0000 7f000842a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00000729e0 0x7f0000160020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.507+0000 7f000842a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f000006ec50 0x7f00000ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.507+0000 7f000842a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f00000718f0 con 0x7f000015fc40 2024-06-02T23:58:19.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.507+0000 7f000842a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0000160560 con 0x7f000006ec50 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.507+0000 7f000842a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0000072fa0 con 0x7f00000729e0 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.507+0000 7f00061c6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f000015fc40 0x7f0000071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.507+0000 7f00061c6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f000015fc40 0x7f0000071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35508/0 (socket says 172.21.15.96:35508) 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.507+0000 7f00061c6640 1 -- 172.21.15.96:0/1846833843 learned_addr learned my addr 172.21.15.96:0/1846833843 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.508+0000 7f00069c7640 1 --2- 172.21.15.96:0/1846833843 >> v2:172.21.15.162:3300/0 conn(0x7f000006ec50 0x7f00000ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.508+0000 7f00059c5640 1 --2- 172.21.15.96:0/1846833843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00000729e0 0x7f0000160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.508+0000 7f00061c6640 1 -- 172.21.15.96:0/1846833843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00000729e0 msgr2=0x7f0000160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.508+0000 7f00061c6640 1 --2- 172.21.15.96:0/1846833843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00000729e0 0x7f0000160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.508+0000 7f00061c6640 1 -- 172.21.15.96:0/1846833843 >> v2:172.21.15.162:3300/0 conn(0x7f000006ec50 msgr2=0x7f00000ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.508+0000 7f00061c6640 1 --2- 172.21.15.96:0/1846833843 >> v2:172.21.15.162:3300/0 conn(0x7f000006ec50 0x7f00000ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.508+0000 7f00061c6640 1 -- 172.21.15.96:0/1846833843 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00000712a0 con 0x7f000015fc40 2024-06-02T23:58:19.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.508+0000 7f00059c5640 1 --2- 172.21.15.96:0/1846833843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00000729e0 0x7f0000160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:19.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.508+0000 7f00061c6640 1 --2- 172.21.15.96:0/1846833843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f000015fc40 0x7f0000071d80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f00000ca290 tx=0x7efffc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6e29be35375e1e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:19.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f00051c4640 1 -- 172.21.15.96:0/1846833843 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc036070 con 0x7f000015fc40 2024-06-02T23:58:19.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f00051c4640 1 -- 172.21.15.96:0/1846833843 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efffc031600 con 0x7f000015fc40 2024-06-02T23:58:19.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f00051c4640 1 -- 172.21.15.96:0/1846833843 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc0319d0 con 0x7f000015fc40 2024-06-02T23:58:19.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f000842a640 1 -- 172.21.15.96:0/1846833843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f000015fc40 msgr2=0x7f0000071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:19.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f000842a640 1 --2- 172.21.15.96:0/1846833843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f000015fc40 0x7f0000071d80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f00000ca290 tx=0x7efffc02a610 comp rx=0 tx=0).stop 2024-06-02T23:58:19.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f000842a640 1 -- 172.21.15.96:0/1846833843 shutdown_connections 2024-06-02T23:58:19.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f000842a640 1 --2- 172.21.15.96:0/1846833843 >> v2:172.21.15.162:3300/0 conn(0x7f000006ec50 0x7f00000ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f000842a640 1 --2- 172.21.15.96:0/1846833843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00000729e0 0x7f0000160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f000842a640 1 --2- 172.21.15.96:0/1846833843 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f000015fc40 0x7f0000071d80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f000842a640 1 -- 172.21.15.96:0/1846833843 >> 172.21.15.96:0/1846833843 conn(0x7f00000cfcb0 msgr2=0x7f00000d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:19.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f000842a640 1 -- 172.21.15.96:0/1846833843 shutdown_connections 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.509+0000 7f000842a640 1 -- 172.21.15.96:0/1846833843 wait complete. 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.510+0000 7f000842a640 1 Processor -- start 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.511+0000 7f000842a640 1 -- start start 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.511+0000 7f000842a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f000006ec50 0x7f00000c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.511+0000 7f000842a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00000729e0 0x7f000014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.511+0000 7f000842a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f000015fc40 0x7f000014ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.511+0000 7f000842a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f000006f240 con 0x7f00000729e0 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.511+0000 7f000842a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f000006f0c0 con 0x7f000006ec50 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.511+0000 7f000842a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00000ca840 con 0x7f000015fc40 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.511+0000 7f00059c5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00000729e0 0x7f000014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.511+0000 7f00059c5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00000729e0 0x7f000014d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35516/0 (socket says 172.21.15.96:35516) 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.511+0000 7f00059c5640 1 -- 172.21.15.96:0/3790392821 learned_addr learned my addr 172.21.15.96:0/3790392821 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7f00061c6640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f000006ec50 0x7f00000c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7f00069c7640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f000015fc40 0x7f000014ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7f00059c5640 1 -- 172.21.15.96:0/3790392821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f000015fc40 msgr2=0x7f000014ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7f00059c5640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f000015fc40 0x7f000014ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7f00059c5640 1 -- 172.21.15.96:0/3790392821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f000006ec50 msgr2=0x7f00000c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7f00059c5640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f000006ec50 0x7f00000c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7f00059c5640 1 -- 172.21.15.96:0/3790392821 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000014de30 con 0x7f00000729e0 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7f00059c5640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00000729e0 0x7f000014d1e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efff000c7f0 tx=0x7efff000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7efff6ffd640 1 -- 172.21.15.96:0/3790392821 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0015070 con 0x7f00000729e0 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7efff6ffd640 1 -- 172.21.15.96:0/3790392821 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff0007a30 con 0x7f00000729e0 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7efff6ffd640 1 -- 172.21.15.96:0/3790392821 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0007e00 con 0x7f00000729e0 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7f000842a640 1 -- 172.21.15.96:0/3790392821 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000014e110 con 0x7f00000729e0 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.512+0000 7f000842a640 1 -- 172.21.15.96:0/3790392821 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00000c8b40 con 0x7f00000729e0 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.513+0000 7f000842a640 1 -- 172.21.15.96:0/3790392821 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00000683e0 con 0x7f00000729e0 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.514+0000 7efff6ffd640 1 -- 172.21.15.96:0/3790392821 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7efff0018070 con 0x7f00000729e0 2024-06-02T23:58:19.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.514+0000 7efff6ffd640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7effe406c030 0x7effe406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.514+0000 7efff6ffd640 1 -- 172.21.15.96:0/3790392821 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7efff008b500 con 0x7f00000729e0 2024-06-02T23:58:19.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.514+0000 7f00061c6640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7effe406c030 0x7effe406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.514+0000 7f00061c6640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7effe406c030 0x7effe406e4f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efffc033000 tx=0x7efffc009000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:19.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.519+0000 7efff6ffd640 1 -- 172.21.15.96:0/3790392821 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efff0059900 con 0x7f00000729e0 2024-06-02T23:58:19.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.713+0000 7f000842a640 1 -- 172.21.15.96:0/3790392821 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir0", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f00000c6a50 con 0x7effe406c030 2024-06-02T23:58:19.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.787+0000 7efff6ffd640 1 -- 172.21.15.96:0/3790392821 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f00000c6a50 con 0x7effe406c030 2024-06-02T23:58:19.788 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2024-06-02T23:58:19.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 -- 172.21.15.96:0/3790392821 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7effe406c030 msgr2=0x7effe406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7effe406c030 0x7effe406e4f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efffc033000 tx=0x7efffc009000 comp rx=0 tx=0).stop 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 -- 172.21.15.96:0/3790392821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00000729e0 msgr2=0x7f000014d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00000729e0 0x7f000014d1e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efff000c7f0 tx=0x7efff000cbf0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 -- 172.21.15.96:0/3790392821 shutdown_connections 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7effe406c030 0x7effe406e4f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f000015fc40 0x7f000014ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00000729e0 0x7f000014d1e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 --2- 172.21.15.96:0/3790392821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f000006ec50 0x7f00000c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 -- 172.21.15.96:0/3790392821 >> 172.21.15.96:0/3790392821 conn(0x7f00000cfcb0 msgr2=0x7f00000c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 -- 172.21.15.96:0/3790392821 shutdown_connections 2024-06-02T23:58:19.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.789+0000 7f000842a640 1 -- 172.21.15.96:0/3790392821 wait complete. 2024-06-02T23:58:19.800 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2024-06-02T23:58:19.800 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir1 1m 2024-06-02T23:58:19.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.901+0000 7eff1f6a5640 1 Processor -- start 2024-06-02T23:58:19.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.901+0000 7eff1f6a5640 1 -- start start 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff1f6a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff1815a510 0x7eff180cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff1f6a5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff18073200 con 0x7eff1815a8f0 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff1f6a5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff18071030 con 0x7eff18072070 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff1f6a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7eff18072c30 con 0x7eff1815a510 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff1cc40640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7eff1815a8f0 0x7eff180cdd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59936/0 (socket says 172.21.15.96:59936) 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff1cc40640 1 -- 172.21.15.96:0/1301335914 learned_addr learned my addr 172.21.15.96:0/1301335914 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff1d441640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff1815a510 0x7eff180cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990205663 0 0) 0x7eff18073200 con 0x7eff1815a8f0 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff04004630 con 0x7eff1815a8f0 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2047119308 0 0) 0x7eff10001490 con 0x7eff18072070 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff18073200 con 0x7eff18072070 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3655705782 0 0) 0x7eff04004630 con 0x7eff1815a8f0 2024-06-02T23:58:19.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff1815a510 msgr2=0x7eff180cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff0ffff640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff1815a510 0x7eff180cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 >> v1:172.21.15.162:6789/0 conn(0x7eff18072070 legacy=0x7eff18072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff180712b0 con 0x7eff1815a8f0 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7eff08001670 con 0x7eff1815a8f0 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.902+0000 7eff1d441640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff1815a510 0x7eff180cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 >> v1:172.21.15.96:6789/0 conn(0x7eff1815a8f0 legacy=0x7eff180cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff0ffff640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04004c80 0x7eff04005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff0ffff640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff04005910 0x7eff04005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff0ffff640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff1815a510 0x7eff040062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7eff0400cb80 con 0x7eff04004c80 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff0400cd30 con 0x7eff04005910 2024-06-02T23:58:19.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7eff0400cf30 con 0x7eff1815a510 2024-06-02T23:58:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff1d441640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04004c80 0x7eff04005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff1cc40640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff04005910 0x7eff04005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff1dc42640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff1815a510 0x7eff040062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff1d441640 1 -- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff1815a510 msgr2=0x7eff040062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff1d441640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff1815a510 0x7eff040062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff1d441640 1 -- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff04005910 msgr2=0x7eff04005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff1d441640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff04005910 0x7eff04005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff1d441640 1 -- 172.21.15.96:0/1301335914 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff04004630 con 0x7eff04004c80 2024-06-02T23:58:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.903+0000 7eff1dc42640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff1815a510 0x7eff040062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:19.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff1d441640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04004c80 0x7eff04005080 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7eff14009c60 tx=0x7eff04006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1cff394cfca0ff server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14036070 con 0x7eff04004c80 2024-06-02T23:58:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff14031400 con 0x7eff04004c80 2024-06-02T23:58:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff0ffff640 1 -- 172.21.15.96:0/1301335914 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14009860 con 0x7eff04004c80 2024-06-02T23:58:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff1f6a5640 1 -- 172.21.15.96:0/1301335914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04004c80 msgr2=0x7eff04005080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff1f6a5640 1 --2- 172.21.15.96:0/1301335914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04004c80 0x7eff04005080 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7eff14009c60 tx=0x7eff04006940 comp rx=0 tx=0).stop 2024-06-02T23:58:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff1dc42640 1 -- 172.21.15.96:0/1301335914 reap_dead start 2024-06-02T23:58:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff1f6a5640 1 -- 172.21.15.96:0/1301335914 shutdown_connections 2024-06-02T23:58:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff1f6a5640 1 -- 172.21.15.96:0/1301335914 >> 172.21.15.96:0/1301335914 conn(0x7eff180cfcb0 msgr2=0x7eff180d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff1f6a5640 1 -- 172.21.15.96:0/1301335914 shutdown_connections 2024-06-02T23:58:19.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.904+0000 7eff1f6a5640 1 -- 172.21.15.96:0/1301335914 wait complete. 2024-06-02T23:58:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.905+0000 7eff1f6a5640 1 Processor -- start 2024-06-02T23:58:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1f6a5640 1 -- start start 2024-06-02T23:58:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1f6a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff04004c80 0x7eff181544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1f6a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff1815c240 0x7eff1815d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1f6a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff18154090 0x7eff181537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1f6a5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7eff18071b50 con 0x7eff1815c240 2024-06-02T23:58:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1f6a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff18071870 con 0x7eff18154090 2024-06-02T23:58:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1f6a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7eff180cad10 con 0x7eff04004c80 2024-06-02T23:58:19.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1cc40640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff1815c240 0x7eff1815d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1cc40640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff1815c240 0x7eff1815d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35536/0 (socket says 172.21.15.96:35536) 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1cc40640 1 -- 172.21.15.96:0/2679755131 learned_addr learned my addr 172.21.15.96:0/2679755131 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1d441640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff04004c80 0x7eff181544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.906+0000 7eff1dc42640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff18154090 0x7eff181537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff1cc40640 1 -- 172.21.15.96:0/2679755131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff04004c80 msgr2=0x7eff181544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff1cc40640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff04004c80 0x7eff181544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff1cc40640 1 -- 172.21.15.96:0/2679755131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff18154090 msgr2=0x7eff181537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff1cc40640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff18154090 0x7eff181537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff1cc40640 1 -- 172.21.15.96:0/2679755131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1815c6d0 con 0x7eff1815c240 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff1dc42640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff18154090 0x7eff181537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:19.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff1cc40640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff1815c240 0x7eff1815d770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7eff08007290 tx=0x7eff08007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff0dffb640 1 -- 172.21.15.96:0/2679755131 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0800f9c0 con 0x7eff1815c240 2024-06-02T23:58:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff0dffb640 1 -- 172.21.15.96:0/2679755131 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08018070 con 0x7eff1815c240 2024-06-02T23:58:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff1f6a5640 1 -- 172.21.15.96:0/2679755131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1815c9b0 con 0x7eff1815c240 2024-06-02T23:58:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff0dffb640 1 -- 172.21.15.96:0/2679755131 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0800fd80 con 0x7eff1815c240 2024-06-02T23:58:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.907+0000 7eff1f6a5640 1 -- 172.21.15.96:0/2679755131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1815cf70 con 0x7eff1815c240 2024-06-02T23:58:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.908+0000 7eff1f6a5640 1 -- 172.21.15.96:0/2679755131 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff18067c90 con 0x7eff1815c240 2024-06-02T23:58:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.909+0000 7eff0dffb640 1 -- 172.21.15.96:0/2679755131 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7eff0801d460 con 0x7eff1815c240 2024-06-02T23:58:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.909+0000 7eff0dffb640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7efefc06c060 0x7efefc06e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.909+0000 7eff0dffb640 1 -- 172.21.15.96:0/2679755131 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7eff0808b370 con 0x7eff1815c240 2024-06-02T23:58:19.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.909+0000 7eff1d441640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7efefc06c060 0x7efefc06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.910+0000 7eff1d441640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7efefc06c060 0x7efefc06e520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff14033000 tx=0x7eff14008030 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:19.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:19.914+0000 7eff0dffb640 1 -- 172.21.15.96:0/2679755131 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7eff18067c90 con 0x7eff1815c240 2024-06-02T23:58:20.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.111+0000 7eff1f6a5640 1 -- 172.21.15.96:0/2679755131 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir1", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7eff18153d10 con 0x7efefc06c060 2024-06-02T23:58:20.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.184+0000 7eff0dffb640 1 -- 172.21.15.96:0/2679755131 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7eff18153d10 con 0x7efefc06c060 2024-06-02T23:58:20.184 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2024-06-02T23:58:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 -- 172.21.15.96:0/2679755131 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7efefc06c060 msgr2=0x7efefc06e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7efefc06c060 0x7efefc06e520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff14033000 tx=0x7eff14008030 comp rx=0 tx=0).stop 2024-06-02T23:58:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 -- 172.21.15.96:0/2679755131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff1815c240 msgr2=0x7eff1815d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff1815c240 0x7eff1815d770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7eff08007290 tx=0x7eff08007750 comp rx=0 tx=0).stop 2024-06-02T23:58:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 -- 172.21.15.96:0/2679755131 shutdown_connections 2024-06-02T23:58:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7efefc06c060 0x7efefc06e520 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff18154090 0x7eff181537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff1815c240 0x7eff1815d770 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 --2- 172.21.15.96:0/2679755131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff04004c80 0x7eff181544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 -- 172.21.15.96:0/2679755131 >> 172.21.15.96:0/2679755131 conn(0x7eff180cfcb0 msgr2=0x7eff181560c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 -- 172.21.15.96:0/2679755131 shutdown_connections 2024-06-02T23:58:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.186+0000 7eff1f6a5640 1 -- 172.21.15.96:0/2679755131 wait complete. 2024-06-02T23:58:20.197 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2024-06-02T23:58:20.197 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir2 1m 2024-06-02T23:58:20.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.300+0000 7f253f010640 1 Processor -- start 2024-06-02T23:58:20.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.300+0000 7f253f010640 1 -- start start 2024-06-02T23:58:20.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f253f010640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2538071d80 0x7f25380ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:20.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f253f010640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25380721f0 con 0x7f25380729e0 2024-06-02T23:58:20.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f253f010640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2538072fa0 con 0x7f253815fc40 2024-06-02T23:58:20.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f253f010640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f25380718f0 con 0x7f2538071d80 2024-06-02T23:58:20.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f252ffff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f25380729e0 0x7f253806ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59952/0 (socket says 172.21.15.96:59952) 2024-06-02T23:58:20.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f252ffff640 1 -- 172.21.15.96:0/633090125 learned_addr learned my addr 172.21.15.96:0/633090125 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:20.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f253d5ad640 1 --2- 172.21.15.96:0/633090125 >> v2:172.21.15.96:3300/0 conn(0x7f2538071d80 0x7f25380ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:20.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f252f7fe640 1 -- 172.21.15.96:0/633090125 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975232651 0 0) 0x7f25380721f0 con 0x7f25380729e0 2024-06-02T23:58:20.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f252f7fe640 1 -- 172.21.15.96:0/633090125 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2520003520 con 0x7f25380729e0 2024-06-02T23:58:20.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f253d5ad640 1 -- 172.21.15.96:0/633090125 >> v1:172.21.15.162:6789/0 conn(0x7f253815fc40 legacy=0x7f2538160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:20.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f253d5ad640 1 -- 172.21.15.96:0/633090125 >> v1:172.21.15.96:6789/0 conn(0x7f25380729e0 legacy=0x7f253806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.301+0000 7f253d5ad640 1 -- 172.21.15.96:0/633090125 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25380712a0 con 0x7f2538071d80 2024-06-02T23:58:20.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.302+0000 7f253d5ad640 1 --2- 172.21.15.96:0/633090125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2538071d80 0x7f25380ca300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2538071a70 tx=0x7f253002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08895268bd1269c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:20.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.302+0000 7f252f7fe640 1 -- 172.21.15.96:0/633090125 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530031600 con 0x7f2538071d80 2024-06-02T23:58:20.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.302+0000 7f252f7fe640 1 -- 172.21.15.96:0/633090125 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25300317a0 con 0x7f2538071d80 2024-06-02T23:58:20.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.302+0000 7f252f7fe640 1 -- 172.21.15.96:0/633090125 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530031b70 con 0x7f2538071d80 2024-06-02T23:58:20.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.302+0000 7f253f010640 1 -- 172.21.15.96:0/633090125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2538071d80 msgr2=0x7f25380ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.302+0000 7f253f010640 1 --2- 172.21.15.96:0/633090125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2538071d80 0x7f25380ca300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2538071a70 tx=0x7f253002a610 comp rx=0 tx=0).stop 2024-06-02T23:58:20.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.303+0000 7f253f010640 1 -- 172.21.15.96:0/633090125 shutdown_connections 2024-06-02T23:58:20.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.303+0000 7f253f010640 1 --2- 172.21.15.96:0/633090125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2538071d80 0x7f25380ca300 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.303+0000 7f253f010640 1 -- 172.21.15.96:0/633090125 >> 172.21.15.96:0/633090125 conn(0x7f25380cfcb0 msgr2=0x7f25380d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:20.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.303+0000 7f253f010640 1 -- 172.21.15.96:0/633090125 shutdown_connections 2024-06-02T23:58:20.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.303+0000 7f253f010640 1 -- 172.21.15.96:0/633090125 wait complete. 2024-06-02T23:58:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.304+0000 7f253f010640 1 Processor -- start 2024-06-02T23:58:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.304+0000 7f253f010640 1 -- start start 2024-06-02T23:58:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253f010640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2538071d80 0x7f2538154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253f010640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25380729e0 0x7f2538157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253f010640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f253815fc40 0x7f25380c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253f010640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f25380ca9c0 con 0x7f253815fc40 2024-06-02T23:58:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253f010640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f25380ca840 con 0x7f25380729e0 2024-06-02T23:58:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253f010640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f25380cab40 con 0x7f2538071d80 2024-06-02T23:58:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253d5ad640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f253815fc40 0x7f25380c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:20.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253d5ad640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f253815fc40 0x7f25380c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35562/0 (socket says 172.21.15.96:35562) 2024-06-02T23:58:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253d5ad640 1 -- 172.21.15.96:0/3366095403 learned_addr learned my addr 172.21.15.96:0/3366095403 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f252ffff640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25380729e0 0x7f2538157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253d5ad640 1 -- 172.21.15.96:0/3366095403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2538071d80 msgr2=0x7f2538154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253d5ad640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2538071d80 0x7f2538154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253d5ad640 1 -- 172.21.15.96:0/3366095403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25380729e0 msgr2=0x7f2538157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253d5ad640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25380729e0 0x7f2538157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253d5ad640 1 -- 172.21.15.96:0/3366095403 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2538159d10 con 0x7f253815fc40 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253d5ad640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f253815fc40 0x7f25380c5230 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f253002ac00 tx=0x7f2530004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f252d7fa640 1 -- 172.21.15.96:0/3366095403 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253003f070 con 0x7f253815fc40 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f252d7fa640 1 -- 172.21.15.96:0/3366095403 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2530030b60 con 0x7f253815fc40 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253f010640 1 -- 172.21.15.96:0/3366095403 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2538159fb0 con 0x7f253815fc40 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f252d7fa640 1 -- 172.21.15.96:0/3366095403 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530009450 con 0x7f253815fc40 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.305+0000 7f253f010640 1 -- 172.21.15.96:0/3366095403 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25381585d0 con 0x7f253815fc40 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.306+0000 7f253f010640 1 -- 172.21.15.96:0/3366095403 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25380683e0 con 0x7f253815fc40 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.307+0000 7f252d7fa640 1 -- 172.21.15.96:0/3366095403 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f2530044460 con 0x7f253815fc40 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.307+0000 7f252d7fa640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f252406c030 0x7f252406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:20.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.307+0000 7f253cdac640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f252406c030 0x7f252406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:20.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.307+0000 7f252d7fa640 1 -- 172.21.15.96:0/3366095403 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f25300acac0 con 0x7f253815fc40 2024-06-02T23:58:20.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.308+0000 7f253cdac640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f252406c030 0x7f252406e4f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25381f5a80 tx=0x7f25340079b0 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:20.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.312+0000 7f252d7fa640 1 -- 172.21.15.96:0/3366095403 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f253007aec0 con 0x7f253815fc40 2024-06-02T23:58:20.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.507+0000 7f253f010640 1 -- 172.21.15.96:0/3366095403 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir2", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f25380721f0 con 0x7f252406c030 2024-06-02T23:58:20.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.576+0000 7f252d7fa640 1 -- 172.21.15.96:0/3366095403 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f25380721f0 con 0x7f252406c030 2024-06-02T23:58:20.576 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2024-06-02T23:58:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 -- 172.21.15.96:0/3366095403 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f252406c030 msgr2=0x7f252406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f252406c030 0x7f252406e4f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25381f5a80 tx=0x7f25340079b0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 -- 172.21.15.96:0/3366095403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f253815fc40 msgr2=0x7f25380c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f253815fc40 0x7f25380c5230 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f253002ac00 tx=0x7f2530004a40 comp rx=0 tx=0).stop 2024-06-02T23:58:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 -- 172.21.15.96:0/3366095403 shutdown_connections 2024-06-02T23:58:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f252406c030 0x7f252406e4f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f253815fc40 0x7f25380c5230 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25380729e0 0x7f2538157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 --2- 172.21.15.96:0/3366095403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2538071d80 0x7f2538154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 -- 172.21.15.96:0/3366095403 >> 172.21.15.96:0/3366095403 conn(0x7f25380cfcb0 msgr2=0x7f2538160020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 -- 172.21.15.96:0/3366095403 shutdown_connections 2024-06-02T23:58:20.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.578+0000 7f253f010640 1 -- 172.21.15.96:0/3366095403 wait complete. 2024-06-02T23:58:20.589 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2024-06-02T23:58:20.589 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir3 1m 2024-06-02T23:58:20.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.690+0000 7fe5f6d5a640 1 Processor -- start 2024-06-02T23:58:20.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.691+0000 7fe5f6d5a640 1 -- start start 2024-06-02T23:58:20.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.691+0000 7fe5f6d5a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5f00b4640 0x7fe5f00b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:20.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.691+0000 7fe5f6d5a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f00b73e0 con 0x7fe5f00d2d40 2024-06-02T23:58:20.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.691+0000 7fe5f6d5a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f00cec60 con 0x7fe5f00b4b50 2024-06-02T23:58:20.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.691+0000 7fe5f6d5a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe5f00d4ff0 con 0x7fe5f00b4640 2024-06-02T23:58:20.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.691+0000 7fe5f4af6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe5f00b4640 0x7fe5f00b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:20.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.691+0000 7fe5f52f7640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe5f00d2d40 0x7fe5f00cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59958/0 (socket says 172.21.15.96:59958) 2024-06-02T23:58:20.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.691+0000 7fe5f52f7640 1 -- 172.21.15.96:0/2487050767 learned_addr learned my addr 172.21.15.96:0/2487050767 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:20.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.692+0000 7fe5f4af6640 1 -- 172.21.15.96:0/2487050767 >> v1:172.21.15.162:6789/0 conn(0x7fe5f00b4b50 legacy=0x7fe5f00d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:20.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.692+0000 7fe5f4af6640 1 -- 172.21.15.96:0/2487050767 >> v1:172.21.15.96:6789/0 conn(0x7fe5f00d2d40 legacy=0x7fe5f00cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.692+0000 7fe5f4af6640 1 -- 172.21.15.96:0/2487050767 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f00d1fd0 con 0x7fe5f00b4640 2024-06-02T23:58:20.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.692+0000 7fe5ef7fe640 1 -- 172.21.15.96:0/2487050767 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3874424652 0 0) 0x7fe5f00b73e0 con 0x7fe5f00d2d40 2024-06-02T23:58:20.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.692+0000 7fe5f4af6640 1 --2- 172.21.15.96:0/2487050767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4640 0x7fe5f00b6ea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009d90 tx=0x7fe5e002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354e6b3b098aea08 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:20.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.693+0000 7fe5ef7fe640 1 -- 172.21.15.96:0/2487050767 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0031600 con 0x7fe5f00b4640 2024-06-02T23:58:20.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.693+0000 7fe5ef7fe640 1 -- 172.21.15.96:0/2487050767 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e00317a0 con 0x7fe5f00b4640 2024-06-02T23:58:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.693+0000 7fe5ef7fe640 1 -- 172.21.15.96:0/2487050767 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0031b70 con 0x7fe5f00b4640 2024-06-02T23:58:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.693+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/2487050767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4640 msgr2=0x7fe5f00b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.693+0000 7fe5f6d5a640 1 --2- 172.21.15.96:0/2487050767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4640 0x7fe5f00b6ea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009d90 tx=0x7fe5e002a610 comp rx=0 tx=0).stop 2024-06-02T23:58:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.693+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/2487050767 shutdown_connections 2024-06-02T23:58:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.693+0000 7fe5f6d5a640 1 --2- 172.21.15.96:0/2487050767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4640 0x7fe5f00b6ea0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.693+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/2487050767 >> 172.21.15.96:0/2487050767 conn(0x7fe5f00d4050 msgr2=0x7fe5f00d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.693+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/2487050767 shutdown_connections 2024-06-02T23:58:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.693+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/2487050767 wait complete. 2024-06-02T23:58:20.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.694+0000 7fe5f6d5a640 1 Processor -- start 2024-06-02T23:58:20.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.694+0000 7fe5f6d5a640 1 -- start start 2024-06-02T23:58:20.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.695+0000 7fe5f6d5a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f00b4640 0x7fe5f0150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.695+0000 7fe5f6d5a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4b50 0x7fe5f00b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.695+0000 7fe5f6d5a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f00d2d40 0x7fe5f00b82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.695+0000 7fe5f6d5a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f00d13b0 con 0x7fe5f00b4b50 2024-06-02T23:58:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.695+0000 7fe5f6d5a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f00cef00 con 0x7fe5f00d2d40 2024-06-02T23:58:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.695+0000 7fe5f6d5a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f00b5000 con 0x7fe5f00b4640 2024-06-02T23:58:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.695+0000 7fe5effff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4b50 0x7fe5f00b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.695+0000 7fe5effff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4b50 0x7fe5f00b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35574/0 (socket says 172.21.15.96:35574) 2024-06-02T23:58:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.695+0000 7fe5effff640 1 -- 172.21.15.96:0/1295424137 learned_addr learned my addr 172.21.15.96:0/1295424137 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:20.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5f52f7640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f00d2d40 0x7fe5f00b82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5f4af6640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f00b4640 0x7fe5f0150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5effff640 1 -- 172.21.15.96:0/1295424137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f00b4640 msgr2=0x7fe5f0150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5effff640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f00b4640 0x7fe5f0150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5effff640 1 -- 172.21.15.96:0/1295424137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f00d2d40 msgr2=0x7fe5f00b82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5effff640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f00d2d40 0x7fe5f00b82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5effff640 1 -- 172.21.15.96:0/1295424137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f01518e0 con 0x7fe5f00b4b50 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5f52f7640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f00d2d40 0x7fe5f00b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5effff640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4b50 0x7fe5f00b0e60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800c430 tx=0x7fe5d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5ed7fa640 1 -- 172.21.15.96:0/1295424137 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8011790 con 0x7fe5f00b4b50 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5ed7fa640 1 -- 172.21.15.96:0/1295424137 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d8017070 con 0x7fe5f00b4b50 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5ed7fa640 1 -- 172.21.15.96:0/1295424137 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8011b70 con 0x7fe5f00b4b50 2024-06-02T23:58:20.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/1295424137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f0151bc0 con 0x7fe5f00b4b50 2024-06-02T23:58:20.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.696+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/1295424137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f0152180 con 0x7fe5f00b4b50 2024-06-02T23:58:20.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.697+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/1295424137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f00683e0 con 0x7fe5f00b4b50 2024-06-02T23:58:20.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.698+0000 7fe5ed7fa640 1 -- 172.21.15.96:0/1295424137 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7fe5d8011d10 con 0x7fe5f00b4b50 2024-06-02T23:58:20.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.698+0000 7fe5ed7fa640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe5d006c030 0x7fe5d006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:20.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.698+0000 7fe5ed7fa640 1 -- 172.21.15.96:0/1295424137 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7fe5d808b270 con 0x7fe5f00b4b50 2024-06-02T23:58:20.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.698+0000 7fe5f4af6640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe5d006c030 0x7fe5d006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:20.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.699+0000 7fe5f4af6640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe5d006c030 0x7fe5d006e4f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0034000 tx=0x7fe5e002f000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:20.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.703+0000 7fe5ed7fa640 1 -- 172.21.15.96:0/1295424137 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe5d8059780 con 0x7fe5f00b4b50 2024-06-02T23:58:20.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.897+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/1295424137 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir3", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fe5f00b53b0 con 0x7fe5d006c030 2024-06-02T23:58:20.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.966+0000 7fe5ed7fa640 1 -- 172.21.15.96:0/1295424137 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fe5f00b53b0 con 0x7fe5d006c030 2024-06-02T23:58:20.967 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.968+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/1295424137 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe5d006c030 msgr2=0x7fe5d006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.968+0000 7fe5f6d5a640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe5d006c030 0x7fe5d006e4f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0034000 tx=0x7fe5e002f000 comp rx=0 tx=0).stop 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.968+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/1295424137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4b50 msgr2=0x7fe5f00b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.968+0000 7fe5f6d5a640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4b50 0x7fe5f00b0e60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800c430 tx=0x7fe5d800c8f0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.969+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/1295424137 shutdown_connections 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.969+0000 7fe5f6d5a640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe5d006c030 0x7fe5d006e4f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.969+0000 7fe5f6d5a640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f00d2d40 0x7fe5f00b82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.969+0000 7fe5f6d5a640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5f00b4b50 0x7fe5f00b0e60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.969+0000 7fe5f6d5a640 1 --2- 172.21.15.96:0/1295424137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f00b4640 0x7fe5f0150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.969+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/1295424137 >> 172.21.15.96:0/1295424137 conn(0x7fe5f00d4050 msgr2=0x7fe5f00cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:20.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.969+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/1295424137 shutdown_connections 2024-06-02T23:58:20.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:20.969+0000 7fe5f6d5a640 1 -- 172.21.15.96:0/1295424137 wait complete. 2024-06-02T23:58:20.979 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2024-06-02T23:58:20.979 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir4 1m 2024-06-02T23:58:21.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.084+0000 7f5c72076640 1 Processor -- start 2024-06-02T23:58:21.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.084+0000 7f5c72076640 1 -- start start 2024-06-02T23:58:21.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.084+0000 7f5c72076640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5c6c0b4640 0x7f5c6c0b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.084+0000 7f5c72076640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5c6c0b4b50 0x7f5c6c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.084+0000 7f5c72076640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c6c0d2630 0x7f5c6c0d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.084+0000 7f5c72076640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f5c6c0d4ff0 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.084+0000 7f5c72076640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5c6c0b73e0 con 0x7f5c6c0b4640 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.084+0000 7f5c72076640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6c0cec60 con 0x7f5c6c0d2630 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.085+0000 7f5c6affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5c6c0b4b50 0x7f5c6c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.085+0000 7f5c6affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5c6c0b4b50 0x7f5c6c0b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35582/0 (socket says 172.21.15.96:35582) 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.085+0000 7f5c6affd640 1 -- 172.21.15.96:0/1807077866 learned_addr learned my addr 172.21.15.96:0/1807077866 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.085+0000 7f5c6affd640 1 -- 172.21.15.96:0/1807077866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c6c0d2630 msgr2=0x7f5c6c0d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.085+0000 7f5c6affd640 1 --2- 172.21.15.96:0/1807077866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c6c0d2630 0x7f5c6c0d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.085+0000 7f5c6affd640 1 -- 172.21.15.96:0/1807077866 >> v2:172.21.15.162:3300/0 conn(0x7f5c6c0b4640 msgr2=0x7f5c6c0b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.085+0000 7f5c6b7fe640 1 --2- 172.21.15.96:0/1807077866 >> v2:172.21.15.162:3300/0 conn(0x7f5c6c0b4640 0x7f5c6c0b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.085+0000 7f5c6affd640 1 --2- 172.21.15.96:0/1807077866 >> v2:172.21.15.162:3300/0 conn(0x7f5c6c0b4640 0x7f5c6c0b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.085+0000 7f5c6affd640 1 -- 172.21.15.96:0/1807077866 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c0d1fd0 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.085+0000 7f5c6b7fe640 1 --2- 172.21.15.96:0/1807077866 >> v2:172.21.15.162:3300/0 conn(0x7f5c6c0b4640 0x7f5c6c0b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c6affd640 1 --2- 172.21.15.96:0/1807077866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 0x7f5c6c0b5000 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c08c4c0 tx=0x7f5c6002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9ee410f4a4fbb3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c6a7fc640 1 -- 172.21.15.96:0/1807077866 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60037070 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c6a7fc640 1 -- 172.21.15.96:0/1807077866 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6002ae00 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c6a7fc640 1 -- 172.21.15.96:0/1807077866 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60032660 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c72076640 1 -- 172.21.15.96:0/1807077866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 msgr2=0x7f5c6c0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c72076640 1 --2- 172.21.15.96:0/1807077866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 0x7f5c6c0b5000 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c08c4c0 tx=0x7f5c6002a0b0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c72076640 1 -- 172.21.15.96:0/1807077866 shutdown_connections 2024-06-02T23:58:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c72076640 1 --2- 172.21.15.96:0/1807077866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c6c0d2630 0x7f5c6c0d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c72076640 1 --2- 172.21.15.96:0/1807077866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 0x7f5c6c0b5000 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c72076640 1 --2- 172.21.15.96:0/1807077866 >> v2:172.21.15.162:3300/0 conn(0x7f5c6c0b4640 0x7f5c6c0b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c72076640 1 -- 172.21.15.96:0/1807077866 >> 172.21.15.96:0/1807077866 conn(0x7f5c6c0d4050 msgr2=0x7f5c6c0d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c72076640 1 -- 172.21.15.96:0/1807077866 shutdown_connections 2024-06-02T23:58:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.086+0000 7f5c72076640 1 -- 172.21.15.96:0/1807077866 wait complete. 2024-06-02T23:58:21.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.087+0000 7f5c72076640 1 Processor -- start 2024-06-02T23:58:21.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.088+0000 7f5c72076640 1 -- start start 2024-06-02T23:58:21.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.088+0000 7f5c72076640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6c0b4640 0x7f5c6c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.088+0000 7f5c72076640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 0x7f5c6c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.088+0000 7f5c72076640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c6c0d2630 0x7f5c6c0cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.088+0000 7f5c72076640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c0d13b0 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.088+0000 7f5c72076640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c0cef00 con 0x7f5c6c0b4640 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.088+0000 7f5c72076640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6c0cf420 con 0x7f5c6c0d2630 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.088+0000 7f5c6affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 0x7f5c6c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 0x7f5c6c0cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35588/0 (socket says 172.21.15.96:35588) 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6affd640 1 -- 172.21.15.96:0/1704376024 learned_addr learned my addr 172.21.15.96:0/1704376024 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6b7fe640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6c0b4640 0x7f5c6c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6bfff640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c6c0d2630 0x7f5c6c0cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6affd640 1 -- 172.21.15.96:0/1704376024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c6c0d2630 msgr2=0x7f5c6c0cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6affd640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c6c0d2630 0x7f5c6c0cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6affd640 1 -- 172.21.15.96:0/1704376024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6c0b4640 msgr2=0x7f5c6c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6affd640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6c0b4640 0x7f5c6c0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6affd640 1 -- 172.21.15.96:0/1704376024 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c1581c0 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6b7fe640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6c0b4640 0x7f5c6c0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:21.093 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c6affd640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 0x7f5c6c0cd2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5c60000c00 tx=0x7f5c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c53fff640 1 -- 172.21.15.96:0/1704376024 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60042070 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c53fff640 1 -- 172.21.15.96:0/1704376024 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6003e670 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c53fff640 1 -- 172.21.15.96:0/1704376024 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60037040 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c72076640 1 -- 172.21.15.96:0/1704376024 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6c0c8950 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.089+0000 7f5c72076640 1 -- 172.21.15.96:0/1704376024 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6c158710 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.090+0000 7f5c72076640 1 -- 172.21.15.96:0/1704376024 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6c0683e0 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.091+0000 7f5c53fff640 1 -- 172.21.15.96:0/1704376024 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f5c6003a040 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.091+0000 7f5c53fff640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5c5806c030 0x7f5c5806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.091+0000 7f5c53fff640 1 -- 172.21.15.96:0/1704376024 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f5c600ab530 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.091+0000 7f5c6b7fe640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5c5806c030 0x7f5c5806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.094 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.091+0000 7f5c6b7fe640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5c5806c030 0x7f5c5806e4f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00aa30 tx=0x7f5c5c008040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:21.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.095+0000 7f5c53fff640 1 -- 172.21.15.96:0/1704376024 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5c60079a40 con 0x7f5c6c0b4b50 2024-06-02T23:58:21.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.294+0000 7f5c72076640 1 -- 172.21.15.96:0/1704376024 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir4", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5c6c0d2410 con 0x7f5c5806c030 2024-06-02T23:58:21.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.360+0000 7f5c53fff640 1 -- 172.21.15.96:0/1704376024 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f5c6c0d2410 con 0x7f5c5806c030 2024-06-02T23:58:21.361 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2024-06-02T23:58:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 -- 172.21.15.96:0/1704376024 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5c5806c030 msgr2=0x7f5c5806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5c5806c030 0x7f5c5806e4f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00aa30 tx=0x7f5c5c008040 comp rx=0 tx=0).stop 2024-06-02T23:58:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 -- 172.21.15.96:0/1704376024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 msgr2=0x7f5c6c0cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 0x7f5c6c0cd2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5c60000c00 tx=0x7f5c600046c0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 -- 172.21.15.96:0/1704376024 shutdown_connections 2024-06-02T23:58:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5c5806c030 0x7f5c5806e4f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c6c0d2630 0x7f5c6c0cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6c0b4b50 0x7f5c6c0cd2f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 --2- 172.21.15.96:0/1704376024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6c0b4640 0x7f5c6c0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 -- 172.21.15.96:0/1704376024 >> 172.21.15.96:0/1704376024 conn(0x7f5c6c0d4050 msgr2=0x7f5c6c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:21.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 -- 172.21.15.96:0/1704376024 shutdown_connections 2024-06-02T23:58:21.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.362+0000 7f5c72076640 1 -- 172.21.15.96:0/1704376024 wait complete. 2024-06-02T23:58:21.373 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2024-06-02T23:58:21.373 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir5 1m 2024-06-02T23:58:21.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.475+0000 7f62e7b6a640 1 Processor -- start 2024-06-02T23:58:21.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.476+0000 7f62e7b6a640 1 -- start start 2024-06-02T23:58:21.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.476+0000 7f62e7b6a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e00b4640 0x7f62e00b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.476+0000 7f62e7b6a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f62e00b4b50 0x7f62e00b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.476+0000 7f62e7b6a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f62e00d2630 0x7f62e00d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.476+0000 7f62e7b6a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f62e00d4ff0 con 0x7f62e00d2630 2024-06-02T23:58:21.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.476+0000 7f62e7b6a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f62e00b73e0 con 0x7f62e00b4b50 2024-06-02T23:58:21.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.476+0000 7f62e7b6a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62e00cec60 con 0x7f62e00b4640 2024-06-02T23:58:21.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.476+0000 7f62e6107640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f62e00d2630 0x7f62e00d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.477+0000 7f62e6107640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f62e00d2630 0x7f62e00d2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35596/0 (socket says 172.21.15.96:35596) 2024-06-02T23:58:21.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.477+0000 7f62e6107640 1 -- 172.21.15.96:0/2825833919 learned_addr learned my addr 172.21.15.96:0/2825833919 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:21.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.477+0000 7f62e5105640 1 --2- 172.21.15.96:0/2825833919 >> v2:172.21.15.162:3300/0 conn(0x7f62e00b4b50 0x7f62e00b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.477+0000 7f62e5906640 1 --2- 172.21.15.96:0/2825833919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e00b4640 0x7f62e00b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.477+0000 7f62e6107640 1 -- 172.21.15.96:0/2825833919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e00b4640 msgr2=0x7f62e00b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:21.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.477+0000 7f62e6107640 1 --2- 172.21.15.96:0/2825833919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e00b4640 0x7f62e00b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.477+0000 7f62e6107640 1 -- 172.21.15.96:0/2825833919 >> v2:172.21.15.162:3300/0 conn(0x7f62e00b4b50 msgr2=0x7f62e00b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:21.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.477+0000 7f62e6107640 1 --2- 172.21.15.96:0/2825833919 >> v2:172.21.15.162:3300/0 conn(0x7f62e00b4b50 0x7f62e00b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.477+0000 7f62e6107640 1 -- 172.21.15.96:0/2825833919 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e00d1fd0 con 0x7f62e00d2630 2024-06-02T23:58:21.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.477+0000 7f62e6107640 1 --2- 172.21.15.96:0/2825833919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00d2630 0x7f62e00d2ac0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f62e008da30 tx=0x7f62d802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb44c010d053cb5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:21.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e4904640 1 -- 172.21.15.96:0/2825833919 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d8037070 con 0x7f62e00d2630 2024-06-02T23:58:21.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e4904640 1 -- 172.21.15.96:0/2825833919 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d8032440 con 0x7f62e00d2630 2024-06-02T23:58:21.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e4904640 1 -- 172.21.15.96:0/2825833919 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d8032810 con 0x7f62e00d2630 2024-06-02T23:58:21.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e7b6a640 1 -- 172.21.15.96:0/2825833919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00d2630 msgr2=0x7f62e00d2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e7b6a640 1 --2- 172.21.15.96:0/2825833919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00d2630 0x7f62e00d2ac0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f62e008da30 tx=0x7f62d802a140 comp rx=0 tx=0).stop 2024-06-02T23:58:21.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e7b6a640 1 -- 172.21.15.96:0/2825833919 shutdown_connections 2024-06-02T23:58:21.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e7b6a640 1 --2- 172.21.15.96:0/2825833919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00d2630 0x7f62e00d2ac0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e7b6a640 1 --2- 172.21.15.96:0/2825833919 >> v2:172.21.15.162:3300/0 conn(0x7f62e00b4b50 0x7f62e00b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e7b6a640 1 --2- 172.21.15.96:0/2825833919 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e00b4640 0x7f62e00b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e7b6a640 1 -- 172.21.15.96:0/2825833919 >> 172.21.15.96:0/2825833919 conn(0x7f62e00d4050 msgr2=0x7f62e00d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:21.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e7b6a640 1 -- 172.21.15.96:0/2825833919 shutdown_connections 2024-06-02T23:58:21.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.478+0000 7f62e7b6a640 1 -- 172.21.15.96:0/2825833919 wait complete. 2024-06-02T23:58:21.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.479+0000 7f62e7b6a640 1 Processor -- start 2024-06-02T23:58:21.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.479+0000 7f62e7b6a640 1 -- start start 2024-06-02T23:58:21.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e7b6a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00b4640 0x7f62e0150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e7b6a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00b4b50 0x7f62e00a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e7b6a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e00d2630 0x7f62e00a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e7b6a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f62e00d13b0 con 0x7f62e00b4b50 2024-06-02T23:58:21.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e7b6a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62e00cef00 con 0x7f62e00b4640 2024-06-02T23:58:21.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e7b6a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62e00cf420 con 0x7f62e00d2630 2024-06-02T23:58:21.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e5105640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00b4b50 0x7f62e00a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e5105640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00b4b50 0x7f62e00a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35612/0 (socket says 172.21.15.96:35612) 2024-06-02T23:58:21.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e5105640 1 -- 172.21.15.96:0/3369042067 learned_addr learned my addr 172.21.15.96:0/3369042067 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:21.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e6107640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e00d2630 0x7f62e00a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.480+0000 7f62e5906640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00b4640 0x7f62e0150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62e5105640 1 -- 172.21.15.96:0/3369042067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e00d2630 msgr2=0x7f62e00a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62e5105640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e00d2630 0x7f62e00a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62e5105640 1 -- 172.21.15.96:0/3369042067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00b4640 msgr2=0x7f62e0150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62e5105640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00b4640 0x7f62e0150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62e5105640 1 -- 172.21.15.96:0/3369042067 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e00b30f0 con 0x7f62e00b4b50 2024-06-02T23:58:21.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62e5906640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00b4640 0x7f62e0150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:21.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62e5105640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00b4b50 0x7f62e00a0dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f62d000d800 tx=0x7f62d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:21.486 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62d67fc640 1 -- 172.21.15.96:0/3369042067 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d000b6c0 con 0x7f62e00b4b50 2024-06-02T23:58:21.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62d67fc640 1 -- 172.21.15.96:0/3369042067 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d0019070 con 0x7f62e00b4b50 2024-06-02T23:58:21.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62e7b6a640 1 -- 172.21.15.96:0/3369042067 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e0151910 con 0x7f62e00b4b50 2024-06-02T23:58:21.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62d67fc640 1 -- 172.21.15.96:0/3369042067 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d000ba80 con 0x7f62e00b4b50 2024-06-02T23:58:21.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.481+0000 7f62e7b6a640 1 -- 172.21.15.96:0/3369042067 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e0151ed0 con 0x7f62e00b4b50 2024-06-02T23:58:21.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.482+0000 7f62e7b6a640 1 -- 172.21.15.96:0/3369042067 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e00caf50 con 0x7f62e00b4b50 2024-06-02T23:58:21.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.482+0000 7f62d67fc640 1 -- 172.21.15.96:0/3369042067 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f62d000bc20 con 0x7f62e00b4b50 2024-06-02T23:58:21.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.483+0000 7f62d67fc640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f62c406c030 0x7f62c406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.483+0000 7f62d67fc640 1 -- 172.21.15.96:0/3369042067 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f62d008b8d0 con 0x7f62e00b4b50 2024-06-02T23:58:21.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.483+0000 7f62e5906640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f62c406c030 0x7f62c406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.483+0000 7f62e5906640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f62c406c030 0x7f62c406e4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009aa0 tx=0x7f62dc0039f0 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:21.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.487+0000 7f62d67fc640 1 -- 172.21.15.96:0/3369042067 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f62d0059d40 con 0x7f62e00b4b50 2024-06-02T23:58:21.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.681+0000 7f62e7b6a640 1 -- 172.21.15.96:0/3369042067 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir5", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f62e0151700 con 0x7f62c406c030 2024-06-02T23:58:21.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.748+0000 7f62d67fc640 1 -- 172.21.15.96:0/3369042067 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f62e0151700 con 0x7f62c406c030 2024-06-02T23:58:21.748 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2024-06-02T23:58:21.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 -- 172.21.15.96:0/3369042067 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f62c406c030 msgr2=0x7f62c406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f62c406c030 0x7f62c406e4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009aa0 tx=0x7f62dc0039f0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 -- 172.21.15.96:0/3369042067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00b4b50 msgr2=0x7f62e00a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00b4b50 0x7f62e00a0dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f62d000d800 tx=0x7f62d000dcc0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 -- 172.21.15.96:0/3369042067 shutdown_connections 2024-06-02T23:58:21.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f62c406c030 0x7f62c406e4f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e00d2630 0x7f62e00a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f62e00b4b50 0x7f62e00a0dd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 --2- 172.21.15.96:0/3369042067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00b4640 0x7f62e0150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 -- 172.21.15.96:0/3369042067 >> 172.21.15.96:0/3369042067 conn(0x7f62e00d4050 msgr2=0x7f62e006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:21.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 -- 172.21.15.96:0/3369042067 shutdown_connections 2024-06-02T23:58:21.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.750+0000 7f62e7b6a640 1 -- 172.21.15.96:0/3369042067 wait complete. 2024-06-02T23:58:21.761 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2024-06-02T23:58:21.761 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir6 1m 2024-06-02T23:58:21.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.862+0000 7f865e0c1640 1 Processor -- start 2024-06-02T23:58:21.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.862+0000 7f865e0c1640 1 -- start start 2024-06-02T23:58:21.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f865e0c1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f865815fc40 0x7f8658071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f865e0c1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f865806ec50 0x7f86580ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f865e0c1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8658072fa0 con 0x7f86580729e0 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f865e0c1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f86580718f0 con 0x7f865806ec50 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f865e0c1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f86580712a0 con 0x7f865815fc40 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f8657fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f865806ec50 0x7f86580ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f8657fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f865806ec50 0x7f86580ca300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35628/0 (socket says 172.21.15.96:35628) 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f8657fff640 1 -- 172.21.15.96:0/3436311974 learned_addr learned my addr 172.21.15.96:0/3436311974 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f86577fe640 1 --2- 172.21.15.96:0/3436311974 >> v2:172.21.15.162:3300/0 conn(0x7f865815fc40 0x7f8658071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f8657fff640 1 -- 172.21.15.96:0/3436311974 >> v2:172.21.15.162:3300/0 conn(0x7f865815fc40 msgr2=0x7f8658071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f8657fff640 1 --2- 172.21.15.96:0/3436311974 >> v2:172.21.15.162:3300/0 conn(0x7f865815fc40 0x7f8658071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f8657fff640 1 -- 172.21.15.96:0/3436311974 >> v1:172.21.15.162:6789/0 conn(0x7f86580729e0 legacy=0x7f8658160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.863+0000 7f8657fff640 1 -- 172.21.15.96:0/3436311974 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8658071580 con 0x7f865806ec50 2024-06-02T23:58:21.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.864+0000 7f8657fff640 1 --2- 172.21.15.96:0/3436311974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 0x7f86580ca300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8658069d10 tx=0x7f865002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6c100ac1746131 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.864+0000 7f86567fc640 1 -- 172.21.15.96:0/3436311974 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650036070 con 0x7f865806ec50 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.864+0000 7f86567fc640 1 -- 172.21.15.96:0/3436311974 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8650031600 con 0x7f865806ec50 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.864+0000 7f86567fc640 1 -- 172.21.15.96:0/3436311974 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86500319d0 con 0x7f865806ec50 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.864+0000 7f865e0c1640 1 -- 172.21.15.96:0/3436311974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 msgr2=0x7f86580ca300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.864+0000 7f865e0c1640 1 --2- 172.21.15.96:0/3436311974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 0x7f86580ca300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8658069d10 tx=0x7f865002a6a0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.864+0000 7f865e0c1640 1 -- 172.21.15.96:0/3436311974 shutdown_connections 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.864+0000 7f865e0c1640 1 --2- 172.21.15.96:0/3436311974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 0x7f86580ca300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.865+0000 7f865e0c1640 1 --2- 172.21.15.96:0/3436311974 >> v2:172.21.15.162:3300/0 conn(0x7f865815fc40 0x7f8658071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.865+0000 7f865e0c1640 1 -- 172.21.15.96:0/3436311974 >> 172.21.15.96:0/3436311974 conn(0x7f86580cfcb0 msgr2=0x7f86580d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.865+0000 7f865e0c1640 1 -- 172.21.15.96:0/3436311974 shutdown_connections 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.865+0000 7f865e0c1640 1 -- 172.21.15.96:0/3436311974 wait complete. 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.866+0000 7f865e0c1640 1 Processor -- start 2024-06-02T23:58:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.866+0000 7f865e0c1640 1 -- start start 2024-06-02T23:58:21.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f865e0c1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 0x7f86580c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f865e0c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86580729e0 0x7f86581f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f865e0c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f865815fc40 0x7f865814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f865e0c1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f86580ca9c0 con 0x7f865806ec50 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f865e0c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f86580ca840 con 0x7f865815fc40 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f865e0c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f86580cab40 con 0x7f86580729e0 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f86577fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 0x7f86580c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f86577fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 0x7f86580c6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35636/0 (socket says 172.21.15.96:35636) 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f86577fe640 1 -- 172.21.15.96:0/4172218882 learned_addr learned my addr 172.21.15.96:0/4172218882 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f8657fff640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f865815fc40 0x7f865814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f8656ffd640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86580729e0 0x7f86581f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f86577fe640 1 -- 172.21.15.96:0/4172218882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86580729e0 msgr2=0x7f86581f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f86577fe640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86580729e0 0x7f86581f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f86577fe640 1 -- 172.21.15.96:0/4172218882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f865815fc40 msgr2=0x7f865814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f86577fe640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f865815fc40 0x7f865814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f86577fe640 1 -- 172.21.15.96:0/4172218882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8658150a10 con 0x7f865806ec50 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f8656ffd640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86580729e0 0x7f86581f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:21.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f86577fe640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 0x7f86580c6340 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f864800d830 tx=0x7f864800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:21.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f864ffff640 1 -- 172.21.15.96:0/4172218882 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864800b6c0 con 0x7f865806ec50 2024-06-02T23:58:21.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f864ffff640 1 -- 172.21.15.96:0/4172218882 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8648019070 con 0x7f865806ec50 2024-06-02T23:58:21.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f865e0c1640 1 -- 172.21.15.96:0/4172218882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8658150cf0 con 0x7f865806ec50 2024-06-02T23:58:21.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f864ffff640 1 -- 172.21.15.96:0/4172218882 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864800ba80 con 0x7f865806ec50 2024-06-02T23:58:21.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.867+0000 7f865e0c1640 1 -- 172.21.15.96:0/4172218882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86581f2840 con 0x7f865806ec50 2024-06-02T23:58:21.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.868+0000 7f865e0c1640 1 -- 172.21.15.96:0/4172218882 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86580683e0 con 0x7f865806ec50 2024-06-02T23:58:21.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.869+0000 7f864ffff640 1 -- 172.21.15.96:0/4172218882 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f864800bc20 con 0x7f865806ec50 2024-06-02T23:58:21.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.869+0000 7f864ffff640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f863806c030 0x7f863806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:21.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.869+0000 7f864ffff640 1 -- 172.21.15.96:0/4172218882 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f864808b820 con 0x7f865806ec50 2024-06-02T23:58:21.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.869+0000 7f8656ffd640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f863806c030 0x7f863806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:21.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.870+0000 7f8656ffd640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f863806c030 0x7f863806e4f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f865806dec0 tx=0x7f8640009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:21.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:21.874+0000 7f864ffff640 1 -- 172.21.15.96:0/4172218882 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8648059d30 con 0x7f865806ec50 2024-06-02T23:58:22.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.069+0000 7f865e0c1640 1 -- 172.21.15.96:0/4172218882 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir6", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f86581507c0 con 0x7f863806c030 2024-06-02T23:58:22.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.132+0000 7f864ffff640 1 -- 172.21.15.96:0/4172218882 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f86581507c0 con 0x7f863806c030 2024-06-02T23:58:22.133 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.134+0000 7f865e0c1640 1 -- 172.21.15.96:0/4172218882 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f863806c030 msgr2=0x7f863806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.134+0000 7f865e0c1640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f863806c030 0x7f863806e4f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f865806dec0 tx=0x7f8640009040 comp rx=0 tx=0).stop 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.134+0000 7f865e0c1640 1 -- 172.21.15.96:0/4172218882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 msgr2=0x7f86580c6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.134+0000 7f865e0c1640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 0x7f86580c6340 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f864800d830 tx=0x7f864800dcf0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.135+0000 7f865e0c1640 1 -- 172.21.15.96:0/4172218882 shutdown_connections 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.135+0000 7f865e0c1640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f863806c030 0x7f863806e4f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.135+0000 7f865e0c1640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f865815fc40 0x7f865814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.135+0000 7f865e0c1640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86580729e0 0x7f86581f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.135+0000 7f865e0c1640 1 --2- 172.21.15.96:0/4172218882 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f865806ec50 0x7f86580c6340 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.135+0000 7f865e0c1640 1 -- 172.21.15.96:0/4172218882 >> 172.21.15.96:0/4172218882 conn(0x7f86580cfcb0 msgr2=0x7f865815ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:22.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.135+0000 7f865e0c1640 1 -- 172.21.15.96:0/4172218882 shutdown_connections 2024-06-02T23:58:22.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.135+0000 7f865e0c1640 1 -- 172.21.15.96:0/4172218882 wait complete. 2024-06-02T23:58:22.145 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2024-06-02T23:58:22.145 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir7 1m 2024-06-02T23:58:22.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.248+0000 7fa9bdd9e640 1 Processor -- start 2024-06-02T23:58:22.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.248+0000 7fa9bdd9e640 1 -- start start 2024-06-02T23:58:22.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9bdd9e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b815e530 0x7fa9b80cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9bdd9e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa9b80cb2a0 0x7fa9b806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9bdd9e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9b80723e0 con 0x7fa9b806eb50 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9bdd9e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa9b806efa0 con 0x7fa9b80cb2a0 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9bdd9e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b80cb7b0 con 0x7fa9b815e530 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b7fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa9b806eb50 0x7fa9b815ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:59960/0 (socket says 172.21.15.96:59960) 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b7fff640 1 -- 172.21.15.96:0/3223608619 learned_addr learned my addr 172.21.15.96:0/3223608619 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b77fe640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b815e530 0x7fa9b80cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b6ffd640 1 --2- 172.21.15.96:0/3223608619 >> v2:172.21.15.162:3300/0 conn(0x7fa9b80cb2a0 0x7fa9b806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989073881 0 0) 0x7fa9b80723e0 con 0x7fa9b806eb50 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9a0003520 con 0x7fa9b806eb50 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 307960197 0 0) 0x7fa9a0003520 con 0x7fa9b806eb50 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b815e530 msgr2=0x7fa9b80cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b67fc640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b815e530 0x7fa9b80cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 >> v2:172.21.15.162:3300/0 conn(0x7fa9b80cb2a0 msgr2=0x7fa9b806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:22.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b67fc640 1 --2- 172.21.15.96:0/3223608619 >> v2:172.21.15.162:3300/0 conn(0x7fa9b80cb2a0 0x7fa9b806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b8072680 con 0x7fa9b806eb50 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fa9b00019f0 con 0x7fa9b806eb50 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.249+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 >> v1:172.21.15.96:6789/0 conn(0x7fa9b806eb50 legacy=0x7fa9b815ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b67fc640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b815e530 0x7fa9a00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b67fc640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a0003f30 0x7fa9a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b67fc640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a0004d40 0x7fa9a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b806efa0 con 0x7fa9a0003f30 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b80cb7b0 con 0x7fa9a0004d40 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a000baa0 con 0x7fa9b815e530 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b6ffd640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a0003f30 0x7fa9a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b77fe640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b815e530 0x7fa9a00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b7fff640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a0004d40 0x7fa9a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b6ffd640 1 -- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b815e530 msgr2=0x7fa9a00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:22.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b6ffd640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b815e530 0x7fa9a00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b6ffd640 1 -- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a0004d40 msgr2=0x7fa9a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b6ffd640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a0004d40 0x7fa9a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.250+0000 7fa9b6ffd640 1 -- 172.21.15.96:0/3223608619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a0003520 con 0x7fa9a0003f30 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9b6ffd640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a0003f30 0x7fa9a0004800 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009a90 tx=0x7fa9a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7781144f98b6504e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac036070 con 0x7fa9a0003f30 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ac031400 con 0x7fa9a0003f30 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9b67fc640 1 -- 172.21.15.96:0/3223608619 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac009690 con 0x7fa9a0003f30 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/3223608619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a0003f30 msgr2=0x7fa9a0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9bdd9e640 1 --2- 172.21.15.96:0/3223608619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a0003f30 0x7fa9a0004800 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009a90 tx=0x7fa9a0005830 comp rx=0 tx=0).stop 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9b7fff640 1 -- 172.21.15.96:0/3223608619 reap_dead start 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/3223608619 shutdown_connections 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/3223608619 >> 172.21.15.96:0/3223608619 conn(0x7fa9b80cfcb0 msgr2=0x7fa9b80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/3223608619 shutdown_connections 2024-06-02T23:58:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.251+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/3223608619 wait complete. 2024-06-02T23:58:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.253+0000 7fa9bdd9e640 1 Processor -- start 2024-06-02T23:58:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.253+0000 7fa9bdd9e640 1 -- start start 2024-06-02T23:58:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9bdd9e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a0003f30 0x7fa9b8147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9bdd9e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9b80b28d0 0x7fa9b80b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9bdd9e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b80ad970 0x7fa9b80addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9bdd9e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b80ce890 con 0x7fa9b80b28d0 2024-06-02T23:58:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9bdd9e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b8072c40 con 0x7fa9a0003f30 2024-06-02T23:58:22.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9bdd9e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b815e910 con 0x7fa9b80ad970 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9b80b28d0 0x7fa9b80b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b6ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9b80b28d0 0x7fa9b80b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35644/0 (socket says 172.21.15.96:35644) 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b6ffd640 1 -- 172.21.15.96:0/2411446425 learned_addr learned my addr 172.21.15.96:0/2411446425 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b77fe640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a0003f30 0x7fa9b8147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b7fff640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b80ad970 0x7fa9b80addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b6ffd640 1 -- 172.21.15.96:0/2411446425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b80ad970 msgr2=0x7fa9b80addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b6ffd640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b80ad970 0x7fa9b80addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b6ffd640 1 -- 172.21.15.96:0/2411446425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a0003f30 msgr2=0x7fa9b8147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b6ffd640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a0003f30 0x7fa9b8147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b6ffd640 1 -- 172.21.15.96:0/2411446425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b81f7e30 con 0x7fa9b80b28d0 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9b6ffd640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9b80b28d0 0x7fa9b80b2d30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000c00 tx=0x7fa9ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa99ffff640 1 -- 172.21.15.96:0/2411446425 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac040020 con 0x7fa9b80b28d0 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa99ffff640 1 -- 172.21.15.96:0/2411446425 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ac003c60 con 0x7fa9b80b28d0 2024-06-02T23:58:22.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/2411446425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b80b4740 con 0x7fa9b80b28d0 2024-06-02T23:58:22.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa99ffff640 1 -- 172.21.15.96:0/2411446425 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac036040 con 0x7fa9b80b28d0 2024-06-02T23:58:22.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.254+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/2411446425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b81f7350 con 0x7fa9b80b28d0 2024-06-02T23:58:22.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.255+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/2411446425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b80683e0 con 0x7fa9b80b28d0 2024-06-02T23:58:22.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.256+0000 7fa99ffff640 1 -- 172.21.15.96:0/2411446425 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7fa9ac043020 con 0x7fa9b80b28d0 2024-06-02T23:58:22.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.256+0000 7fa99ffff640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa9a406c030 0x7fa9a406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.256+0000 7fa99ffff640 1 -- 172.21.15.96:0/2411446425 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7fa9ac0ab480 con 0x7fa9b80b28d0 2024-06-02T23:58:22.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.256+0000 7fa9b77fe640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa9a406c030 0x7fa9a406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.257+0000 7fa9b77fe640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa9a406c030 0x7fa9a406e4f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009ae0 tx=0x7fa9a8009190 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:22.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.261+0000 7fa99ffff640 1 -- 172.21.15.96:0/2411446425 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa9ac04a070 con 0x7fa9b80b28d0 2024-06-02T23:58:22.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.454+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/2411446425 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir7", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa9b80753a0 con 0x7fa9a406c030 2024-06-02T23:58:22.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.517+0000 7fa99ffff640 1 -- 172.21.15.96:0/2411446425 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fa9b80753a0 con 0x7fa9a406c030 2024-06-02T23:58:22.517 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2024-06-02T23:58:22.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/2411446425 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa9a406c030 msgr2=0x7fa9a406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa9a406c030 0x7fa9a406e4f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8009ae0 tx=0x7fa9a8009190 comp rx=0 tx=0).stop 2024-06-02T23:58:22.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/2411446425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9b80b28d0 msgr2=0x7fa9b80b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9b80b28d0 0x7fa9b80b2d30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac000c00 tx=0x7fa9ac004730 comp rx=0 tx=0).stop 2024-06-02T23:58:22.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/2411446425 shutdown_connections 2024-06-02T23:58:22.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa9a406c030 0x7fa9a406e4f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9b80ad970 0x7fa9b80addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9b80b28d0 0x7fa9b80b2d30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 --2- 172.21.15.96:0/2411446425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a0003f30 0x7fa9b8147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/2411446425 >> 172.21.15.96:0/2411446425 conn(0x7fa9b80cfcb0 msgr2=0x7fa9b80b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:22.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/2411446425 shutdown_connections 2024-06-02T23:58:22.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.519+0000 7fa9bdd9e640 1 -- 172.21.15.96:0/2411446425 wait complete. 2024-06-02T23:58:22.530 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2024-06-02T23:58:22.530 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir8 1m 2024-06-02T23:58:22.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.631+0000 7fc1f9c4d640 1 Processor -- start 2024-06-02T23:58:22.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.632+0000 7fc1f9c4d640 1 -- start start 2024-06-02T23:58:22.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.632+0000 7fc1f9c4d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc1f406e610 0x7fc1f406eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.632+0000 7fc1f9c4d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f40cd880 0x7fc1f40cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.632+0000 7fc1f9c4d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f40723e0 con 0x7fc1f415e530 2024-06-02T23:58:22.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.632+0000 7fc1f9c4d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc1f40cb7b0 con 0x7fc1f406e610 2024-06-02T23:58:22.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.632+0000 7fc1f9c4d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f4072680 con 0x7fc1f40cd880 2024-06-02T23:58:22.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.633+0000 7fc1f3fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f40cd880 0x7fc1f40cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.633+0000 7fc1f2ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc1f406e610 0x7fc1f406eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.633+0000 7fc1f37fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc1f415e530 0x7fc1f40cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:58060/0 (socket says 172.21.15.96:58060) 2024-06-02T23:58:22.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.633+0000 7fc1f37fe640 1 -- 172.21.15.96:0/2738291499 learned_addr learned my addr 172.21.15.96:0/2738291499 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.633+0000 7fc1f2ffd640 1 -- 172.21.15.96:0/2738291499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f40cd880 msgr2=0x7fc1f40cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.633+0000 7fc1f2ffd640 1 --2- 172.21.15.96:0/2738291499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f40cd880 0x7fc1f40cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.633+0000 7fc1f2ffd640 1 -- 172.21.15.96:0/2738291499 >> v1:172.21.15.162:6789/0 conn(0x7fc1f415e530 legacy=0x7fc1f40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.633+0000 7fc1f2ffd640 1 -- 172.21.15.96:0/2738291499 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f4072960 con 0x7fc1f406e610 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.633+0000 7fc1f27fc640 1 -- 172.21.15.96:0/2738291499 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123567976 0 0) 0x7fc1f40723e0 con 0x7fc1f415e530 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.633+0000 7fc1f3fff640 1 --2- 172.21.15.96:0/2738291499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f40cd880 0x7fc1f40cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.634+0000 7fc1f2ffd640 1 --2- 172.21.15.96:0/2738291499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f406e610 0x7fc1f406eaa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009d90 tx=0x7fc1e802a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dfe60cbd711c5fb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.634+0000 7fc1f27fc640 1 -- 172.21.15.96:0/2738291499 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8007740 con 0x7fc1f406e610 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.634+0000 7fc1f27fc640 1 -- 172.21.15.96:0/2738291499 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e80078e0 con 0x7fc1f406e610 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.634+0000 7fc1f27fc640 1 -- 172.21.15.96:0/2738291499 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8007cb0 con 0x7fc1f406e610 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.635+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/2738291499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f406e610 msgr2=0x7fc1f406eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.635+0000 7fc1f9c4d640 1 --2- 172.21.15.96:0/2738291499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f406e610 0x7fc1f406eaa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009d90 tx=0x7fc1e802a530 comp rx=0 tx=0).stop 2024-06-02T23:58:22.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.635+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/2738291499 shutdown_connections 2024-06-02T23:58:22.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.635+0000 7fc1f9c4d640 1 --2- 172.21.15.96:0/2738291499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f40cd880 0x7fc1f40cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.635+0000 7fc1f9c4d640 1 --2- 172.21.15.96:0/2738291499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f406e610 0x7fc1f406eaa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.635+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/2738291499 >> 172.21.15.96:0/2738291499 conn(0x7fc1f40cfcb0 msgr2=0x7fc1f40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:22.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.635+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/2738291499 shutdown_connections 2024-06-02T23:58:22.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.635+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/2738291499 wait complete. 2024-06-02T23:58:22.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.636+0000 7fc1f9c4d640 1 Processor -- start 2024-06-02T23:58:22.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.636+0000 7fc1f9c4d640 1 -- start start 2024-06-02T23:58:22.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f9c4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f406e610 0x7fc1f41f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f9c4d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cd880 0x7fc1f414f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f9c4d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f415e530 0x7fc1f4153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f9c4d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f4073160 con 0x7fc1f40cd880 2024-06-02T23:58:22.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f9c4d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f415e910 con 0x7fc1f406e610 2024-06-02T23:58:22.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f9c4d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f40cb470 con 0x7fc1f415e530 2024-06-02T23:58:22.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f2ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cd880 0x7fc1f414f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f2ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cd880 0x7fc1f414f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35648/0 (socket says 172.21.15.96:35648) 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f2ffd640 1 -- 172.21.15.96:0/3982733627 learned_addr learned my addr 172.21.15.96:0/3982733627 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f37fe640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f406e610 0x7fc1f41f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f3fff640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f415e530 0x7fc1f4153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f2ffd640 1 -- 172.21.15.96:0/3982733627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f415e530 msgr2=0x7fc1f4153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f2ffd640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f415e530 0x7fc1f4153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f2ffd640 1 -- 172.21.15.96:0/3982733627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f406e610 msgr2=0x7fc1f41f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f2ffd640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f406e610 0x7fc1f41f5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f2ffd640 1 -- 172.21.15.96:0/3982733627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f40c5fa0 con 0x7fc1f40cd880 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f2ffd640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cd880 0x7fc1f414f700 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8000f80 tx=0x7fc1e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1dbfff640 1 -- 172.21.15.96:0/3982733627 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e803f070 con 0x7fc1f40cd880 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1dbfff640 1 -- 172.21.15.96:0/3982733627 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e8031c40 con 0x7fc1f40cd880 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.637+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/3982733627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f40c6280 con 0x7fc1f40cd880 2024-06-02T23:58:22.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.638+0000 7fc1dbfff640 1 -- 172.21.15.96:0/3982733627 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8009450 con 0x7fc1f40cd880 2024-06-02T23:58:22.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.638+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/3982733627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f40c6840 con 0x7fc1f40cd880 2024-06-02T23:58:22.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.639+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/3982733627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f40683e0 con 0x7fc1f40cd880 2024-06-02T23:58:22.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.639+0000 7fc1dbfff640 1 -- 172.21.15.96:0/3982733627 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7fc1e8003990 con 0x7fc1f40cd880 2024-06-02T23:58:22.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.639+0000 7fc1dbfff640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc1e006c030 0x7fc1e006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:22.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.640+0000 7fc1dbfff640 1 -- 172.21.15.96:0/3982733627 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7fc1e80ac5a0 con 0x7fc1f40cd880 2024-06-02T23:58:22.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.640+0000 7fc1f37fe640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc1e006c030 0x7fc1e006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:22.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.640+0000 7fc1f37fe640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc1e006c030 0x7fc1e006e4f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4000f60 tx=0x7fc1e4009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:22.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.644+0000 7fc1dbfff640 1 -- 172.21.15.96:0/3982733627 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc1e807a2c0 con 0x7fc1f40cd880 2024-06-02T23:58:22.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.839+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/3982733627 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir8", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc1f406cd40 con 0x7fc1e006c030 2024-06-02T23:58:22.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.906+0000 7fc1dbfff640 1 -- 172.21.15.96:0/3982733627 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fc1f406cd40 con 0x7fc1e006c030 2024-06-02T23:58:22.906 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2024-06-02T23:58:22.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/3982733627 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc1e006c030 msgr2=0x7fc1e006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc1e006c030 0x7fc1e006e4f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4000f60 tx=0x7fc1e4009040 comp rx=0 tx=0).stop 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/3982733627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cd880 msgr2=0x7fc1f414f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cd880 0x7fc1f414f700 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8000f80 tx=0x7fc1e8004a40 comp rx=0 tx=0).stop 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/3982733627 shutdown_connections 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fc1e006c030 0x7fc1e006e4f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f415e530 0x7fc1f4153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cd880 0x7fc1f414f700 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 --2- 172.21.15.96:0/3982733627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f406e610 0x7fc1f41f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/3982733627 >> 172.21.15.96:0/3982733627 conn(0x7fc1f40cfcb0 msgr2=0x7fc1f40c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/3982733627 shutdown_connections 2024-06-02T23:58:22.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:22.908+0000 7fc1f9c4d640 1 -- 172.21.15.96:0/3982733627 wait complete. 2024-06-02T23:58:22.919 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2024-06-02T23:58:22.919 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir9 1m 2024-06-02T23:58:23.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.020+0000 7f5268288640 1 Processor -- start 2024-06-02T23:58:23.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.021+0000 7f5268288640 1 -- start start 2024-06-02T23:58:23.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5268288640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f52600b4b50 0x7f52600b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5268288640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f52600d2630 0x7f52600d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5268288640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52600cec60 con 0x7f52600b4640 2024-06-02T23:58:23.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5268288640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f52600d2fe0 con 0x7f52600d2630 2024-06-02T23:58:23.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5268288640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f52600d4ff0 con 0x7f52600b4b50 2024-06-02T23:58:23.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5266825640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f52600d2630 0x7f52600d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5266825640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f52600d2630 0x7f52600d2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60812/0 (socket says 172.21.15.96:60812) 2024-06-02T23:58:23.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5266825640 1 -- 172.21.15.96:0/2298739110 learned_addr learned my addr 172.21.15.96:0/2298739110 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:23.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5265823640 1 --2- 172.21.15.96:0/2298739110 >> v2:172.21.15.162:3300/0 conn(0x7f52600b4b50 0x7f52600b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5266825640 1 -- 172.21.15.96:0/2298739110 >> v2:172.21.15.162:3300/0 conn(0x7f52600b4b50 msgr2=0x7f52600b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:23.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5266825640 1 --2- 172.21.15.96:0/2298739110 >> v2:172.21.15.162:3300/0 conn(0x7f52600b4b50 0x7f52600b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5266825640 1 -- 172.21.15.96:0/2298739110 >> v1:172.21.15.162:6789/0 conn(0x7f52600b4640 legacy=0x7f52600b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:23.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5266825640 1 -- 172.21.15.96:0/2298739110 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52600d1fd0 con 0x7f52600d2630 2024-06-02T23:58:23.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.022+0000 7f5265823640 1 --2- 172.21.15.96:0/2298739110 >> v2:172.21.15.162:3300/0 conn(0x7f52600b4b50 0x7f52600b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.023+0000 7f5266825640 1 --2- 172.21.15.96:0/2298739110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 0x7f52600d2aa0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f52600d3d40 tx=0x7f525802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7220ddd1cf045204 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.023+0000 7f5265022640 1 -- 172.21.15.96:0/2298739110 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258036070 con 0x7f52600d2630 2024-06-02T23:58:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.023+0000 7f5265022640 1 -- 172.21.15.96:0/2298739110 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5258031600 con 0x7f52600d2630 2024-06-02T23:58:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.023+0000 7f5265022640 1 -- 172.21.15.96:0/2298739110 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52580319d0 con 0x7f52600d2630 2024-06-02T23:58:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.023+0000 7f5268288640 1 -- 172.21.15.96:0/2298739110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 msgr2=0x7f52600d2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.023+0000 7f5268288640 1 --2- 172.21.15.96:0/2298739110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 0x7f52600d2aa0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f52600d3d40 tx=0x7f525802a5d0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.023+0000 7f5268288640 1 -- 172.21.15.96:0/2298739110 shutdown_connections 2024-06-02T23:58:23.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.023+0000 7f5268288640 1 --2- 172.21.15.96:0/2298739110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 0x7f52600d2aa0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.023+0000 7f5268288640 1 --2- 172.21.15.96:0/2298739110 >> v2:172.21.15.162:3300/0 conn(0x7f52600b4b50 0x7f52600b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.023+0000 7f5268288640 1 -- 172.21.15.96:0/2298739110 >> 172.21.15.96:0/2298739110 conn(0x7f52600d4050 msgr2=0x7f52600d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.024+0000 7f5268288640 1 -- 172.21.15.96:0/2298739110 shutdown_connections 2024-06-02T23:58:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.024+0000 7f5268288640 1 -- 172.21.15.96:0/2298739110 wait complete. 2024-06-02T23:58:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.025+0000 7f5268288640 1 Processor -- start 2024-06-02T23:58:23.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.025+0000 7f5268288640 1 -- start start 2024-06-02T23:58:23.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.025+0000 7f5268288640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52600b4640 0x7f52600b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.025+0000 7f5268288640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52600b4b50 0x7f5260158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.025+0000 7f5268288640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 0x7f52600c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.025+0000 7f5268288640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f52600d13b0 con 0x7f52600d2630 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.025+0000 7f5268288640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52600cef00 con 0x7f52600b4b50 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.025+0000 7f5268288640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f52600cf420 con 0x7f52600b4640 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266825640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 0x7f52600c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266825640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 0x7f52600c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60820/0 (socket says 172.21.15.96:60820) 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266825640 1 -- 172.21.15.96:0/2081781723 learned_addr learned my addr 172.21.15.96:0/2081781723 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5265823640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52600b4b50 0x7f5260158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266024640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52600b4640 0x7f52600b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266825640 1 -- 172.21.15.96:0/2081781723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52600b4640 msgr2=0x7f52600b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266825640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52600b4640 0x7f52600b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266825640 1 -- 172.21.15.96:0/2081781723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52600b4b50 msgr2=0x7f5260158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266825640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52600b4b50 0x7f5260158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266825640 1 -- 172.21.15.96:0/2081781723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52600b8db0 con 0x7f52600d2630 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266024640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52600b4640 0x7f52600b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5266825640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 0x7f52600c7b80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5258009f40 tx=0x7f5258004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5252ffd640 1 -- 172.21.15.96:0/2081781723 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258036050 con 0x7f52600d2630 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5252ffd640 1 -- 172.21.15.96:0/2081781723 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5258042070 con 0x7f52600d2630 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5268288640 1 -- 172.21.15.96:0/2081781723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52601f7ae0 con 0x7f52600d2630 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5252ffd640 1 -- 172.21.15.96:0/2081781723 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258009510 con 0x7f52600d2630 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.026+0000 7f5268288640 1 -- 172.21.15.96:0/2081781723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52601f8380 con 0x7f52600d2630 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.027+0000 7f5268288640 1 -- 172.21.15.96:0/2081781723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52601f7ed0 con 0x7f52600d2630 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.028+0000 7f5252ffd640 1 -- 172.21.15.96:0/2081781723 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f5258007bd0 con 0x7f52600d2630 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.028+0000 7f5252ffd640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f524406c060 0x7f524406e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.028+0000 7f5266024640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f524406c060 0x7f524406e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.028+0000 7f5252ffd640 1 -- 172.21.15.96:0/2081781723 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f52580ac410 con 0x7f52600d2630 2024-06-02T23:58:23.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.028+0000 7f5266024640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f524406c060 0x7f524406e520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f525c003eb0 tx=0x7f525c009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.032+0000 7f5252ffd640 1 -- 172.21.15.96:0/2081781723 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f525807a780 con 0x7f52600d2630 2024-06-02T23:58:23.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.231+0000 7f5268288640 1 -- 172.21.15.96:0/2081781723 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir9", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f52600d2410 con 0x7f524406c060 2024-06-02T23:58:23.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.294+0000 7f5252ffd640 1 -- 172.21.15.96:0/2081781723 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f52600d2410 con 0x7f524406c060 2024-06-02T23:58:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2024-06-02T23:58:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.296+0000 7f5268288640 1 -- 172.21.15.96:0/2081781723 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f524406c060 msgr2=0x7f524406e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.296+0000 7f5268288640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f524406c060 0x7f524406e520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f525c003eb0 tx=0x7f525c009040 comp rx=0 tx=0).stop 2024-06-02T23:58:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.296+0000 7f5268288640 1 -- 172.21.15.96:0/2081781723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 msgr2=0x7f52600c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.296+0000 7f5268288640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 0x7f52600c7b80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5258009f40 tx=0x7f5258004a40 comp rx=0 tx=0).stop 2024-06-02T23:58:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.296+0000 7f5268288640 1 -- 172.21.15.96:0/2081781723 shutdown_connections 2024-06-02T23:58:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.296+0000 7f5268288640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f524406c060 0x7f524406e520 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.296+0000 7f5268288640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52600d2630 0x7f52600c7b80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.296+0000 7f5268288640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52600b4b50 0x7f5260158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.297+0000 7f5268288640 1 --2- 172.21.15.96:0/2081781723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52600b4640 0x7f52600b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.297+0000 7f5268288640 1 -- 172.21.15.96:0/2081781723 >> 172.21.15.96:0/2081781723 conn(0x7f52600d4050 msgr2=0x7f52600cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.297+0000 7f5268288640 1 -- 172.21.15.96:0/2081781723 shutdown_connections 2024-06-02T23:58:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.297+0000 7f5268288640 1 -- 172.21.15.96:0/2081781723 wait complete. 2024-06-02T23:58:23.307 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2024-06-02T23:58:23.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:23.308 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2024-06-02T23:58:23.328 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:23.328 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:23.328 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:23.328 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:23.328 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:23.328 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:23.328 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:23.328 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:23.329 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:23.329 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:23.329 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:23.329 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-06-02-23_48_00_UTC', 'scheduled-2024-06-02-23_49_00_UTC', 'scheduled-2024-06-02-23_50_00_UTC', 'scheduled-2024-06-02-23_51_00_UTC', 'scheduled-2024-06-02-23_52_00_UTC', 'scheduled-2024-06-02-23_53_00_UTC', 'scheduled-2024-06-02-23_54_00_UTC', 'scheduled-2024-06-02-23_55_00_UTC', 'scheduled-2024-06-02-23_56_00_UTC', 'scheduled-2024-06-02-23_57_00_UTC', 'scheduled-2024-06-02-23_58_00_UTC'] 2024-06-02T23:58:23.329 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir0 2024-06-02T23:58:23.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.469+0000 7fce562f5640 1 Processor -- start 2024-06-02T23:58:23.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.469+0000 7fce562f5640 1 -- start start 2024-06-02T23:58:23.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce562f5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fce5015e530 0x7fce500cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce562f5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce500cb2a0 0x7fce5006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce562f5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce500723e0 con 0x7fce5006eb50 2024-06-02T23:58:23.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce562f5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fce5006ef80 con 0x7fce5015e530 2024-06-02T23:58:23.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce562f5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fce500cb7b0 con 0x7fce500cb2a0 2024-06-02T23:58:23.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce4ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fce5015e530 0x7fce500cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce4ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fce5015e530 0x7fce500cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60828/0 (socket says 172.21.15.96:60828) 2024-06-02T23:58:23.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce4ffff640 1 -- 172.21.15.96:0/2818999999 learned_addr learned my addr 172.21.15.96:0/2818999999 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:23.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce4f7fe640 1 --2- 172.21.15.96:0/2818999999 >> v2:172.21.15.162:3300/0 conn(0x7fce500cb2a0 0x7fce5006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce4ffff640 1 -- 172.21.15.96:0/2818999999 >> v2:172.21.15.162:3300/0 conn(0x7fce500cb2a0 msgr2=0x7fce5006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:23.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce4ffff640 1 --2- 172.21.15.96:0/2818999999 >> v2:172.21.15.162:3300/0 conn(0x7fce500cb2a0 0x7fce5006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.470+0000 7fce4ffff640 1 -- 172.21.15.96:0/2818999999 >> v1:172.21.15.162:6789/0 conn(0x7fce5006eb50 legacy=0x7fce5015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.471+0000 7fce4ffff640 1 -- 172.21.15.96:0/2818999999 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce50072680 con 0x7fce5015e530 2024-06-02T23:58:23.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.471+0000 7fce4ffff640 1 --2- 172.21.15.96:0/2818999999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5015e530 0x7fce500cad60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fce500af6e0 tx=0x7fce4002c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51a9abb56e22831 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.471+0000 7fce4effd640 1 -- 172.21.15.96:0/2818999999 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40032710 con 0x7fce5015e530 2024-06-02T23:58:23.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.471+0000 7fce4effd640 1 -- 172.21.15.96:0/2818999999 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce400328b0 con 0x7fce5015e530 2024-06-02T23:58:23.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.471+0000 7fce4effd640 1 -- 172.21.15.96:0/2818999999 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40032ca0 con 0x7fce5015e530 2024-06-02T23:58:23.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.472+0000 7fce562f5640 1 -- 172.21.15.96:0/2818999999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5015e530 msgr2=0x7fce500cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.472+0000 7fce562f5640 1 --2- 172.21.15.96:0/2818999999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5015e530 0x7fce500cad60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fce500af6e0 tx=0x7fce4002c810 comp rx=0 tx=0).stop 2024-06-02T23:58:23.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.472+0000 7fce562f5640 1 -- 172.21.15.96:0/2818999999 shutdown_connections 2024-06-02T23:58:23.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.472+0000 7fce562f5640 1 --2- 172.21.15.96:0/2818999999 >> v2:172.21.15.162:3300/0 conn(0x7fce500cb2a0 0x7fce5006e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.472+0000 7fce562f5640 1 --2- 172.21.15.96:0/2818999999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5015e530 0x7fce500cad60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.472+0000 7fce562f5640 1 -- 172.21.15.96:0/2818999999 >> 172.21.15.96:0/2818999999 conn(0x7fce500cfcb0 msgr2=0x7fce500d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:23.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.472+0000 7fce562f5640 1 -- 172.21.15.96:0/2818999999 shutdown_connections 2024-06-02T23:58:23.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.472+0000 7fce562f5640 1 -- 172.21.15.96:0/2818999999 wait complete. 2024-06-02T23:58:23.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.473+0000 7fce562f5640 1 Processor -- start 2024-06-02T23:58:23.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.473+0000 7fce562f5640 1 -- start start 2024-06-02T23:58:23.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce562f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce5006eb50 0x7fce50147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce562f5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce500cb2a0 0x7fce500b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce562f5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce5015e530 0x7fce500c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce562f5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fce500ce890 con 0x7fce500cb2a0 2024-06-02T23:58:23.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce562f5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce50072c40 con 0x7fce5006eb50 2024-06-02T23:58:23.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce562f5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fce5015e910 con 0x7fce5015e530 2024-06-02T23:58:23.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce4f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce500cb2a0 0x7fce500b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce4f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce500cb2a0 0x7fce500b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60842/0 (socket says 172.21.15.96:60842) 2024-06-02T23:58:23.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce4f7fe640 1 -- 172.21.15.96:0/2911821466 learned_addr learned my addr 172.21.15.96:0/2911821466 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:23.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce4ffff640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce5006eb50 0x7fce50147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce54892640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce5015e530 0x7fce500c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce4f7fe640 1 -- 172.21.15.96:0/2911821466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce5015e530 msgr2=0x7fce500c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce4f7fe640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce5015e530 0x7fce500c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce4f7fe640 1 -- 172.21.15.96:0/2911821466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce5006eb50 msgr2=0x7fce50147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce4f7fe640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce5006eb50 0x7fce50147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce4f7fe640 1 -- 172.21.15.96:0/2911821466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce500b5420 con 0x7fce500cb2a0 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.474+0000 7fce4ffff640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce5006eb50 0x7fce50147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.475+0000 7fce4f7fe640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce500cb2a0 0x7fce500b28d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fce4400d800 tx=0x7fce4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.475+0000 7fce4cff9640 1 -- 172.21.15.96:0/2911821466 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4400b6c0 con 0x7fce500cb2a0 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.475+0000 7fce4cff9640 1 -- 172.21.15.96:0/2911821466 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44019070 con 0x7fce500cb2a0 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.475+0000 7fce562f5640 1 -- 172.21.15.96:0/2911821466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce500b5700 con 0x7fce500cb2a0 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.475+0000 7fce4cff9640 1 -- 172.21.15.96:0/2911821466 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4400ba80 con 0x7fce500cb2a0 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.475+0000 7fce562f5640 1 -- 172.21.15.96:0/2911821466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce50147790 con 0x7fce500cb2a0 2024-06-02T23:58:23.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.476+0000 7fce562f5640 1 -- 172.21.15.96:0/2911821466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce500683e0 con 0x7fce500cb2a0 2024-06-02T23:58:23.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.476+0000 7fce4cff9640 1 -- 172.21.15.96:0/2911821466 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7fce4400bc20 con 0x7fce500cb2a0 2024-06-02T23:58:23.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.477+0000 7fce4cff9640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fce3c06c030 0x7fce3c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.477+0000 7fce4cff9640 1 -- 172.21.15.96:0/2911821466 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7fce4408b8d0 con 0x7fce500cb2a0 2024-06-02T23:58:23.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.477+0000 7fce4ffff640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fce3c06c030 0x7fce3c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.477+0000 7fce4ffff640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fce3c06c030 0x7fce3c06e4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce40037000 tx=0x7fce40036040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.481 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.481+0000 7fce4cff9640 1 -- 172.21.15.96:0/2911821466 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fce4401c360 con 0x7fce500cb2a0 2024-06-02T23:58:23.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.674+0000 7fce562f5640 1 -- 172.21.15.96:0/2911821466 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce5006cd40 con 0x7fce3c06c030 2024-06-02T23:58:23.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.681+0000 7fce4cff9640 1 -- 172.21.15.96:0/2911821466 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7fce5006cd40 con 0x7fce3c06c030 2024-06-02T23:58:23.681 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:23.681 INFO:teuthology.orchestra.run.smithi096.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:38", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 -- 172.21.15.96:0/2911821466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fce3c06c030 msgr2=0x7fce3c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fce3c06c030 0x7fce3c06e4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce40037000 tx=0x7fce40036040 comp rx=0 tx=0).stop 2024-06-02T23:58:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 -- 172.21.15.96:0/2911821466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce500cb2a0 msgr2=0x7fce500b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce500cb2a0 0x7fce500b28d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fce4400d800 tx=0x7fce4400dcc0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 -- 172.21.15.96:0/2911821466 shutdown_connections 2024-06-02T23:58:23.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fce3c06c030 0x7fce3c06e4f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce5015e530 0x7fce500c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce500cb2a0 0x7fce500b28d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 --2- 172.21.15.96:0/2911821466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce5006eb50 0x7fce50147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 -- 172.21.15.96:0/2911821466 >> 172.21.15.96:0/2911821466 conn(0x7fce500cfcb0 msgr2=0x7fce500cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 -- 172.21.15.96:0/2911821466 shutdown_connections 2024-06-02T23:58:23.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.683+0000 7fce562f5640 1 -- 172.21.15.96:0/2911821466 wait complete. 2024-06-02T23:58:23.694 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:38", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:23.694 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1m', 'retention': {}, 'start': '2024-06-02T00:00:00', 'created': '2024-06-02T23:47:38', 'first': '2024-06-02T23:48:00', 'last': '2024-06-02T23:58:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-06-02T23:58:23.694 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-06-02T23:58:23.694 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-06-02T23:58:23.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:23.694 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2024-06-02T23:58:23.714 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:23.714 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:23.715 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:23.715 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:23.715 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:23.715 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:23.715 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:23.715 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:23.715 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:23.715 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:23.715 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:23.716 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-06-02-23_48_00_UTC', 'scheduled-2024-06-02-23_49_00_UTC', 'scheduled-2024-06-02-23_50_00_UTC', 'scheduled-2024-06-02-23_51_00_UTC', 'scheduled-2024-06-02-23_52_00_UTC', 'scheduled-2024-06-02-23_53_00_UTC', 'scheduled-2024-06-02-23_54_00_UTC', 'scheduled-2024-06-02-23_55_00_UTC', 'scheduled-2024-06-02-23_56_00_UTC', 'scheduled-2024-06-02-23_57_00_UTC', 'scheduled-2024-06-02-23_58_00_UTC'] 2024-06-02T23:58:23.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir1 2024-06-02T23:58:23.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.856+0000 7fe1d99dc640 1 Processor -- start 2024-06-02T23:58:23.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.856+0000 7fe1d99dc640 1 -- start start 2024-06-02T23:58:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d99dc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe1d415e530 0x7fe1d40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d99dc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d40cb2a0 0x7fe1d406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d99dc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe1d406eb50 0x7fe1d415ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d99dc640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d406efa0 con 0x7fe1d415e530 2024-06-02T23:58:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d99dc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d40723e0 con 0x7fe1d406eb50 2024-06-02T23:58:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d99dc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d40cb7b0 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d2ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe1d415e530 0x7fe1d40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d2ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe1d415e530 0x7fe1d40cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60852/0 (socket says 172.21.15.96:60852) 2024-06-02T23:58:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d2ffd640 1 -- 172.21.15.96:0/2852539273 learned_addr learned my addr 172.21.15.96:0/2852539273 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d2ffd640 1 -- 172.21.15.96:0/2852539273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d40cb2a0 msgr2=0x7fe1d406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d27fc640 1 --2- 172.21.15.96:0/2852539273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d40cb2a0 0x7fe1d406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d37fe640 1 --2- 172.21.15.96:0/2852539273 >> v2:172.21.15.162:3300/0 conn(0x7fe1d406eb50 0x7fe1d415ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d2ffd640 1 --2- 172.21.15.96:0/2852539273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d40cb2a0 0x7fe1d406e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d2ffd640 1 -- 172.21.15.96:0/2852539273 >> v2:172.21.15.162:3300/0 conn(0x7fe1d406eb50 msgr2=0x7fe1d415ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.857+0000 7fe1d2ffd640 1 --2- 172.21.15.96:0/2852539273 >> v2:172.21.15.162:3300/0 conn(0x7fe1d406eb50 0x7fe1d415ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.858+0000 7fe1d2ffd640 1 -- 172.21.15.96:0/2852539273 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d4072680 con 0x7fe1d415e530 2024-06-02T23:58:23.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.858+0000 7fe1d2ffd640 1 --2- 172.21.15.96:0/2852539273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d415e530 0x7fe1d40cad60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40cd7d0 tx=0x7fe1c402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94698d94e9f84e4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.858+0000 7fe1d1ffb640 1 -- 172.21.15.96:0/2852539273 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4037070 con 0x7fe1d415e530 2024-06-02T23:58:23.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.858+0000 7fe1d1ffb640 1 -- 172.21.15.96:0/2852539273 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c402ae00 con 0x7fe1d415e530 2024-06-02T23:58:23.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.858+0000 7fe1d1ffb640 1 -- 172.21.15.96:0/2852539273 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4032660 con 0x7fe1d415e530 2024-06-02T23:58:23.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.859+0000 7fe1d99dc640 1 -- 172.21.15.96:0/2852539273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d415e530 msgr2=0x7fe1d40cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.859+0000 7fe1d99dc640 1 --2- 172.21.15.96:0/2852539273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d415e530 0x7fe1d40cad60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40cd7d0 tx=0x7fe1c402a0b0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.859+0000 7fe1d99dc640 1 -- 172.21.15.96:0/2852539273 shutdown_connections 2024-06-02T23:58:23.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.859+0000 7fe1d99dc640 1 --2- 172.21.15.96:0/2852539273 >> v2:172.21.15.162:3300/0 conn(0x7fe1d406eb50 0x7fe1d415ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.859+0000 7fe1d99dc640 1 --2- 172.21.15.96:0/2852539273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d40cb2a0 0x7fe1d406e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.859+0000 7fe1d99dc640 1 --2- 172.21.15.96:0/2852539273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d415e530 0x7fe1d40cad60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.859+0000 7fe1d99dc640 1 -- 172.21.15.96:0/2852539273 >> 172.21.15.96:0/2852539273 conn(0x7fe1d40cfcb0 msgr2=0x7fe1d40d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.859+0000 7fe1d99dc640 1 -- 172.21.15.96:0/2852539273 shutdown_connections 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.859+0000 7fe1d99dc640 1 -- 172.21.15.96:0/2852539273 wait complete. 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.860+0000 7fe1d99dc640 1 Processor -- start 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.860+0000 7fe1d99dc640 1 -- start start 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d99dc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d406eb50 0x7fe1d41f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d99dc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d40cb2a0 0x7fe1d40cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d99dc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d415e530 0x7fe1d41e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d99dc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d415e910 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d99dc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4072c40 con 0x7fe1d406eb50 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d99dc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d4073160 con 0x7fe1d415e530 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d27fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d40cb2a0 0x7fe1d40cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d27fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d40cb2a0 0x7fe1d40cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60858/0 (socket says 172.21.15.96:60858) 2024-06-02T23:58:23.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d27fc640 1 -- 172.21.15.96:0/391561178 learned_addr learned my addr 172.21.15.96:0/391561178 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d2ffd640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d406eb50 0x7fe1d41f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d37fe640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d415e530 0x7fe1d41e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d27fc640 1 -- 172.21.15.96:0/391561178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d415e530 msgr2=0x7fe1d41e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d27fc640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d415e530 0x7fe1d41e7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d27fc640 1 -- 172.21.15.96:0/391561178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d406eb50 msgr2=0x7fe1d41f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d27fc640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d406eb50 0x7fe1d41f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d27fc640 1 -- 172.21.15.96:0/391561178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d40cf250 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.861+0000 7fe1d2ffd640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d406eb50 0x7fe1d41f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.862+0000 7fe1d27fc640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d40cb2a0 0x7fe1d40cd860 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c7f0 tx=0x7fe1c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.862+0000 7fe1bbfff640 1 -- 172.21.15.96:0/391561178 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8015070 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.862+0000 7fe1bbfff640 1 -- 172.21.15.96:0/391561178 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c8004220 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.862+0000 7fe1d99dc640 1 -- 172.21.15.96:0/391561178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d41f78b0 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.862+0000 7fe1bbfff640 1 -- 172.21.15.96:0/391561178 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8007620 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.862+0000 7fe1d99dc640 1 -- 172.21.15.96:0/391561178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d40ce790 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.863+0000 7fe1d99dc640 1 -- 172.21.15.96:0/391561178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d40683e0 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.863+0000 7fe1bbfff640 1 -- 172.21.15.96:0/391561178 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7fe1c80077c0 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.864+0000 7fe1bbfff640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe1c006c030 0x7fe1c006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.864+0000 7fe1d2ffd640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe1c006c030 0x7fe1c006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.864+0000 7fe1bbfff640 1 -- 172.21.15.96:0/391561178 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7fe1c808b7c0 con 0x7fe1d40cb2a0 2024-06-02T23:58:23.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.864+0000 7fe1d2ffd640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe1c006c030 0x7fe1c006e4f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4034000 tx=0x7fe1c402e000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:23.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:23.868+0000 7fe1bbfff640 1 -- 172.21.15.96:0/391561178 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe1d40cf250 con 0x7fe1d40cb2a0 2024-06-02T23:58:24.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.064+0000 7fe1d99dc640 1 -- 172.21.15.96:0/391561178 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1d406cd40 con 0x7fe1c006c030 2024-06-02T23:58:24.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.071+0000 7fe1bbfff640 1 -- 172.21.15.96:0/391561178 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7fe1d406cd40 con 0x7fe1c006c030 2024-06-02T23:58:24.071 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:24.071 INFO:teuthology.orchestra.run.smithi096.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:39", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:24.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 -- 172.21.15.96:0/391561178 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe1c006c030 msgr2=0x7fe1c006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe1c006c030 0x7fe1c006e4f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4034000 tx=0x7fe1c402e000 comp rx=0 tx=0).stop 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 -- 172.21.15.96:0/391561178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d40cb2a0 msgr2=0x7fe1d40cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d40cb2a0 0x7fe1d40cd860 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c7f0 tx=0x7fe1c800ccb0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 -- 172.21.15.96:0/391561178 shutdown_connections 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fe1c006c030 0x7fe1c006e4f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d415e530 0x7fe1d41e7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1d40cb2a0 0x7fe1d40cd860 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 --2- 172.21.15.96:0/391561178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d406eb50 0x7fe1d41f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 -- 172.21.15.96:0/391561178 >> 172.21.15.96:0/391561178 conn(0x7fe1d40cfcb0 msgr2=0x7fe1d40af700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 -- 172.21.15.96:0/391561178 shutdown_connections 2024-06-02T23:58:24.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.073+0000 7fe1d99dc640 1 -- 172.21.15.96:0/391561178 wait complete. 2024-06-02T23:58:24.085 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:39", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:24.085 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1m', 'retention': {}, 'start': '2024-06-02T00:00:00', 'created': '2024-06-02T23:47:39', 'first': '2024-06-02T23:48:00', 'last': '2024-06-02T23:58:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-06-02T23:58:24.085 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-06-02T23:58:24.085 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-06-02T23:58:24.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:24.085 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:24.105 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:24.106 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-06-02-23_48_00_UTC', 'scheduled-2024-06-02-23_49_00_UTC', 'scheduled-2024-06-02-23_50_00_UTC', 'scheduled-2024-06-02-23_51_00_UTC', 'scheduled-2024-06-02-23_52_00_UTC', 'scheduled-2024-06-02-23_53_00_UTC', 'scheduled-2024-06-02-23_54_00_UTC', 'scheduled-2024-06-02-23_55_00_UTC', 'scheduled-2024-06-02-23_56_00_UTC', 'scheduled-2024-06-02-23_57_00_UTC', 'scheduled-2024-06-02-23_58_00_UTC'] 2024-06-02T23:58:24.106 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir2 2024-06-02T23:58:24.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.247+0000 7f012368c640 1 Processor -- start 2024-06-02T23:58:24.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.247+0000 7f012368c640 1 -- start start 2024-06-02T23:58:24.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f012368c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f011c06eaa0 0x7f011c0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f012368c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011c0723e0 con 0x7f011c06e610 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f012368c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011c0cb7b0 con 0x7f011c15e530 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f012368c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f011c072680 con 0x7f011c06eaa0 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0120c27640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f011c06e610 0x7f011c0cd880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45386/0 (socket says 172.21.15.96:45386) 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0120c27640 1 -- 172.21.15.96:0/3964322213 learned_addr learned my addr 172.21.15.96:0/3964322213 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0121c29640 1 --2- 172.21.15.96:0/3964322213 >> v2:172.21.15.162:3300/0 conn(0x7f011c06eaa0 0x7f011c0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1416695929 0 0) 0x7f011c0723e0 con 0x7f011c06e610 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0108003520 con 0x7f011c06e610 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 424613115 0 0) 0x7f0108003520 con 0x7f011c06e610 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 >> v2:172.21.15.162:3300/0 conn(0x7f011c06eaa0 msgr2=0x7f011c0cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0113fff640 1 --2- 172.21.15.96:0/3964322213 >> v2:172.21.15.162:3300/0 conn(0x7f011c06eaa0 0x7f011c0cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 >> v1:172.21.15.162:6789/0 conn(0x7f011c15e530 legacy=0x7f011c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c072960 con 0x7f011c06e610 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f010c001670 con 0x7f011c06e610 2024-06-02T23:58:24.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 >> v1:172.21.15.96:6789/0 conn(0x7f011c06e610 legacy=0x7f011c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.248+0000 7f0113fff640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080039b0 0x7f0108003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0113fff640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0108004800 0x7f0108004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0113fff640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01080052e0 0x7f010800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f011c072680 con 0x7f01080052e0 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f010800c1b0 con 0x7f0108004800 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f010800c3b0 con 0x7f01080039b0 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0121c29640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01080052e0 0x7f010800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0120c27640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0108004800 0x7f0108004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0121428640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080039b0 0x7f0108003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0121c29640 1 -- 172.21.15.96:0/3964322213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080039b0 msgr2=0x7f0108003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0121c29640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080039b0 0x7f0108003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0121c29640 1 -- 172.21.15.96:0/3964322213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0108004800 msgr2=0x7f0108004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0121c29640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0108004800 0x7f0108004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0121c29640 1 -- 172.21.15.96:0/3964322213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0108003520 con 0x7f01080052e0 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0121428640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080039b0 0x7f0108003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0120c27640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0108004800 0x7f0108004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.249+0000 7f0121c29640 1 -- 172.21.15.96:0/3964322213 reap_dead start 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f0121c29640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01080052e0 0x7f010800b9c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0114009f90 tx=0x7f0108005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0777dd7881ba20 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114035020 con 0x7f01080052e0 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0114003b90 con 0x7f01080052e0 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f0113fff640 1 -- 172.21.15.96:0/3964322213 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114009c10 con 0x7f01080052e0 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f012368c640 1 -- 172.21.15.96:0/3964322213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01080052e0 msgr2=0x7f010800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f012368c640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01080052e0 0x7f010800b9c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0114009f90 tx=0x7f0108005830 comp rx=0 tx=0).stop 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f012368c640 1 -- 172.21.15.96:0/3964322213 shutdown_connections 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f012368c640 1 --2- 172.21.15.96:0/3964322213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01080052e0 0x7f010800b9c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f012368c640 1 -- 172.21.15.96:0/3964322213 >> 172.21.15.96:0/3964322213 conn(0x7f011c0cfcb0 msgr2=0x7f011c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f012368c640 1 -- 172.21.15.96:0/3964322213 shutdown_connections 2024-06-02T23:58:24.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.250+0000 7f012368c640 1 -- 172.21.15.96:0/3964322213 wait complete. 2024-06-02T23:58:24.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f012368c640 1 Processor -- start 2024-06-02T23:58:24.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f012368c640 1 -- start start 2024-06-02T23:58:24.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f012368c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080052e0 0x7f011c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f012368c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f011c15d320 0x7f011c153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f012368c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f011c0c53d0 0x7f011c0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f012368c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f011c073160 con 0x7f011c15d320 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f012368c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f011c15e910 con 0x7f011c0c53d0 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f012368c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f011c06eeb0 con 0x7f01080052e0 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f0120c27640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f011c15d320 0x7f011c153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f0120c27640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f011c15d320 0x7f011c153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60878/0 (socket says 172.21.15.96:60878) 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.252+0000 7f0120c27640 1 -- 172.21.15.96:0/71737481 learned_addr learned my addr 172.21.15.96:0/71737481 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0121428640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080052e0 0x7f011c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0121c29640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f011c0c53d0 0x7f011c0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0120c27640 1 -- 172.21.15.96:0/71737481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080052e0 msgr2=0x7f011c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0120c27640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080052e0 0x7f011c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0120c27640 1 -- 172.21.15.96:0/71737481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f011c0c53d0 msgr2=0x7f011c0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0120c27640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f011c0c53d0 0x7f011c0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0120c27640 1 -- 172.21.15.96:0/71737481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c0cdcd0 con 0x7f011c15d320 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0121428640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080052e0 0x7f011c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0121c29640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f011c0c53d0 0x7f011c0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0120c27640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f011c15d320 0x7f011c153660 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f010c00e5e0 tx=0x7f010c00eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0111ffb640 1 -- 172.21.15.96:0/71737481 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c00c5f0 con 0x7f011c15d320 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0111ffb640 1 -- 172.21.15.96:0/71737481 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010c018070 con 0x7f011c15d320 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f0111ffb640 1 -- 172.21.15.96:0/71737481 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c00c990 con 0x7f011c15d320 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f012368c640 1 -- 172.21.15.96:0/71737481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011c0cdfb0 con 0x7f011c15d320 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.253+0000 7f012368c640 1 -- 172.21.15.96:0/71737481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f011c0ce570 con 0x7f011c15d320 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.254+0000 7f012368c640 1 -- 172.21.15.96:0/71737481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f011c0683e0 con 0x7f011c15d320 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.255+0000 7f0111ffb640 1 -- 172.21.15.96:0/71737481 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f010c00cb30 con 0x7f011c15d320 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.255+0000 7f0111ffb640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f010006c030 0x7f010006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.255+0000 7f0111ffb640 1 -- 172.21.15.96:0/71737481 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f010c08b180 con 0x7f011c15d320 2024-06-02T23:58:24.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.255+0000 7f0121428640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f010006c030 0x7f010006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.255+0000 7f0121428640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f010006c030 0x7f010006e4f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0118000c00 tx=0x7f0118009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:24.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.259+0000 7f0111ffb640 1 -- 172.21.15.96:0/71737481 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f010c00ce20 con 0x7f011c15d320 2024-06-02T23:58:24.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.453+0000 7f012368c640 1 -- 172.21.15.96:0/71737481 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f011c153ba0 con 0x7f010006c030 2024-06-02T23:58:24.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.460+0000 7f0111ffb640 1 -- 172.21.15.96:0/71737481 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f011800f520 con 0x7f010006c030 2024-06-02T23:58:24.461 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:24.461 INFO:teuthology.orchestra.run.smithi096.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:39", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:24.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.462+0000 7f012368c640 1 -- 172.21.15.96:0/71737481 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f010006c030 msgr2=0x7f010006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.462+0000 7f012368c640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f010006c030 0x7f010006e4f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0118000c00 tx=0x7f0118009040 comp rx=0 tx=0).stop 2024-06-02T23:58:24.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.462+0000 7f012368c640 1 -- 172.21.15.96:0/71737481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f011c15d320 msgr2=0x7f011c153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.462+0000 7f012368c640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f011c15d320 0x7f011c153660 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f010c00e5e0 tx=0x7f010c00eaa0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.462+0000 7f012368c640 1 -- 172.21.15.96:0/71737481 shutdown_connections 2024-06-02T23:58:24.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.462+0000 7f012368c640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f010006c030 0x7f010006e4f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.462+0000 7f012368c640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f011c0c53d0 0x7f011c0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.462+0000 7f012368c640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f011c15d320 0x7f011c153660 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.462+0000 7f012368c640 1 --2- 172.21.15.96:0/71737481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01080052e0 0x7f011c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.462+0000 7f012368c640 1 -- 172.21.15.96:0/71737481 >> 172.21.15.96:0/71737481 conn(0x7f011c0cfcb0 msgr2=0x7f011c0c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:24.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.463+0000 7f012368c640 1 -- 172.21.15.96:0/71737481 shutdown_connections 2024-06-02T23:58:24.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.463+0000 7f012368c640 1 -- 172.21.15.96:0/71737481 wait complete. 2024-06-02T23:58:24.473 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:39", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:24.473 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1m', 'retention': {}, 'start': '2024-06-02T00:00:00', 'created': '2024-06-02T23:47:39', 'first': '2024-06-02T23:48:00', 'last': '2024-06-02T23:58:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-06-02T23:58:24.473 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-06-02T23:58:24.473 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-06-02T23:58:24.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:24.474 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:24.493 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:24.494 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-06-02-23_48_00_UTC', 'scheduled-2024-06-02-23_49_00_UTC', 'scheduled-2024-06-02-23_50_00_UTC', 'scheduled-2024-06-02-23_51_00_UTC', 'scheduled-2024-06-02-23_52_00_UTC', 'scheduled-2024-06-02-23_53_00_UTC', 'scheduled-2024-06-02-23_54_00_UTC', 'scheduled-2024-06-02-23_55_00_UTC', 'scheduled-2024-06-02-23_56_00_UTC', 'scheduled-2024-06-02-23_57_00_UTC', 'scheduled-2024-06-02-23_58_00_UTC'] 2024-06-02T23:58:24.494 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir3 2024-06-02T23:58:24.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.634+0000 7f0bfd7ab640 1 Processor -- start 2024-06-02T23:58:24.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.634+0000 7f0bfd7ab640 1 -- start start 2024-06-02T23:58:24.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.635+0000 7f0bfd7ab640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0bf80b4640 0x7f0bf80b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.635+0000 7f0bfd7ab640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf80b73e0 con 0x7f0bf80b4b50 2024-06-02T23:58:24.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.635+0000 7f0bfd7ab640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf80cec60 con 0x7f0bf80d2d40 2024-06-02T23:58:24.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.635+0000 7f0bfd7ab640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf80d4ff0 con 0x7f0bf80b4640 2024-06-02T23:58:24.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.635+0000 7f0bf67fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f0bf80b4b50 0x7f0bf80d2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45392/0 (socket says 172.21.15.96:45392) 2024-06-02T23:58:24.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.635+0000 7f0bf67fc640 1 -- 172.21.15.96:0/580667598 learned_addr learned my addr 172.21.15.96:0/580667598 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:24.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995376069 0 0) 0x7f0bf80b73e0 con 0x7f0bf80b4b50 2024-06-02T23:58:24.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0be0003520 con 0x7f0bf80b4b50 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf6ffd640 1 --2- 172.21.15.96:0/580667598 >> v2:172.21.15.162:3300/0 conn(0x7f0bf80b4640 0x7f0bf80b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2890793339 0 0) 0x7f0be0003520 con 0x7f0bf80b4b50 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 >> v2:172.21.15.162:3300/0 conn(0x7f0bf80b4640 msgr2=0x7f0bf80b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 --2- 172.21.15.96:0/580667598 >> v2:172.21.15.162:3300/0 conn(0x7f0bf80b4640 0x7f0bf80b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 >> v1:172.21.15.162:6789/0 conn(0x7f0bf80d2d40 legacy=0x7f0bf80cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf80d1fd0 con 0x7f0bf80b4b50 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f0bec001670 con 0x7f0bf80b4b50 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 >> v1:172.21.15.96:6789/0 conn(0x7f0bf80b4b50 legacy=0x7f0bf80d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0be00039b0 0x7f0be0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0be0004800 0x7f0be0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0be00051c0 0x7f0be000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0be000c130 con 0x7f0be00051c0 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0be000c2e0 con 0x7f0be0004800 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0be000c4e0 con 0x7f0be00039b0 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf77fe640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0be00051c0 0x7f0be000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf67fc640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0be0004800 0x7f0be0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf6ffd640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0be00039b0 0x7f0be0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf77fe640 1 -- 172.21.15.96:0/580667598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0be00039b0 msgr2=0x7f0be0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf77fe640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0be00039b0 0x7f0be0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf77fe640 1 -- 172.21.15.96:0/580667598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0be0004800 msgr2=0x7f0be0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf77fe640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0be0004800 0x7f0be0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf77fe640 1 -- 172.21.15.96:0/580667598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be0003520 con 0x7f0be00051c0 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.636+0000 7f0bf6ffd640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0be00039b0 0x7f0be0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.637+0000 7f0bf77fe640 1 -- 172.21.15.96:0/580667598 reap_dead start 2024-06-02T23:58:24.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.637+0000 7f0bf77fe640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0be00051c0 0x7f0be000b9c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0bf808d510 tx=0x7f0be0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efa6805d79de7a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:24.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.637+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0001370 con 0x7f0be00051c0 2024-06-02T23:58:24.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.637+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf00052d0 con 0x7f0be00051c0 2024-06-02T23:58:24.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.637+0000 7f0bf5ffb640 1 -- 172.21.15.96:0/580667598 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf002ab70 con 0x7f0be00051c0 2024-06-02T23:58:24.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.638+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/580667598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0be00051c0 msgr2=0x7f0be000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.638+0000 7f0bfd7ab640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0be00051c0 0x7f0be000b9c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0bf808d510 tx=0x7f0be0005830 comp rx=0 tx=0).stop 2024-06-02T23:58:24.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.638+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/580667598 shutdown_connections 2024-06-02T23:58:24.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.638+0000 7f0bfd7ab640 1 --2- 172.21.15.96:0/580667598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0be00051c0 0x7f0be000b9c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.638+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/580667598 >> 172.21.15.96:0/580667598 conn(0x7f0bf80d4050 msgr2=0x7f0bf80d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:24.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.638+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/580667598 shutdown_connections 2024-06-02T23:58:24.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.638+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/580667598 wait complete. 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.639+0000 7f0bfd7ab640 1 Processor -- start 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.639+0000 7f0bfd7ab640 1 -- start start 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bfd7ab640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0be00051c0 0x7f0bf814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bfd7ab640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bf815af50 0x7f0bf8158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bfd7ab640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bf815a2b0 0x7f0bf815a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bfd7ab640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf80d13b0 con 0x7f0bf815a2b0 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bfd7ab640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf80cef00 con 0x7f0be00051c0 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bfd7ab640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf80b6ea0 con 0x7f0bf815af50 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bf815a2b0 0x7f0bf815a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bf815a2b0 0x7f0bf815a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60904/0 (socket says 172.21.15.96:60904) 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf77fe640 1 -- 172.21.15.96:0/2021585497 learned_addr learned my addr 172.21.15.96:0/2021585497 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:24.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf6ffd640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0be00051c0 0x7f0bf814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf67fc640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bf815af50 0x7f0bf8158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf77fe640 1 -- 172.21.15.96:0/2021585497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bf815af50 msgr2=0x7f0bf8158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf77fe640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bf815af50 0x7f0bf8158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf77fe640 1 -- 172.21.15.96:0/2021585497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0be00051c0 msgr2=0x7f0bf814e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf77fe640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0be00051c0 0x7f0bf814e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf77fe640 1 -- 172.21.15.96:0/2021585497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf80b1700 con 0x7f0bf815a2b0 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf67fc640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bf815af50 0x7f0bf8158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bf77fe640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bf815a2b0 0x7f0bf815a730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0bf002a540 tx=0x7f0bf0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bdf7fe640 1 -- 172.21.15.96:0/2021585497 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0007a30 con 0x7f0bf815a2b0 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bdf7fe640 1 -- 172.21.15.96:0/2021585497 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf0005480 con 0x7f0bf815a2b0 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/2021585497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf80b19e0 con 0x7f0bf815a2b0 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bdf7fe640 1 -- 172.21.15.96:0/2021585497 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0004b40 con 0x7f0bf815a2b0 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.640+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/2021585497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf80b1fa0 con 0x7f0bf815a2b0 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.642+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/2021585497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf80683e0 con 0x7f0bf815a2b0 2024-06-02T23:58:24.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.642+0000 7f0bdf7fe640 1 -- 172.21.15.96:0/2021585497 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f0bf0004ce0 con 0x7f0bf815a2b0 2024-06-02T23:58:24.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.642+0000 7f0bdf7fe640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0be406c030 0x7f0be406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:24.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.643+0000 7f0bdf7fe640 1 -- 172.21.15.96:0/2021585497 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f0bf00aa820 con 0x7f0bf815a2b0 2024-06-02T23:58:24.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.643+0000 7f0bf6ffd640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0be406c030 0x7f0be406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:24.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.643+0000 7f0bf6ffd640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0be406c030 0x7f0be406e4f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80d06c0 tx=0x7f0be800b040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:24.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.647+0000 7f0bdf7fe640 1 -- 172.21.15.96:0/2021585497 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0bf0043060 con 0x7f0bf815a2b0 2024-06-02T23:58:24.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.837+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/2021585497 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0bf80ce150 con 0x7f0be406c030 2024-06-02T23:58:24.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.844+0000 7f0bdf7fe640 1 -- 172.21.15.96:0/2021585497 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f0bf80ce150 con 0x7f0be406c030 2024-06-02T23:58:24.844 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:24.844 INFO:teuthology.orchestra.run.smithi096.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:39", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:24.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/2021585497 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0be406c030 msgr2=0x7f0be406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0be406c030 0x7f0be406e4f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80d06c0 tx=0x7f0be800b040 comp rx=0 tx=0).stop 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/2021585497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bf815a2b0 msgr2=0x7f0bf815a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bf815a2b0 0x7f0bf815a730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0bf002a540 tx=0x7f0bf0001120 comp rx=0 tx=0).stop 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/2021585497 shutdown_connections 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f0be406c030 0x7f0be406e4f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bf815a2b0 0x7f0bf815a730 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0bf815af50 0x7f0bf8158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 --2- 172.21.15.96:0/2021585497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0be00051c0 0x7f0bf814e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/2021585497 >> 172.21.15.96:0/2021585497 conn(0x7f0bf80d4050 msgr2=0x7f0bf806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/2021585497 shutdown_connections 2024-06-02T23:58:24.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:24.846+0000 7f0bfd7ab640 1 -- 172.21.15.96:0/2021585497 wait complete. 2024-06-02T23:58:24.857 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:39", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:24.857 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1m', 'retention': {}, 'start': '2024-06-02T00:00:00', 'created': '2024-06-02T23:47:39', 'first': '2024-06-02T23:48:00', 'last': '2024-06-02T23:58:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-06-02T23:58:24.857 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-06-02T23:58:24.857 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-06-02T23:58:24.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:24.857 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2024-06-02T23:58:24.876 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:24.876 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:24.876 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:24.876 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:24.876 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:24.877 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:24.877 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:24.877 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:24.877 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:24.877 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:24.877 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:24.878 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-06-02-23_48_00_UTC', 'scheduled-2024-06-02-23_49_00_UTC', 'scheduled-2024-06-02-23_50_00_UTC', 'scheduled-2024-06-02-23_51_00_UTC', 'scheduled-2024-06-02-23_52_00_UTC', 'scheduled-2024-06-02-23_53_00_UTC', 'scheduled-2024-06-02-23_54_00_UTC', 'scheduled-2024-06-02-23_55_00_UTC', 'scheduled-2024-06-02-23_56_00_UTC', 'scheduled-2024-06-02-23_57_00_UTC', 'scheduled-2024-06-02-23_58_00_UTC'] 2024-06-02T23:58:24.878 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir4 2024-06-02T23:58:25.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.019+0000 7f4811c31640 1 Processor -- start 2024-06-02T23:58:25.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.019+0000 7f4811c31640 1 -- start start 2024-06-02T23:58:25.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.020+0000 7f4811c31640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f480c0cad10 0x7f480c072780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.020+0000 7f4811c31640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480c073200 con 0x7f480c15a8f0 2024-06-02T23:58:25.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.020+0000 7f4811c31640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480c071030 con 0x7f480c15a510 2024-06-02T23:58:25.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.020+0000 7f4811c31640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f480c0712b0 con 0x7f480c0cad10 2024-06-02T23:58:25.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.020+0000 7f480bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f480c0cad10 0x7f480c072780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.020+0000 7f480bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f480c0cad10 0x7f480c072780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60914/0 (socket says 172.21.15.96:60914) 2024-06-02T23:58:25.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.020+0000 7f480bfff640 1 -- 172.21.15.96:0/46300394 learned_addr learned my addr 172.21.15.96:0/46300394 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:25.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.020+0000 7f480affd640 1 --1- 172.21.15.96:0/46300394 >> v1:172.21.15.96:6789/0 conn(0x7f480c15a8f0 0x7f480c072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45400/0 (socket says 172.21.15.96:45400) 2024-06-02T23:58:25.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.021+0000 7f480bfff640 1 -- 172.21.15.96:0/46300394 >> v1:172.21.15.162:6789/0 conn(0x7f480c15a510 legacy=0x7f480c0cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.021+0000 7f480bfff640 1 -- 172.21.15.96:0/46300394 >> v1:172.21.15.96:6789/0 conn(0x7f480c15a8f0 legacy=0x7f480c072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.021+0000 7f480bfff640 1 -- 172.21.15.96:0/46300394 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480c071590 con 0x7f480c0cad10 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.021+0000 7f480bfff640 1 --2- 172.21.15.96:0/46300394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c0cad10 0x7f480c072780 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f480400d150 tx=0x7f480402c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8cb6fce2510d21 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.021+0000 7f480a7fc640 1 -- 172.21.15.96:0/46300394 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804035020 con 0x7f480c0cad10 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.021+0000 7f480a7fc640 1 -- 172.21.15.96:0/46300394 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480400b2d0 con 0x7f480c0cad10 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.021+0000 7f480a7fc640 1 -- 172.21.15.96:0/46300394 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480400b480 con 0x7f480c0cad10 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.022+0000 7f4811c31640 1 -- 172.21.15.96:0/46300394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c0cad10 msgr2=0x7f480c072780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.022+0000 7f4811c31640 1 --2- 172.21.15.96:0/46300394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c0cad10 0x7f480c072780 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f480400d150 tx=0x7f480402c9c0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.022+0000 7f4811c31640 1 -- 172.21.15.96:0/46300394 shutdown_connections 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.022+0000 7f4811c31640 1 --2- 172.21.15.96:0/46300394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c0cad10 0x7f480c072780 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.022+0000 7f4811c31640 1 -- 172.21.15.96:0/46300394 >> 172.21.15.96:0/46300394 conn(0x7f480c0cfcb0 msgr2=0x7f480c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.022+0000 7f4811c31640 1 -- 172.21.15.96:0/46300394 shutdown_connections 2024-06-02T23:58:25.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.022+0000 7f4811c31640 1 -- 172.21.15.96:0/46300394 wait complete. 2024-06-02T23:58:25.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.023+0000 7f4811c31640 1 Processor -- start 2024-06-02T23:58:25.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.023+0000 7f4811c31640 1 -- start start 2024-06-02T23:58:25.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f4811c31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f480c0cad10 0x7f480c153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f4811c31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f480c15a510 0x7f480c0ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f4811c31640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c15a8f0 0x7f480c0c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f4811c31640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f480c06cc70 con 0x7f480c15a8f0 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f4811c31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f480c071b50 con 0x7f480c15a510 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f4811c31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f480c06cdf0 con 0x7f480c0cad10 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f480bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c15a8f0 0x7f480c0c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f480bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c15a8f0 0x7f480c0c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60930/0 (socket says 172.21.15.96:60930) 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f480bfff640 1 -- 172.21.15.96:0/2874704913 learned_addr learned my addr 172.21.15.96:0/2874704913 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f480bfff640 1 -- 172.21.15.96:0/2874704913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f480c0cad10 msgr2=0x7f480c153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f480bfff640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f480c0cad10 0x7f480c153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f480bfff640 1 -- 172.21.15.96:0/2874704913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f480c15a510 msgr2=0x7f480c0ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f480bfff640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f480c15a510 0x7f480c0ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.024+0000 7f480bfff640 1 -- 172.21.15.96:0/2874704913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480c15be20 con 0x7f480c15a8f0 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.025+0000 7f480bfff640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c15a8f0 0x7f480c0c56a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f480402cfb0 tx=0x7f4804004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.025+0000 7f47f3fff640 1 -- 172.21.15.96:0/2874704913 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804035070 con 0x7f480c15a8f0 2024-06-02T23:58:25.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.025+0000 7f47f3fff640 1 -- 172.21.15.96:0/2874704913 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48040317c0 con 0x7f480c15a8f0 2024-06-02T23:58:25.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.025+0000 7f4811c31640 1 -- 172.21.15.96:0/2874704913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f480c15c100 con 0x7f480c15a8f0 2024-06-02T23:58:25.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.025+0000 7f47f3fff640 1 -- 172.21.15.96:0/2874704913 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480400b720 con 0x7f480c15a8f0 2024-06-02T23:58:25.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.025+0000 7f4811c31640 1 -- 172.21.15.96:0/2874704913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f480c0c4ea0 con 0x7f480c15a8f0 2024-06-02T23:58:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.026+0000 7f4811c31640 1 -- 172.21.15.96:0/2874704913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f480c0683e0 con 0x7f480c15a8f0 2024-06-02T23:58:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.026+0000 7f47f3fff640 1 -- 172.21.15.96:0/2874704913 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f4804038020 con 0x7f480c15a8f0 2024-06-02T23:58:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.027+0000 7f47f3fff640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f47f806c030 0x7f47f806e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.027+0000 7f47f3fff640 1 -- 172.21.15.96:0/2874704913 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f48040ac3e0 con 0x7f480c15a8f0 2024-06-02T23:58:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.027+0000 7f480b7fe640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f47f806c030 0x7f47f806e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.027+0000 7f480b7fe640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f47f806c030 0x7f47f806e4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f47fc000f60 tx=0x7f47fc0079d0 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.031+0000 7f47f3fff640 1 -- 172.21.15.96:0/2874704913 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f480407a860 con 0x7f480c15a8f0 2024-06-02T23:58:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.227+0000 7f4811c31640 1 -- 172.21.15.96:0/2874704913 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f480c15afa0 con 0x7f47f806c030 2024-06-02T23:58:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.235+0000 7f47f3fff640 1 -- 172.21.15.96:0/2874704913 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f480c15afa0 con 0x7f47f806c030 2024-06-02T23:58:25.235 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:25.235 INFO:teuthology.orchestra.run.smithi096.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:40", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.237+0000 7f4811c31640 1 -- 172.21.15.96:0/2874704913 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f47f806c030 msgr2=0x7f47f806e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.237+0000 7f4811c31640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f47f806c030 0x7f47f806e4f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f47fc000f60 tx=0x7f47fc0079d0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.237+0000 7f4811c31640 1 -- 172.21.15.96:0/2874704913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c15a8f0 msgr2=0x7f480c0c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.237+0000 7f4811c31640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c15a8f0 0x7f480c0c56a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f480402cfb0 tx=0x7f4804004a40 comp rx=0 tx=0).stop 2024-06-02T23:58:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.237+0000 7f4811c31640 1 -- 172.21.15.96:0/2874704913 shutdown_connections 2024-06-02T23:58:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.237+0000 7f4811c31640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f47f806c030 0x7f47f806e4f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.237+0000 7f4811c31640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c15a8f0 0x7f480c0c56a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.237+0000 7f4811c31640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f480c15a510 0x7f480c0ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.237+0000 7f4811c31640 1 --2- 172.21.15.96:0/2874704913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f480c0cad10 0x7f480c153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.237+0000 7f4811c31640 1 -- 172.21.15.96:0/2874704913 >> 172.21.15.96:0/2874704913 conn(0x7f480c0cfcb0 msgr2=0x7f480c0cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.238+0000 7f4811c31640 1 -- 172.21.15.96:0/2874704913 shutdown_connections 2024-06-02T23:58:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.238+0000 7f4811c31640 1 -- 172.21.15.96:0/2874704913 wait complete. 2024-06-02T23:58:25.248 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:40", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:25.248 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1m', 'retention': {}, 'start': '2024-06-02T00:00:00', 'created': '2024-06-02T23:47:40', 'first': '2024-06-02T23:48:00', 'last': '2024-06-02T23:58:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-06-02T23:58:25.248 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-06-02T23:58:25.248 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-06-02T23:58:25.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:25.249 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2024-06-02T23:58:25.268 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:25.268 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:25.268 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_01_UTC 2024-06-02T23:58:25.268 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:25.268 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:25.268 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:25.268 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:25.268 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:25.268 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:25.269 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:25.269 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:25.269 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-06-02-23_48_00_UTC', 'scheduled-2024-06-02-23_49_00_UTC', 'scheduled-2024-06-02-23_50_01_UTC', 'scheduled-2024-06-02-23_51_00_UTC', 'scheduled-2024-06-02-23_52_00_UTC', 'scheduled-2024-06-02-23_53_00_UTC', 'scheduled-2024-06-02-23_54_00_UTC', 'scheduled-2024-06-02-23_55_00_UTC', 'scheduled-2024-06-02-23_56_00_UTC', 'scheduled-2024-06-02-23_57_00_UTC', 'scheduled-2024-06-02-23_58_00_UTC'] 2024-06-02T23:58:25.269 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir5 2024-06-02T23:58:25.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.409+0000 7f9a0afb7640 1 Processor -- start 2024-06-02T23:58:25.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.410+0000 7f9a0afb7640 1 -- start start 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.410+0000 7f9a0afb7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9a0415e470 0x7f9a040d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.410+0000 7f9a0afb7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9a040ce790 0x7f9a040cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.410+0000 7f9a0afb7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a040b7020 0x7f9a040b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.410+0000 7f9a0afb7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f9a040cf140 con 0x7f9a040ce790 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.410+0000 7f9a0afb7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9a0415e850 con 0x7f9a0415e470 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.410+0000 7f9a0afb7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9a040d12a0 con 0x7f9a040b7020 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.410+0000 7f9a03fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9a040ce790 0x7f9a040cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.411+0000 7f9a03fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9a040ce790 0x7f9a040cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60946/0 (socket says 172.21.15.96:60946) 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.411+0000 7f9a03fff640 1 -- 172.21.15.96:0/28614497 learned_addr learned my addr 172.21.15.96:0/28614497 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.411+0000 7f9a08d53640 1 --2- 172.21.15.96:0/28614497 >> v2:172.21.15.162:3300/0 conn(0x7f9a0415e470 0x7f9a040d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.411+0000 7f9a03fff640 1 -- 172.21.15.96:0/28614497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a040b7020 msgr2=0x7f9a040b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.411+0000 7f9a03fff640 1 --2- 172.21.15.96:0/28614497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a040b7020 0x7f9a040b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.411+0000 7f9a03fff640 1 -- 172.21.15.96:0/28614497 >> v2:172.21.15.162:3300/0 conn(0x7f9a0415e470 msgr2=0x7f9a040d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:25.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.411+0000 7f9a03fff640 1 --2- 172.21.15.96:0/28614497 >> v2:172.21.15.162:3300/0 conn(0x7f9a0415e470 0x7f9a040d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.411+0000 7f9a03fff640 1 -- 172.21.15.96:0/28614497 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a040cc600 con 0x7f9a040ce790 2024-06-02T23:58:25.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.411+0000 7f9a03fff640 1 --2- 172.21.15.96:0/28614497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 0x7f9a040cec00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9a040725a0 tx=0x7f99ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea0901d842c35e0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a037fe640 1 -- 172.21.15.96:0/28614497 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec037070 con 0x7f9a040ce790 2024-06-02T23:58:25.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a037fe640 1 -- 172.21.15.96:0/28614497 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec032440 con 0x7f9a040ce790 2024-06-02T23:58:25.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a037fe640 1 -- 172.21.15.96:0/28614497 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec032810 con 0x7f9a040ce790 2024-06-02T23:58:25.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a0afb7640 1 -- 172.21.15.96:0/28614497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 msgr2=0x7f9a040cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a0afb7640 1 --2- 172.21.15.96:0/28614497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 0x7f9a040cec00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9a040725a0 tx=0x7f99ec02a270 comp rx=0 tx=0).stop 2024-06-02T23:58:25.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a0afb7640 1 -- 172.21.15.96:0/28614497 shutdown_connections 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a0afb7640 1 --2- 172.21.15.96:0/28614497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a040b7020 0x7f9a040b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a0afb7640 1 --2- 172.21.15.96:0/28614497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 0x7f9a040cec00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a0afb7640 1 --2- 172.21.15.96:0/28614497 >> v2:172.21.15.162:3300/0 conn(0x7f9a0415e470 0x7f9a040d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a0afb7640 1 -- 172.21.15.96:0/28614497 >> 172.21.15.96:0/28614497 conn(0x7f9a040d1f10 msgr2=0x7f9a040d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a0afb7640 1 -- 172.21.15.96:0/28614497 shutdown_connections 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.412+0000 7f9a0afb7640 1 -- 172.21.15.96:0/28614497 wait complete. 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.413+0000 7f9a0afb7640 1 Processor -- start 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.413+0000 7f9a0afb7640 1 -- start start 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.414+0000 7f9a0afb7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a040b7020 0x7f9a040c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.414+0000 7f9a0afb7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 0x7f9a0415f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.414+0000 7f9a0afb7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0415e470 0x7f9a04152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.414+0000 7f9a0afb7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9a040ccea0 con 0x7f9a040ce790 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.414+0000 7f9a0afb7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a040ccbc0 con 0x7f9a0415e470 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.414+0000 7f9a0afb7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9a040b4d60 con 0x7f9a040b7020 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.414+0000 7f9a03fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 0x7f9a0415f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.414+0000 7f9a03fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 0x7f9a0415f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60952/0 (socket says 172.21.15.96:60952) 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.414+0000 7f9a03fff640 1 -- 172.21.15.96:0/3011340359 learned_addr learned my addr 172.21.15.96:0/3011340359 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a08d53640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a040b7020 0x7f9a040c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a09554640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0415e470 0x7f9a04152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a03fff640 1 -- 172.21.15.96:0/3011340359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a040b7020 msgr2=0x7f9a040c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a03fff640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a040b7020 0x7f9a040c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a03fff640 1 -- 172.21.15.96:0/3011340359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0415e470 msgr2=0x7f9a04152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a03fff640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0415e470 0x7f9a04152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a03fff640 1 -- 172.21.15.96:0/3011340359 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a04152ca0 con 0x7f9a040ce790 2024-06-02T23:58:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a08d53640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a040b7020 0x7f9a040c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a09554640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0415e470 0x7f9a04152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a03fff640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 0x7f9a0415f8b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f99ec000c00 tx=0x7f99ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a017fa640 1 -- 172.21.15.96:0/3011340359 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec041020 con 0x7f9a040ce790 2024-06-02T23:58:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a017fa640 1 -- 172.21.15.96:0/3011340359 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec030970 con 0x7f9a040ce790 2024-06-02T23:58:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a017fa640 1 -- 172.21.15.96:0/3011340359 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec037040 con 0x7f9a040ce790 2024-06-02T23:58:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a0afb7640 1 -- 172.21.15.96:0/3011340359 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a040c6e20 con 0x7f9a040ce790 2024-06-02T23:58:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.415+0000 7f9a0afb7640 1 -- 172.21.15.96:0/3011340359 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a040c73e0 con 0x7f9a040ce790 2024-06-02T23:58:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.416+0000 7f9a0afb7640 1 -- 172.21.15.96:0/3011340359 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a040d2c40 con 0x7f9a040ce790 2024-06-02T23:58:25.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.417+0000 7f9a017fa640 1 -- 172.21.15.96:0/3011340359 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f99ec044020 con 0x7f9a040ce790 2024-06-02T23:58:25.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.417+0000 7f9a017fa640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f99e406c030 0x7f99e406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.417+0000 7f9a017fa640 1 -- 172.21.15.96:0/3011340359 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f99ec0abf60 con 0x7f9a040ce790 2024-06-02T23:58:25.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.417+0000 7f9a08d53640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f99e406c030 0x7f99e406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.418+0000 7f9a08d53640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f99e406c030 0x7f99e406e4f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99f4007f50 tx=0x7f99f40074a0 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.421+0000 7f9a017fa640 1 -- 172.21.15.96:0/3011340359 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9a040d2c40 con 0x7f9a040ce790 2024-06-02T23:58:25.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.613+0000 7f9a0afb7640 1 -- 172.21.15.96:0/3011340359 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a040683e0 con 0x7f99e406c030 2024-06-02T23:58:25.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.621+0000 7f9a017fa640 1 -- 172.21.15.96:0/3011340359 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f9a040683e0 con 0x7f99e406c030 2024-06-02T23:58:25.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:25.622 INFO:teuthology.orchestra.run.smithi096.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:40", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.623+0000 7f9a0afb7640 1 -- 172.21.15.96:0/3011340359 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f99e406c030 msgr2=0x7f99e406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.623+0000 7f9a0afb7640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f99e406c030 0x7f99e406e4f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99f4007f50 tx=0x7f99f40074a0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.623+0000 7f9a0afb7640 1 -- 172.21.15.96:0/3011340359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 msgr2=0x7f9a0415f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.623+0000 7f9a0afb7640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 0x7f9a0415f8b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f99ec000c00 tx=0x7f99ec0046c0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.623+0000 7f9a0afb7640 1 -- 172.21.15.96:0/3011340359 shutdown_connections 2024-06-02T23:58:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.623+0000 7f9a0afb7640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f99e406c030 0x7f99e406e4f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.623+0000 7f9a0afb7640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a0415e470 0x7f9a04152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.623+0000 7f9a0afb7640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a040ce790 0x7f9a0415f8b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.623+0000 7f9a0afb7640 1 --2- 172.21.15.96:0/3011340359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a040b7020 0x7f9a040c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.624+0000 7f9a0afb7640 1 -- 172.21.15.96:0/3011340359 >> 172.21.15.96:0/3011340359 conn(0x7f9a040d1f10 msgr2=0x7f9a040cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.624+0000 7f9a0afb7640 1 -- 172.21.15.96:0/3011340359 shutdown_connections 2024-06-02T23:58:25.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.624+0000 7f9a0afb7640 1 -- 172.21.15.96:0/3011340359 wait complete. 2024-06-02T23:58:25.634 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:40", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:25.634 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1m', 'retention': {}, 'start': '2024-06-02T00:00:00', 'created': '2024-06-02T23:47:40', 'first': '2024-06-02T23:48:00', 'last': '2024-06-02T23:58:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-06-02T23:58:25.634 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-06-02T23:58:25.634 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-06-02T23:58:25.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:25.635 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2024-06-02T23:58:25.655 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:25.655 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:25.655 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:25.655 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:25.655 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:25.656 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:25.656 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:25.656 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:25.656 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:25.656 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:25.656 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:25.656 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-06-02-23_48_00_UTC', 'scheduled-2024-06-02-23_49_00_UTC', 'scheduled-2024-06-02-23_50_00_UTC', 'scheduled-2024-06-02-23_51_00_UTC', 'scheduled-2024-06-02-23_52_00_UTC', 'scheduled-2024-06-02-23_53_00_UTC', 'scheduled-2024-06-02-23_54_00_UTC', 'scheduled-2024-06-02-23_55_00_UTC', 'scheduled-2024-06-02-23_56_00_UTC', 'scheduled-2024-06-02-23_57_00_UTC', 'scheduled-2024-06-02-23_58_00_UTC'] 2024-06-02T23:58:25.657 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir6 2024-06-02T23:58:25.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.796+0000 7f4ea2fce640 1 Processor -- start 2024-06-02T23:58:25.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.796+0000 7f4ea2fce640 1 -- start start 2024-06-02T23:58:25.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea2fce640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4e9c15e530 0x7f4e9c0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea2fce640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4e9c06ed20 0x7f4e9c0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea2fce640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e9c0723e0 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea2fce640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4e9c0cb7b0 con 0x7f4e9c06ed20 2024-06-02T23:58:25.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea2fce640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4e9c072680 con 0x7f4e9c15e530 2024-06-02T23:58:25.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea156b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4e9c06ed20 0x7f4e9c0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea156b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4e9c06ed20 0x7f4e9c0cd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60960/0 (socket says 172.21.15.96:60960) 2024-06-02T23:58:25.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea156b640 1 -- 172.21.15.96:0/86537878 learned_addr learned my addr 172.21.15.96:0/86537878 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:25.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea0d6a640 1 --2- 172.21.15.96:0/86537878 >> v2:172.21.15.162:3300/0 conn(0x7f4e9c15e530 0x7f4e9c0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea156b640 1 -- 172.21.15.96:0/86537878 >> v2:172.21.15.162:3300/0 conn(0x7f4e9c15e530 msgr2=0x7f4e9c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.797+0000 7f4ea156b640 1 --2- 172.21.15.96:0/86537878 >> v2:172.21.15.162:3300/0 conn(0x7f4e9c15e530 0x7f4e9c0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.798+0000 7f4ea156b640 1 -- 172.21.15.96:0/86537878 >> v1:172.21.15.162:6789/0 conn(0x7f4e9c0cb2a0 legacy=0x7f4e9c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.798+0000 7f4ea156b640 1 -- 172.21.15.96:0/86537878 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c072960 con 0x7f4e9c06ed20 2024-06-02T23:58:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.798+0000 7f4ea0d6a640 1 --2- 172.21.15.96:0/86537878 >> v2:172.21.15.162:3300/0 conn(0x7f4e9c15e530 0x7f4e9c0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.798+0000 7f4ea156b640 1 --2- 172.21.15.96:0/86537878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c06ed20 0x7f4e9c0cd880 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0ca400 tx=0x7f4e9402a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc66cf3391e8852 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.798+0000 7f4e9b7fe640 1 -- 172.21.15.96:0/86537878 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94036070 con 0x7f4e9c06ed20 2024-06-02T23:58:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.798+0000 7f4e9b7fe640 1 -- 172.21.15.96:0/86537878 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e94031600 con 0x7f4e9c06ed20 2024-06-02T23:58:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.798+0000 7f4e9b7fe640 1 -- 172.21.15.96:0/86537878 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940319d0 con 0x7f4e9c06ed20 2024-06-02T23:58:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.799+0000 7f4ea2fce640 1 -- 172.21.15.96:0/86537878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c06ed20 msgr2=0x7f4e9c0cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.799+0000 7f4ea2fce640 1 --2- 172.21.15.96:0/86537878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c06ed20 0x7f4e9c0cd880 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0ca400 tx=0x7f4e9402a590 comp rx=0 tx=0).stop 2024-06-02T23:58:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.799+0000 7f4ea2fce640 1 -- 172.21.15.96:0/86537878 shutdown_connections 2024-06-02T23:58:25.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.799+0000 7f4ea2fce640 1 --2- 172.21.15.96:0/86537878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c06ed20 0x7f4e9c0cd880 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.799+0000 7f4ea2fce640 1 --2- 172.21.15.96:0/86537878 >> v2:172.21.15.162:3300/0 conn(0x7f4e9c15e530 0x7f4e9c0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.799+0000 7f4ea2fce640 1 -- 172.21.15.96:0/86537878 >> 172.21.15.96:0/86537878 conn(0x7f4e9c0cfcb0 msgr2=0x7f4e9c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.799+0000 7f4ea2fce640 1 -- 172.21.15.96:0/86537878 shutdown_connections 2024-06-02T23:58:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.799+0000 7f4ea2fce640 1 -- 172.21.15.96:0/86537878 wait complete. 2024-06-02T23:58:25.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.800+0000 7f4ea2fce640 1 Processor -- start 2024-06-02T23:58:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.800+0000 7f4ea2fce640 1 -- start start 2024-06-02T23:58:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4ea2fce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e9c06ed20 0x7f4e9c0c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4ea2fce640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0cb2a0 0x7f4e9c15ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4ea2fce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e9c15e530 0x7f4e9c0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4ea2fce640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c073160 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4ea2fce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c15e910 con 0x7f4e9c06ed20 2024-06-02T23:58:25.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4ea2fce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4e9c06d120 con 0x7f4e9c15e530 2024-06-02T23:58:25.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4e9bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0cb2a0 0x7f4e9c15ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4e9bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0cb2a0 0x7f4e9c15ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60970/0 (socket says 172.21.15.96:60970) 2024-06-02T23:58:25.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4e9bfff640 1 -- 172.21.15.96:0/3601445689 learned_addr learned my addr 172.21.15.96:0/3601445689 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:25.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4ea0d6a640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e9c06ed20 0x7f4e9c0c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4e9bfff640 1 -- 172.21.15.96:0/3601445689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e9c15e530 msgr2=0x7f4e9c0c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4ea156b640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e9c15e530 0x7f4e9c0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4e9bfff640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e9c15e530 0x7f4e9c0c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4e9bfff640 1 -- 172.21.15.96:0/3601445689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e9c06ed20 msgr2=0x7f4e9c0c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:25.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4e9bfff640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e9c06ed20 0x7f4e9c0c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:25.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4e9bfff640 1 -- 172.21.15.96:0/3601445689 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c15dc60 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4ea0d6a640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e9c06ed20 0x7f4e9c0c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:25.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.801+0000 7f4ea156b640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e9c15e530 0x7f4e9c0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:25.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.802+0000 7f4e9bfff640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0cb2a0 0x7f4e9c15ca10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000c460 tx=0x7f4e9000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.802+0000 7f4e997fa640 1 -- 172.21.15.96:0/3601445689 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90016020 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.802+0000 7f4e997fa640 1 -- 172.21.15.96:0/3601445689 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e90012870 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.802+0000 7f4ea2fce640 1 -- 172.21.15.96:0/3601445689 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c15d060 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.802+0000 7f4e997fa640 1 -- 172.21.15.96:0/3601445689 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90012c60 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.802+0000 7f4ea2fce640 1 -- 172.21.15.96:0/3601445689 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9c0c7a70 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.803+0000 7f4ea2fce640 1 -- 172.21.15.96:0/3601445689 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9c0683e0 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.803+0000 7f4e997fa640 1 -- 172.21.15.96:0/3601445689 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f4e90019020 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.804+0000 7f4e997fa640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4e8806c060 0x7f4e8806e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:25.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.804+0000 7f4e997fa640 1 -- 172.21.15.96:0/3601445689 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f4e9008b170 con 0x7f4e9c0cb2a0 2024-06-02T23:58:25.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.804+0000 7f4ea0d6a640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4e8806c060 0x7f4e8806e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:25.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.804+0000 7f4ea0d6a640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4e8806c060 0x7f4e8806e520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c006fd0 tx=0x7f4e8c008040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:25.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:25.808+0000 7f4e997fa640 1 -- 172.21.15.96:0/3601445689 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4e90020030 con 0x7f4e9c0cb2a0 2024-06-02T23:58:26.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.002+0000 7f4ea2fce640 1 -- 172.21.15.96:0/3601445689 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e9c06cd40 con 0x7f4e8806c060 2024-06-02T23:58:26.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.010+0000 7f4e997fa640 1 -- 172.21.15.96:0/3601445689 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f4e9c06cd40 con 0x7f4e8806c060 2024-06-02T23:58:26.010 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:26.010 INFO:teuthology.orchestra.run.smithi096.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:41", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 -- 172.21.15.96:0/3601445689 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4e8806c060 msgr2=0x7f4e8806e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4e8806c060 0x7f4e8806e520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c006fd0 tx=0x7f4e8c008040 comp rx=0 tx=0).stop 2024-06-02T23:58:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 -- 172.21.15.96:0/3601445689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0cb2a0 msgr2=0x7f4e9c15ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0cb2a0 0x7f4e9c15ca10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000c460 tx=0x7f4e9000c920 comp rx=0 tx=0).stop 2024-06-02T23:58:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 -- 172.21.15.96:0/3601445689 shutdown_connections 2024-06-02T23:58:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4e8806c060 0x7f4e8806e520 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e9c15e530 0x7f4e9c0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e9c0cb2a0 0x7f4e9c15ca10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 --2- 172.21.15.96:0/3601445689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e9c06ed20 0x7f4e9c0c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 -- 172.21.15.96:0/3601445689 >> 172.21.15.96:0/3601445689 conn(0x7f4e9c0cfcb0 msgr2=0x7f4e9c0ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 -- 172.21.15.96:0/3601445689 shutdown_connections 2024-06-02T23:58:26.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.012+0000 7f4ea2fce640 1 -- 172.21.15.96:0/3601445689 wait complete. 2024-06-02T23:58:26.022 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:41", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:26.023 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1m', 'retention': {}, 'start': '2024-06-02T00:00:00', 'created': '2024-06-02T23:47:41', 'first': '2024-06-02T23:48:00', 'last': '2024-06-02T23:58:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-06-02T23:58:26.023 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-06-02T23:58:26.023 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-06-02T23:58:26.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:26.023 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2024-06-02T23:58:26.043 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:26.043 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:26.043 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:26.043 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:26.043 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:26.043 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:26.043 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:26.043 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:26.043 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:26.044 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:26.044 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:26.044 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-06-02-23_48_00_UTC', 'scheduled-2024-06-02-23_49_00_UTC', 'scheduled-2024-06-02-23_50_00_UTC', 'scheduled-2024-06-02-23_51_00_UTC', 'scheduled-2024-06-02-23_52_00_UTC', 'scheduled-2024-06-02-23_53_00_UTC', 'scheduled-2024-06-02-23_54_00_UTC', 'scheduled-2024-06-02-23_55_00_UTC', 'scheduled-2024-06-02-23_56_00_UTC', 'scheduled-2024-06-02-23_57_00_UTC', 'scheduled-2024-06-02-23_58_00_UTC'] 2024-06-02T23:58:26.044 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir7 2024-06-02T23:58:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.185+0000 7f0393129640 1 Processor -- start 2024-06-02T23:58:26.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.185+0000 7f0393129640 1 -- start start 2024-06-02T23:58:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f0393129640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c06e610 0x7f038c06ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f0393129640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f038c0cd880 0x7f038c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f0393129640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038c0723e0 con 0x7f038c15e530 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f0393129640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f038c06efb0 con 0x7f038c0cd880 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f0393129640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f038c0cb7b0 con 0x7f038c06e610 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f03916c6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f038c0cd880 0x7f038c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f03916c6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f038c0cd880 0x7f038c0cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60982/0 (socket says 172.21.15.96:60982) 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f03916c6640 1 -- 172.21.15.96:0/3768448749 learned_addr learned my addr 172.21.15.96:0/3768448749 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f038bfff640 1 --2- 172.21.15.96:0/3768448749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c06e610 0x7f038c06ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f03916c6640 1 -- 172.21.15.96:0/3768448749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c06e610 msgr2=0x7f038c06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f03916c6640 1 --2- 172.21.15.96:0/3768448749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c06e610 0x7f038c06ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f03916c6640 1 -- 172.21.15.96:0/3768448749 >> v1:172.21.15.162:6789/0 conn(0x7f038c15e530 legacy=0x7f038c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f03916c6640 1 -- 172.21.15.96:0/3768448749 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c072680 con 0x7f038c0cd880 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.186+0000 7f038bfff640 1 --2- 172.21.15.96:0/3768448749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c06e610 0x7f038c06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:26.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.187+0000 7f03916c6640 1 --2- 172.21.15.96:0/3768448749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 0x7f038c0cdcd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0384009e50 tx=0x7f038402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cefb43fa6a1b41 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.187+0000 7f038b7fe640 1 -- 172.21.15.96:0/3768448749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384036070 con 0x7f038c0cd880 2024-06-02T23:58:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.187+0000 7f038b7fe640 1 -- 172.21.15.96:0/3768448749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0384031600 con 0x7f038c0cd880 2024-06-02T23:58:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.187+0000 7f038b7fe640 1 -- 172.21.15.96:0/3768448749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03840319d0 con 0x7f038c0cd880 2024-06-02T23:58:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.187+0000 7f0393129640 1 -- 172.21.15.96:0/3768448749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 msgr2=0x7f038c0cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.187+0000 7f0393129640 1 --2- 172.21.15.96:0/3768448749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 0x7f038c0cdcd0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0384009e50 tx=0x7f038402a5f0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.187+0000 7f0393129640 1 -- 172.21.15.96:0/3768448749 shutdown_connections 2024-06-02T23:58:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.187+0000 7f0393129640 1 --2- 172.21.15.96:0/3768448749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 0x7f038c0cdcd0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.187+0000 7f0393129640 1 --2- 172.21.15.96:0/3768448749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c06e610 0x7f038c06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.187+0000 7f0393129640 1 -- 172.21.15.96:0/3768448749 >> 172.21.15.96:0/3768448749 conn(0x7f038c0cfcb0 msgr2=0x7f038c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:26.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.188+0000 7f0393129640 1 -- 172.21.15.96:0/3768448749 shutdown_connections 2024-06-02T23:58:26.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.188+0000 7f0393129640 1 -- 172.21.15.96:0/3768448749 wait complete. 2024-06-02T23:58:26.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.189+0000 7f0393129640 1 Processor -- start 2024-06-02T23:58:26.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.189+0000 7f0393129640 1 -- start start 2024-06-02T23:58:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f0393129640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c06e610 0x7f038c1503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f0393129640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 0x7f038c0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f0393129640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c15e530 0x7f038c157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f0393129640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f038c15e910 con 0x7f038c0cd880 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f0393129640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f038c072c40 con 0x7f038c06e610 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f0393129640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f038c073160 con 0x7f038c15e530 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f038bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 0x7f038c0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f038bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 0x7f038c0b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:60988/0 (socket says 172.21.15.96:60988) 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f038bfff640 1 -- 172.21.15.96:0/1781412996 learned_addr learned my addr 172.21.15.96:0/1781412996 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f0390ec5640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c06e610 0x7f038c1503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f03916c6640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c15e530 0x7f038c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f038bfff640 1 -- 172.21.15.96:0/1781412996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c15e530 msgr2=0x7f038c157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f038bfff640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c15e530 0x7f038c157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f038bfff640 1 -- 172.21.15.96:0/1781412996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c06e610 msgr2=0x7f038c1503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f038bfff640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c06e610 0x7f038c1503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f038bfff640 1 -- 172.21.15.96:0/1781412996 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c15ce90 con 0x7f038c0cd880 2024-06-02T23:58:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.190+0000 7f038bfff640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 0x7f038c0b3550 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f037800c7f0 tx=0x7f037800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.191+0000 7f03897fa640 1 -- 172.21.15.96:0/1781412996 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378015070 con 0x7f038c0cd880 2024-06-02T23:58:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.191+0000 7f03897fa640 1 -- 172.21.15.96:0/1781412996 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0378007a30 con 0x7f038c0cd880 2024-06-02T23:58:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.191+0000 7f03897fa640 1 -- 172.21.15.96:0/1781412996 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378007e00 con 0x7f038c0cd880 2024-06-02T23:58:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.191+0000 7f0393129640 1 -- 172.21.15.96:0/1781412996 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c0b2a70 con 0x7f038c0cd880 2024-06-02T23:58:26.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.191+0000 7f0393129640 1 -- 172.21.15.96:0/1781412996 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c0b3a90 con 0x7f038c0cd880 2024-06-02T23:58:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.192+0000 7f0393129640 1 -- 172.21.15.96:0/1781412996 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038c0683e0 con 0x7f038c0cd880 2024-06-02T23:58:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.192+0000 7f03897fa640 1 -- 172.21.15.96:0/1781412996 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f0378018070 con 0x7f038c0cd880 2024-06-02T23:58:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.193+0000 7f03897fa640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f037006c030 0x7f037006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.193+0000 7f03897fa640 1 -- 172.21.15.96:0/1781412996 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f037808b440 con 0x7f038c0cd880 2024-06-02T23:58:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.193+0000 7f0390ec5640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f037006c030 0x7f037006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.193+0000 7f0390ec5640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f037006c030 0x7f037006e4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03800016e0 tx=0x7f0380009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:26.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.197+0000 7f03897fa640 1 -- 172.21.15.96:0/1781412996 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0378059200 con 0x7f038c0cd880 2024-06-02T23:58:26.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.394+0000 7f0393129640 1 -- 172.21.15.96:0/1781412996 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f038c06cd40 con 0x7f037006c030 2024-06-02T23:58:26.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.402+0000 7f03897fa640 1 -- 172.21.15.96:0/1781412996 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f038c06cd40 con 0x7f037006c030 2024-06-02T23:58:26.403 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:26.404 INFO:teuthology.orchestra.run.smithi096.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:41", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:26.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 -- 172.21.15.96:0/1781412996 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f037006c030 msgr2=0x7f037006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f037006c030 0x7f037006e4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03800016e0 tx=0x7f0380009040 comp rx=0 tx=0).stop 2024-06-02T23:58:26.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 -- 172.21.15.96:0/1781412996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 msgr2=0x7f038c0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 0x7f038c0b3550 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f037800c7f0 tx=0x7f037800cbf0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 -- 172.21.15.96:0/1781412996 shutdown_connections 2024-06-02T23:58:26.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f037006c030 0x7f037006e4f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c15e530 0x7f038c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f038c0cd880 0x7f038c0b3550 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 --2- 172.21.15.96:0/1781412996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c06e610 0x7f038c1503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 -- 172.21.15.96:0/1781412996 >> 172.21.15.96:0/1781412996 conn(0x7f038c0cfcb0 msgr2=0x7f038c0afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:26.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 -- 172.21.15.96:0/1781412996 shutdown_connections 2024-06-02T23:58:26.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.404+0000 7f0393129640 1 -- 172.21.15.96:0/1781412996 wait complete. 2024-06-02T23:58:26.415 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:41", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:26.416 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1m', 'retention': {}, 'start': '2024-06-02T00:00:00', 'created': '2024-06-02T23:47:41', 'first': '2024-06-02T23:48:00', 'last': '2024-06-02T23:58:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-06-02T23:58:26.416 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-06-02T23:58:26.416 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-06-02T23:58:26.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:26.416 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2024-06-02T23:58:26.437 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:26.437 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:26.437 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:26.437 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:26.438 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:26.438 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:26.438 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:26.438 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:26.438 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:26.438 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:26.438 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:26.438 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-06-02-23_48_00_UTC', 'scheduled-2024-06-02-23_49_00_UTC', 'scheduled-2024-06-02-23_50_00_UTC', 'scheduled-2024-06-02-23_51_00_UTC', 'scheduled-2024-06-02-23_52_00_UTC', 'scheduled-2024-06-02-23_53_00_UTC', 'scheduled-2024-06-02-23_54_00_UTC', 'scheduled-2024-06-02-23_55_00_UTC', 'scheduled-2024-06-02-23_56_00_UTC', 'scheduled-2024-06-02-23_57_00_UTC', 'scheduled-2024-06-02-23_58_00_UTC'] 2024-06-02T23:58:26.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir8 2024-06-02T23:58:26.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.587+0000 7f9915989640 1 Processor -- start 2024-06-02T23:58:26.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.587+0000 7f9915989640 1 -- start start 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.588+0000 7f9915989640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f99100ca730 0x7f99100c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.588+0000 7f9915989640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99100caca0 con 0x7f9910145d80 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.588+0000 7f9915989640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99100c5140 con 0x7f991006d980 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.588+0000 7f9915989640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f99100c5420 con 0x7f99100ca730 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.588+0000 7f990effd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9910145d80 0x7f991006d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45410/0 (socket says 172.21.15.96:45410) 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.588+0000 7f990effd640 1 -- 172.21.15.96:0/2496666062 learned_addr learned my addr 172.21.15.96:0/2496666062 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.588+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616927386 0 0) 0x7f99100caca0 con 0x7f9910145d80 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.588+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98fc003520 con 0x7f9910145d80 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.588+0000 7f990f7fe640 1 --2- 172.21.15.96:0/2496666062 >> v2:172.21.15.162:3300/0 conn(0x7f99100ca730 0x7f99100c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 194077963 0 0) 0x7f98fc003520 con 0x7f9910145d80 2024-06-02T23:58:26.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 >> v2:172.21.15.162:3300/0 conn(0x7f99100ca730 msgr2=0x7f99100c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 --2- 172.21.15.96:0/2496666062 >> v2:172.21.15.162:3300/0 conn(0x7f99100ca730 0x7f99100c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 >> v1:172.21.15.162:6789/0 conn(0x7f991006d980 legacy=0x7f9910071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99100c5700 con 0x7f9910145d80 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f99000019f0 con 0x7f9910145d80 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 >> v1:172.21.15.96:6789/0 conn(0x7f9910145d80 legacy=0x7f991006d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98fc0039b0 0x7f98fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98fc004800 0x7f98fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98fc0051c0 0x7f98fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f99100c5420 con 0x7f98fc004800 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc00c160 con 0x7f98fc0051c0 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc00c360 con 0x7f98fc0039b0 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990e7fc640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98fc004800 0x7f98fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.592 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990f7fe640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98fc0051c0 0x7f98fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990effd640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98fc0039b0 0x7f98fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990e7fc640 1 -- 172.21.15.96:0/2496666062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98fc0039b0 msgr2=0x7f98fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990e7fc640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98fc0039b0 0x7f98fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990e7fc640 1 -- 172.21.15.96:0/2496666062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98fc0051c0 msgr2=0x7f98fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990e7fc640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98fc0051c0 0x7f98fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990f7fe640 1 -- 172.21.15.96:0/2496666062 reap_dead start 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990e7fc640 1 -- 172.21.15.96:0/2496666062 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc003520 con 0x7f98fc004800 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.589+0000 7f990effd640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98fc0039b0 0x7f98fc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.590+0000 7f990e7fc640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98fc004800 0x7f98fc004c80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f98f8001750 tx=0x7f98fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837d069afc878c39 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.590+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8001370 con 0x7f98fc004800 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.590+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f80052d0 con 0x7f98fc004800 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.590+0000 7f990dffb640 1 -- 172.21.15.96:0/2496666062 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f802abc0 con 0x7f98fc004800 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.590+0000 7f9915989640 1 -- 172.21.15.96:0/2496666062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98fc004800 msgr2=0x7f98fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.590+0000 7f9915989640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98fc004800 0x7f98fc004c80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f98f8001750 tx=0x7f98fc005830 comp rx=0 tx=0).stop 2024-06-02T23:58:26.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.590+0000 7f9915989640 1 -- 172.21.15.96:0/2496666062 shutdown_connections 2024-06-02T23:58:26.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.590+0000 7f9915989640 1 --2- 172.21.15.96:0/2496666062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98fc004800 0x7f98fc004c80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.590+0000 7f9915989640 1 -- 172.21.15.96:0/2496666062 >> 172.21.15.96:0/2496666062 conn(0x7f99100d00e0 msgr2=0x7f99100d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:26.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.591+0000 7f9915989640 1 -- 172.21.15.96:0/2496666062 shutdown_connections 2024-06-02T23:58:26.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.591+0000 7f9915989640 1 -- 172.21.15.96:0/2496666062 wait complete. 2024-06-02T23:58:26.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.592+0000 7f9915989640 1 Processor -- start 2024-06-02T23:58:26.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.592+0000 7f9915989640 1 -- start start 2024-06-02T23:58:26.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9915989640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98fc004800 0x7f99100c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9915989640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e9b0 0x7f99100c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9915989640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f991015ee10 0x7f99100ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9915989640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f99100c5fb0 con 0x7f991015ee10 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9915989640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f99100c5e30 con 0x7f991015e9b0 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9915989640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9910160650 con 0x7f98fc004800 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f990f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f991015ee10 0x7f99100ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f990f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f991015ee10 0x7f99100ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32784/0 (socket says 172.21.15.96:32784) 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f990f7fe640 1 -- 172.21.15.96:0/1363354866 learned_addr learned my addr 172.21.15.96:0/1363354866 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f990e7fc640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e9b0 0x7f99100c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f990f7fe640 1 -- 172.21.15.96:0/1363354866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98fc004800 msgr2=0x7f99100c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f990f7fe640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98fc004800 0x7f99100c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f990f7fe640 1 -- 172.21.15.96:0/1363354866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e9b0 msgr2=0x7f99100c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f990f7fe640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e9b0 0x7f99100c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f990f7fe640 1 -- 172.21.15.96:0/1363354866 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991015d910 con 0x7f991015ee10 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f990f7fe640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f991015ee10 0x7f99100ca0d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9910070e40 tx=0x7f9908011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9907fff640 1 -- 172.21.15.96:0/1363354866 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9908004240 con 0x7f991015ee10 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9907fff640 1 -- 172.21.15.96:0/1363354866 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990801c070 con 0x7f991015ee10 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9915989640 1 -- 172.21.15.96:0/1363354866 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991015dbf0 con 0x7f991015ee10 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9907fff640 1 -- 172.21.15.96:0/1363354866 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990800f740 con 0x7f991015ee10 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.593+0000 7f9915989640 1 -- 172.21.15.96:0/1363354866 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f991015e1b0 con 0x7f991015ee10 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.594+0000 7f9915989640 1 -- 172.21.15.96:0/1363354866 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99100683e0 con 0x7f991015ee10 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.595+0000 7f9907fff640 1 -- 172.21.15.96:0/1363354866 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f9908012040 con 0x7f991015ee10 2024-06-02T23:58:26.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.595+0000 7f9907fff640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f98f006c060 0x7f98f006e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.595+0000 7f9907fff640 1 -- 172.21.15.96:0/1363354866 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f990808b3e0 con 0x7f991015ee10 2024-06-02T23:58:26.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.595+0000 7f990effd640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f98f006c060 0x7f98f006e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.596+0000 7f990effd640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f98f006c060 0x7f98f006e520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9900001330 tx=0x7f9900002170 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:26.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.600+0000 7f9907fff640 1 -- 172.21.15.96:0/1363354866 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9908059860 con 0x7f991015ee10 2024-06-02T23:58:26.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.791+0000 7f9915989640 1 -- 172.21.15.96:0/1363354866 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9910143e20 con 0x7f98f006c060 2024-06-02T23:58:26.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.798+0000 7f9907fff640 1 -- 172.21.15.96:0/1363354866 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f9910143e20 con 0x7f98f006c060 2024-06-02T23:58:26.798 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:26.798 INFO:teuthology.orchestra.run.smithi096.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:42", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:26.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 -- 172.21.15.96:0/1363354866 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f98f006c060 msgr2=0x7f98f006e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f98f006c060 0x7f98f006e520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9900001330 tx=0x7f9900002170 comp rx=0 tx=0).stop 2024-06-02T23:58:26.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 -- 172.21.15.96:0/1363354866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f991015ee10 msgr2=0x7f99100ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f991015ee10 0x7f99100ca0d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9910070e40 tx=0x7f9908011cf0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.800 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 -- 172.21.15.96:0/1363354866 shutdown_connections 2024-06-02T23:58:26.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f98f006c060 0x7f98f006e520 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f991015ee10 0x7f99100ca0d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f991015e9b0 0x7f99100c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 --2- 172.21.15.96:0/1363354866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98fc004800 0x7f99100c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 -- 172.21.15.96:0/1363354866 >> 172.21.15.96:0/1363354866 conn(0x7f99100d00e0 msgr2=0x7f99101433d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:26.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 -- 172.21.15.96:0/1363354866 shutdown_connections 2024-06-02T23:58:26.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.800+0000 7f9915989640 1 -- 172.21.15.96:0/1363354866 wait complete. 2024-06-02T23:58:26.811 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:42", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:26.811 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1m', 'retention': {}, 'start': '2024-06-02T00:00:00', 'created': '2024-06-02T23:47:42', 'first': '2024-06-02T23:48:00', 'last': '2024-06-02T23:58:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-06-02T23:58:26.811 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-06-02T23:58:26.811 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-06-02T23:58:26.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:26.811 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2024-06-02T23:58:26.831 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:26.831 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:26.831 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:26.832 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:26.832 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-06-02-23_48_00_UTC', 'scheduled-2024-06-02-23_49_00_UTC', 'scheduled-2024-06-02-23_50_00_UTC', 'scheduled-2024-06-02-23_51_00_UTC', 'scheduled-2024-06-02-23_52_00_UTC', 'scheduled-2024-06-02-23_53_00_UTC', 'scheduled-2024-06-02-23_54_00_UTC', 'scheduled-2024-06-02-23_55_00_UTC', 'scheduled-2024-06-02-23_56_00_UTC', 'scheduled-2024-06-02-23_57_00_UTC', 'scheduled-2024-06-02-23_58_00_UTC'] 2024-06-02T23:58:26.832 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir9 2024-06-02T23:58:26.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.973+0000 7f5f7b04d640 1 Processor -- start 2024-06-02T23:58:26.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.973+0000 7f5f7b04d640 1 -- start start 2024-06-02T23:58:26.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f7b04d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f7415a8f0 0x7f5f740cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f7b04d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5f74072070 0x7f5f74072520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f7b04d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f74073200 con 0x7f5f7415a510 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f7b04d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5f74071030 con 0x7f5f74072070 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f7b04d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f740712b0 con 0x7f5f7415a8f0 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f78de9640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5f7415a510 0x7f5f740cdd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45418/0 (socket says 172.21.15.96:45418) 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f78de9640 1 -- 172.21.15.96:0/73301912 learned_addr learned my addr 172.21.15.96:0/73301912 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f795ea640 1 --2- 172.21.15.96:0/73301912 >> v2:172.21.15.162:3300/0 conn(0x7f5f74072070 0x7f5f74072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467676160 0 0) 0x7f5f74073200 con 0x7f5f7415a510 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f73fff640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f7415a8f0 0x7f5f740cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f64003520 con 0x7f5f7415a510 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2060564374 0 0) 0x7f5f64003520 con 0x7f5f7415a510 2024-06-02T23:58:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f7415a8f0 msgr2=0x7f5f740cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f7415a8f0 0x7f5f740cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 >> v2:172.21.15.162:3300/0 conn(0x7f5f74072070 msgr2=0x7f5f74072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 --2- 172.21.15.96:0/73301912 >> v2:172.21.15.162:3300/0 conn(0x7f5f74072070 0x7f5f74072520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f74071590 con 0x7f5f7415a510 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f5f68001670 con 0x7f5f7415a510 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 >> v1:172.21.15.96:6789/0 conn(0x7f5f7415a510 legacy=0x7f5f740cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f7415a8f0 0x7f5f640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f64003f30 0x7f5f64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f64004d40 0x7f5f640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5f74071030 con 0x7f5f64004d40 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f740712b0 con 0x7f5f64003f30 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.974+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f6400ba10 con 0x7f5f7415a8f0 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.975+0000 7f5f795ea640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f64004d40 0x7f5f640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.975+0000 7f5f78de9640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f7415a8f0 0x7f5f640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.975+0000 7f5f73fff640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f64003f30 0x7f5f64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.975+0000 7f5f795ea640 1 -- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f7415a8f0 msgr2=0x7f5f640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.975+0000 7f5f795ea640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f7415a8f0 0x7f5f640039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.975+0000 7f5f795ea640 1 -- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f64003f30 msgr2=0x7f5f64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.975+0000 7f5f795ea640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f64003f30 0x7f5f64004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.975+0000 7f5f795ea640 1 -- 172.21.15.96:0/73301912 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f64003520 con 0x7f5f64004d40 2024-06-02T23:58:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.975+0000 7f5f795ea640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f64004d40 0x7f5f640051c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00e170 tx=0x7f5f64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f50a39b51083f39 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.976+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c034020 con 0x7f5f64004d40 2024-06-02T23:58:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.976+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f6c030430 con 0x7f5f64004d40 2024-06-02T23:58:26.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.976+0000 7f5f737fe640 1 -- 172.21.15.96:0/73301912 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c009c10 con 0x7f5f64004d40 2024-06-02T23:58:26.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.976+0000 7f5f7b04d640 1 -- 172.21.15.96:0/73301912 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f64004d40 msgr2=0x7f5f640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.976+0000 7f5f7b04d640 1 --2- 172.21.15.96:0/73301912 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f64004d40 0x7f5f640051c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00e170 tx=0x7f5f64005830 comp rx=0 tx=0).stop 2024-06-02T23:58:26.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.976+0000 7f5f795ea640 1 -- 172.21.15.96:0/73301912 reap_dead start 2024-06-02T23:58:26.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.976+0000 7f5f7b04d640 1 -- 172.21.15.96:0/73301912 shutdown_connections 2024-06-02T23:58:26.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.976+0000 7f5f7b04d640 1 -- 172.21.15.96:0/73301912 >> 172.21.15.96:0/73301912 conn(0x7f5f740cfcb0 msgr2=0x7f5f740d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.976+0000 7f5f7b04d640 1 -- 172.21.15.96:0/73301912 shutdown_connections 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.976+0000 7f5f7b04d640 1 -- 172.21.15.96:0/73301912 wait complete. 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.977+0000 7f5f7b04d640 1 Processor -- start 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.977+0000 7f5f7b04d640 1 -- start start 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.978+0000 7f5f7b04d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f64004d40 0x7f5f740c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.978+0000 7f5f7b04d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f740c64c0 0x7f5f740b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.978+0000 7f5f7b04d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740b5170 0x7f5f74145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.978+0000 7f5f7b04d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5f74072a60 con 0x7f5f740b5170 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.978+0000 7f5f7b04d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f74071b50 con 0x7f5f740c64c0 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.978+0000 7f5f7b04d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f74072be0 con 0x7f5f64004d40 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.978+0000 7f5f795ea640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740b5170 0x7f5f74145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.978+0000 7f5f795ea640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740b5170 0x7f5f74145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32800/0 (socket says 172.21.15.96:32800) 2024-06-02T23:58:26.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.978+0000 7f5f795ea640 1 -- 172.21.15.96:0/168935351 learned_addr learned my addr 172.21.15.96:0/168935351 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f78de9640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f64004d40 0x7f5f740c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f73fff640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f740c64c0 0x7f5f740b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f795ea640 1 -- 172.21.15.96:0/168935351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f64004d40 msgr2=0x7f5f740c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f795ea640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f64004d40 0x7f5f740c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f795ea640 1 -- 172.21.15.96:0/168935351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f740c64c0 msgr2=0x7f5f740b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f795ea640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f740c64c0 0x7f5f740b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f795ea640 1 -- 172.21.15.96:0/168935351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f74147b20 con 0x7f5f740b5170 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f73fff640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f740c64c0 0x7f5f740b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f78de9640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f64004d40 0x7f5f740c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f795ea640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740b5170 0x7f5f74145c50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00e170 tx=0x7f5f6c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f717fa640 1 -- 172.21.15.96:0/168935351 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c034050 con 0x7f5f740b5170 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f717fa640 1 -- 172.21.15.96:0/168935351 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f6c003b90 con 0x7f5f740b5170 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f7b04d640 1 -- 172.21.15.96:0/168935351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f74147e00 con 0x7f5f740b5170 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f717fa640 1 -- 172.21.15.96:0/168935351 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c009c10 con 0x7f5f740b5170 2024-06-02T23:58:26.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.979+0000 7f5f7b04d640 1 -- 172.21.15.96:0/168935351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f740b2e00 con 0x7f5f740b5170 2024-06-02T23:58:26.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.980+0000 7f5f7b04d640 1 -- 172.21.15.96:0/168935351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f740cd510 con 0x7f5f740b5170 2024-06-02T23:58:26.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.980+0000 7f5f717fa640 1 -- 172.21.15.96:0/168935351 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f5f6c037020 con 0x7f5f740b5170 2024-06-02T23:58:26.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.981+0000 7f5f717fa640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5f5806c060 0x7f5f5806e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:26.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.981+0000 7f5f717fa640 1 -- 172.21.15.96:0/168935351 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f5f6c0aba00 con 0x7f5f740b5170 2024-06-02T23:58:26.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.981+0000 7f5f78de9640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5f5806c060 0x7f5f5806e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:26.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.981+0000 7f5f78de9640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5f5806c060 0x7f5f5806e520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f68000fb0 tx=0x7f5f68009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:26.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:26.985+0000 7f5f717fa640 1 -- 172.21.15.96:0/168935351 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5f740cd510 con 0x7f5f740b5170 2024-06-02T23:58:27.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.178+0000 7f5f7b04d640 1 -- 172.21.15.96:0/168935351 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f740b3000 con 0x7f5f5806c060 2024-06-02T23:58:27.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.186+0000 7f5f717fa640 1 -- 172.21.15.96:0/168935351 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f5f740b3000 con 0x7f5f5806c060 2024-06-02T23:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:27.186 INFO:teuthology.orchestra.run.smithi096.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:42", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 -- 172.21.15.96:0/168935351 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5f5806c060 msgr2=0x7f5f5806e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5f5806c060 0x7f5f5806e520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f68000fb0 tx=0x7f5f68009040 comp rx=0 tx=0).stop 2024-06-02T23:58:27.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 -- 172.21.15.96:0/168935351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740b5170 msgr2=0x7f5f74145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740b5170 0x7f5f74145c50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00e170 tx=0x7f5f6c009750 comp rx=0 tx=0).stop 2024-06-02T23:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 -- 172.21.15.96:0/168935351 shutdown_connections 2024-06-02T23:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f5f5806c060 0x7f5f5806e520 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f740b5170 0x7f5f74145c50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f740c64c0 0x7f5f740b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 --2- 172.21.15.96:0/168935351 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f64004d40 0x7f5f740c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 -- 172.21.15.96:0/168935351 >> 172.21.15.96:0/168935351 conn(0x7f5f740cfcb0 msgr2=0x7f5f740cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 -- 172.21.15.96:0/168935351 shutdown_connections 2024-06-02T23:58:27.189 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.188+0000 7f5f7b04d640 1 -- 172.21.15.96:0/168935351 wait complete. 2024-06-02T23:58:27.199 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1m", "retention": {}, "start": "2024-06-02T00:00:00", "created": "2024-06-02T23:47:42", "first": "2024-06-02T23:48:00", "last": "2024-06-02T23:58:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-06-02T23:58:27.199 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1m', 'retention': {}, 'start': '2024-06-02T00:00:00', 'created': '2024-06-02T23:47:42', 'first': '2024-06-02T23:48:00', 'last': '2024-06-02T23:58:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-06-02T23:58:27.199 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-06-02T23:58:27.199 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-06-02T23:58:27.199 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir0 1m 2024-06-02T23:58:27.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.302+0000 7fafa0c79640 1 Processor -- start 2024-06-02T23:58:27.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.302+0000 7fafa0c79640 1 -- start start 2024-06-02T23:58:27.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7fafa0c79640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c0cf450 0x7faf9c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7fafa0c79640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9c06d2e0 con 0x7faf9c06e380 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7fafa0c79640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9c06d5c0 con 0x7faf9c143d70 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7fafa0c79640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c06d8a0 con 0x7faf9c0cf450 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf99d9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7faf9c06e380 0x7faf9c0ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45430/0 (socket says 172.21.15.96:45430) 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf99d9b640 1 -- 172.21.15.96:0/2589104650 learned_addr learned my addr 172.21.15.96:0/2589104650 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327674314 0 0) 0x7faf9c06d2e0 con 0x7faf9c06e380 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf84003520 con 0x7faf9c06e380 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9ad9d640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c0cf450 0x7faf9c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3535114165 0 0) 0x7faf84003520 con 0x7faf9c06e380 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c0cf450 msgr2=0x7faf9c06cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c0cf450 0x7faf9c06cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 >> v1:172.21.15.162:6789/0 conn(0x7faf9c143d70 legacy=0x7faf9c144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c06db80 con 0x7faf9c06e380 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9ad9d640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c0cf450 0x7faf9c06cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:27.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7faf90001670 con 0x7faf9c06e380 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 >> v1:172.21.15.96:6789/0 conn(0x7faf9c06e380 legacy=0x7faf9c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 0x7faf84003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c0cf450 0x7faf84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf84004d40 0x7faf840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c06d8a0 con 0x7faf840039e0 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf8400bb80 con 0x7faf84004d40 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faf8400bd80 con 0x7faf9c0cf450 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.303+0000 7faf9a59c640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 0x7faf84003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.304+0000 7faf9ad9d640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf84004d40 0x7faf840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.304+0000 7faf99d9b640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c0cf450 0x7faf84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.304+0000 7faf9a59c640 1 -- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c0cf450 msgr2=0x7faf84004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.304+0000 7faf9a59c640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c0cf450 0x7faf84004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.304+0000 7faf9a59c640 1 -- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf84004d40 msgr2=0x7faf840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:27.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.304+0000 7faf9a59c640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf84004d40 0x7faf840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.304+0000 7faf9a59c640 1 -- 172.21.15.96:0/2589104650 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf84003520 con 0x7faf840039e0 2024-06-02T23:58:27.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.304+0000 7faf99d9b640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c0cf450 0x7faf84004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:27.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.304+0000 7faf9a59c640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 0x7faf84003e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7faf8c001750 tx=0x7faf84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895ded24458250da server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:27.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.304+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c001370 con 0x7faf840039e0 2024-06-02T23:58:27.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.305+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c0052d0 con 0x7faf840039e0 2024-06-02T23:58:27.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.305+0000 7faf9959a640 1 -- 172.21.15.96:0/2589104650 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c02abe0 con 0x7faf840039e0 2024-06-02T23:58:27.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.305+0000 7fafa0c79640 1 -- 172.21.15.96:0/2589104650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 msgr2=0x7faf84003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.305+0000 7fafa0c79640 1 --2- 172.21.15.96:0/2589104650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 0x7faf84003e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7faf8c001750 tx=0x7faf84005830 comp rx=0 tx=0).stop 2024-06-02T23:58:27.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.305+0000 7faf9ad9d640 1 -- 172.21.15.96:0/2589104650 reap_dead start 2024-06-02T23:58:27.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.305+0000 7fafa0c79640 1 -- 172.21.15.96:0/2589104650 shutdown_connections 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.305+0000 7fafa0c79640 1 -- 172.21.15.96:0/2589104650 >> 172.21.15.96:0/2589104650 conn(0x7faf9c0b18a0 msgr2=0x7faf9c0b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.305+0000 7fafa0c79640 1 -- 172.21.15.96:0/2589104650 shutdown_connections 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.305+0000 7fafa0c79640 1 -- 172.21.15.96:0/2589104650 wait complete. 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.306+0000 7fafa0c79640 1 Processor -- start 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.307+0000 7fafa0c79640 1 -- start start 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.307+0000 7fafa0c79640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 0x7faf9c159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.307+0000 7fafa0c79640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf9c134590 0x7faf9c134a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.307+0000 7fafa0c79640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c071550 0x7faf9c0719d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.307+0000 7fafa0c79640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c06ce80 con 0x7faf840039e0 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.307+0000 7fafa0c79640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c06cd00 con 0x7faf9c134590 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.307+0000 7fafa0c79640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c06d000 con 0x7faf9c071550 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.307+0000 7faf9a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 0x7faf9c159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.307+0000 7faf9a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 0x7faf9c159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32828/0 (socket says 172.21.15.96:32828) 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.307+0000 7faf9a59c640 1 -- 172.21.15.96:0/1511518215 learned_addr learned my addr 172.21.15.96:0/1511518215 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7faf9a59c640 1 -- 172.21.15.96:0/1511518215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c071550 msgr2=0x7faf9c0719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7faf9a59c640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c071550 0x7faf9c0719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7faf9a59c640 1 -- 172.21.15.96:0/1511518215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf9c134590 msgr2=0x7faf9c134a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7faf9a59c640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf9c134590 0x7faf9c134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7faf9a59c640 1 -- 172.21.15.96:0/1511518215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c15a1e0 con 0x7faf840039e0 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7faf9a59c640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 0x7faf9c159ca0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faf8c008fd0 tx=0x7faf8c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7faf8affd640 1 -- 172.21.15.96:0/1511518215 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c040020 con 0x7faf840039e0 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7faf8affd640 1 -- 172.21.15.96:0/1511518215 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c005480 con 0x7faf840039e0 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7fafa0c79640 1 -- 172.21.15.96:0/1511518215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c137640 con 0x7faf840039e0 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7faf8affd640 1 -- 172.21.15.96:0/1511518215 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c007a30 con 0x7faf840039e0 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.308+0000 7fafa0c79640 1 -- 172.21.15.96:0/1511518215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c1353c0 con 0x7faf840039e0 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.309+0000 7fafa0c79640 1 -- 172.21.15.96:0/1511518215 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9c0683e0 con 0x7faf840039e0 2024-06-02T23:58:27.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.309+0000 7faf8affd640 1 -- 172.21.15.96:0/1511518215 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7faf8c043020 con 0x7faf840039e0 2024-06-02T23:58:27.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.310+0000 7faf8affd640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7faf7c06c030 0x7faf7c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:27.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.310+0000 7faf8affd640 1 -- 172.21.15.96:0/1511518215 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7faf8c0ab310 con 0x7faf840039e0 2024-06-02T23:58:27.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.310+0000 7faf99d9b640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7faf7c06c030 0x7faf7c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:27.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.310+0000 7faf99d9b640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7faf7c06c030 0x7faf7c06e4f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf90001b80 tx=0x7faf90001df0 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.314+0000 7faf8affd640 1 -- 172.21.15.96:0/1511518215 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7faf8c04a030 con 0x7faf840039e0 2024-06-02T23:58:27.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.508+0000 7fafa0c79640 1 -- 172.21.15.96:0/1511518215 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir0", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7faf9c0b2490 con 0x7faf7c06c030 2024-06-02T23:58:27.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.583+0000 7faf8affd640 1 -- 172.21.15.96:0/1511518215 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7faf9c0b2490 con 0x7faf7c06c030 2024-06-02T23:58:27.584 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule removed for path /snap_test_dir1/dir0 2024-06-02T23:58:27.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 -- 172.21.15.96:0/1511518215 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7faf7c06c030 msgr2=0x7faf7c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7faf7c06c030 0x7faf7c06e4f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf90001b80 tx=0x7faf90001df0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 -- 172.21.15.96:0/1511518215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 msgr2=0x7faf9c159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:27.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 0x7faf9c159ca0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7faf8c008fd0 tx=0x7faf8c001120 comp rx=0 tx=0).stop 2024-06-02T23:58:27.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 -- 172.21.15.96:0/1511518215 shutdown_connections 2024-06-02T23:58:27.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7faf7c06c030 0x7faf7c06e4f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf9c071550 0x7faf9c0719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf9c134590 0x7faf9c134a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 --2- 172.21.15.96:0/1511518215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf840039e0 0x7faf9c159ca0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:27.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 -- 172.21.15.96:0/1511518215 >> 172.21.15.96:0/1511518215 conn(0x7faf9c0b18a0 msgr2=0x7faf9c144150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:27.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 -- 172.21.15.96:0/1511518215 shutdown_connections 2024-06-02T23:58:27.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:27.586+0000 7fafa0c79640 1 -- 172.21.15.96:0/1511518215 wait complete. 2024-06-02T23:58:27.596 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2024-06-02T23:58:27.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:27.597 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2024-06-02T23:58:27.616 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:27.617 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:27.617 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:27.617 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:27.617 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:27.617 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:27.617 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:27.617 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:27.617 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:27.617 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:27.617 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:27.617 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:27.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:27.618 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_48_00_UTC) 2024-06-02T23:58:27.680 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:27.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:27.681 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_49_00_UTC) 2024-06-02T23:58:27.746 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:27.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:27.746 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_50_00_UTC) 2024-06-02T23:58:27.808 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:27.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:27.809 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_51_00_UTC) 2024-06-02T23:58:27.871 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:27.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:27.872 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_52_00_UTC) 2024-06-02T23:58:27.934 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:27.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:27.934 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_53_00_UTC) 2024-06-02T23:58:27.998 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:27.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:27.998 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_54_00_UTC) 2024-06-02T23:58:28.060 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:28.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:28.061 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_55_00_UTC) 2024-06-02T23:58:28.125 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:28.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:28.126 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_56_00_UTC) 2024-06-02T23:58:28.188 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:28.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:28.188 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_57_00_UTC) 2024-06-02T23:58:28.252 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:28.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:28.253 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-06-02-23_58_00_UTC) 2024-06-02T23:58:28.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:28.316 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2024-06-02T23:58:28.376 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir1 1m 2024-06-02T23:58:28.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.520+0000 7f4ab4e2a640 1 Processor -- start 2024-06-02T23:58:28.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.520+0000 7f4ab4e2a640 1 -- start start 2024-06-02T23:58:28.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.520+0000 7f4ab4e2a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab00b2f40 0x7f4ab00d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:28.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.520+0000 7f4ab4e2a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ab00d4f30 con 0x7f4ab015e340 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.520+0000 7f4ab4e2a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ab00cede0 con 0x7f4ab00d1070 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.520+0000 7f4ab4e2a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ab00cf710 con 0x7f4ab00b2f40 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aae59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4ab015e340 0x7f4ab00cfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45442/0 (socket says 172.21.15.96:45442) 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aae59c640 1 -- 172.21.15.96:0/534713057 learned_addr learned my addr 172.21.15.96:0/534713057 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aa7fff640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab00b2f40 0x7f4ab00d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479166324 0 0) 0x7f4ab00d4f30 con 0x7f4ab015e340 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a9c003520 con 0x7f4ab015e340 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1601257263 0 0) 0x7f4a9c003520 con 0x7f4ab015e340 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab00b2f40 msgr2=0x7f4ab00d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab00b2f40 0x7f4ab00d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 >> v1:172.21.15.162:6789/0 conn(0x7f4ab00d1070 legacy=0x7f4ab00b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:28.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab00cf0c0 con 0x7f4ab015e340 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f4aa0001670 con 0x7f4ab015e340 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 >> v1:172.21.15.96:6789/0 conn(0x7f4ab015e340 legacy=0x7f4ab00cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab00b2f40 0x7f4a9c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a9c004010 0x7f4a9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9c004d40 0x7f4a9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab00cf710 con 0x7f4a9c004010 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c00bc00 con 0x7f4a9c004d40 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9c00be00 con 0x7f4ab00b2f40 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aa7fff640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a9c004010 0x7f4a9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aae59c640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab00b2f40 0x7f4a9c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.521+0000 7f4aaed9d640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9c004d40 0x7f4a9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:28.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.522+0000 7f4aa7fff640 1 -- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab00b2f40 msgr2=0x7f4a9c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.522+0000 7f4aa7fff640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab00b2f40 0x7f4a9c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.522+0000 7f4aa7fff640 1 -- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9c004d40 msgr2=0x7f4a9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.522+0000 7f4aa7fff640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9c004d40 0x7f4a9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.522+0000 7f4aa7fff640 1 -- 172.21.15.96:0/534713057 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c003520 con 0x7f4a9c004010 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.522+0000 7f4aaed9d640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a9c004d40 0x7f4a9c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.522+0000 7f4aa7fff640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a9c004010 0x7f4a9c004800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800ba00 tx=0x7f4a9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40336682dc7b7e6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.522+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98030070 con 0x7f4a9c004010 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.522+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9802adb0 con 0x7f4a9c004010 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.522+0000 7f4aadd9b640 1 -- 172.21.15.96:0/534713057 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800b600 con 0x7f4a9c004010 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.523+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/534713057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a9c004010 msgr2=0x7f4a9c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.523+0000 7f4ab4e2a640 1 --2- 172.21.15.96:0/534713057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a9c004010 0x7f4a9c004800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800ba00 tx=0x7f4a9c005830 comp rx=0 tx=0).stop 2024-06-02T23:58:28.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.523+0000 7f4aaed9d640 1 -- 172.21.15.96:0/534713057 reap_dead start 2024-06-02T23:58:28.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.523+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/534713057 shutdown_connections 2024-06-02T23:58:28.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.523+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/534713057 >> 172.21.15.96:0/534713057 conn(0x7f4ab00d4030 msgr2=0x7f4ab00d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:28.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.523+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/534713057 shutdown_connections 2024-06-02T23:58:28.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.523+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/534713057 wait complete. 2024-06-02T23:58:28.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.524+0000 7f4ab4e2a640 1 Processor -- start 2024-06-02T23:58:28.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.524+0000 7f4ab4e2a640 1 -- start start 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4ab4e2a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a9c004010 0x7f4ab00cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4ab4e2a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ab00cb1b0 0x7f4ab00cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4ab4e2a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ab00ccd00 0x7f4ab009f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4ab4e2a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab00d4b50 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4ab4e2a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab015e720 con 0x7f4ab00ccd00 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4ab4e2a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ab00d4cd0 con 0x7f4a9c004010 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4aa7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ab00cb1b0 0x7f4ab00cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4aa7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ab00cb1b0 0x7f4ab00cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32840/0 (socket says 172.21.15.96:32840) 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4aa7fff640 1 -- 172.21.15.96:0/296141565 learned_addr learned my addr 172.21.15.96:0/296141565 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4aa7fff640 1 -- 172.21.15.96:0/296141565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a9c004010 msgr2=0x7f4ab00cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4aa7fff640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a9c004010 0x7f4ab00cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4aaed9d640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ab00ccd00 0x7f4ab009f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:28.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4aa7fff640 1 -- 172.21.15.96:0/296141565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ab00ccd00 msgr2=0x7f4ab009f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4aa7fff640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ab00ccd00 0x7f4ab009f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.525+0000 7f4aa7fff640 1 -- 172.21.15.96:0/296141565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab00cb720 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.526+0000 7f4aa7fff640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ab00cb1b0 0x7f4ab00cc7c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4a9802a8a0 tx=0x7f4a98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.526+0000 7f4aa6ffd640 1 -- 172.21.15.96:0/296141565 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98043020 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.526+0000 7f4aa6ffd640 1 -- 172.21.15.96:0/296141565 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9803f680 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.526+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/296141565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab00cba00 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.526+0000 7f4aa6ffd640 1 -- 172.21.15.96:0/296141565 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9800b600 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.526+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/296141565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab00cbfc0 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.527+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/296141565 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab00683e0 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.527+0000 7f4aa6ffd640 1 -- 172.21.15.96:0/296141565 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f4a98046020 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.528+0000 7f4aa6ffd640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4a9006c030 0x7f4a9006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.528+0000 7f4aa6ffd640 1 -- 172.21.15.96:0/296141565 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6388+0+0 (secure 0 0 0) 0x7f4a980ac420 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.528+0000 7f4aae59c640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4a9006c030 0x7f4a9006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:28.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.528+0000 7f4aae59c640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4a9006c030 0x7f4a9006e4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0001cd0 tx=0x7f4aa0001b60 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.532+0000 7f4aa6ffd640 1 -- 172.21.15.96:0/296141565 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4a9804d020 con 0x7f4ab00cb1b0 2024-06-02T23:58:28.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.732+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/296141565 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir1", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f4ab015cd60 con 0x7f4a9006c030 2024-06-02T23:58:28.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.810+0000 7f4aa6ffd640 1 -- 172.21.15.96:0/296141565 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f4ab015cd60 con 0x7f4a9006c030 2024-06-02T23:58:28.810 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule removed for path /snap_test_dir1/dir1 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/296141565 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4a9006c030 msgr2=0x7f4a9006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4a9006c030 0x7f4a9006e4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0001cd0 tx=0x7f4aa0001b60 comp rx=0 tx=0).stop 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/296141565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ab00cb1b0 msgr2=0x7f4ab00cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ab00cb1b0 0x7f4ab00cc7c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4a9802a8a0 tx=0x7f4a98004730 comp rx=0 tx=0).stop 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/296141565 shutdown_connections 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4a9006c030 0x7f4a9006e4f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ab00ccd00 0x7f4ab009f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ab00cb1b0 0x7f4ab00cc7c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 --2- 172.21.15.96:0/296141565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a9c004010 0x7f4ab00cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/296141565 >> 172.21.15.96:0/296141565 conn(0x7f4ab00d4030 msgr2=0x7f4ab00b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:28.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.812+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/296141565 shutdown_connections 2024-06-02T23:58:28.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:28.813+0000 7f4ab4e2a640 1 -- 172.21.15.96:0/296141565 wait complete. 2024-06-02T23:58:28.823 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2024-06-02T23:58:28.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:28.823 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2024-06-02T23:58:28.846 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:28.846 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:28.846 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:28.846 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:28.846 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:28.846 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:28.846 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:28.847 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:28.847 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:28.847 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:28.847 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:28.847 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:28.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:28.847 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_48_00_UTC) 2024-06-02T23:58:28.912 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:28.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:28.912 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_49_00_UTC) 2024-06-02T23:58:28.975 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:28.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:28.976 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_50_00_UTC) 2024-06-02T23:58:29.038 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:29.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:29.038 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_51_00_UTC) 2024-06-02T23:58:29.101 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:29.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:29.102 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_52_00_UTC) 2024-06-02T23:58:29.165 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:29.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:29.165 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_53_00_UTC) 2024-06-02T23:58:29.226 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:58:29.250 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:58:29.251 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:29.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:29.251 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_54_00_UTC) 2024-06-02T23:58:29.320 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:29.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:29.320 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_55_00_UTC) 2024-06-02T23:58:29.383 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:29.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:29.383 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_56_00_UTC) 2024-06-02T23:58:29.447 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:29.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:29.448 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_57_00_UTC) 2024-06-02T23:58:29.511 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:29.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:29.511 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-06-02-23_58_00_UTC) 2024-06-02T23:58:29.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:29.573 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2024-06-02T23:58:29.633 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir2 1m 2024-06-02T23:58:29.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.775+0000 7fdb2d3c1640 1 Processor -- start 2024-06-02T23:58:29.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.776+0000 7fdb2d3c1640 1 -- start start 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.776+0000 7fdb2d3c1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdb280b2f40 0x7fdb280d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.776+0000 7fdb2d3c1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb280d4f30 con 0x7fdb2815e340 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.776+0000 7fdb2d3c1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb280cede0 con 0x7fdb280d1070 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.776+0000 7fdb2d3c1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fdb280cf710 con 0x7fdb280b2f40 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.776+0000 7fdb267fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdb280b2f40 0x7fdb280d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.776+0000 7fdb26ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fdb2815e340 0x7fdb280cfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45446/0 (socket says 172.21.15.96:45446) 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.776+0000 7fdb26ffd640 1 -- 172.21.15.96:0/1831093457 learned_addr learned my addr 172.21.15.96:0/1831093457 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.777+0000 7fdb267fc640 1 -- 172.21.15.96:0/1831093457 >> v1:172.21.15.162:6789/0 conn(0x7fdb280d1070 legacy=0x7fdb280b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.777+0000 7fdb267fc640 1 -- 172.21.15.96:0/1831093457 >> v1:172.21.15.96:6789/0 conn(0x7fdb2815e340 legacy=0x7fdb280cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.777+0000 7fdb267fc640 1 -- 172.21.15.96:0/1831093457 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb280cf0c0 con 0x7fdb280b2f40 2024-06-02T23:58:29.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.777+0000 7fdb25ffb640 1 -- 172.21.15.96:0/1831093457 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441559190 0 0) 0x7fdb280d4f30 con 0x7fdb2815e340 2024-06-02T23:58:29.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.777+0000 7fdb267fc640 1 --2- 172.21.15.96:0/1831093457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280b2f40 0x7fdb280d2610 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdb100097a0 tx=0x7fdb1002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa66dbc66434d6dc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.778+0000 7fdb25ffb640 1 -- 172.21.15.96:0/1831093457 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10037070 con 0x7fdb280b2f40 2024-06-02T23:58:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.778+0000 7fdb25ffb640 1 -- 172.21.15.96:0/1831093457 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1002ae50 con 0x7fdb280b2f40 2024-06-02T23:58:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.778+0000 7fdb25ffb640 1 -- 172.21.15.96:0/1831093457 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10032660 con 0x7fdb280b2f40 2024-06-02T23:58:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.778+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/1831093457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280b2f40 msgr2=0x7fdb280d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.778+0000 7fdb2d3c1640 1 --2- 172.21.15.96:0/1831093457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280b2f40 0x7fdb280d2610 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fdb100097a0 tx=0x7fdb1002a140 comp rx=0 tx=0).stop 2024-06-02T23:58:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.778+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/1831093457 shutdown_connections 2024-06-02T23:58:29.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.778+0000 7fdb2d3c1640 1 --2- 172.21.15.96:0/1831093457 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280b2f40 0x7fdb280d2610 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:29.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.778+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/1831093457 >> 172.21.15.96:0/1831093457 conn(0x7fdb280d4030 msgr2=0x7fdb280d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:29.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.778+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/1831093457 shutdown_connections 2024-06-02T23:58:29.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.778+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/1831093457 wait complete. 2024-06-02T23:58:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb2d3c1640 1 Processor -- start 2024-06-02T23:58:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb2d3c1640 1 -- start start 2024-06-02T23:58:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb2d3c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb280b2f40 0x7fdb281606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb2d3c1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280d1070 0x7fdb280b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:29.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb2d3c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb2815e340 0x7fdb280b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb2d3c1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdb280d4b50 con 0x7fdb280d1070 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb2d3c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2815e720 con 0x7fdb280b2f40 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb2d3c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb280d4cd0 con 0x7fdb2815e340 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb267fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280d1070 0x7fdb280b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb267fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280d1070 0x7fdb280b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32858/0 (socket says 172.21.15.96:32858) 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.780+0000 7fdb267fc640 1 -- 172.21.15.96:0/2650088616 learned_addr learned my addr 172.21.15.96:0/2650088616 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb26ffd640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb280b2f40 0x7fdb281606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb277fe640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb2815e340 0x7fdb280b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb267fc640 1 -- 172.21.15.96:0/2650088616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb2815e340 msgr2=0x7fdb280b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb267fc640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb2815e340 0x7fdb280b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb267fc640 1 -- 172.21.15.96:0/2650088616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb280b2f40 msgr2=0x7fdb281606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb267fc640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb280b2f40 0x7fdb281606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb267fc640 1 -- 172.21.15.96:0/2650088616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb28160c20 con 0x7fdb280d1070 2024-06-02T23:58:29.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb26ffd640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb280b2f40 0x7fdb281606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb267fc640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280d1070 0x7fdb280b3340 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdb100097a0 tx=0x7fdb100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb1f7fe640 1 -- 172.21.15.96:0/2650088616 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10042070 con 0x7fdb280d1070 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb1f7fe640 1 -- 172.21.15.96:0/2650088616 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1003e670 con 0x7fdb280d1070 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb1f7fe640 1 -- 172.21.15.96:0/2650088616 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10037040 con 0x7fdb280d1070 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/2650088616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2815fc40 con 0x7fdb280d1070 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.781+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/2650088616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb280b5e30 con 0x7fdb280d1070 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.782+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/2650088616 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb280683e0 con 0x7fdb280d1070 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.783+0000 7fdb1f7fe640 1 -- 172.21.15.96:0/2650088616 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7fdb10045070 con 0x7fdb280d1070 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.783+0000 7fdb1f7fe640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fdb0806c060 0x7fdb0806e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.783+0000 7fdb1f7fe640 1 -- 172.21.15.96:0/2650088616 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6860+0+0 (secure 0 0 0) 0x7fdb100abe00 con 0x7fdb280d1070 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.783+0000 7fdb26ffd640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fdb0806c060 0x7fdb0806e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:29.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.784+0000 7fdb26ffd640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fdb0806c060 0x7fdb0806e520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb180012e0 tx=0x7fdb18005b90 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:29.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.788+0000 7fdb1f7fe640 1 -- 172.21.15.96:0/2650088616 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdb1007a140 con 0x7fdb280d1070 2024-06-02T23:58:29.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:29.996+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/2650088616 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir2", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fdb28073790 con 0x7fdb0806c060 2024-06-02T23:58:30.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.071+0000 7fdb1f7fe640 1 -- 172.21.15.96:0/2650088616 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fdb28073790 con 0x7fdb0806c060 2024-06-02T23:58:30.071 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule removed for path /snap_test_dir1/dir2 2024-06-02T23:58:30.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/2650088616 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fdb0806c060 msgr2=0x7fdb0806e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fdb0806c060 0x7fdb0806e520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb180012e0 tx=0x7fdb18005b90 comp rx=0 tx=0).stop 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/2650088616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280d1070 msgr2=0x7fdb280b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280d1070 0x7fdb280b3340 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdb100097a0 tx=0x7fdb100046c0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/2650088616 shutdown_connections 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fdb0806c060 0x7fdb0806e520 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb2815e340 0x7fdb280b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb280d1070 0x7fdb280b3340 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 --2- 172.21.15.96:0/2650088616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb280b2f40 0x7fdb281606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/2650088616 >> 172.21.15.96:0/2650088616 conn(0x7fdb280d4030 msgr2=0x7fdb280d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/2650088616 shutdown_connections 2024-06-02T23:58:30.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:30.073+0000 7fdb2d3c1640 1 -- 172.21.15.96:0/2650088616 wait complete. 2024-06-02T23:58:30.084 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2024-06-02T23:58:30.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.084 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2024-06-02T23:58:30.107 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:30.108 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:30.108 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:30.108 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:30.108 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:30.108 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:30.108 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:30.108 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:30.108 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:30.108 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:30.108 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:30.108 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:30.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.109 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_48_00_UTC) 2024-06-02T23:58:30.171 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:30.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.172 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_49_00_UTC) 2024-06-02T23:58:30.247 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:30.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.247 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_50_00_UTC) 2024-06-02T23:58:30.310 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:30.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.310 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_51_00_UTC) 2024-06-02T23:58:30.372 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:30.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.372 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_52_00_UTC) 2024-06-02T23:58:30.436 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:30.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.436 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_53_00_UTC) 2024-06-02T23:58:30.499 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:30.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.499 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_54_00_UTC) 2024-06-02T23:58:30.561 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:30.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.561 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_55_00_UTC) 2024-06-02T23:58:30.625 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:30.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.625 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_56_00_UTC) 2024-06-02T23:58:30.688 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:30.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.689 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_57_00_UTC) 2024-06-02T23:58:30.753 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:30.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.753 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-06-02-23_58_00_UTC) 2024-06-02T23:58:30.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:30.816 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2024-06-02T23:58:30.874 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir3 1m 2024-06-02T23:58:31.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.020+0000 7f6c1d16a640 1 Processor -- start 2024-06-02T23:58:31.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.020+0000 7f6c1d16a640 1 -- start start 2024-06-02T23:58:31.023 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.020+0000 7f6c1d16a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6c180d2d20 0x7f6c180b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:31.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.020+0000 7f6c1d16a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c180d4f30 con 0x7f6c1815e340 2024-06-02T23:58:31.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.020+0000 7f6c1d16a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c180cede0 con 0x7f6c180b2f40 2024-06-02T23:58:31.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.020+0000 7f6c1d16a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6c180cf710 con 0x7f6c180d2d20 2024-06-02T23:58:31.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.020+0000 7f6c16d9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f6c1815e340 0x7f6c180cfba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45460/0 (socket says 172.21.15.96:45460) 2024-06-02T23:58:31.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.020+0000 7f6c16d9d640 1 -- 172.21.15.96:0/1995048178 learned_addr learned my addr 172.21.15.96:0/1995048178 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:31.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.021+0000 7f6c1759e640 1 --2- 172.21.15.96:0/1995048178 >> v2:172.21.15.162:3300/0 conn(0x7f6c180d2d20 0x7f6c180b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:31.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.021+0000 7f6c15d9b640 1 -- 172.21.15.96:0/1995048178 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183959584 0 0) 0x7f6c180d4f30 con 0x7f6c1815e340 2024-06-02T23:58:31.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.021+0000 7f6c15d9b640 1 -- 172.21.15.96:0/1995048178 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c04003520 con 0x7f6c1815e340 2024-06-02T23:58:31.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.021+0000 7f6c1759e640 1 -- 172.21.15.96:0/1995048178 >> v1:172.21.15.162:6789/0 conn(0x7f6c180b2f40 legacy=0x7f6c180d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:31.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.021+0000 7f6c15d9b640 1 -- 172.21.15.96:0/1995048178 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1637047849 0 0) 0x7f6c04003520 con 0x7f6c1815e340 2024-06-02T23:58:31.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.021+0000 7f6c1759e640 1 -- 172.21.15.96:0/1995048178 >> v1:172.21.15.96:6789/0 conn(0x7f6c1815e340 legacy=0x7f6c180cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:31.025 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.021+0000 7f6c1759e640 1 -- 172.21.15.96:0/1995048178 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180cf0c0 con 0x7f6c180d2d20 2024-06-02T23:58:31.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.022+0000 7f6c1759e640 1 --2- 172.21.15.96:0/1995048178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c180d2d20 0x7f6c180b0c00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6c080097a0 tx=0x7f6c0802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b93093c263aa08df server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:31.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.022+0000 7f6c15d9b640 1 -- 172.21.15.96:0/1995048178 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08037070 con 0x7f6c180d2d20 2024-06-02T23:58:31.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.022+0000 7f6c15d9b640 1 -- 172.21.15.96:0/1995048178 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0802ac50 con 0x7f6c180d2d20 2024-06-02T23:58:31.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.022+0000 7f6c15d9b640 1 -- 172.21.15.96:0/1995048178 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c100019f0 con 0x7f6c180d2d20 2024-06-02T23:58:31.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.022+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1995048178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c180d2d20 msgr2=0x7f6c180b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:31.026 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.022+0000 7f6c1d16a640 1 --2- 172.21.15.96:0/1995048178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c180d2d20 0x7f6c180b0c00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6c080097a0 tx=0x7f6c0802a1c0 comp rx=0 tx=0).stop 2024-06-02T23:58:31.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.022+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1995048178 shutdown_connections 2024-06-02T23:58:31.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.022+0000 7f6c1d16a640 1 --2- 172.21.15.96:0/1995048178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c180d2d20 0x7f6c180b0c00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:31.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.022+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1995048178 >> 172.21.15.96:0/1995048178 conn(0x7f6c180d4030 msgr2=0x7f6c180d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:31.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.022+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1995048178 shutdown_connections 2024-06-02T23:58:31.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.023+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1995048178 wait complete. 2024-06-02T23:58:31.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.024+0000 7f6c1d16a640 1 Processor -- start 2024-06-02T23:58:31.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.024+0000 7f6c1d16a640 1 -- start start 2024-06-02T23:58:31.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1d16a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c180b2f40 0x7f6c18150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:31.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1d16a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c180d2d20 0x7f6c180cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:31.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1d16a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c1815e340 0x7f6c180b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:31.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1d16a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180d4b50 con 0x7f6c180d2d20 2024-06-02T23:58:31.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1d16a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1815e720 con 0x7f6c1815e340 2024-06-02T23:58:31.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1d16a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c180d4cd0 con 0x7f6c180b2f40 2024-06-02T23:58:31.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c180d2d20 0x7f6c180cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:31.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c180d2d20 0x7f6c180cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32866/0 (socket says 172.21.15.96:32866) 2024-06-02T23:58:31.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1659c640 1 -- 172.21.15.96:0/1715135210 learned_addr learned my addr 172.21.15.96:0/1715135210 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:31.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1759e640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c1815e340 0x7f6c180b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:31.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c16d9d640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c180b2f40 0x7f6c18150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:31.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1659c640 1 -- 172.21.15.96:0/1715135210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c180b2f40 msgr2=0x7f6c18150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:31.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1659c640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c180b2f40 0x7f6c18150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:31.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1659c640 1 -- 172.21.15.96:0/1715135210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c1815e340 msgr2=0x7f6c180b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:31.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1659c640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c1815e340 0x7f6c180b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:31.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1659c640 1 -- 172.21.15.96:0/1715135210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180cdc10 con 0x7f6c180d2d20 2024-06-02T23:58:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1759e640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c1815e340 0x7f6c180b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1659c640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c180d2d20 0x7f6c180cd6d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000c400 tx=0x7f6c0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c0f7fe640 1 -- 172.21.15.96:0/1715135210 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00017070 con 0x7f6c180d2d20 2024-06-02T23:58:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c0f7fe640 1 -- 172.21.15.96:0/1715135210 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c000052d0 con 0x7f6c180d2d20 2024-06-02T23:58:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1715135210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c180b40f0 con 0x7f6c180d2d20 2024-06-02T23:58:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c0f7fe640 1 -- 172.21.15.96:0/1715135210 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00003830 con 0x7f6c180d2d20 2024-06-02T23:58:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.025+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1715135210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c180b46b0 con 0x7f6c180d2d20 2024-06-02T23:58:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.027+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1715135210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c180cb0e0 con 0x7f6c180d2d20 2024-06-02T23:58:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.027+0000 7f6c0f7fe640 1 -- 172.21.15.96:0/1715135210 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f6c0001a070 con 0x7f6c180d2d20 2024-06-02T23:58:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.027+0000 7f6c0f7fe640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f6bf806c060 0x7f6bf806e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.028+0000 7f6c16d9d640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f6bf806c060 0x7f6bf806e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.028+0000 7f6c0f7fe640 1 -- 172.21.15.96:0/1715135210 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6716+0+0 (secure 0 0 0) 0x7f6c0008a900 con 0x7f6c180d2d20 2024-06-02T23:58:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.028+0000 7f6c16d9d640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f6bf806c060 0x7f6bf806e520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c10001560 tx=0x7f6c10009040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.032+0000 7f6c0f7fe640 1 -- 172.21.15.96:0/1715135210 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f6c00058cd0 con 0x7f6c180d2d20 2024-06-02T23:58:31.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.238+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1715135210 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir3", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f6c18073790 con 0x7f6bf806c060 2024-06-02T23:58:31.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.328+0000 7f6c0f7fe640 1 -- 172.21.15.96:0/1715135210 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f6c18073790 con 0x7f6bf806c060 2024-06-02T23:58:31.328 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule removed for path /snap_test_dir1/dir3 2024-06-02T23:58:31.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1715135210 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f6bf806c060 msgr2=0x7f6bf806e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:31.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f6bf806c060 0x7f6bf806e520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c10001560 tx=0x7f6c10009040 comp rx=0 tx=0).stop 2024-06-02T23:58:31.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1715135210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c180d2d20 msgr2=0x7f6c180cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:31.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c180d2d20 0x7f6c180cd6d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000c400 tx=0x7f6c0000c8c0 comp rx=0 tx=0).stop 2024-06-02T23:58:31.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1715135210 shutdown_connections 2024-06-02T23:58:31.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f6bf806c060 0x7f6bf806e520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:31.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c1815e340 0x7f6c180b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:31.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c180d2d20 0x7f6c180cd6d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:31.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 --2- 172.21.15.96:0/1715135210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c180b2f40 0x7f6c18150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:31.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1715135210 >> 172.21.15.96:0/1715135210 conn(0x7f6c180d4030 msgr2=0x7f6c180ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:31.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1715135210 shutdown_connections 2024-06-02T23:58:31.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:31.330+0000 7f6c1d16a640 1 -- 172.21.15.96:0/1715135210 wait complete. 2024-06-02T23:58:31.341 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2024-06-02T23:58:31.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.341 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2024-06-02T23:58:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:31.365 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:31.366 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:31.366 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:31.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.366 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_48_00_UTC) 2024-06-02T23:58:31.428 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:31.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.429 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_49_00_UTC) 2024-06-02T23:58:31.493 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:31.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.493 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_50_00_UTC) 2024-06-02T23:58:31.562 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:31.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.563 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_51_00_UTC) 2024-06-02T23:58:31.629 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:31.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.630 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_52_00_UTC) 2024-06-02T23:58:31.697 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:31.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.698 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_53_00_UTC) 2024-06-02T23:58:31.764 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:31.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.764 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_54_00_UTC) 2024-06-02T23:58:31.830 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:31.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.831 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_55_00_UTC) 2024-06-02T23:58:31.899 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:31.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.900 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_56_00_UTC) 2024-06-02T23:58:31.963 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:31.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:31.963 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_57_00_UTC) 2024-06-02T23:58:32.027 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:32.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:32.027 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-06-02-23_58_00_UTC) 2024-06-02T23:58:32.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:32.092 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2024-06-02T23:58:32.151 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir4 1m 2024-06-02T23:58:32.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.301+0000 7f9b516a5640 1 Processor -- start 2024-06-02T23:58:32.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.301+0000 7f9b516a5640 1 -- start start 2024-06-02T23:58:32.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.301+0000 7f9b516a5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9b4c06e380 0x7f9b4c06cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.301+0000 7f9b516a5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4c06d2e0 con 0x7f9b4c0ced40 2024-06-02T23:58:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.301+0000 7f9b516a5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4c06d5c0 con 0x7f9b4c143d70 2024-06-02T23:58:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.301+0000 7f9b516a5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f9b4c06d8a0 con 0x7f9b4c06e380 2024-06-02T23:58:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.301+0000 7f9b4a7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9b4c06e380 0x7f9b4c06cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.302+0000 7f9b4b7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9b4c0ced40 0x7f9b4c070f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:45468/0 (socket says 172.21.15.96:45468) 2024-06-02T23:58:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.302+0000 7f9b4b7fe640 1 -- 172.21.15.96:0/2090332564 learned_addr learned my addr 172.21.15.96:0/2090332564 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.302+0000 7f9b4a7fc640 1 -- 172.21.15.96:0/2090332564 >> v1:172.21.15.162:6789/0 conn(0x7f9b4c143d70 legacy=0x7f9b4c144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.302+0000 7f9b4a7fc640 1 -- 172.21.15.96:0/2090332564 >> v1:172.21.15.96:6789/0 conn(0x7f9b4c0ced40 legacy=0x7f9b4c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.302+0000 7f9b4a7fc640 1 -- 172.21.15.96:0/2090332564 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c06db80 con 0x7f9b4c06e380 2024-06-02T23:58:32.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.302+0000 7f9b49ffb640 1 -- 172.21.15.96:0/2090332564 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962310756 0 0) 0x7f9b4c06d2e0 con 0x7f9b4c0ced40 2024-06-02T23:58:32.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.302+0000 7f9b4a7fc640 1 --2- 172.21.15.96:0/2090332564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c06e380 0x7f9b4c06cd00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9b340097a0 tx=0x7f9b3402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7835d3b24e2de9 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:32.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.303+0000 7f9b49ffb640 1 -- 172.21.15.96:0/2090332564 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34037070 con 0x7f9b4c06e380 2024-06-02T23:58:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.303+0000 7f9b49ffb640 1 -- 172.21.15.96:0/2090332564 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3402ae50 con 0x7f9b4c06e380 2024-06-02T23:58:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.303+0000 7f9b49ffb640 1 -- 172.21.15.96:0/2090332564 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34032660 con 0x7f9b4c06e380 2024-06-02T23:58:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.303+0000 7f9b516a5640 1 -- 172.21.15.96:0/2090332564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c06e380 msgr2=0x7f9b4c06cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.303+0000 7f9b516a5640 1 --2- 172.21.15.96:0/2090332564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c06e380 0x7f9b4c06cd00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9b340097a0 tx=0x7f9b3402a140 comp rx=0 tx=0).stop 2024-06-02T23:58:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.303+0000 7f9b516a5640 1 -- 172.21.15.96:0/2090332564 shutdown_connections 2024-06-02T23:58:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.303+0000 7f9b516a5640 1 --2- 172.21.15.96:0/2090332564 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c06e380 0x7f9b4c06cd00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.303+0000 7f9b516a5640 1 -- 172.21.15.96:0/2090332564 >> 172.21.15.96:0/2090332564 conn(0x7f9b4c0b18a0 msgr2=0x7f9b4c0b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.303+0000 7f9b516a5640 1 -- 172.21.15.96:0/2090332564 shutdown_connections 2024-06-02T23:58:32.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.303+0000 7f9b516a5640 1 -- 172.21.15.96:0/2090332564 wait complete. 2024-06-02T23:58:32.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.304+0000 7f9b516a5640 1 Processor -- start 2024-06-02T23:58:32.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b516a5640 1 -- start start 2024-06-02T23:58:32.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b516a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c06e380 0x7f9b4c0aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b516a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c0ced40 0x7f9b4c071970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b516a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b4c143d70 0x7f9b4c071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b516a5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c0cf2f0 con 0x7f9b4c0ced40 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b516a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c0cf170 con 0x7f9b4c06e380 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b516a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9b4c0cf470 con 0x7f9b4c143d70 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b4a7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c0ced40 0x7f9b4c071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b4a7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c0ced40 0x7f9b4c071970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:32878/0 (socket says 172.21.15.96:32878) 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b4a7fc640 1 -- 172.21.15.96:0/2013298999 learned_addr learned my addr 172.21.15.96:0/2013298999 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.305+0000 7f9b4affd640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c06e380 0x7f9b4c0aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b4b7fe640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b4c143d70 0x7f9b4c071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b4a7fc640 1 -- 172.21.15.96:0/2013298999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b4c143d70 msgr2=0x7f9b4c071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b4a7fc640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b4c143d70 0x7f9b4c071eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:32.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b4a7fc640 1 -- 172.21.15.96:0/2013298999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c06e380 msgr2=0x7f9b4c0aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b4a7fc640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c06e380 0x7f9b4c0aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b4a7fc640 1 -- 172.21.15.96:0/2013298999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c0adc90 con 0x7f9b4c0ced40 2024-06-02T23:58:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b4a7fc640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c0ced40 0x7f9b4c071970 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9b340097a0 tx=0x7f9b340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b437fe640 1 -- 172.21.15.96:0/2013298999 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34042070 con 0x7f9b4c0ced40 2024-06-02T23:58:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b437fe640 1 -- 172.21.15.96:0/2013298999 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3403e670 con 0x7f9b4c0ced40 2024-06-02T23:58:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b516a5640 1 -- 172.21.15.96:0/2013298999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4c0adf70 con 0x7f9b4c0ced40 2024-06-02T23:58:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b437fe640 1 -- 172.21.15.96:0/2013298999 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34037040 con 0x7f9b4c0ced40 2024-06-02T23:58:32.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.306+0000 7f9b516a5640 1 -- 172.21.15.96:0/2013298999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4c0ae530 con 0x7f9b4c0ced40 2024-06-02T23:58:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.307+0000 7f9b516a5640 1 -- 172.21.15.96:0/2013298999 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b4c0683e0 con 0x7f9b4c0ced40 2024-06-02T23:58:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.308+0000 7f9b437fe640 1 -- 172.21.15.96:0/2013298999 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f9b34045070 con 0x7f9b4c0ced40 2024-06-02T23:58:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.308+0000 7f9b437fe640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9b2c06c030 0x7f9b2c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.308+0000 7f9b437fe640 1 -- 172.21.15.96:0/2013298999 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 7068+0+0 (secure 0 0 0) 0x7f9b340abf80 con 0x7f9b4c0ced40 2024-06-02T23:58:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.308+0000 7f9b4affd640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9b2c06c030 0x7f9b2c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:32.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.308+0000 7f9b4affd640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9b2c06c030 0x7f9b2c06e4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009f20 tx=0x7f9b3c0094d0 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:32.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.312+0000 7f9b437fe640 1 -- 172.21.15.96:0/2013298999 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f9b3407a260 con 0x7f9b4c0ced40 2024-06-02T23:58:32.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.510+0000 7f9b516a5640 1 -- 172.21.15.96:0/2013298999 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir4", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9b4c0b2490 con 0x7f9b2c06c030 2024-06-02T23:58:32.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.607+0000 7f9b437fe640 1 -- 172.21.15.96:0/2013298999 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f9b4c0b2490 con 0x7f9b2c06c030 2024-06-02T23:58:32.607 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule removed for path /snap_test_dir1/dir4 2024-06-02T23:58:32.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.608+0000 7f9b516a5640 1 -- 172.21.15.96:0/2013298999 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9b2c06c030 msgr2=0x7f9b2c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:32.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.608+0000 7f9b516a5640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9b2c06c030 0x7f9b2c06e4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009f20 tx=0x7f9b3c0094d0 comp rx=0 tx=0).stop 2024-06-02T23:58:32.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.608+0000 7f9b516a5640 1 -- 172.21.15.96:0/2013298999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c0ced40 msgr2=0x7f9b4c071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:32.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.608+0000 7f9b516a5640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c0ced40 0x7f9b4c071970 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9b340097a0 tx=0x7f9b340046c0 comp rx=0 tx=0).stop 2024-06-02T23:58:32.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.609+0000 7f9b516a5640 1 -- 172.21.15.96:0/2013298999 shutdown_connections 2024-06-02T23:58:32.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.609+0000 7f9b516a5640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f9b2c06c030 0x7f9b2c06e4f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:32.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.609+0000 7f9b516a5640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b4c143d70 0x7f9b4c071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:32.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.609+0000 7f9b516a5640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9b4c0ced40 0x7f9b4c071970 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:32.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.609+0000 7f9b516a5640 1 --2- 172.21.15.96:0/2013298999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b4c06e380 0x7f9b4c0aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:32.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.609+0000 7f9b516a5640 1 -- 172.21.15.96:0/2013298999 >> 172.21.15.96:0/2013298999 conn(0x7f9b4c0b18a0 msgr2=0x7f9b4c144150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:32.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.609+0000 7f9b516a5640 1 -- 172.21.15.96:0/2013298999 shutdown_connections 2024-06-02T23:58:32.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:32.609+0000 7f9b516a5640 1 -- 172.21.15.96:0/2013298999 wait complete. 2024-06-02T23:58:32.619 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2024-06-02T23:58:32.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:32.620 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2024-06-02T23:58:32.646 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:32.646 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:32.646 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:32.646 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:32.646 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:32.646 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:32.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:32.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:32.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:32.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:32.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:32.648 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:32.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:32.648 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_48_00_UTC) 2024-06-02T23:58:32.711 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:32.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:32.711 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_49_00_UTC) 2024-06-02T23:58:32.773 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:32.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:32.773 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_50_00_UTC) 2024-06-02T23:58:32.836 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:32.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:32.836 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_51_00_UTC) 2024-06-02T23:58:32.901 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:32.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:32.901 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_52_00_UTC) 2024-06-02T23:58:32.964 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:32.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:32.965 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_53_00_UTC) 2024-06-02T23:58:33.028 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:33.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:33.028 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_54_00_UTC) 2024-06-02T23:58:33.091 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:33.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:33.091 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_55_00_UTC) 2024-06-02T23:58:33.155 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:33.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:33.155 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_56_00_UTC) 2024-06-02T23:58:33.218 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:33.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:33.218 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_57_00_UTC) 2024-06-02T23:58:33.296 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:33.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:33.296 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-06-02-23_58_00_UTC) 2024-06-02T23:58:33.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:33.358 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2024-06-02T23:58:33.416 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir5 1m 2024-06-02T23:58:33.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.568+0000 7f2b0db89640 1 Processor -- start 2024-06-02T23:58:33.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.568+0000 7f2b0db89640 1 -- start start 2024-06-02T23:58:33.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b0db89640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 0x7f2b080ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:33.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b0db89640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b08071400 0x7f2b080cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:33.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b0db89640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b080b4730 con 0x7f2b08154f80 2024-06-02T23:58:33.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b0db89640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2b080ce870 con 0x7f2b08071400 2024-06-02T23:58:33.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b0db89640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b080b49a0 con 0x7f2b08070f80 2024-06-02T23:58:33.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b077fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2b08154f80 0x7f2b080b2ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50340/0 (socket says 172.21.15.96:50340) 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b077fe640 1 -- 172.21.15.96:0/36118294 learned_addr learned my addr 172.21.15.96:0/36118294 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b07fff640 1 --2- 172.21.15.96:0/36118294 >> v2:172.21.15.162:3300/0 conn(0x7f2b08071400 0x7f2b080cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b06ffd640 1 --2- 172.21.15.96:0/36118294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 0x7f2b080ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b067fc640 1 -- 172.21.15.96:0/36118294 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283959648 0 0) 0x7f2b080b4730 con 0x7f2b08154f80 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b067fc640 1 -- 172.21.15.96:0/36118294 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2af0003440 con 0x7f2b08154f80 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b067fc640 1 -- 172.21.15.96:0/36118294 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 894694309 0 0) 0x7f2af0003440 con 0x7f2b08154f80 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b07fff640 1 -- 172.21.15.96:0/36118294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 msgr2=0x7f2b080ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b07fff640 1 --2- 172.21.15.96:0/36118294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 0x7f2b080ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b07fff640 1 -- 172.21.15.96:0/36118294 >> v1:172.21.15.96:6789/0 conn(0x7f2b08154f80 legacy=0x7f2b080b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b07fff640 1 -- 172.21.15.96:0/36118294 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b080b4c80 con 0x7f2b08071400 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.569+0000 7f2b06ffd640 1 --2- 172.21.15.96:0/36118294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 0x7f2b080ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.570+0000 7f2b07fff640 1 --2- 172.21.15.96:0/36118294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b08071400 0x7f2b080cf240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009d90 tx=0x7f2b0002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cf6c2c344ffcd61 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.570+0000 7f2b067fc640 1 -- 172.21.15.96:0/36118294 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8001670 con 0x7f2b08071400 2024-06-02T23:58:33.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.570+0000 7f2b067fc640 1 -- 172.21.15.96:0/36118294 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b00007540 con 0x7f2b08071400 2024-06-02T23:58:33.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.570+0000 7f2b067fc640 1 -- 172.21.15.96:0/36118294 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00007910 con 0x7f2b08071400 2024-06-02T23:58:33.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.571+0000 7f2b0db89640 1 -- 172.21.15.96:0/36118294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b08071400 msgr2=0x7f2b080cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:33.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.571+0000 7f2b0db89640 1 --2- 172.21.15.96:0/36118294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b08071400 0x7f2b080cf240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009d90 tx=0x7f2b0002a5f0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.571+0000 7f2b0db89640 1 -- 172.21.15.96:0/36118294 shutdown_connections 2024-06-02T23:58:33.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.571+0000 7f2b0db89640 1 --2- 172.21.15.96:0/36118294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b08071400 0x7f2b080cf240 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.571+0000 7f2b0db89640 1 --2- 172.21.15.96:0/36118294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 0x7f2b080ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.571+0000 7f2b0db89640 1 -- 172.21.15.96:0/36118294 >> 172.21.15.96:0/36118294 conn(0x7f2b080b18a0 msgr2=0x7f2b080b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.571+0000 7f2b0db89640 1 -- 172.21.15.96:0/36118294 shutdown_connections 2024-06-02T23:58:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.571+0000 7f2b0db89640 1 -- 172.21.15.96:0/36118294 wait complete. 2024-06-02T23:58:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.572+0000 7f2b0db89640 1 Processor -- start 2024-06-02T23:58:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.572+0000 7f2b0db89640 1 -- start start 2024-06-02T23:58:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b0db89640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 0x7f2b0813d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b0db89640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b08071400 0x7f2b0815d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b0db89640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b08154f80 0x7f2b0815d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b0db89640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2b080ccb80 con 0x7f2b08154f80 2024-06-02T23:58:33.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b0db89640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b080cca00 con 0x7f2b08071400 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b0db89640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b080ccd00 con 0x7f2b08070f80 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b07fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b08154f80 0x7f2b0815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b07fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b08154f80 0x7f2b0815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56076/0 (socket says 172.21.15.96:56076) 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b07fff640 1 -- 172.21.15.96:0/2696550561 learned_addr learned my addr 172.21.15.96:0/2696550561 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b06ffd640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b08071400 0x7f2b0815d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b077fe640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 0x7f2b0813d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b07fff640 1 -- 172.21.15.96:0/2696550561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 msgr2=0x7f2b0813d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b07fff640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 0x7f2b0813d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b07fff640 1 -- 172.21.15.96:0/2696550561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b08071400 msgr2=0x7f2b0815d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b07fff640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b08071400 0x7f2b0815d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b07fff640 1 -- 172.21.15.96:0/2696550561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b08153860 con 0x7f2b08154f80 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.573+0000 7f2b07fff640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b08154f80 0x7f2b0815d950 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009eb0 tx=0x7f2b00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:33.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.574+0000 7f2aeffff640 1 -- 172.21.15.96:0/2696550561 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00040070 con 0x7f2b08154f80 2024-06-02T23:58:33.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.574+0000 7f2aeffff640 1 -- 172.21.15.96:0/2696550561 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b00031b40 con 0x7f2b08154f80 2024-06-02T23:58:33.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.574+0000 7f2aeffff640 1 -- 172.21.15.96:0/2696550561 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00007e90 con 0x7f2b08154f80 2024-06-02T23:58:33.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.574+0000 7f2b0db89640 1 -- 172.21.15.96:0/2696550561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b08153b40 con 0x7f2b08154f80 2024-06-02T23:58:33.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.574+0000 7f2b0db89640 1 -- 172.21.15.96:0/2696550561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b081512d0 con 0x7f2b08154f80 2024-06-02T23:58:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.575+0000 7f2b0db89640 1 -- 172.21.15.96:0/2696550561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b081514d0 con 0x7f2b08154f80 2024-06-02T23:58:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.575+0000 7f2aeffff640 1 -- 172.21.15.96:0/2696550561 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f2b00039040 con 0x7f2b08154f80 2024-06-02T23:58:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.575+0000 7f2aeffff640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2af406c030 0x7f2af406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.576+0000 7f2aeffff640 1 -- 172.21.15.96:0/2696550561 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 7116+0+0 (secure 0 0 0) 0x7f2b000acb50 con 0x7f2b08154f80 2024-06-02T23:58:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.576+0000 7f2b077fe640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2af406c030 0x7f2af406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:33.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.576+0000 7f2b077fe640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2af406c030 0x7f2af406e4f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2af8005880 tx=0x7f2af80057f0 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:33.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.580+0000 7f2aeffff640 1 -- 172.21.15.96:0/2696550561 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2b081514d0 con 0x7f2b08154f80 2024-06-02T23:58:33.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.790+0000 7f2b0db89640 1 -- 172.21.15.96:0/2696550561 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir5", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f2b0815cef0 con 0x7f2af406c030 2024-06-02T23:58:33.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.869+0000 7f2aeffff640 1 -- 172.21.15.96:0/2696550561 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f2b0815cef0 con 0x7f2af406c030 2024-06-02T23:58:33.869 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule removed for path /snap_test_dir1/dir5 2024-06-02T23:58:33.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 -- 172.21.15.96:0/2696550561 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2af406c030 msgr2=0x7f2af406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:33.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2af406c030 0x7f2af406e4f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2af8005880 tx=0x7f2af80057f0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 -- 172.21.15.96:0/2696550561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b08154f80 msgr2=0x7f2b0815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:33.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b08154f80 0x7f2b0815d950 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009eb0 tx=0x7f2b00004a40 comp rx=0 tx=0).stop 2024-06-02T23:58:33.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 -- 172.21.15.96:0/2696550561 shutdown_connections 2024-06-02T23:58:33.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2af406c030 0x7f2af406e4f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b08154f80 0x7f2b0815d950 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b08071400 0x7f2b0815d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 --2- 172.21.15.96:0/2696550561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b08070f80 0x7f2b0813d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:33.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 -- 172.21.15.96:0/2696550561 >> 172.21.15.96:0/2696550561 conn(0x7f2b080b18a0 msgr2=0x7f2b0814f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:33.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 -- 172.21.15.96:0/2696550561 shutdown_connections 2024-06-02T23:58:33.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:33.871+0000 7f2b0db89640 1 -- 172.21.15.96:0/2696550561 wait complete. 2024-06-02T23:58:33.883 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2024-06-02T23:58:33.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:33.883 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2024-06-02T23:58:33.906 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:33.906 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:33.907 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_01_UTC 2024-06-02T23:58:33.907 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:33.907 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:33.907 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:33.907 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:33.907 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:33.907 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:33.907 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:33.907 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:33.908 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:33.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:33.908 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_48_00_UTC) 2024-06-02T23:58:33.974 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:33.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:33.975 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_49_00_UTC) 2024-06-02T23:58:34.038 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_50_01_UTC 2024-06-02T23:58:34.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:34.038 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_50_01_UTC) 2024-06-02T23:58:34.103 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:34.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:34.104 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_51_00_UTC) 2024-06-02T23:58:34.167 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:34.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:34.167 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_52_00_UTC) 2024-06-02T23:58:34.230 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:34.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:34.231 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_53_00_UTC) 2024-06-02T23:58:34.307 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:34.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:34.308 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_54_00_UTC) 2024-06-02T23:58:34.371 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:34.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:34.371 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_55_00_UTC) 2024-06-02T23:58:34.434 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:34.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:34.435 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_56_00_UTC) 2024-06-02T23:58:34.499 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:34.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:34.499 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_57_00_UTC) 2024-06-02T23:58:34.562 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:34.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:34.562 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-06-02-23_58_00_UTC) 2024-06-02T23:58:34.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:34.636 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2024-06-02T23:58:34.694 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir6 1m 2024-06-02T23:58:34.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.836+0000 7fad5f6d6640 1 Processor -- start 2024-06-02T23:58:34.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.837+0000 7fad5f6d6640 1 -- start start 2024-06-02T23:58:34.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.837+0000 7fad5f6d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580cf450 0x7fad5806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.837+0000 7fad5f6d6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad5806d2e0 con 0x7fad58143d70 2024-06-02T23:58:34.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.837+0000 7fad5f6d6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad5806d5c0 con 0x7fad5806e380 2024-06-02T23:58:34.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.837+0000 7fad5f6d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fad5806d8a0 con 0x7fad580cf450 2024-06-02T23:58:34.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad5d472640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fad58143d70 0x7fad58144570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50352/0 (socket says 172.21.15.96:50352) 2024-06-02T23:58:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad5d472640 1 -- 172.21.15.96:0/911740238 learned_addr learned my addr 172.21.15.96:0/911740238 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2665864807 0 0) 0x7fad5806d2e0 con 0x7fad58143d70 2024-06-02T23:58:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad5dc73640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580cf450 0x7fad5806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad44003520 con 0x7fad58143d70 2024-06-02T23:58:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 415010184 0 0) 0x7fad44003520 con 0x7fad58143d70 2024-06-02T23:58:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580cf450 msgr2=0x7fad5806cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580cf450 0x7fad5806cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 >> v1:172.21.15.162:6789/0 conn(0x7fad5806e380 legacy=0x7fad580ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5806db80 con 0x7fad58143d70 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fad54001670 con 0x7fad58143d70 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 >> v1:172.21.15.96:6789/0 conn(0x7fad58143d70 legacy=0x7fad58144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad440039e0 0x7fad44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 0x7fad44004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580cf450 0x7fad44005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fad5806d8a0 con 0x7fad44004390 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad4400baa0 con 0x7fad440039e0 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fad4400bca0 con 0x7fad580cf450 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad5cc71640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 0x7fad44004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad5d472640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad440039e0 0x7fad44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad5dc73640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580cf450 0x7fad44005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad5cc71640 1 -- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580cf450 msgr2=0x7fad44005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:34.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad5cc71640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580cf450 0x7fad44005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad5cc71640 1 -- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad440039e0 msgr2=0x7fad44003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.838+0000 7fad5cc71640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad440039e0 0x7fad44003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.839+0000 7fad5cc71640 1 -- 172.21.15.96:0/911740238 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad44003520 con 0x7fad44004390 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.839+0000 7fad5cc71640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 0x7fad44004860 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fad48001860 tx=0x7fad44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81eef42d5607ecd4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.839+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48037070 con 0x7fad44004390 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.839+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4802abf0 con 0x7fad44004390 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.839+0000 7fad4ffff640 1 -- 172.21.15.96:0/911740238 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48001430 con 0x7fad44004390 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.840+0000 7fad5f6d6640 1 -- 172.21.15.96:0/911740238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 msgr2=0x7fad44004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.840+0000 7fad5f6d6640 1 --2- 172.21.15.96:0/911740238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 0x7fad44004860 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fad48001860 tx=0x7fad44005830 comp rx=0 tx=0).stop 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.840+0000 7fad5dc73640 1 -- 172.21.15.96:0/911740238 reap_dead start 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.840+0000 7fad5f6d6640 1 -- 172.21.15.96:0/911740238 shutdown_connections 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.840+0000 7fad5f6d6640 1 -- 172.21.15.96:0/911740238 >> 172.21.15.96:0/911740238 conn(0x7fad580b18a0 msgr2=0x7fad580b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.840+0000 7fad5f6d6640 1 -- 172.21.15.96:0/911740238 shutdown_connections 2024-06-02T23:58:34.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.840+0000 7fad5f6d6640 1 -- 172.21.15.96:0/911740238 wait complete. 2024-06-02T23:58:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.841+0000 7fad5f6d6640 1 Processor -- start 2024-06-02T23:58:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.841+0000 7fad5f6d6640 1 -- start start 2024-06-02T23:58:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5f6d6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 0x7fad5815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5f6d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580ad8d0 0x7fad580cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5f6d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad580ce170 0x7fad5815d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5f6d6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fad5806ce80 con 0x7fad44004390 2024-06-02T23:58:34.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5f6d6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad5806cd00 con 0x7fad580ce170 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5f6d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fad5806d000 con 0x7fad580ad8d0 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5d472640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 0x7fad5815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5d472640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 0x7fad5815a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56090/0 (socket says 172.21.15.96:56090) 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5d472640 1 -- 172.21.15.96:0/1152255883 learned_addr learned my addr 172.21.15.96:0/1152255883 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5dc73640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad580ce170 0x7fad5815d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5cc71640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580ad8d0 0x7fad580cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5d472640 1 -- 172.21.15.96:0/1152255883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580ad8d0 msgr2=0x7fad580cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5d472640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580ad8d0 0x7fad580cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5d472640 1 -- 172.21.15.96:0/1152255883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad580ce170 msgr2=0x7fad5815d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5d472640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad580ce170 0x7fad5815d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:34.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5d472640 1 -- 172.21.15.96:0/1152255883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad58141360 con 0x7fad44004390 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad5d472640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 0x7fad5815a850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fad540072c0 tx=0x7fad54007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.842+0000 7fad4dffb640 1 -- 172.21.15.96:0/1152255883 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad54001660 con 0x7fad44004390 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.843+0000 7fad4dffb640 1 -- 172.21.15.96:0/1152255883 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad54018070 con 0x7fad44004390 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.843+0000 7fad5f6d6640 1 -- 172.21.15.96:0/1152255883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad58141640 con 0x7fad44004390 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.843+0000 7fad4dffb640 1 -- 172.21.15.96:0/1152255883 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5400fb80 con 0x7fad44004390 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.843+0000 7fad5f6d6640 1 -- 172.21.15.96:0/1152255883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad58141c00 con 0x7fad44004390 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.844+0000 7fad5f6d6640 1 -- 172.21.15.96:0/1152255883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad58142040 con 0x7fad44004390 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.844+0000 7fad4dffb640 1 -- 172.21.15.96:0/1152255883 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7fad5400fd20 con 0x7fad44004390 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.844+0000 7fad4dffb640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fad3c06c200 0x7fad3c06e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.844+0000 7fad4dffb640 1 -- 172.21.15.96:0/1152255883 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 7132+0+0 (secure 0 0 0) 0x7fad5408b7b0 con 0x7fad44004390 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.844+0000 7fad5cc71640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fad3c06c200 0x7fad3c06e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:34.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.845+0000 7fad5cc71640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fad3c06c200 0x7fad3c06e6c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad48034000 tx=0x7fad48009030 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:34.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:34.849+0000 7fad4dffb640 1 -- 172.21.15.96:0/1152255883 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fad54059950 con 0x7fad44004390 2024-06-02T23:58:35.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.041+0000 7fad5f6d6640 1 -- 172.21.15.96:0/1152255883 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir6", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fad580683e0 con 0x7fad3c06c200 2024-06-02T23:58:35.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.114+0000 7fad4dffb640 1 -- 172.21.15.96:0/1152255883 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fad580683e0 con 0x7fad3c06c200 2024-06-02T23:58:35.114 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule removed for path /snap_test_dir1/dir6 2024-06-02T23:58:35.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 -- 172.21.15.96:0/1152255883 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fad3c06c200 msgr2=0x7fad3c06e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fad3c06c200 0x7fad3c06e6c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad48034000 tx=0x7fad48009030 comp rx=0 tx=0).stop 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 -- 172.21.15.96:0/1152255883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 msgr2=0x7fad5815a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 0x7fad5815a850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fad540072c0 tx=0x7fad54007780 comp rx=0 tx=0).stop 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 -- 172.21.15.96:0/1152255883 shutdown_connections 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fad3c06c200 0x7fad3c06e6c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad580ce170 0x7fad5815d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad580ad8d0 0x7fad580cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 --2- 172.21.15.96:0/1152255883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad44004390 0x7fad5815a850 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 -- 172.21.15.96:0/1152255883 >> 172.21.15.96:0/1152255883 conn(0x7fad580b18a0 msgr2=0x7fad580cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 -- 172.21.15.96:0/1152255883 shutdown_connections 2024-06-02T23:58:35.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:35.116+0000 7fad5f6d6640 1 -- 172.21.15.96:0/1152255883 wait complete. 2024-06-02T23:58:35.127 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2024-06-02T23:58:35.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.127 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2024-06-02T23:58:35.150 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:35.151 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:35.151 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:35.151 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:35.151 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:35.151 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:35.151 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:35.151 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:35.151 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:35.151 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:35.151 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:35.151 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:35.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.152 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_48_00_UTC) 2024-06-02T23:58:35.214 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:35.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.214 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_49_00_UTC) 2024-06-02T23:58:35.289 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:35.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.289 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_50_00_UTC) 2024-06-02T23:58:35.351 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:35.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.352 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_51_00_UTC) 2024-06-02T23:58:35.414 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:35.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.415 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_52_00_UTC) 2024-06-02T23:58:35.477 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:35.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.478 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_53_00_UTC) 2024-06-02T23:58:35.540 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:35.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.540 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_54_00_UTC) 2024-06-02T23:58:35.601 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:35.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.602 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_55_00_UTC) 2024-06-02T23:58:35.664 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:35.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.664 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_56_00_UTC) 2024-06-02T23:58:35.727 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:35.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.727 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_57_00_UTC) 2024-06-02T23:58:35.790 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:35.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.790 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-06-02-23_58_00_UTC) 2024-06-02T23:58:35.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:35.852 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2024-06-02T23:58:35.912 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir7 1m 2024-06-02T23:58:36.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.053+0000 7fa1b76a5640 1 Processor -- start 2024-06-02T23:58:36.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.054+0000 7fa1b76a5640 1 -- start start 2024-06-02T23:58:36.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.054+0000 7fa1b76a5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa1b00b2f40 0x7fa1b00d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:36.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.054+0000 7fa1b76a5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b00d4f30 con 0x7fa1b00d1070 2024-06-02T23:58:36.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.054+0000 7fa1b76a5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b00cede0 con 0x7fa1b015e340 2024-06-02T23:58:36.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.054+0000 7fa1b76a5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b00cf710 con 0x7fa1b00b2f40 2024-06-02T23:58:36.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.055+0000 7fa1b4c40640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa1b00b2f40 0x7fa1b00d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:36.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.055+0000 7fa1b5c42640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa1b00d1070 0x7fa1b00b0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50354/0 (socket says 172.21.15.96:50354) 2024-06-02T23:58:36.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.055+0000 7fa1b5c42640 1 -- 172.21.15.96:0/2388928520 learned_addr learned my addr 172.21.15.96:0/2388928520 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:36.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.055+0000 7fa1b4c40640 1 -- 172.21.15.96:0/2388928520 >> v1:172.21.15.162:6789/0 conn(0x7fa1b015e340 legacy=0x7fa1b00cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:36.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.055+0000 7fa1b4c40640 1 -- 172.21.15.96:0/2388928520 >> v1:172.21.15.96:6789/0 conn(0x7fa1b00d1070 legacy=0x7fa1b00b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:36.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.055+0000 7fa1affff640 1 -- 172.21.15.96:0/2388928520 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253847950 0 0) 0x7fa1b00d4f30 con 0x7fa1b00d1070 2024-06-02T23:58:36.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.055+0000 7fa1b4c40640 1 -- 172.21.15.96:0/2388928520 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b00cf0c0 con 0x7fa1b00b2f40 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1b4c40640 1 --2- 172.21.15.96:0/2388928520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 0x7fa1b00d2610 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa1a40097a0 tx=0x7fa1a402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1991f78015d866e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1affff640 1 -- 172.21.15.96:0/2388928520 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4037070 con 0x7fa1b00b2f40 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1affff640 1 -- 172.21.15.96:0/2388928520 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a402ae50 con 0x7fa1b00b2f40 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1affff640 1 -- 172.21.15.96:0/2388928520 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4032660 con 0x7fa1b00b2f40 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2388928520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 msgr2=0x7fa1b00d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1b76a5640 1 --2- 172.21.15.96:0/2388928520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 0x7fa1b00d2610 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa1a40097a0 tx=0x7fa1a402a140 comp rx=0 tx=0).stop 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2388928520 shutdown_connections 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1b76a5640 1 --2- 172.21.15.96:0/2388928520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 0x7fa1b00d2610 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2388928520 >> 172.21.15.96:0/2388928520 conn(0x7fa1b00d4030 msgr2=0x7fa1b00d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2388928520 shutdown_connections 2024-06-02T23:58:36.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.056+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2388928520 wait complete. 2024-06-02T23:58:36.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.057+0000 7fa1b76a5640 1 Processor -- start 2024-06-02T23:58:36.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.057+0000 7fa1b76a5640 1 -- start start 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b76a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 0x7fa1b01e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b76a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1b00d1070 0x7fa1b00cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b76a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1b015e340 0x7fa1b015c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b76a5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b00d4b50 con 0x7fa1b00b2f40 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b76a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b015e720 con 0x7fa1b00d1070 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b76a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b00d4cd0 con 0x7fa1b015e340 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b5441640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 0x7fa1b01e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b5441640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 0x7fa1b01e92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56114/0 (socket says 172.21.15.96:56114) 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b5441640 1 -- 172.21.15.96:0/2675993335 learned_addr learned my addr 172.21.15.96:0/2675993335 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b4c40640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1b00d1070 0x7fa1b00cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.058+0000 7fa1b5c42640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1b015e340 0x7fa1b015c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1b5441640 1 -- 172.21.15.96:0/2675993335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1b015e340 msgr2=0x7fa1b015c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1b5441640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1b015e340 0x7fa1b015c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:36.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1b5441640 1 -- 172.21.15.96:0/2675993335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1b00d1070 msgr2=0x7fa1b00cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1b5441640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1b00d1070 0x7fa1b00cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1b5441640 1 -- 172.21.15.96:0/2675993335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b00cd410 con 0x7fa1b00b2f40 2024-06-02T23:58:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1b5441640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 0x7fa1b01e92e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000b3f0 tx=0x7fa1a000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1adffb640 1 -- 172.21.15.96:0/2675993335 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0015020 con 0x7fa1b00b2f40 2024-06-02T23:58:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1adffb640 1 -- 172.21.15.96:0/2675993335 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a0011830 con 0x7fa1b00b2f40 2024-06-02T23:58:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2675993335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b015cb70 con 0x7fa1b00b2f40 2024-06-02T23:58:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1adffb640 1 -- 172.21.15.96:0/2675993335 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0011c20 con 0x7fa1b00b2f40 2024-06-02T23:58:36.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.059+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2675993335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b00cd6b0 con 0x7fa1b00b2f40 2024-06-02T23:58:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.060+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2675993335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b00683e0 con 0x7fa1b00b2f40 2024-06-02T23:58:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.060+0000 7fa1adffb640 1 -- 172.21.15.96:0/2675993335 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7fa1a0018020 con 0x7fa1b00b2f40 2024-06-02T23:58:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.061+0000 7fa1adffb640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa19c06c030 0x7fa19c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.061+0000 7fa1b4c40640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa19c06c030 0x7fa19c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.061+0000 7fa1adffb640 1 -- 172.21.15.96:0/2675993335 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6972+0+0 (secure 0 0 0) 0x7fa1a008b1d0 con 0x7fa1b00b2f40 2024-06-02T23:58:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.061+0000 7fa1b4c40640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa19c06c030 0x7fa19c06e4f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4034000 tx=0x7fa1a402e000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:36.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.065+0000 7fa1adffb640 1 -- 172.21.15.96:0/2675993335 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa1a001f030 con 0x7fa1b00b2f40 2024-06-02T23:58:36.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.270+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2675993335 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir7", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa1b00b9eb0 con 0x7fa19c06c030 2024-06-02T23:58:36.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.343+0000 7fa1adffb640 1 -- 172.21.15.96:0/2675993335 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fa1b00b9eb0 con 0x7fa19c06c030 2024-06-02T23:58:36.343 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule removed for path /snap_test_dir1/dir7 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2675993335 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa19c06c030 msgr2=0x7fa19c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa19c06c030 0x7fa19c06e4f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4034000 tx=0x7fa1a402e000 comp rx=0 tx=0).stop 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2675993335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 msgr2=0x7fa1b01e92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 0x7fa1b01e92e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000b3f0 tx=0x7fa1a000b8b0 comp rx=0 tx=0).stop 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2675993335 shutdown_connections 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fa19c06c030 0x7fa19c06e4f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1b015e340 0x7fa1b015c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1b00d1070 0x7fa1b00cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 --2- 172.21.15.96:0/2675993335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa1b00b2f40 0x7fa1b01e92e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2675993335 >> 172.21.15.96:0/2675993335 conn(0x7fa1b00d4030 msgr2=0x7fa1b006d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2675993335 shutdown_connections 2024-06-02T23:58:36.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:36.345+0000 7fa1b76a5640 1 -- 172.21.15.96:0/2675993335 wait complete. 2024-06-02T23:58:36.356 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2024-06-02T23:58:36.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.356 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:36.388 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:36.389 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:36.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.389 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_48_00_UTC) 2024-06-02T23:58:36.450 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:36.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.450 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_49_00_UTC) 2024-06-02T23:58:36.528 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:36.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.528 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_50_00_UTC) 2024-06-02T23:58:36.591 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:36.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.591 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_51_00_UTC) 2024-06-02T23:58:36.654 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:36.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.654 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_52_00_UTC) 2024-06-02T23:58:36.716 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:36.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.716 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_53_00_UTC) 2024-06-02T23:58:36.779 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:36.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.779 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_54_00_UTC) 2024-06-02T23:58:36.854 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:36.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.854 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_55_00_UTC) 2024-06-02T23:58:36.917 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:36.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.917 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_56_00_UTC) 2024-06-02T23:58:36.979 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:36.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:36.979 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_57_00_UTC) 2024-06-02T23:58:37.042 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:37.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:37.042 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-06-02-23_58_00_UTC) 2024-06-02T23:58:37.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:37.104 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2024-06-02T23:58:37.164 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir8 1m 2024-06-02T23:58:37.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.319+0000 7f2f1d9dc640 1 Processor -- start 2024-06-02T23:58:37.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.319+0000 7f2f1d9dc640 1 -- start start 2024-06-02T23:58:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.320+0000 7f2f1d9dc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2f180cf110 0x7f2f180cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.320+0000 7f2f1d9dc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2f180b33d0 0x7f2f180cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.320+0000 7f2f1d9dc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f180b2c40 con 0x7f2f180cc6f0 2024-06-02T23:58:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.320+0000 7f2f1d9dc640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2f180b2f40 con 0x7f2f180cf110 2024-06-02T23:58:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.320+0000 7f2f1d9dc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2f180cfa30 con 0x7f2f180b33d0 2024-06-02T23:58:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.320+0000 7f2f16ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2f180cf110 0x7f2f180cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.320+0000 7f2f16ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2f180cf110 0x7f2f180cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56120/0 (socket says 172.21.15.96:56120) 2024-06-02T23:58:37.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.320+0000 7f2f16ffd640 1 -- 172.21.15.96:0/1750827239 learned_addr learned my addr 172.21.15.96:0/1750827239 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:37.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.320+0000 7f2f16ffd640 1 -- 172.21.15.96:0/1750827239 >> v2:172.21.15.162:3300/0 conn(0x7f2f180b33d0 msgr2=0x7f2f180cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:37.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.320+0000 7f2f16ffd640 1 --2- 172.21.15.96:0/1750827239 >> v2:172.21.15.162:3300/0 conn(0x7f2f180b33d0 0x7f2f180cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:37.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.321+0000 7f2f16ffd640 1 -- 172.21.15.96:0/1750827239 >> v1:172.21.15.162:6789/0 conn(0x7f2f180cc6f0 legacy=0x7f2f1815fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:37.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.321+0000 7f2f16ffd640 1 -- 172.21.15.96:0/1750827239 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f18160580 con 0x7f2f180cf110 2024-06-02T23:58:37.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.321+0000 7f2f16ffd640 1 --2- 172.21.15.96:0/1750827239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cf110 0x7f2f180cf4f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2f180b5090 tx=0x7f2f0802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1544fc1472efb2e5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.321+0000 7f2f167fc640 1 -- 172.21.15.96:0/1750827239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08037070 con 0x7f2f180cf110 2024-06-02T23:58:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.321+0000 7f2f167fc640 1 -- 172.21.15.96:0/1750827239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f08032440 con 0x7f2f180cf110 2024-06-02T23:58:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.321+0000 7f2f167fc640 1 -- 172.21.15.96:0/1750827239 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08032810 con 0x7f2f180cf110 2024-06-02T23:58:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.322+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1750827239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cf110 msgr2=0x7f2f180cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.322+0000 7f2f1d9dc640 1 --2- 172.21.15.96:0/1750827239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cf110 0x7f2f180cf4f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2f180b5090 tx=0x7f2f0802a230 comp rx=0 tx=0).stop 2024-06-02T23:58:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.322+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1750827239 shutdown_connections 2024-06-02T23:58:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.322+0000 7f2f1d9dc640 1 --2- 172.21.15.96:0/1750827239 >> v2:172.21.15.162:3300/0 conn(0x7f2f180b33d0 0x7f2f180cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.322+0000 7f2f1d9dc640 1 --2- 172.21.15.96:0/1750827239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cf110 0x7f2f180cf4f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:37.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.322+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1750827239 >> 172.21.15.96:0/1750827239 conn(0x7f2f180b18a0 msgr2=0x7f2f180b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.322+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1750827239 shutdown_connections 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.322+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1750827239 wait complete. 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.323+0000 7f2f1d9dc640 1 Processor -- start 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.323+0000 7f2f1d9dc640 1 -- start start 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f1d9dc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f180b33d0 0x7f2f1815bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f1d9dc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cc6f0 0x7f2f18144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f1d9dc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f180cf110 0x7f2f1815eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f1d9dc640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2f18145d00 con 0x7f2f180cc6f0 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f1d9dc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2f18160b40 con 0x7f2f180b33d0 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f1d9dc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2f18145e80 con 0x7f2f180cf110 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f0ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cc6f0 0x7f2f18144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f0ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cc6f0 0x7f2f18144640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56126/0 (socket says 172.21.15.96:56126) 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f0ffff640 1 -- 172.21.15.96:0/1119321749 learned_addr learned my addr 172.21.15.96:0/1119321749 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:37.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f16ffd640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f180b33d0 0x7f2f1815bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f177fe640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f180cf110 0x7f2f1815eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f0ffff640 1 -- 172.21.15.96:0/1119321749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f180cf110 msgr2=0x7f2f1815eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f0ffff640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f180cf110 0x7f2f1815eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f0ffff640 1 -- 172.21.15.96:0/1119321749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f180b33d0 msgr2=0x7f2f1815bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:37.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f0ffff640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f180b33d0 0x7f2f1815bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f0ffff640 1 -- 172.21.15.96:0/1119321749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1813d740 con 0x7f2f180cc6f0 2024-06-02T23:58:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f16ffd640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f180b33d0 0x7f2f1815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.324+0000 7f2f0ffff640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cc6f0 0x7f2f18144640 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000c440 tx=0x7f2f0000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.325+0000 7f2f14ff9640 1 -- 172.21.15.96:0/1119321749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00017070 con 0x7f2f180cc6f0 2024-06-02T23:58:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.325+0000 7f2f14ff9640 1 -- 172.21.15.96:0/1119321749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f000035f0 con 0x7f2f180cc6f0 2024-06-02T23:58:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.325+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1119321749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1813da20 con 0x7f2f180cc6f0 2024-06-02T23:58:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.325+0000 7f2f14ff9640 1 -- 172.21.15.96:0/1119321749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f000039e0 con 0x7f2f180cc6f0 2024-06-02T23:58:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.325+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1119321749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1813dfe0 con 0x7f2f180cc6f0 2024-06-02T23:58:37.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.326+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1119321749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f180ceef0 con 0x7f2f180cc6f0 2024-06-02T23:58:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.326+0000 7f2f14ff9640 1 -- 172.21.15.96:0/1119321749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f2f0001a070 con 0x7f2f180cc6f0 2024-06-02T23:58:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.327+0000 7f2f14ff9640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2ef806c060 0x7f2ef806e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.327+0000 7f2f14ff9640 1 -- 172.21.15.96:0/1119321749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 7608+0+0 (secure 0 0 0) 0x7f2f0008ac60 con 0x7f2f180cc6f0 2024-06-02T23:58:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.327+0000 7f2f16ffd640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2ef806c060 0x7f2ef806e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:37.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.327+0000 7f2f16ffd640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2ef806c060 0x7f2ef806e520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f08034000 tx=0x7f2f0802e000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:37.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.331+0000 7f2f14ff9640 1 -- 172.21.15.96:0/1119321749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2f00058c20 con 0x7f2f180cc6f0 2024-06-02T23:58:37.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.524+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1119321749 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir8", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f2f18141770 con 0x7f2ef806c060 2024-06-02T23:58:37.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.611+0000 7f2f14ff9640 1 -- 172.21.15.96:0/1119321749 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f2f18141770 con 0x7f2ef806c060 2024-06-02T23:58:37.612 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule removed for path /snap_test_dir1/dir8 2024-06-02T23:58:37.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.613+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1119321749 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2ef806c060 msgr2=0x7f2ef806e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:37.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2ef806c060 0x7f2ef806e520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f08034000 tx=0x7f2f0802e000 comp rx=0 tx=0).stop 2024-06-02T23:58:37.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1119321749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cc6f0 msgr2=0x7f2f18144640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cc6f0 0x7f2f18144640 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000c440 tx=0x7f2f0000c900 comp rx=0 tx=0).stop 2024-06-02T23:58:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1119321749 shutdown_connections 2024-06-02T23:58:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f2ef806c060 0x7f2ef806e520 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f180cf110 0x7f2f1815eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f180cc6f0 0x7f2f18144640 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 --2- 172.21.15.96:0/1119321749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f180b33d0 0x7f2f1815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1119321749 >> 172.21.15.96:0/1119321749 conn(0x7f2f180b18a0 msgr2=0x7f2f1815e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1119321749 shutdown_connections 2024-06-02T23:58:37.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:37.614+0000 7f2f1d9dc640 1 -- 172.21.15.96:0/1119321749 wait complete. 2024-06-02T23:58:37.624 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2024-06-02T23:58:37.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:37.625 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2024-06-02T23:58:37.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:37.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:37.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:37.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:37.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:37.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:37.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:37.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:37.647 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:37.648 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:37.648 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:37.649 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:37.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:37.649 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_48_00_UTC) 2024-06-02T23:58:37.711 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:37.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:37.712 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_49_00_UTC) 2024-06-02T23:58:37.774 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:37.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:37.774 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_50_00_UTC) 2024-06-02T23:58:37.845 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:37.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:37.845 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_51_00_UTC) 2024-06-02T23:58:37.907 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:37.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:37.908 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_52_00_UTC) 2024-06-02T23:58:37.971 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:37.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:37.971 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_53_00_UTC) 2024-06-02T23:58:38.034 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:38.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:38.034 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_54_00_UTC) 2024-06-02T23:58:38.096 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:38.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:38.096 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_55_00_UTC) 2024-06-02T23:58:38.159 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:38.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:38.159 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_56_00_UTC) 2024-06-02T23:58:38.221 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:38.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:38.221 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_57_00_UTC) 2024-06-02T23:58:38.284 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:38.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:38.284 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-06-02-23_58_00_UTC) 2024-06-02T23:58:38.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:38.346 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2024-06-02T23:58:38.404 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir9 1m 2024-06-02T23:58:38.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.546+0000 7f3fe9553640 1 Processor -- start 2024-06-02T23:58:38.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.546+0000 7f3fe9553640 1 -- start start 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe9553640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3fe40cced0 0x7f3fe406e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe9553640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40cd2b0 0x7f3fe4147820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe9553640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3fe40cdc90 0x7f3fe40ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe9553640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe40ce630 con 0x7f3fe40cdc90 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe9553640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe4147d60 con 0x7f3fe40cced0 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe9553640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe406eff0 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe37fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3fe40cdc90 0x7f3fe40ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe37fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3fe40cdc90 0x7f3fe40ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56128/0 (socket says 172.21.15.96:56128) 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe37fe640 1 -- 172.21.15.96:0/848845753 learned_addr learned my addr 172.21.15.96:0/848845753 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe2ffd640 1 --2- 172.21.15.96:0/848845753 >> v2:172.21.15.162:3300/0 conn(0x7f3fe40cced0 0x7f3fe406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fda7fc640 1 --2- 172.21.15.96:0/848845753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40cd2b0 0x7f3fe4147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe37fe640 1 -- 172.21.15.96:0/848845753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40cd2b0 msgr2=0x7f3fe4147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:38.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe37fe640 1 --2- 172.21.15.96:0/848845753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40cd2b0 0x7f3fe4147820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe37fe640 1 -- 172.21.15.96:0/848845753 >> v2:172.21.15.162:3300/0 conn(0x7f3fe40cced0 msgr2=0x7f3fe406e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:38.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe37fe640 1 --2- 172.21.15.96:0/848845753 >> v2:172.21.15.162:3300/0 conn(0x7f3fe40cced0 0x7f3fe406e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe37fe640 1 -- 172.21.15.96:0/848845753 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe406f2d0 con 0x7f3fe40cdc90 2024-06-02T23:58:38.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fda7fc640 1 --2- 172.21.15.96:0/848845753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40cd2b0 0x7f3fe4147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:38.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.547+0000 7f3fe2ffd640 1 --2- 172.21.15.96:0/848845753 >> v2:172.21.15.162:3300/0 conn(0x7f3fe40cced0 0x7f3fe406e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:38.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.548+0000 7f3fe37fe640 1 --2- 172.21.15.96:0/848845753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cdc90 0x7f3fe40ce0f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4073a20 tx=0x7f3fdc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33df5618c79e66bc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:38.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.548+0000 7f3fe27fc640 1 -- 172.21.15.96:0/848845753 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc036070 con 0x7f3fe40cdc90 2024-06-02T23:58:38.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.548+0000 7f3fe27fc640 1 -- 172.21.15.96:0/848845753 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc031600 con 0x7f3fe40cdc90 2024-06-02T23:58:38.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.548+0000 7f3fe27fc640 1 -- 172.21.15.96:0/848845753 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0319d0 con 0x7f3fe40cdc90 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.549+0000 7f3fe9553640 1 -- 172.21.15.96:0/848845753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cdc90 msgr2=0x7f3fe40ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.549+0000 7f3fe9553640 1 --2- 172.21.15.96:0/848845753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cdc90 0x7f3fe40ce0f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4073a20 tx=0x7f3fdc02a610 comp rx=0 tx=0).stop 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.549+0000 7f3fe9553640 1 -- 172.21.15.96:0/848845753 shutdown_connections 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.549+0000 7f3fe9553640 1 --2- 172.21.15.96:0/848845753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cdc90 0x7f3fe40ce0f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.549+0000 7f3fe9553640 1 --2- 172.21.15.96:0/848845753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40cd2b0 0x7f3fe4147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.549+0000 7f3fe9553640 1 --2- 172.21.15.96:0/848845753 >> v2:172.21.15.162:3300/0 conn(0x7f3fe40cced0 0x7f3fe406e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.549+0000 7f3fe9553640 1 -- 172.21.15.96:0/848845753 >> 172.21.15.96:0/848845753 conn(0x7f3fe40b1c50 msgr2=0x7f3fe40b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.549+0000 7f3fe9553640 1 -- 172.21.15.96:0/848845753 shutdown_connections 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.549+0000 7f3fe9553640 1 -- 172.21.15.96:0/848845753 wait complete. 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.550+0000 7f3fe9553640 1 Processor -- start 2024-06-02T23:58:38.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.550+0000 7f3fe9553640 1 -- start start 2024-06-02T23:58:38.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fe9553640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40cced0 0x7f3fe4159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fe9553640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cd2b0 0x7f3fe40c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fe9553640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40cdc90 0x7f3fe40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fe9553640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe4161e20 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fe9553640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe406f890 con 0x7f3fe40cdc90 2024-06-02T23:58:38.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fe9553640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe4161fa0 con 0x7f3fe40cced0 2024-06-02T23:58:38.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fda7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cd2b0 0x7f3fe40c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fda7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cd2b0 0x7f3fe40c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56132/0 (socket says 172.21.15.96:56132) 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fda7fc640 1 -- 172.21.15.96:0/2471810314 learned_addr learned my addr 172.21.15.96:0/2471810314 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fe37fe640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40cdc90 0x7f3fe40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fda7fc640 1 -- 172.21.15.96:0/2471810314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40cced0 msgr2=0x7f3fe4159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fda7fc640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40cced0 0x7f3fe4159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fda7fc640 1 -- 172.21.15.96:0/2471810314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40cdc90 msgr2=0x7f3fe40c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fda7fc640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40cdc90 0x7f3fe40c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.551+0000 7f3fda7fc640 1 -- 172.21.15.96:0/2471810314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe40b0d40 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.552+0000 7f3fda7fc640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cd2b0 0x7f3fe40c8c70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00e810 tx=0x7f3fcc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.552+0000 7f3fdbfff640 1 -- 172.21.15.96:0/2471810314 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00f040 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.552+0000 7f3fdbfff640 1 -- 172.21.15.96:0/2471810314 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc004030 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.552+0000 7f3fe9553640 1 -- 172.21.15.96:0/2471810314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe40b1020 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.552+0000 7f3fdbfff640 1 -- 172.21.15.96:0/2471810314 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc004400 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.552+0000 7f3fe9553640 1 -- 172.21.15.96:0/2471810314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe40b15e0 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.553+0000 7f3fe9553640 1 -- 172.21.15.96:0/2471810314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe4161b50 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.553+0000 7f3fdbfff640 1 -- 172.21.15.96:0/2471810314 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f3fcc00c6d0 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.554+0000 7f3fdbfff640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3fc406c060 0x7f3fc406e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:38.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.554+0000 7f3fdbfff640 1 -- 172.21.15.96:0/2471810314 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 7036+0+0 (secure 0 0 0) 0x7f3fcc08b650 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.554+0000 7f3fe2ffd640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3fc406c060 0x7f3fc406e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:38.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.554+0000 7f3fe2ffd640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3fc406c060 0x7f3fc406e520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40096f0 tx=0x7f3fd4008040 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:38.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.558+0000 7f3fdbfff640 1 -- 172.21.15.96:0/2471810314 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3fe4161b50 con 0x7f3fe40cd2b0 2024-06-02T23:58:38.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.754+0000 7f3fe9553640 1 -- 172.21.15.96:0/2471810314 --> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir9", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f3fe40683e0 con 0x7f3fc406c060 2024-06-02T23:58:38.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.864+0000 7f3fdbfff640 1 -- 172.21.15.96:0/2471810314 <== mgr.5130 v2:172.21.15.96:6832/908493645 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f3fe40683e0 con 0x7f3fc406c060 2024-06-02T23:58:38.864 INFO:teuthology.orchestra.run.smithi096.stdout:Schedule removed for path /snap_test_dir1/dir9 2024-06-02T23:58:38.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 -- 172.21.15.96:0/2471810314 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3fc406c060 msgr2=0x7f3fc406e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3fc406c060 0x7f3fc406e520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40096f0 tx=0x7f3fd4008040 comp rx=0 tx=0).stop 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 -- 172.21.15.96:0/2471810314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cd2b0 msgr2=0x7f3fe40c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cd2b0 0x7f3fe40c8c70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00e810 tx=0x7f3fcc00ecd0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 -- 172.21.15.96:0/2471810314 shutdown_connections 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f3fc406c060 0x7f3fc406e520 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40cdc90 0x7f3fe40c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fe40cd2b0 0x7f3fe40c8c70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 --2- 172.21.15.96:0/2471810314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe40cced0 0x7f3fe4159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 -- 172.21.15.96:0/2471810314 >> 172.21.15.96:0/2471810314 conn(0x7f3fe40b1c50 msgr2=0x7f3fe415dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 -- 172.21.15.96:0/2471810314 shutdown_connections 2024-06-02T23:58:38.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:38.866+0000 7f3fe9553640 1 -- 172.21.15.96:0/2471810314 wait complete. 2024-06-02T23:58:38.877 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2024-06-02T23:58:38.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:38.877 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:38.904 INFO:teuthology.orchestra.run.smithi096.stdout:scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:38.905 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_48_00_UTC 2024-06-02T23:58:38.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:38.906 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_48_00_UTC) 2024-06-02T23:58:38.969 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_49_00_UTC 2024-06-02T23:58:38.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:38.970 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_49_00_UTC) 2024-06-02T23:58:39.033 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_50_00_UTC 2024-06-02T23:58:39.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:39.033 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_50_00_UTC) 2024-06-02T23:58:39.099 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_51_00_UTC 2024-06-02T23:58:39.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:39.099 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_51_00_UTC) 2024-06-02T23:58:39.161 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_52_00_UTC 2024-06-02T23:58:39.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:39.161 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_52_00_UTC) 2024-06-02T23:58:39.225 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_53_00_UTC 2024-06-02T23:58:39.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:39.225 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_53_00_UTC) 2024-06-02T23:58:39.287 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_54_00_UTC 2024-06-02T23:58:39.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:39.288 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_54_00_UTC) 2024-06-02T23:58:39.351 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_55_00_UTC 2024-06-02T23:58:39.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:39.352 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_55_00_UTC) 2024-06-02T23:58:39.414 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_56_00_UTC 2024-06-02T23:58:39.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:39.414 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_56_00_UTC) 2024-06-02T23:58:39.476 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_57_00_UTC 2024-06-02T23:58:39.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:39.476 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_57_00_UTC) 2024-06-02T23:58:39.538 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_58_00_UTC 2024-06-02T23:58:39.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:39.538 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-06-02-23_58_00_UTC) 2024-06-02T23:58:39.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:39.602 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2024-06-02T23:58:39.661 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-06-02T23:58:39.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.804+0000 7f20be9ee640 1 Processor -- start 2024-06-02T23:58:39.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.804+0000 7f20be9ee640 1 -- start start 2024-06-02T23:58:39.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20be9ee640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20b815e530 0x7f20b80cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:39.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20be9ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b80cb2a0 0x7f20b806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:39.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20be9ee640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b80723e0 con 0x7f20b806eb50 2024-06-02T23:58:39.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20be9ee640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f20b806efa0 con 0x7f20b815e530 2024-06-02T23:58:39.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20be9ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20b80cb7b0 con 0x7f20b80cb2a0 2024-06-02T23:58:39.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20b7fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20b815e530 0x7f20b80cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:39.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20b7fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f20b815e530 0x7f20b80cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56140/0 (socket says 172.21.15.96:56140) 2024-06-02T23:58:39.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20b7fff640 1 -- 172.21.15.96:0/3028947236 learned_addr learned my addr 172.21.15.96:0/3028947236 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:39.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20b77fe640 1 --2- 172.21.15.96:0/3028947236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b80cb2a0 0x7f20b806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:39.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20b7fff640 1 -- 172.21.15.96:0/3028947236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b80cb2a0 msgr2=0x7f20b806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:39.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20b7fff640 1 --2- 172.21.15.96:0/3028947236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b80cb2a0 0x7f20b806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:39.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20b7fff640 1 -- 172.21.15.96:0/3028947236 >> v1:172.21.15.162:6789/0 conn(0x7f20b806eb50 legacy=0x7f20b815ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:39.807 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.805+0000 7f20b7fff640 1 -- 172.21.15.96:0/3028947236 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b8072680 con 0x7f20b815e530 2024-06-02T23:58:39.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.806+0000 7f20b7fff640 1 --2- 172.21.15.96:0/3028947236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 0x7f20b80cad60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009870 tx=0x7f20a802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01f86ab6b0a2675 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:39.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.806+0000 7f20b6ffd640 1 -- 172.21.15.96:0/3028947236 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8037070 con 0x7f20b815e530 2024-06-02T23:58:39.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.806+0000 7f20b6ffd640 1 -- 172.21.15.96:0/3028947236 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a8032440 con 0x7f20b815e530 2024-06-02T23:58:39.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.806+0000 7f20b6ffd640 1 -- 172.21.15.96:0/3028947236 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8032810 con 0x7f20b815e530 2024-06-02T23:58:39.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.807+0000 7f20be9ee640 1 -- 172.21.15.96:0/3028947236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 msgr2=0x7f20b80cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:39.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.807+0000 7f20be9ee640 1 --2- 172.21.15.96:0/3028947236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 0x7f20b80cad60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009870 tx=0x7f20a802a130 comp rx=0 tx=0).stop 2024-06-02T23:58:39.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.807+0000 7f20be9ee640 1 -- 172.21.15.96:0/3028947236 shutdown_connections 2024-06-02T23:58:39.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.807+0000 7f20be9ee640 1 --2- 172.21.15.96:0/3028947236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b80cb2a0 0x7f20b806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:39.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.807+0000 7f20be9ee640 1 --2- 172.21.15.96:0/3028947236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 0x7f20b80cad60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:39.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.807+0000 7f20be9ee640 1 -- 172.21.15.96:0/3028947236 >> 172.21.15.96:0/3028947236 conn(0x7f20b80cfcb0 msgr2=0x7f20b80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:39.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.807+0000 7f20be9ee640 1 -- 172.21.15.96:0/3028947236 shutdown_connections 2024-06-02T23:58:39.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.807+0000 7f20be9ee640 1 -- 172.21.15.96:0/3028947236 wait complete. 2024-06-02T23:58:39.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.808+0000 7f20be9ee640 1 Processor -- start 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.808+0000 7f20be9ee640 1 -- start start 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20be9ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b806eb50 0x7f20b814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20be9ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20b80cb2a0 0x7f20b814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20be9ee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 0x7f20b81e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20be9ee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f20b80ce890 con 0x7f20b815e530 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20be9ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20b8072c40 con 0x7f20b80cb2a0 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20be9ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20b815e910 con 0x7f20b806eb50 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20bcf8b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 0x7f20b81e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20bcf8b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 0x7f20b81e7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56144/0 (socket says 172.21.15.96:56144) 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20bcf8b640 1 -- 172.21.15.96:0/1842276414 learned_addr learned my addr 172.21.15.96:0/1842276414 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20b77fe640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20b80cb2a0 0x7f20b814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.809+0000 7f20b7fff640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b806eb50 0x7f20b814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:39.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.810+0000 7f20bcf8b640 1 -- 172.21.15.96:0/1842276414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b806eb50 msgr2=0x7f20b814fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.810+0000 7f20bcf8b640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b806eb50 0x7f20b814fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.810+0000 7f20bcf8b640 1 -- 172.21.15.96:0/1842276414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20b80cb2a0 msgr2=0x7f20b814b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.810+0000 7f20bcf8b640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20b80cb2a0 0x7f20b814b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.810+0000 7f20bcf8b640 1 -- 172.21.15.96:0/1842276414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b815da40 con 0x7f20b815e530 2024-06-02T23:58:39.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.810+0000 7f20bcf8b640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 0x7f20b81e7cb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f20b000c6b0 tx=0x7f20b000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.817+0000 7f20b4ff9640 1 -- 172.21.15.96:0/1842276414 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0003b70 con 0x7f20b815e530 2024-06-02T23:58:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.817+0000 7f20b4ff9640 1 -- 172.21.15.96:0/1842276414 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b0003d30 con 0x7f20b815e530 2024-06-02T23:58:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.817+0000 7f20b4ff9640 1 -- 172.21.15.96:0/1842276414 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0005310 con 0x7f20b815e530 2024-06-02T23:58:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.817+0000 7f20be9ee640 1 -- 172.21.15.96:0/1842276414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b8152cb0 con 0x7f20b815e530 2024-06-02T23:58:39.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.817+0000 7f20be9ee640 1 -- 172.21.15.96:0/1842276414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b814ba60 con 0x7f20b815e530 2024-06-02T23:58:39.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.819+0000 7f20be9ee640 1 -- 172.21.15.96:0/1842276414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b80683e0 con 0x7f20b815e530 2024-06-02T23:58:39.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.819+0000 7f20b4ff9640 1 -- 172.21.15.96:0/1842276414 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) ==== 90686+0+0 (secure 0 0 0) 0x7f20b00054b0 con 0x7f20b815e530 2024-06-02T23:58:39.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.820+0000 7f20b4ff9640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20a406c030 0x7f20a406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:39.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.820+0000 7f20b4ff9640 1 -- 172.21.15.96:0/1842276414 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 7132+0+0 (secure 0 0 0) 0x7f20b008b5e0 con 0x7f20b815e530 2024-06-02T23:58:39.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.820+0000 7f20b7fff640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20a406c030 0x7f20a406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:39.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.821+0000 7f20b7fff640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20a406c030 0x7f20a406e4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f20a8034000 tx=0x7f20a802e000 comp rx=0 tx=0).ready entity=mgr.5130 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:39.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:39.829+0000 7f20b4ff9640 1 -- 172.21.15.96:0/1842276414 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f20b0059010 con 0x7f20b815e530 2024-06-02T23:58:40.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.075+0000 7f20be9ee640 1 -- 172.21.15.96:0/1842276414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) -- 0x7f20b80c32e0 con 0x7f20b815e530 2024-06-02T23:58:40.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.820+0000 7f20b4ff9640 1 -- 172.21.15.96:0/1842276414 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v14) ==== 93+0+0 (secure 0 0 0) 0x7f20b005d310 con 0x7f20b815e530 2024-06-02T23:58:40.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.824+0000 7f20be9ee640 1 -- 172.21.15.96:0/1842276414 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20a406c030 msgr2=0x7f20a406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:40.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.824+0000 7f20be9ee640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20a406c030 0x7f20a406e4f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f20a8034000 tx=0x7f20a802e000 comp rx=0 tx=0).stop 2024-06-02T23:58:40.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.824+0000 7f20be9ee640 1 -- 172.21.15.96:0/1842276414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 msgr2=0x7f20b81e7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:40.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.824+0000 7f20be9ee640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 0x7f20b81e7cb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f20b000c6b0 tx=0x7f20b000cb70 comp rx=0 tx=0).stop 2024-06-02T23:58:40.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.827+0000 7f20be9ee640 1 -- 172.21.15.96:0/1842276414 shutdown_connections 2024-06-02T23:58:40.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.827+0000 7f20be9ee640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f20a406c030 0x7f20a406e4f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:40.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.827+0000 7f20be9ee640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b815e530 0x7f20b81e7cb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:40.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.827+0000 7f20be9ee640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20b80cb2a0 0x7f20b814b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:40.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.827+0000 7f20be9ee640 1 --2- 172.21.15.96:0/1842276414 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20b806eb50 0x7f20b814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:40.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.827+0000 7f20be9ee640 1 -- 172.21.15.96:0/1842276414 >> 172.21.15.96:0/1842276414 conn(0x7f20b80cfcb0 msgr2=0x7f20b80cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:40.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.836+0000 7f20be9ee640 1 -- 172.21.15.96:0/1842276414 shutdown_connections 2024-06-02T23:58:40.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:40.836+0000 7f20be9ee640 1 -- 172.21.15.96:0/1842276414 wait complete. 2024-06-02T23:58:40.856 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T23:58:40.856 DEBUG:teuthology.orchestra.run.smithi096:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T23:58:40.926 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T23:58:40.965 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:40.965+0000 7fb16f621040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:58:40.974 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:40.974+0000 7f30d6d24040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T23:58:40.981 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T23:58:40.981 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T23:58:40.981 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:58:40.981 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:58:40.997 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T23:58:41.080 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:41.080+0000 7fb16f621040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:58:41.092 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:41.092+0000 7f30d6d24040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:58:41.126 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:41.126+0000 7fb16f621040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:58:41.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.141+0000 7f7b5a76a640 1 Processor -- start 2024-06-02T23:58:41.141 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:41.141+0000 7f30d6d24040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T23:58:41.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.141+0000 7f7b5a76a640 1 -- start start 2024-06-02T23:58:41.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.141+0000 7f7b5a76a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7b540b5510 0x7f7b540c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:41.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.141+0000 7f7b5a76a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b540d4a90 con 0x7f7b540d1120 2024-06-02T23:58:41.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.141+0000 7f7b5a76a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b540d4d70 con 0x7f7b54161900 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.141+0000 7f7b5a76a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7b540cf5c0 con 0x7f7b540b5510 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.142+0000 7f7b58d07640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7b540b5510 0x7f7b540c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.142+0000 7f7b58d07640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7b540b5510 0x7f7b540c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56164/0 (socket says 172.21.15.96:56164) 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.142+0000 7f7b537fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7b540d1120 0x7f7b540c7bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50382/0 (socket says 172.21.15.96:50382) 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.142+0000 7f7b58d07640 1 -- 172.21.15.96:0/2430882540 learned_addr learned my addr 172.21.15.96:0/2430882540 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.142+0000 7f7b58d07640 1 -- 172.21.15.96:0/2430882540 >> v1:172.21.15.162:6789/0 conn(0x7f7b54161900 legacy=0x7f7b540d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.142+0000 7f7b58d07640 1 -- 172.21.15.96:0/2430882540 >> v1:172.21.15.96:6789/0 conn(0x7f7b540d1120 legacy=0x7f7b540c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.142+0000 7f7b58d07640 1 -- 172.21.15.96:0/2430882540 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b540cf800 con 0x7f7b540b5510 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.142+0000 7f7b52ffd640 1 -- 172.21.15.96:0/2430882540 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156021112 0 0) 0x7f7b540d4a90 con 0x7f7b540d1120 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b58d07640 1 --2- 172.21.15.96:0/2430882540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 0x7f7b540c82d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009e50 tx=0x7f7b4c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3668b55f5079bd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b52ffd640 1 -- 172.21.15.96:0/2430882540 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c036070 con 0x7f7b540b5510 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b52ffd640 1 -- 172.21.15.96:0/2430882540 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b4c031600 con 0x7f7b540b5510 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b52ffd640 1 -- 172.21.15.96:0/2430882540 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c0319d0 con 0x7f7b540b5510 2024-06-02T23:58:41.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b5a76a640 1 -- 172.21.15.96:0/2430882540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 msgr2=0x7f7b540c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b5a76a640 1 --2- 172.21.15.96:0/2430882540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 0x7f7b540c82d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c009e50 tx=0x7f7b4c02a730 comp rx=0 tx=0).stop 2024-06-02T23:58:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b5a76a640 1 -- 172.21.15.96:0/2430882540 shutdown_connections 2024-06-02T23:58:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b5a76a640 1 --2- 172.21.15.96:0/2430882540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 0x7f7b540c82d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b5a76a640 1 -- 172.21.15.96:0/2430882540 >> 172.21.15.96:0/2430882540 conn(0x7f7b5409d3b0 msgr2=0x7f7b540d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b5a76a640 1 -- 172.21.15.96:0/2430882540 shutdown_connections 2024-06-02T23:58:41.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.143+0000 7f7b5a76a640 1 -- 172.21.15.96:0/2430882540 wait complete. 2024-06-02T23:58:41.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.145+0000 7f7b5a76a640 1 Processor -- start 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.145+0000 7f7b5a76a640 1 -- start start 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.145+0000 7f7b5a76a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 0x7f7b5415b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.145+0000 7f7b5a76a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b540d1120 0x7f7b54158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.145+0000 7f7b5a76a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b54161900 0x7f7b540c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.145+0000 7f7b5a76a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7b540d4780 con 0x7f7b540b5510 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.145+0000 7f7b5a76a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b540caf70 con 0x7f7b540d1120 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.145+0000 7f7b5a76a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b54161ce0 con 0x7f7b54161900 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b53fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 0x7f7b5415b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b53fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 0x7f7b5415b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56166/0 (socket says 172.21.15.96:56166) 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b53fff640 1 -- 172.21.15.96:0/1826511341 learned_addr learned my addr 172.21.15.96:0/1826511341 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b58d07640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b54161900 0x7f7b540c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:41.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b537fe640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b540d1120 0x7f7b54158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:41.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b53fff640 1 -- 172.21.15.96:0/1826511341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b54161900 msgr2=0x7f7b540c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b53fff640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b54161900 0x7f7b540c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b53fff640 1 -- 172.21.15.96:0/1826511341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b540d1120 msgr2=0x7f7b54158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b53fff640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b540d1120 0x7f7b54158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b53fff640 1 -- 172.21.15.96:0/1826511341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b540ccbc0 con 0x7f7b540b5510 2024-06-02T23:58:41.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b53fff640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 0x7f7b5415b690 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c400 tx=0x7f7b4400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:41.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b50ff9640 1 -- 172.21.15.96:0/1826511341 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44017070 con 0x7f7b540b5510 2024-06-02T23:58:41.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b50ff9640 1 -- 172.21.15.96:0/1826511341 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b440052d0 con 0x7f7b540b5510 2024-06-02T23:58:41.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b5a76a640 1 -- 172.21.15.96:0/1826511341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b540ccea0 con 0x7f7b540b5510 2024-06-02T23:58:41.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b50ff9640 1 -- 172.21.15.96:0/1826511341 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44003830 con 0x7f7b540b5510 2024-06-02T23:58:41.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.146+0000 7f7b5a76a640 1 -- 172.21.15.96:0/1826511341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b540cd460 con 0x7f7b540b5510 2024-06-02T23:58:41.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.147+0000 7f7b5a76a640 1 -- 172.21.15.96:0/1826511341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b540683e0 con 0x7f7b540b5510 2024-06-02T23:58:41.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.148+0000 7f7b50ff9640 1 -- 172.21.15.96:0/1826511341 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) ==== 90669+0+0 (secure 0 0 0) 0x7f7b4401a070 con 0x7f7b540b5510 2024-06-02T23:58:41.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.148+0000 7f7b50ff9640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f7b3406bfe0 0x7f7b3406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:41.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.148+0000 7f7b537fe640 1 -- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f7b3406bfe0 msgr2=0x7f7b3406e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:41.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.148+0000 7f7b50ff9640 1 -- 172.21.15.96:0/1826511341 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 7068+0+0 (secure 0 0 0) 0x7f7b4408a810 con 0x7f7b540b5510 2024-06-02T23:58:41.151 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.148+0000 7f7b537fe640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f7b3406bfe0 0x7f7b3406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:58:41.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.153+0000 7f7b50ff9640 1 -- 172.21.15.96:0/1826511341 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7b440584e0 con 0x7f7b540b5510 2024-06-02T23:58:41.329 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:41.329+0000 7fb16f621040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:58:41.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.346+0000 7f7b5a76a640 1 -- 172.21.15.96:0/1826511341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7b540d05e0 con 0x7f7b540b5510 2024-06-02T23:58:41.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.347+0000 7f7b50ff9640 1 -- 172.21.15.96:0/1826511341 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v55) ==== 80+0+352 (secure 0 0 0) 0x7f7b4405c7e0 con 0x7f7b540b5510 2024-06-02T23:58:41.348 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/3970369200 2024-06-03T23:47:37.584660+0000 2024-06-02T23:58:41.348 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/78106757 2024-06-03T23:47:37.584660+0000 2024-06-02T23:58:41.348 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6833/1776728888 2024-06-03T23:47:37.584660+0000 2024-06-02T23:58:41.348 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6832/1776728888 2024-06-03T23:47:37.584660+0000 2024-06-02T23:58:41.348 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/2390098734 2024-06-03T23:47:37.584660+0000 2024-06-02T23:58:41.349 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1293902884 2024-06-03T23:47:37.584660+0000 2024-06-02T23:58:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:listed 6 entries 2024-06-02T23:58:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b537fe640 1 -- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f7b3406bfe0 msgr2=0x7f7b3406e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b537fe640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f7b3406bfe0 0x7f7b3406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:58:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 -- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f7b3406bfe0 msgr2=0x7f7b3406e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:58:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f7b3406bfe0 0x7f7b3406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 -- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 msgr2=0x7f7b5415b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 0x7f7b5415b690 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c400 tx=0x7f7b4400c8c0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 -- 172.21.15.96:0/1826511341 shutdown_connections 2024-06-02T23:58:41.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f7b3406bfe0 0x7f7b3406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b54161900 0x7f7b540c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b540d1120 0x7f7b54158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 --2- 172.21.15.96:0/1826511341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b540b5510 0x7f7b5415b690 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 -- 172.21.15.96:0/1826511341 >> 172.21.15.96:0/1826511341 conn(0x7f7b5409d3b0 msgr2=0x7f7b5406c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 -- 172.21.15.96:0/1826511341 shutdown_connections 2024-06-02T23:58:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.349+0000 7f7b5a76a640 1 -- 172.21.15.96:0/1826511341 wait complete. 2024-06-02T23:58:41.354 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:41.354+0000 7f30d6d24040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T23:58:41.361 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2024-06-02T23:58:41.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:41.361 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-02T23:58:41.372 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:41.373+0000 7fb16f621040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:58:41.385 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[51215]: fuse finished with error 0 and tester_r 0 2024-06-02T23:58:41.387 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:58:41.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:41.387 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-02T23:58:41.401 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:41.401+0000 7f30d6d24040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T23:58:41.528 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T23:58:41.528 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:58:41.529 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:58:41.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056333,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16850 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T23:58:41.546 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T23:58:41.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:41.546 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-06-02T23:58:41.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:58:41.601 INFO:teuthology.orchestra.run.smithi162.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-06-02T23:58:41.601 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T23:58:41.601 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:58:41.601 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:58:41.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17530 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T23:58:41.617 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-06-02T23:58:41.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:41.618 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-06-02T23:58:41.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:58:41.673 INFO:teuthology.orchestra.run.smithi096.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-06-02T23:58:41.673 INFO:tasks.cephfs.mount:Terminating background process 2024-06-02T23:58:41.674 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:58:41.674 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:58:41.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056333,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16850 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T23:58:41.690 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T23:58:41.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:58:41.690 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-06-02T23:58:41.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T23:58:41.745 INFO:teuthology.orchestra.run.smithi162.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-06-02T23:58:41.745 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:58:41.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.849+0000 7ff43d342640 1 Processor -- start 2024-06-02T23:58:41.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.849+0000 7ff43d342640 1 -- start start 2024-06-02T23:58:41.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff43d342640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4380ced20 0x7ff4380b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:41.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff43d342640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4380ce2b0 con 0x7ff4380cfb70 2024-06-02T23:58:41.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff43d342640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4380cdd30 con 0x7ff43815c360 2024-06-02T23:58:41.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff43d342640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff4380cdfd0 con 0x7ff4380ced20 2024-06-02T23:58:41.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff4377fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff4380cfb70 0x7ff4380b1d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:50390/0 (socket says 172.21.15.96:50390) 2024-06-02T23:58:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff4377fe640 1 -- 172.21.15.96:0/2001805132 learned_addr learned my addr 172.21.15.96:0/2001805132 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff42ffff640 1 --2- 172.21.15.96:0/2001805132 >> v2:172.21.15.162:3300/0 conn(0x7ff4380ced20 0x7ff4380b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff4367fc640 1 -- 172.21.15.96:0/2001805132 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60229345 0 0) 0x7ff4380ce2b0 con 0x7ff4380cfb70 2024-06-02T23:58:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff4367fc640 1 -- 172.21.15.96:0/2001805132 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff424003520 con 0x7ff4380cfb70 2024-06-02T23:58:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff42ffff640 1 -- 172.21.15.96:0/2001805132 >> v1:172.21.15.162:6789/0 conn(0x7ff43815c360 legacy=0x7ff4380ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff42ffff640 1 -- 172.21.15.96:0/2001805132 >> v1:172.21.15.96:6789/0 conn(0x7ff4380cfb70 legacy=0x7ff4380b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.850+0000 7ff42ffff640 1 -- 172.21.15.96:0/2001805132 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4380d0070 con 0x7ff4380ced20 2024-06-02T23:58:41.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.851+0000 7ff42ffff640 1 --2- 172.21.15.96:0/2001805132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4380ced20 0x7ff4380b1810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff4200097a0 tx=0x7ff42002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2943ea01ae63e8c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:41.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.851+0000 7ff4367fc640 1 -- 172.21.15.96:0/2001805132 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff420037070 con 0x7ff4380ced20 2024-06-02T23:58:41.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.851+0000 7ff4367fc640 1 -- 172.21.15.96:0/2001805132 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff420032440 con 0x7ff4380ced20 2024-06-02T23:58:41.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.851+0000 7ff4367fc640 1 -- 172.21.15.96:0/2001805132 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42002ae60 con 0x7ff4380ced20 2024-06-02T23:58:41.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.852+0000 7ff43d342640 1 -- 172.21.15.96:0/2001805132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4380ced20 msgr2=0x7ff4380b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.852+0000 7ff43d342640 1 --2- 172.21.15.96:0/2001805132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4380ced20 0x7ff4380b1810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff4200097a0 tx=0x7ff42002a110 comp rx=0 tx=0).stop 2024-06-02T23:58:41.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.852+0000 7ff43d342640 1 -- 172.21.15.96:0/2001805132 shutdown_connections 2024-06-02T23:58:41.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.852+0000 7ff43d342640 1 --2- 172.21.15.96:0/2001805132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4380ced20 0x7ff4380b1810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.852+0000 7ff43d342640 1 -- 172.21.15.96:0/2001805132 >> 172.21.15.96:0/2001805132 conn(0x7ff4380d1d90 msgr2=0x7ff4380d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:41.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.852+0000 7ff43d342640 1 -- 172.21.15.96:0/2001805132 shutdown_connections 2024-06-02T23:58:41.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.852+0000 7ff43d342640 1 -- 172.21.15.96:0/2001805132 wait complete. 2024-06-02T23:58:41.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.853+0000 7ff43d342640 1 Processor -- start 2024-06-02T23:58:41.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.853+0000 7ff43d342640 1 -- start start 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff43d342640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4380ced20 0x7ff4380b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff43d342640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4380cfb70 0x7ff4380ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff43d342640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff43815c360 0x7ff4380cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff43d342640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff4380d2a30 con 0x7ff4380cfb70 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff43d342640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4380d28b0 con 0x7ff4380ced20 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff43d342640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4380d2bb0 con 0x7ff43815c360 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff42ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4380cfb70 0x7ff4380ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff42ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4380cfb70 0x7ff4380ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56178/0 (socket says 172.21.15.96:56178) 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff42ffff640 1 -- 172.21.15.96:0/3108039706 learned_addr learned my addr 172.21.15.96:0/3108039706 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff436ffd640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4380ced20 0x7ff4380b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff4377fe640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff43815c360 0x7ff4380cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff42ffff640 1 -- 172.21.15.96:0/3108039706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff43815c360 msgr2=0x7ff4380cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.858 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff42ffff640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff43815c360 0x7ff4380cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff42ffff640 1 -- 172.21.15.96:0/3108039706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4380ced20 msgr2=0x7ff4380b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:41.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff42ffff640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4380ced20 0x7ff4380b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:41.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff42ffff640 1 -- 172.21.15.96:0/3108039706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4380b01f0 con 0x7ff4380cfb70 2024-06-02T23:58:41.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff42ffff640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4380cfb70 0x7ff4380ca710 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff4200098c0 tx=0x7ff4200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:41.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.854+0000 7ff42f7fe640 1 -- 172.21.15.96:0/3108039706 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff420037040 con 0x7ff4380cfb70 2024-06-02T23:58:41.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.855+0000 7ff42f7fe640 1 -- 172.21.15.96:0/3108039706 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff420030500 con 0x7ff4380cfb70 2024-06-02T23:58:41.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.855+0000 7ff43d342640 1 -- 172.21.15.96:0/3108039706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4380b04d0 con 0x7ff4380cfb70 2024-06-02T23:58:41.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.855+0000 7ff42f7fe640 1 -- 172.21.15.96:0/3108039706 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4200308d0 con 0x7ff4380cfb70 2024-06-02T23:58:41.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.855+0000 7ff43d342640 1 -- 172.21.15.96:0/3108039706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4380c9f10 con 0x7ff4380cfb70 2024-06-02T23:58:41.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.856+0000 7ff43d342640 1 -- 172.21.15.96:0/3108039706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff438068af0 con 0x7ff4380cfb70 2024-06-02T23:58:41.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.856+0000 7ff42f7fe640 1 -- 172.21.15.96:0/3108039706 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) ==== 90669+0+0 (secure 0 0 0) 0x7ff420044020 con 0x7ff4380cfb70 2024-06-02T23:58:41.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.857+0000 7ff42f7fe640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff41806bfe0 0x7ff41806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:41.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.857+0000 7ff436ffd640 1 -- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff41806bfe0 msgr2=0x7ff41806e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:41.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.857+0000 7ff42f7fe640 1 -- 172.21.15.96:0/3108039706 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 7356+0+0 (secure 0 0 0) 0x7ff4200ab9e0 con 0x7ff4380cfb70 2024-06-02T23:58:41.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.857+0000 7ff436ffd640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff41806bfe0 0x7ff41806e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:58:41.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:41.861+0000 7ff42f7fe640 1 -- 172.21.15.96:0/3108039706 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff4200793d0 con 0x7ff4380cfb70 2024-06-02T23:58:41.871 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:41.871+0000 7fb16f621040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:58:41.904 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:41.904+0000 7f30d6d24040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T23:58:41.954 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:41.954+0000 7fb16f621040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:58:41.989 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:41.988+0000 7f30d6d24040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T23:58:41.996 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:41.996+0000 7fb16f621040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:58:42.033 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:42.030+0000 7f30d6d24040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T23:58:42.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.058+0000 7ff436ffd640 1 -- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff41806bfe0 msgr2=0x7ff41806e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:42.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.058+0000 7ff436ffd640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff41806bfe0 0x7ff41806e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:58:42.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.073+0000 7ff43d342640 1 -- 172.21.15.96:0/3108039706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4380d2310 con 0x7ff4380cfb70 2024-06-02T23:58:42.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.073+0000 7ff42f7fe640 1 -- 172.21.15.96:0/3108039706 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5181 (secure 0 0 0) 0x7ff42007d6d0 con 0x7ff4380cfb70 2024-06-02T23:58:42.075 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:42.075 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/980156426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":980156426},{"type":"v1","addr":"172.21.15.162:6833","nonce":980156426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1567915962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1567915962},{"type":"v1","addr":"172.21.15.162:6835","nonce":1567915962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2700846904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2700846904},{"type":"v1","addr":"172.21.15.96:6835","nonce":2700846904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:47:26.438755+0000","modified":"2024-06-02T23:47:28.444285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.96:6837/593845400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":593845400},{"type":"v1","addr":"172.21.15.96:6837","nonce":593845400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-06-02T23:58:42.075 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2024-06-02T23:58:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.075+0000 7ff43d342640 1 -- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff41806bfe0 msgr2=0x7ff41806e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:58:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.075+0000 7ff43d342640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff41806bfe0 0x7ff41806e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.075+0000 7ff43d342640 1 -- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4380cfb70 msgr2=0x7ff4380ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.075+0000 7ff43d342640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4380cfb70 0x7ff4380ca710 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff4200098c0 tx=0x7ff4200046c0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.075+0000 7ff43d342640 1 -- 172.21.15.96:0/3108039706 shutdown_connections 2024-06-02T23:58:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.076+0000 7ff43d342640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff41806bfe0 0x7ff41806e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.076+0000 7ff43d342640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff43815c360 0x7ff4380cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.076+0000 7ff43d342640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4380cfb70 0x7ff4380ca710 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.076+0000 7ff43d342640 1 --2- 172.21.15.96:0/3108039706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4380ced20 0x7ff4380b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.076+0000 7ff43d342640 1 -- 172.21.15.96:0/3108039706 >> 172.21.15.96:0/3108039706 conn(0x7ff4380d1d90 msgr2=0x7ff43806fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:42.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.076+0000 7ff43d342640 1 -- 172.21.15.96:0/3108039706 shutdown_connections 2024-06-02T23:58:42.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.076+0000 7ff43d342640 1 -- 172.21.15.96:0/3108039706 wait complete. 2024-06-02T23:58:42.087 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:58:42.156 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:42.156+0000 7fb16f621040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:58:42.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.190+0000 7fbfd0ab3640 1 Processor -- start 2024-06-02T23:58:42.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.190+0000 7fbfd0ab3640 1 -- start start 2024-06-02T23:58:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfd0ab3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbfcc161900 0x7fbfcc0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfd0ab3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfd0ab3640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfcc0d4a90 con 0x7fbfcc0b5510 2024-06-02T23:58:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfd0ab3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbfcc0cf5c0 con 0x7fbfcc161900 2024-06-02T23:58:42.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfd0ab3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbfcc0caf70 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfca59c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbfcc161900 0x7fbfcc0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfcad9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfca59c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbfcc161900 0x7fbfcc0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:54944/0 (socket says 172.21.15.96:54944) 2024-06-02T23:58:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfc9d9b640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fbfcc0b5510 0x7fbfcc0d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:45450/0 (socket says 172.21.15.96:45450) 2024-06-02T23:58:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfcad9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:54304/0 (socket says 172.21.15.96:54304) 2024-06-02T23:58:42.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfca59c640 1 -- 172.21.15.96:0/941055225 learned_addr learned my addr 172.21.15.96:0/941055225 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:42.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfca59c640 1 -- 172.21.15.96:0/941055225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 msgr2=0x7fbfcc0d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:42.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfca59c640 1 --2- 172.21.15.96:0/941055225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfca59c640 1 -- 172.21.15.96:0/941055225 >> v1:172.21.15.162:6789/0 conn(0x7fbfcc0b5510 legacy=0x7fbfcc0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfca59c640 1 -- 172.21.15.96:0/941055225 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfcc0d4d70 con 0x7fbfcc161900 2024-06-02T23:58:42.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.191+0000 7fbfcad9d640 1 --2- 172.21.15.96:0/941055225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:42.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.192+0000 7fbfca59c640 1 --2- 172.21.15.96:0/941055225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfcc161900 0x7fbfcc0d0a10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009870 tx=0x7fbfbc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=700441b18eda8cf4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:42.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.192+0000 7fbfc959a640 1 -- 172.21.15.96:0/941055225 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc037070 con 0x7fbfcc161900 2024-06-02T23:58:42.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.192+0000 7fbfc959a640 1 -- 172.21.15.96:0/941055225 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfbc032440 con 0x7fbfcc161900 2024-06-02T23:58:42.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.192+0000 7fbfc959a640 1 -- 172.21.15.96:0/941055225 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc032810 con 0x7fbfcc161900 2024-06-02T23:58:42.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.193+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/941055225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfcc161900 msgr2=0x7fbfcc0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.193+0000 7fbfd0ab3640 1 --2- 172.21.15.96:0/941055225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfcc161900 0x7fbfcc0d0a10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009870 tx=0x7fbfbc02a270 comp rx=0 tx=0).stop 2024-06-02T23:58:42.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.193+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/941055225 shutdown_connections 2024-06-02T23:58:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.193+0000 7fbfd0ab3640 1 --2- 172.21.15.96:0/941055225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.193+0000 7fbfd0ab3640 1 --2- 172.21.15.96:0/941055225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfcc161900 0x7fbfcc0d0a10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.193+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/941055225 >> 172.21.15.96:0/941055225 conn(0x7fbfcc09d3b0 msgr2=0x7fbfcc0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.193+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/941055225 shutdown_connections 2024-06-02T23:58:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.193+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/941055225 wait complete. 2024-06-02T23:58:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.194+0000 7fbfd0ab3640 1 Processor -- start 2024-06-02T23:58:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.194+0000 7fbfd0ab3640 1 -- start start 2024-06-02T23:58:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfd0ab3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfd0ab3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfcc0b5510 0x7fbfcc1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfd0ab3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfcc161900 0x7fbfcc147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfd0ab3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc0d4780 con 0x7fbfcc161900 2024-06-02T23:58:42.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfd0ab3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc0cfae0 con 0x7fbfcc0b5510 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfd0ab3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbfcc161ce0 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfcad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfcc161900 0x7fbfcc147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfca59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfcad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfcc161900 0x7fbfcc147cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56182/0 (socket says 172.21.15.96:56182) 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfc9d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfcc0b5510 0x7fbfcc1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.195+0000 7fbfcad9d640 1 -- 172.21.15.96:0/317537576 learned_addr learned my addr 172.21.15.96:0/317537576 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfca59c640 1 -- 172.21.15.96:0/317537576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfcc0b5510 msgr2=0x7fbfcc1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfca59c640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfcc0b5510 0x7fbfcc1568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfca59c640 1 -- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfcc161900 msgr2=0x7fbfcc147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfca59c640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfcc161900 0x7fbfcc147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfca59c640 1 -- 172.21.15.96:0/317537576 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfcc148210 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfcad9d640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfcc161900 0x7fbfcc147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:42.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfca59c640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0c9d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc031000 tx=0x7fbfbc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfbaffd640 1 -- 172.21.15.96:0/317537576 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc041020 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfbaffd640 1 -- 172.21.15.96:0/317537576 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfbc030660 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/317537576 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfcc1484b0 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfbaffd640 1 -- 172.21.15.96:0/317537576 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc037040 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.196+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/317537576 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfcc148a70 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.197+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/317537576 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfcc0683e0 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.198+0000 7fbfbaffd640 1 -- 172.21.15.96:0/317537576 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 14) ==== 90669+0+0 (secure 0 0 0) 0x7fbfbc044020 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.198+0000 7fbfbaffd640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fbfac06c010 0x7fbfac06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.198+0000 7fbfc9d9b640 1 -- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fbfac06c010 msgr2=0x7fbfac06e4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.198+0000 7fbfbaffd640 1 -- 172.21.15.96:0/317537576 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(56..56 src has 1..56) ==== 7356+0+0 (secure 0 0 0) 0x7fbfbc0abdd0 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.204 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.198+0000 7fbfc9d9b640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fbfac06c010 0x7fbfac06e4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:58:42.205 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:42.203+0000 7fb16f621040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:58:42.205 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:42.202+0000 7f30d6d24040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T23:58:42.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.202+0000 7fbfbaffd640 1 -- 172.21.15.96:0/317537576 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbfbc04b030 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.252 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:42.251+0000 7f30d6d24040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T23:58:42.254 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:42.254+0000 7fb16f621040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:58:42.303 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:42.302+0000 7f30d6d24040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T23:58:42.365 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:42.365+0000 7fb16f621040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:58:42.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.399+0000 7fbfc9d9b640 1 -- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fbfac06c010 msgr2=0x7fbfac06e4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:42.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.399+0000 7fbfc9d9b640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fbfac06c010 0x7fbfac06e4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:58:42.416 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:42.416+0000 7f30d6d24040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T23:58:42.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.425+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/317537576 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfcc074ea0 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.426+0000 7fbfbaffd640 1 -- 172.21.15.96:0/317537576 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5181 (secure 0 0 0) 0x7fbfbc0ad070 con 0x7fbfcc0b4fa0 2024-06-02T23:58:42.426 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:42.427 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/980156426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":980156426},{"type":"v1","addr":"172.21.15.162:6833","nonce":980156426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1567915962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1567915962},{"type":"v1","addr":"172.21.15.162:6835","nonce":1567915962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2700846904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2700846904},{"type":"v1","addr":"172.21.15.96:6835","nonce":2700846904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:47:26.438755+0000","modified":"2024-06-02T23:47:28.444285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.96:6837/593845400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":593845400},{"type":"v1","addr":"172.21.15.96:6837","nonce":593845400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-06-02T23:58:42.427 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.428+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fbfac06c010 msgr2=0x7fbfac06e4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.428+0000 7fbfd0ab3640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fbfac06c010 0x7fbfac06e4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.428+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/317537576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 msgr2=0x7fbfcc0c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.428+0000 7fbfd0ab3640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0c9d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc031000 tx=0x7fbfbc0046c0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.429+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/317537576 shutdown_connections 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.429+0000 7fbfd0ab3640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fbfac06c010 0x7fbfac06e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.429+0000 7fbfd0ab3640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfcc161900 0x7fbfcc147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.429+0000 7fbfd0ab3640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfcc0b5510 0x7fbfcc1568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.429+0000 7fbfd0ab3640 1 --2- 172.21.15.96:0/317537576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfcc0b4fa0 0x7fbfcc0c9d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.429+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/317537576 >> 172.21.15.96:0/317537576 conn(0x7fbfcc09d3b0 msgr2=0x7fbfcc06d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:42.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.429+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/317537576 shutdown_connections 2024-06-02T23:58:42.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.429+0000 7fbfd0ab3640 1 -- 172.21.15.96:0/317537576 wait complete. 2024-06-02T23:58:42.440 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.543+0000 7f4c86b89640 1 Processor -- start 2024-06-02T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.543+0000 7f4c86b89640 1 -- start start 2024-06-02T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c86b89640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4c800d1120 0x7f4c800c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c86b89640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800b5510 0x7f4c800c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c86b89640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c800d4a90 con 0x7f4c80161900 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c86b89640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4c800cf5c0 con 0x7f4c800d1120 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c86b89640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c800caf70 con 0x7f4c800b5510 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c7ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4c800d1120 0x7f4c800c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c7ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4c800d1120 0x7f4c800c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56190/0 (socket says 172.21.15.96:56190) 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c7ffff640 1 -- 172.21.15.96:0/1969564230 learned_addr learned my addr 172.21.15.96:0/1969564230 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c85126640 1 --2- 172.21.15.96:0/1969564230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800b5510 0x7f4c800c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c7ffff640 1 -- 172.21.15.96:0/1969564230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800b5510 msgr2=0x7f4c800c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c7ffff640 1 --2- 172.21.15.96:0/1969564230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800b5510 0x7f4c800c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c7ffff640 1 -- 172.21.15.96:0/1969564230 >> v1:172.21.15.96:6789/0 conn(0x7f4c80161900 legacy=0x7f4c800d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.544+0000 7f4c7ffff640 1 -- 172.21.15.96:0/1969564230 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c800d4d70 con 0x7f4c800d1120 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.545+0000 7f4c7ffff640 1 --2- 172.21.15.96:0/1969564230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c800d1120 0x7f4c800c7bc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009870 tx=0x7f4c6c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f981086526bf937 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.545+0000 7f4c7f7fe640 1 -- 172.21.15.96:0/1969564230 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c037070 con 0x7f4c800d1120 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.545+0000 7f4c7f7fe640 1 -- 172.21.15.96:0/1969564230 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6c032440 con 0x7f4c800d1120 2024-06-02T23:58:42.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.545+0000 7f4c7f7fe640 1 -- 172.21.15.96:0/1969564230 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c032810 con 0x7f4c800d1120 2024-06-02T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.546+0000 7f4c86b89640 1 -- 172.21.15.96:0/1969564230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c800d1120 msgr2=0x7f4c800c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.546+0000 7f4c86b89640 1 --2- 172.21.15.96:0/1969564230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c800d1120 0x7f4c800c7bc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009870 tx=0x7f4c6c02a1c0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.546+0000 7f4c86b89640 1 -- 172.21.15.96:0/1969564230 shutdown_connections 2024-06-02T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.546+0000 7f4c86b89640 1 --2- 172.21.15.96:0/1969564230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800b5510 0x7f4c800c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.546+0000 7f4c86b89640 1 --2- 172.21.15.96:0/1969564230 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c800d1120 0x7f4c800c7bc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.546+0000 7f4c86b89640 1 -- 172.21.15.96:0/1969564230 >> 172.21.15.96:0/1969564230 conn(0x7f4c8009d3b0 msgr2=0x7f4c800d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.546+0000 7f4c86b89640 1 -- 172.21.15.96:0/1969564230 shutdown_connections 2024-06-02T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.546+0000 7f4c86b89640 1 -- 172.21.15.96:0/1969564230 wait complete. 2024-06-02T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.547+0000 7f4c86b89640 1 Processor -- start 2024-06-02T23:58:42.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.547+0000 7f4c86b89640 1 -- start start 2024-06-02T23:58:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c86b89640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800b5510 0x7f4c801569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c86b89640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c800d1120 0x7f4c800c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c86b89640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c80161900 0x7f4c800b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c86b89640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4c800d4780 con 0x7f4c80161900 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c86b89640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c800cfae0 con 0x7f4c800d1120 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c86b89640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c80161ce0 con 0x7f4c800b5510 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c85126640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c80161900 0x7f4c800b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c85126640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c80161900 0x7f4c800b8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56204/0 (socket says 172.21.15.96:56204) 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c85126640 1 -- 172.21.15.96:0/2703430008 learned_addr learned my addr 172.21.15.96:0/2703430008 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c84925640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800b5510 0x7f4c801569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c7ffff640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c800d1120 0x7f4c800c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c85126640 1 -- 172.21.15.96:0/2703430008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800b5510 msgr2=0x7f4c801569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c85126640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800b5510 0x7f4c801569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c85126640 1 -- 172.21.15.96:0/2703430008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c800d1120 msgr2=0x7f4c800c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c85126640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c800d1120 0x7f4c800c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c85126640 1 -- 172.21.15.96:0/2703430008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c801478b0 con 0x7f4c80161900 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.548+0000 7f4c85126640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c80161900 0x7f4c800b8c40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4c78007e40 tx=0x7f4c7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.549+0000 7f4c7d7fa640 1 -- 172.21.15.96:0/2703430008 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78014620 con 0x7f4c80161900 2024-06-02T23:58:42.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.549+0000 7f4c7d7fa640 1 -- 172.21.15.96:0/2703430008 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c78019070 con 0x7f4c80161900 2024-06-02T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.549+0000 7f4c86b89640 1 -- 172.21.15.96:0/2703430008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c80147b90 con 0x7f4c80161900 2024-06-02T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.549+0000 7f4c7d7fa640 1 -- 172.21.15.96:0/2703430008 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78014a20 con 0x7f4c80161900 2024-06-02T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.549+0000 7f4c86b89640 1 -- 172.21.15.96:0/2703430008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c80148150 con 0x7f4c80161900 2024-06-02T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.550+0000 7f4c86b89640 1 -- 172.21.15.96:0/2703430008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c800683e0 con 0x7f4c80161900 2024-06-02T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.551+0000 7f4c7d7fa640 1 -- 172.21.15.96:0/2703430008 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) ==== 90669+0+0 (secure 0 0 0) 0x7f4c78014bc0 con 0x7f4c80161900 2024-06-02T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.551+0000 7f4c7d7fa640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4c6406bfe0 0x7f4c6406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.551+0000 7f4c84925640 1 -- 172.21.15.96:0/2703430008 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4c6406bfe0 msgr2=0x7f4c6406e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.551+0000 7f4c7d7fa640 1 -- 172.21.15.96:0/2703430008 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 7356+0+0 (secure 0 0 0) 0x7f4c7808c000 con 0x7f4c80161900 2024-06-02T23:58:42.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.551+0000 7f4c84925640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4c6406bfe0 0x7f4c6406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:58:42.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.556+0000 7f4c7d7fa640 1 -- 172.21.15.96:0/2703430008 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4c780599e0 con 0x7f4c80161900 2024-06-02T23:58:42.683 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:42.683+0000 7fb16f621040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:58:42.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.737+0000 7f4c86b89640 1 -- 172.21.15.96:0/2703430008 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c800d19b0 con 0x7f4c80161900 2024-06-02T23:58:42.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.738+0000 7f4c7d7fa640 1 -- 172.21.15.96:0/2703430008 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+18796 (secure 0 0 0) 0x7f4c7805dce0 con 0x7f4c80161900 2024-06-02T23:58:42.739 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:42.739 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":56,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:58:41.794956+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:47:24.283901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T23:47:25.405802+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/3970369200":"2024-06-03T23:47:37.584660+0000","172.21.15.96:0/78106757":"2024-06-03T23:47:37.584660+0000","172.21.15.96:6833/1776728888":"2024-06-03T23:47:37.584660+0000","172.21.15.96:6832/1776728888":"2024-06-03T23:47:37.584660+0000","172.21.15.96:0/2390098734":"2024-06-03T23:47:37.584660+0000","172.21.15.96:0/1293902884":"2024-06-03T23:47:37.584660+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":12,"length":1},{"begin":16,"length":1},{"begin":22,"length":1},{"begin":26,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":43,"length":1},{"begin":47,"length":1},{"begin":54,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":64,"length":1},{"begin":68,"length":1},{"begin":71,"length":2},{"begin":75,"length":1},{"begin":79,"length":1},{"begin":83,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":94,"length":1},{"begin":97,"length":1},{"begin":101,"length":1},{"begin":105,"length":1},{"begin":108,"length":1},{"begin":194,"length":27}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":4,"length":2},{"begin":8,"length":2},{"begin":11,"length":1},{"begin":14,"length":2},{"begin":18,"length":2},{"begin":21,"length":1},{"begin":24,"length":2},{"begin":28,"length":2},{"begin":31,"length":2},{"begin":35,"length":2},{"begin":39,"length":2},{"begin":42,"length":1},{"begin":45,"length":2},{"begin":49,"length":2},{"begin":53,"length":1},{"begin":56,"length":2},{"begin":60,"length":1},{"begin":63,"length":1},{"begin":66,"length":2},{"begin":70,"length":1},{"begin":74,"length":1},{"begin":77,"length":2},{"begin":81,"length":2},{"begin":85,"length":1},{"begin":88,"length":2},{"begin":93,"length":1},{"begin":96,"length":1},{"begin":99,"length":2},{"begin":104,"length":1},{"begin":106,"length":2},{"begin":110,"length":2},{"begin":144,"length":50}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:58:42.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 -- 172.21.15.96:0/2703430008 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4c6406bfe0 msgr2=0x7f4c6406e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:58:42.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4c6406bfe0 0x7f4c6406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 -- 172.21.15.96:0/2703430008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c80161900 msgr2=0x7f4c800b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c80161900 0x7f4c800b8c40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4c78007e40 tx=0x7f4c7800e4b0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 -- 172.21.15.96:0/2703430008 shutdown_connections 2024-06-02T23:58:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f4c6406bfe0 0x7f4c6406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c80161900 0x7f4c800b8c40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c800d1120 0x7f4c800c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 --2- 172.21.15.96:0/2703430008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800b5510 0x7f4c801569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 -- 172.21.15.96:0/2703430008 >> 172.21.15.96:0/2703430008 conn(0x7f4c8009d3b0 msgr2=0x7f4c8006d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 -- 172.21.15.96:0/2703430008 shutdown_connections 2024-06-02T23:58:42.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.741+0000 7f4c86b89640 1 -- 172.21.15.96:0/2703430008 wait complete. 2024-06-02T23:58:42.751 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:42.751+0000 7f30d6d24040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T23:58:42.753 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T23:58:42.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:58:42.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.860+0000 7ff9e9aba640 1 Processor -- start 2024-06-02T23:58:42.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.860+0000 7ff9e9aba640 1 -- start start 2024-06-02T23:58:42.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.861+0000 7ff9e9aba640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff9e40b5510 0x7ff9e40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.861+0000 7ff9e9aba640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e40d4a90 con 0x7ff9e40d1120 2024-06-02T23:58:42.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.861+0000 7ff9e9aba640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e40d4d70 con 0x7ff9e4161900 2024-06-02T23:58:42.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.861+0000 7ff9e9aba640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e40cf5c0 con 0x7ff9e40b5510 2024-06-02T23:58:42.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.861+0000 7ff9e3fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff9e40b5510 0x7ff9e40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.861+0000 7ff9e3fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff9e40b5510 0x7ff9e40c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56216/0 (socket says 172.21.15.96:56216) 2024-06-02T23:58:42.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.861+0000 7ff9e3fff640 1 -- 172.21.15.96:0/1359537025 learned_addr learned my addr 172.21.15.96:0/1359537025 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:42.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.862+0000 7ff9e3fff640 1 -- 172.21.15.96:0/1359537025 >> v1:172.21.15.162:6789/0 conn(0x7ff9e4161900 legacy=0x7ff9e40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.862+0000 7ff9e3fff640 1 -- 172.21.15.96:0/1359537025 >> v1:172.21.15.96:6789/0 conn(0x7ff9e40d1120 legacy=0x7ff9e40c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.862+0000 7ff9e3fff640 1 -- 172.21.15.96:0/1359537025 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e40cf800 con 0x7ff9e40b5510 2024-06-02T23:58:42.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.863+0000 7ff9e3fff640 1 --2- 172.21.15.96:0/1359537025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e40b5510 0x7ff9e40c82d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009e50 tx=0x7ff9dc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d79bfc9d2583b77 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:42.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.863+0000 7ff9e2ffd640 1 -- 172.21.15.96:0/1359537025 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc036070 con 0x7ff9e40b5510 2024-06-02T23:58:42.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.863+0000 7ff9e2ffd640 1 -- 172.21.15.96:0/1359537025 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc031600 con 0x7ff9e40b5510 2024-06-02T23:58:42.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.863+0000 7ff9e2ffd640 1 -- 172.21.15.96:0/1359537025 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0319d0 con 0x7ff9e40b5510 2024-06-02T23:58:42.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.864+0000 7ff9e9aba640 1 -- 172.21.15.96:0/1359537025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e40b5510 msgr2=0x7ff9e40c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.864+0000 7ff9e9aba640 1 --2- 172.21.15.96:0/1359537025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e40b5510 0x7ff9e40c82d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009e50 tx=0x7ff9dc02a730 comp rx=0 tx=0).stop 2024-06-02T23:58:42.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.864+0000 7ff9e9aba640 1 -- 172.21.15.96:0/1359537025 shutdown_connections 2024-06-02T23:58:42.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.864+0000 7ff9e9aba640 1 --2- 172.21.15.96:0/1359537025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e40b5510 0x7ff9e40c82d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.864+0000 7ff9e9aba640 1 -- 172.21.15.96:0/1359537025 >> 172.21.15.96:0/1359537025 conn(0x7ff9e409d3b0 msgr2=0x7ff9e40d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:42.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.864+0000 7ff9e9aba640 1 -- 172.21.15.96:0/1359537025 shutdown_connections 2024-06-02T23:58:42.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.864+0000 7ff9e9aba640 1 -- 172.21.15.96:0/1359537025 wait complete. 2024-06-02T23:58:42.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.865+0000 7ff9e9aba640 1 Processor -- start 2024-06-02T23:58:42.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.865+0000 7ff9e9aba640 1 -- start start 2024-06-02T23:58:42.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.865+0000 7ff9e9aba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9e40b5510 0x7ff9e414d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.865+0000 7ff9e9aba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9e40d1120 0x7ff9e40cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.865+0000 7ff9e9aba640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e4161900 0x7ff9e40cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e9aba640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40d4780 con 0x7ff9e4161900 2024-06-02T23:58:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e9aba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40caf70 con 0x7ff9e40d1120 2024-06-02T23:58:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e9aba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e4161ce0 con 0x7ff9e40b5510 2024-06-02T23:58:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e4161900 0x7ff9e40cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e4161900 0x7ff9e40cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56222/0 (socket says 172.21.15.96:56222) 2024-06-02T23:58:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e3fff640 1 -- 172.21.15.96:0/2695411361 learned_addr learned my addr 172.21.15.96:0/2695411361 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9dbfff640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9e40d1120 0x7ff9e40cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e37fe640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9e40b5510 0x7ff9e414d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e3fff640 1 -- 172.21.15.96:0/2695411361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9e40b5510 msgr2=0x7ff9e414d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e3fff640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9e40b5510 0x7ff9e414d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e3fff640 1 -- 172.21.15.96:0/2695411361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9e40d1120 msgr2=0x7ff9e40cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e3fff640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9e40d1120 0x7ff9e40cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e3fff640 1 -- 172.21.15.96:0/2695411361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e414d9e0 con 0x7ff9e4161900 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e3fff640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e4161900 0x7ff9e40cb280 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009e50 tx=0x7ff9dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e0ff9640 1 -- 172.21.15.96:0/2695411361 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc036050 con 0x7ff9e4161900 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e0ff9640 1 -- 172.21.15.96:0/2695411361 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc042070 con 0x7ff9e4161900 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e9aba640 1 -- 172.21.15.96:0/2695411361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e4159640 con 0x7ff9e4161900 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.866+0000 7ff9e0ff9640 1 -- 172.21.15.96:0/2695411361 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc009510 con 0x7ff9e4161900 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.867+0000 7ff9e9aba640 1 -- 172.21.15.96:0/2695411361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e4159c00 con 0x7ff9e4161900 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.868+0000 7ff9e9aba640 1 -- 172.21.15.96:0/2695411361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e40683e0 con 0x7ff9e4161900 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.868+0000 7ff9e0ff9640 1 -- 172.21.15.96:0/2695411361 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) ==== 90669+0+0 (secure 0 0 0) 0x7ff9dc007bf0 con 0x7ff9e4161900 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.868+0000 7ff9e0ff9640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff9c406bfe0 0x7ff9c406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.868+0000 7ff9e37fe640 1 -- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff9c406bfe0 msgr2=0x7ff9c406e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.869+0000 7ff9e0ff9640 1 -- 172.21.15.96:0/2695411361 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6876+0+0 (secure 0 0 0) 0x7ff9dc0ac530 con 0x7ff9e4161900 2024-06-02T23:58:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.869+0000 7ff9e37fe640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff9c406bfe0 0x7ff9c406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:58:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:42.877+0000 7ff9e0ff9640 1 -- 172.21.15.96:0/2695411361 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff9dc079ff0 con 0x7ff9e4161900 2024-06-02T23:58:42.899 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:42.899+0000 7fb16f621040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:58:42.950 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:42.950+0000 7fb16f621040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:58:42.981 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:42.981+0000 7f30d6d24040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T23:58:43.037 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:43.037+0000 7f30d6d24040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T23:58:43.068 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:43.068+0000 7fb16f621040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:58:43.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.070+0000 7ff9e37fe640 1 -- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff9c406bfe0 msgr2=0x7ff9c406e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:43.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.070+0000 7ff9e37fe640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff9c406bfe0 0x7ff9c406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:58:43.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.102+0000 7ff9e9aba640 1 -- 172.21.15.96:0/2695411361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9e40d27d0 con 0x7ff9e4161900 2024-06-02T23:58:43.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.103+0000 7ff9e0ff9640 1 -- 172.21.15.96:0/2695411361 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5181 (secure 0 0 0) 0x7ff9dc07e2f0 con 0x7ff9e4161900 2024-06-02T23:58:43.103 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:43.103 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/980156426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":980156426},{"type":"v1","addr":"172.21.15.162:6833","nonce":980156426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1567915962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1567915962},{"type":"v1","addr":"172.21.15.162:6835","nonce":1567915962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2700846904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2700846904},{"type":"v1","addr":"172.21.15.96:6835","nonce":2700846904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:47:26.438755+0000","modified":"2024-06-02T23:47:28.444285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.96:6837/593845400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":593845400},{"type":"v1","addr":"172.21.15.96:6837","nonce":593845400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-06-02T23:58:43.103 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2024-06-02T23:58:43.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 -- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff9c406bfe0 msgr2=0x7ff9c406e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:58:43.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff9c406bfe0 0x7ff9c406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 -- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e4161900 msgr2=0x7ff9e40cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e4161900 0x7ff9e40cb280 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009e50 tx=0x7ff9dc004a40 comp rx=0 tx=0).stop 2024-06-02T23:58:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 -- 172.21.15.96:0/2695411361 shutdown_connections 2024-06-02T23:58:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff9c406bfe0 0x7ff9c406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9e4161900 0x7ff9e40cb280 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9e40d1120 0x7ff9e40cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 --2- 172.21.15.96:0/2695411361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9e40b5510 0x7ff9e414d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 -- 172.21.15.96:0/2695411361 >> 172.21.15.96:0/2695411361 conn(0x7ff9e409d3b0 msgr2=0x7ff9e40d1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 -- 172.21.15.96:0/2695411361 shutdown_connections 2024-06-02T23:58:43.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.105+0000 7ff9e9aba640 1 -- 172.21.15.96:0/2695411361 wait complete. 2024-06-02T23:58:43.117 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:58:43.157 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:43.157+0000 7f30d6d24040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T23:58:43.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.218+0000 7fde87dd5640 1 Processor -- start 2024-06-02T23:58:43.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.218+0000 7fde87dd5640 1 -- start start 2024-06-02T23:58:43.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde87dd5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fde800d1120 0x7fde800c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde87dd5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde800b5510 0x7fde800c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde87dd5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde800d4a90 con 0x7fde80161900 2024-06-02T23:58:43.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde87dd5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fde800cf5c0 con 0x7fde800d1120 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde87dd5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde800caf70 con 0x7fde800b5510 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde85b71640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fde80161900 0x7fde800d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:34818/0 (socket says 172.21.15.96:34818) 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde85b71640 1 -- 172.21.15.96:0/4266364727 learned_addr learned my addr 172.21.15.96:0/4266364727 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde85370640 1 --2- 172.21.15.96:0/4266364727 >> v2:172.21.15.162:3300/0 conn(0x7fde800d1120 0x7fde800c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde86372640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde800b5510 0x7fde800c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2328026298 0 0) 0x7fde800d4a90 con 0x7fde80161900 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde6c003520 con 0x7fde80161900 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2199841345 0 0) 0x7fde6c003520 con 0x7fde80161900 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde800b5510 msgr2=0x7fde800c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde800b5510 0x7fde800c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 >> v2:172.21.15.162:3300/0 conn(0x7fde800d1120 msgr2=0x7fde800c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 --2- 172.21.15.96:0/4266364727 >> v2:172.21.15.162:3300/0 conn(0x7fde800d1120 0x7fde800c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde800d4d70 con 0x7fde80161900 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fde7c001670 con 0x7fde80161900 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde86372640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde800b5510 0x7fde800c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 >> v1:172.21.15.96:6789/0 conn(0x7fde80161900 legacy=0x7fde800d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde6c0039b0 0x7fde6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde6c004800 0x7fde6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde800b5510 0x7fde6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fde800cf5c0 con 0x7fde6c0039b0 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde800caf70 con 0x7fde6c004800 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde6c00b9c0 con 0x7fde800b5510 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde85370640 1 --2- 172.21.15.96:0/4266364727 >> v2:172.21.15.162:3300/0 conn(0x7fde800d1120 0x7fde800c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.219+0000 7fde85b71640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde6c0039b0 0x7fde6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.220+0000 7fde86372640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde800b5510 0x7fde6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.220+0000 7fde85370640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde6c004800 0x7fde6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.220+0000 7fde85b71640 1 -- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde800b5510 msgr2=0x7fde6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.220+0000 7fde85b71640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde800b5510 0x7fde6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.220+0000 7fde85b71640 1 -- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde6c004800 msgr2=0x7fde6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.220+0000 7fde85b71640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde6c004800 0x7fde6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.220+0000 7fde85b71640 1 -- 172.21.15.96:0/4266364727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6c003520 con 0x7fde6c0039b0 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.220+0000 7fde85370640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde6c004800 0x7fde6c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.220+0000 7fde86372640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde800b5510 0x7fde6c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.220+0000 7fde85b71640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde6c0039b0 0x7fde6c003dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c290 tx=0x7fde6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a254409e0aa81e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.221+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c007d50 con 0x7fde6c0039b0 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.221+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7c005af0 con 0x7fde6c0039b0 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.221+0000 7fde84b6f640 1 -- 172.21.15.96:0/4266364727 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c007070 con 0x7fde6c0039b0 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.221+0000 7fde87dd5640 1 -- 172.21.15.96:0/4266364727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde6c0039b0 msgr2=0x7fde6c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.221+0000 7fde87dd5640 1 --2- 172.21.15.96:0/4266364727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde6c0039b0 0x7fde6c003dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c290 tx=0x7fde6c005830 comp rx=0 tx=0).stop 2024-06-02T23:58:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.221+0000 7fde86372640 1 -- 172.21.15.96:0/4266364727 reap_dead start 2024-06-02T23:58:43.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.221+0000 7fde87dd5640 1 -- 172.21.15.96:0/4266364727 shutdown_connections 2024-06-02T23:58:43.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.221+0000 7fde87dd5640 1 -- 172.21.15.96:0/4266364727 >> 172.21.15.96:0/4266364727 conn(0x7fde8009d3b0 msgr2=0x7fde800d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:43.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.221+0000 7fde87dd5640 1 -- 172.21.15.96:0/4266364727 shutdown_connections 2024-06-02T23:58:43.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.221+0000 7fde87dd5640 1 -- 172.21.15.96:0/4266364727 wait complete. 2024-06-02T23:58:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.222+0000 7fde87dd5640 1 Processor -- start 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde87dd5640 1 -- start start 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde87dd5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde6c0039b0 0x7fde800cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde87dd5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde800b8eb0 0x7fde801552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde87dd5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde800b9330 0x7fde80155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde87dd5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fde800d4780 con 0x7fde800b9330 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde87dd5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde800cfae0 con 0x7fde800b8eb0 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde87dd5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde80161ce0 con 0x7fde6c0039b0 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde86372640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde800b9330 0x7fde80155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde86372640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde800b9330 0x7fde80155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50292/0 (socket says 172.21.15.96:50292) 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde86372640 1 -- 172.21.15.96:0/3298693608 learned_addr learned my addr 172.21.15.96:0/3298693608 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde85b71640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde6c0039b0 0x7fde800cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.223+0000 7fde85370640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde800b8eb0 0x7fde801552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde86372640 1 -- 172.21.15.96:0/3298693608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde6c0039b0 msgr2=0x7fde800cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde86372640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde6c0039b0 0x7fde800cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde86372640 1 -- 172.21.15.96:0/3298693608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde800b8eb0 msgr2=0x7fde801552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde86372640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde800b8eb0 0x7fde801552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde86372640 1 -- 172.21.15.96:0/3298693608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde800ccc20 con 0x7fde800b9330 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde86372640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde800b9330 0x7fde80155830 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fde8008e7e0 tx=0x7fde780115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde767fc640 1 -- 172.21.15.96:0/3298693608 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78011e10 con 0x7fde800b9330 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde767fc640 1 -- 172.21.15.96:0/3298693608 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7801b070 con 0x7fde800b9330 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde767fc640 1 -- 172.21.15.96:0/3298693608 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78003990 con 0x7fde800b9330 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde87dd5640 1 -- 172.21.15.96:0/3298693608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde800ccf00 con 0x7fde800b9330 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.224+0000 7fde87dd5640 1 -- 172.21.15.96:0/3298693608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde800cd4c0 con 0x7fde800b9330 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.225+0000 7fde87dd5640 1 -- 172.21.15.96:0/3298693608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde800683e0 con 0x7fde800b9330 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.226+0000 7fde767fc640 1 -- 172.21.15.96:0/3298693608 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) ==== 90669+0+0 (secure 0 0 0) 0x7fde78005d10 con 0x7fde800b9330 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.226+0000 7fde767fc640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fde6406c010 0x7fde6406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.226+0000 7fde85b71640 1 -- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fde6406c010 msgr2=0x7fde6406e4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.226+0000 7fde767fc640 1 -- 172.21.15.96:0/3298693608 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6876+0+0 (secure 0 0 0) 0x7fde7808bc40 con 0x7fde800b9330 2024-06-02T23:58:43.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.226+0000 7fde85b71640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fde6406c010 0x7fde6406e4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:58:43.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.231+0000 7fde767fc640 1 -- 172.21.15.96:0/3298693608 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fde78025020 con 0x7fde800b9330 2024-06-02T23:58:43.336 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:43.336+0000 7fb16f621040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:58:43.379 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:43.380+0000 7fb16f621040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:58:43.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.427+0000 7fde85b71640 1 -- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fde6406c010 msgr2=0x7fde6406e4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:43.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.427+0000 7fde85b71640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fde6406c010 0x7fde6406e4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:58:43.438 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:43.438+0000 7f30d6d24040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T23:58:43.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.448+0000 7fde87dd5640 1 -- 172.21.15.96:0/3298693608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde800d05e0 con 0x7fde800b9330 2024-06-02T23:58:43.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.449+0000 7fde767fc640 1 -- 172.21.15.96:0/3298693608 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5181 (secure 0 0 0) 0x7fde78059700 con 0x7fde800b9330 2024-06-02T23:58:43.449 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:43.449 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/980156426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":980156426},{"type":"v1","addr":"172.21.15.162:6833","nonce":980156426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1567915962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1567915962},{"type":"v1","addr":"172.21.15.162:6835","nonce":1567915962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2700846904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2700846904},{"type":"v1","addr":"172.21.15.96:6835","nonce":2700846904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:47:26.438755+0000","modified":"2024-06-02T23:47:28.444285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.96:6837/593845400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":593845400},{"type":"v1","addr":"172.21.15.96:6837","nonce":593845400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4932,"qdb_cluster":[4932]},"id":2}]} 2024-06-02T23:58:43.449 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2024-06-02T23:58:43.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 -- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fde6406c010 msgr2=0x7fde6406e4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fde6406c010 0x7fde6406e4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 -- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde800b9330 msgr2=0x7fde80155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde800b9330 0x7fde80155830 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fde8008e7e0 tx=0x7fde780115a0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 -- 172.21.15.96:0/3298693608 shutdown_connections 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fde6406c010 0x7fde6406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde800b9330 0x7fde80155830 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde800b8eb0 0x7fde801552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 --2- 172.21.15.96:0/3298693608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde6c0039b0 0x7fde800cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 -- 172.21.15.96:0/3298693608 >> 172.21.15.96:0/3298693608 conn(0x7fde8009d3b0 msgr2=0x7fde8015d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 -- 172.21.15.96:0/3298693608 shutdown_connections 2024-06-02T23:58:43.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.451+0000 7fde87dd5640 1 -- 172.21.15.96:0/3298693608 wait complete. 2024-06-02T23:58:43.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:58:43.484 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:43.484+0000 7f30d6d24040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T23:58:43.520 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:43.520+0000 7fb16f621040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:58:43.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.585+0000 7ff0b7658640 1 Processor -- start 2024-06-02T23:58:43.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.585+0000 7ff0b7658640 1 -- start start 2024-06-02T23:58:43.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b7658640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff0b0161900 0x7ff0b00d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b7658640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0b00b4fa0 0x7ff0b00d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b7658640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b00d4a90 con 0x7ff0b00b5510 2024-06-02T23:58:43.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b7658640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b00cf5c0 con 0x7ff0b0161900 2024-06-02T23:58:43.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b7658640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b00caf70 con 0x7ff0b00b4fa0 2024-06-02T23:58:43.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b53f4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff0b0161900 0x7ff0b00d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b53f4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff0b0161900 0x7ff0b00d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50298/0 (socket says 172.21.15.96:50298) 2024-06-02T23:58:43.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b53f4640 1 -- 172.21.15.96:0/75947427 learned_addr learned my addr 172.21.15.96:0/75947427 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:43.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b5bf5640 1 --2- 172.21.15.96:0/75947427 >> v2:172.21.15.162:3300/0 conn(0x7ff0b00b4fa0 0x7ff0b00d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b53f4640 1 -- 172.21.15.96:0/75947427 >> v2:172.21.15.162:3300/0 conn(0x7ff0b00b4fa0 msgr2=0x7ff0b00d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:43.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b53f4640 1 --2- 172.21.15.96:0/75947427 >> v2:172.21.15.162:3300/0 conn(0x7ff0b00b4fa0 0x7ff0b00d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b53f4640 1 -- 172.21.15.96:0/75947427 >> v1:172.21.15.162:6789/0 conn(0x7ff0b00b5510 legacy=0x7ff0b00d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.586+0000 7ff0b53f4640 1 -- 172.21.15.96:0/75947427 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b00d4d70 con 0x7ff0b0161900 2024-06-02T23:58:43.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.587+0000 7ff0b53f4640 1 --2- 172.21.15.96:0/75947427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b0161900 0x7ff0b00d0a10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00d39c0 tx=0x7ff0ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916380d471b25b9a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.587+0000 7ff0a7fff640 1 -- 172.21.15.96:0/75947427 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac037070 con 0x7ff0b0161900 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.587+0000 7ff0a7fff640 1 -- 172.21.15.96:0/75947427 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac032440 con 0x7ff0b0161900 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.587+0000 7ff0a7fff640 1 -- 172.21.15.96:0/75947427 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac032810 con 0x7ff0b0161900 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.588+0000 7ff0b7658640 1 -- 172.21.15.96:0/75947427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b0161900 msgr2=0x7ff0b00d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.588+0000 7ff0b7658640 1 --2- 172.21.15.96:0/75947427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b0161900 0x7ff0b00d0a10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00d39c0 tx=0x7ff0ac02a1e0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.588+0000 7ff0b7658640 1 -- 172.21.15.96:0/75947427 shutdown_connections 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.588+0000 7ff0b7658640 1 --2- 172.21.15.96:0/75947427 >> v2:172.21.15.162:3300/0 conn(0x7ff0b00b4fa0 0x7ff0b00d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.588+0000 7ff0b7658640 1 --2- 172.21.15.96:0/75947427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b0161900 0x7ff0b00d0a10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.588+0000 7ff0b7658640 1 -- 172.21.15.96:0/75947427 >> 172.21.15.96:0/75947427 conn(0x7ff0b009d3b0 msgr2=0x7ff0b00d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.588+0000 7ff0b7658640 1 -- 172.21.15.96:0/75947427 shutdown_connections 2024-06-02T23:58:43.589 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.588+0000 7ff0b7658640 1 -- 172.21.15.96:0/75947427 wait complete. 2024-06-02T23:58:43.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.589+0000 7ff0b7658640 1 Processor -- start 2024-06-02T23:58:43.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.589+0000 7ff0b7658640 1 -- start start 2024-06-02T23:58:43.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b7658640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0b00b4fa0 0x7ff0b01f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.593 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b7658640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b00b5510 0x7ff0b01495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b7658640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0b0161900 0x7ff0b0149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b7658640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b00d4780 con 0x7ff0b00b5510 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b7658640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b00cfae0 con 0x7ff0b00b4fa0 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b7658640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b0161ce0 con 0x7ff0b0161900 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b4bf3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b00b5510 0x7ff0b01495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b4bf3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b00b5510 0x7ff0b01495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50314/0 (socket says 172.21.15.96:50314) 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b4bf3640 1 -- 172.21.15.96:0/1056917466 learned_addr learned my addr 172.21.15.96:0/1056917466 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b53f4640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0b00b4fa0 0x7ff0b01f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b5bf5640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0b0161900 0x7ff0b0149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b4bf3640 1 -- 172.21.15.96:0/1056917466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0b0161900 msgr2=0x7ff0b0149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b4bf3640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0b0161900 0x7ff0b0149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b4bf3640 1 -- 172.21.15.96:0/1056917466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0b00b4fa0 msgr2=0x7ff0b01f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b4bf3640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0b00b4fa0 0x7ff0b01f6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b4bf3640 1 -- 172.21.15.96:0/1056917466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b00cde30 con 0x7ff0b00b5510 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.590+0000 7ff0b4bf3640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b00b5510 0x7ff0b01495e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000c400 tx=0x7ff0a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.591+0000 7ff0a5ffb640 1 -- 172.21.15.96:0/1056917466 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00052d0 con 0x7ff0b00b5510 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.591+0000 7ff0a5ffb640 1 -- 172.21.15.96:0/1056917466 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a0005490 con 0x7ff0b00b5510 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.591+0000 7ff0a5ffb640 1 -- 172.21.15.96:0/1056917466 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0007260 con 0x7ff0b00b5510 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.591+0000 7ff0b7658640 1 -- 172.21.15.96:0/1056917466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b00b6bd0 con 0x7ff0b00b5510 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.591+0000 7ff0b7658640 1 -- 172.21.15.96:0/1056917466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b00b7470 con 0x7ff0b00b5510 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.592+0000 7ff0a5ffb640 1 -- 172.21.15.96:0/1056917466 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) ==== 90669+0+0 (secure 0 0 0) 0x7ff0a0007400 con 0x7ff0b00b5510 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.592+0000 7ff0b7658640 1 -- 172.21.15.96:0/1056917466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b00b6fc0 con 0x7ff0b00b5510 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.592+0000 7ff0a5ffb640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff09406bfe0 0x7ff09406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.593+0000 7ff0b53f4640 1 -- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff09406bfe0 msgr2=0x7ff09406e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.593+0000 7ff0a5ffb640 1 -- 172.21.15.96:0/1056917466 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6876+0+0 (secure 0 0 0) 0x7ff0a008ab50 con 0x7ff0b00b5510 2024-06-02T23:58:43.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.593+0000 7ff0b53f4640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff09406bfe0 0x7ff09406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:58:43.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.597+0000 7ff0a5ffb640 1 -- 172.21.15.96:0/1056917466 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7ff0a0058df0 con 0x7ff0b00b5510 2024-06-02T23:58:43.647 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:43.647+0000 7f30d6d24040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T23:58:43.651 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:43.651+0000 7fb16f621040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:58:43.699 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:43.699+0000 7fb16f621040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:58:43.751 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:43.751+0000 7fb16f621040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:58:43.783 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:43.783+0000 7f30d6d24040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T23:58:43.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.791+0000 7ff0b7658640 1 -- 172.21.15.96:0/1056917466 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0b00b6da0 con 0x7ff0b00b5510 2024-06-02T23:58:43.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.792+0000 7ff0a5ffb640 1 -- 172.21.15.96:0/1056917466 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+18075 (secure 0 0 0) 0x7ff0a00586f0 con 0x7ff0b00b5510 2024-06-02T23:58:43.793 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:43.793 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":57,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:58:42.796734+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:47:24.283901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-06-02T23:47:25.405802+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":57,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.24","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/3970369200":"2024-06-03T23:47:37.584660+0000","172.21.15.96:0/78106757":"2024-06-03T23:47:37.584660+0000","172.21.15.96:6833/1776728888":"2024-06-03T23:47:37.584660+0000","172.21.15.96:6832/1776728888":"2024-06-03T23:47:37.584660+0000","172.21.15.96:0/2390098734":"2024-06-03T23:47:37.584660+0000","172.21.15.96:0/1293902884":"2024-06-03T23:47:37.584660+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":12,"length":1},{"begin":16,"length":1},{"begin":22,"length":1},{"begin":26,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":43,"length":1},{"begin":47,"length":1},{"begin":54,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":64,"length":1},{"begin":68,"length":1},{"begin":71,"length":2},{"begin":75,"length":1},{"begin":79,"length":1},{"begin":83,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":94,"length":1},{"begin":97,"length":1},{"begin":101,"length":2},{"begin":105,"length":1},{"begin":108,"length":1},{"begin":194,"length":28}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":102,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:58:43.794 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:43.794+0000 7fb16f621040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:58:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.794+0000 7ff0b53f4640 1 -- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff09406bfe0 msgr2=0x7ff09406e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:43.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.794+0000 7ff0b53f4640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff09406bfe0 0x7ff09406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:58:43.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 -- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff09406bfe0 msgr2=0x7ff09406e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:58:43.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff09406bfe0 0x7ff09406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 -- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b00b5510 msgr2=0x7ff0b01495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b00b5510 0x7ff0b01495e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000c400 tx=0x7ff0a000c8c0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 -- 172.21.15.96:0/1056917466 shutdown_connections 2024-06-02T23:58:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7ff09406bfe0 0x7ff09406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0b0161900 0x7ff0b0149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0b00b5510 0x7ff0b01495e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 --2- 172.21.15.96:0/1056917466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0b00b4fa0 0x7ff0b01f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 -- 172.21.15.96:0/1056917466 >> 172.21.15.96:0/1056917466 conn(0x7ff0b009d3b0 msgr2=0x7ff0b006d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 -- 172.21.15.96:0/1056917466 shutdown_connections 2024-06-02T23:58:43.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.795+0000 7ff0b7658640 1 -- 172.21.15.96:0/1056917466 wait complete. 2024-06-02T23:58:43.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-02T23:58:43.837 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:43.837+0000 7f30d6d24040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T23:58:43.893 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:43.893+0000 7f30d6d24040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T23:58:43.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.910+0000 7fb11e28c640 1 Processor -- start 2024-06-02T23:58:43.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.910+0000 7fb11e28c640 1 -- start start 2024-06-02T23:58:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb11e28c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 0x7fb1180d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb11e28c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb1180b5510 0x7fb1180d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb11e28c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb1180b4fa0 0x7fb1180d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb11e28c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fb1180cf5c0 con 0x7fb1180b5510 2024-06-02T23:58:43.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb11e28c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb1180caf70 con 0x7fb1180b4fa0 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb11e28c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb1180d4a90 con 0x7fb118161900 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb10ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb1180b5510 0x7fb1180d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb10ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb1180b5510 0x7fb1180d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50324/0 (socket says 172.21.15.96:50324) 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb10ffff640 1 -- 172.21.15.96:0/1679251892 learned_addr learned my addr 172.21.15.96:0/1679251892 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb11c829640 1 --2- 172.21.15.96:0/1679251892 >> v2:172.21.15.162:3300/0 conn(0x7fb1180b4fa0 0x7fb1180d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb117fff640 1 --2- 172.21.15.96:0/1679251892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 0x7fb1180d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb10ffff640 1 -- 172.21.15.96:0/1679251892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 msgr2=0x7fb1180d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb10ffff640 1 --2- 172.21.15.96:0/1679251892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 0x7fb1180d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb10ffff640 1 -- 172.21.15.96:0/1679251892 >> v2:172.21.15.162:3300/0 conn(0x7fb1180b4fa0 msgr2=0x7fb1180d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb10ffff640 1 --2- 172.21.15.96:0/1679251892 >> v2:172.21.15.162:3300/0 conn(0x7fb1180b4fa0 0x7fb1180d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb10ffff640 1 -- 172.21.15.96:0/1679251892 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1180d4d70 con 0x7fb1180b5510 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb117fff640 1 --2- 172.21.15.96:0/1679251892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 0x7fb1180d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:43.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.911+0000 7fb11c829640 1 --2- 172.21.15.96:0/1679251892 >> v2:172.21.15.162:3300/0 conn(0x7fb1180b4fa0 0x7fb1180d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.912+0000 7fb10ffff640 1 --2- 172.21.15.96:0/1679251892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b5510 0x7fb1180d0f50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb1180ce650 tx=0x7fb10002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d231058c5805e835 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.912+0000 7fb1177fe640 1 -- 172.21.15.96:0/1679251892 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100037070 con 0x7fb1180b5510 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.912+0000 7fb1177fe640 1 -- 172.21.15.96:0/1679251892 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb100032440 con 0x7fb1180b5510 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.912+0000 7fb1177fe640 1 -- 172.21.15.96:0/1679251892 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100032810 con 0x7fb1180b5510 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.913+0000 7fb11e28c640 1 -- 172.21.15.96:0/1679251892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b5510 msgr2=0x7fb1180d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.913+0000 7fb11e28c640 1 --2- 172.21.15.96:0/1679251892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b5510 0x7fb1180d0f50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb1180ce650 tx=0x7fb10002a140 comp rx=0 tx=0).stop 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.913+0000 7fb11e28c640 1 -- 172.21.15.96:0/1679251892 shutdown_connections 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.913+0000 7fb11e28c640 1 --2- 172.21.15.96:0/1679251892 >> v2:172.21.15.162:3300/0 conn(0x7fb1180b4fa0 0x7fb1180d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.913+0000 7fb11e28c640 1 --2- 172.21.15.96:0/1679251892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b5510 0x7fb1180d0f50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.913+0000 7fb11e28c640 1 --2- 172.21.15.96:0/1679251892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 0x7fb1180d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.913+0000 7fb11e28c640 1 -- 172.21.15.96:0/1679251892 >> 172.21.15.96:0/1679251892 conn(0x7fb11809d3b0 msgr2=0x7fb1180d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:43.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.913+0000 7fb11e28c640 1 -- 172.21.15.96:0/1679251892 shutdown_connections 2024-06-02T23:58:43.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.913+0000 7fb11e28c640 1 -- 172.21.15.96:0/1679251892 wait complete. 2024-06-02T23:58:43.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.914+0000 7fb11e28c640 1 Processor -- start 2024-06-02T23:58:43.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.914+0000 7fb11e28c640 1 -- start start 2024-06-02T23:58:43.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb11e28c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b4fa0 0x7fb1180c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb11e28c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1180b5510 0x7fb11814b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb11e28c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 0x7fb11815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb11e28c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fb1180d4780 con 0x7fb1180b4fa0 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb11e28c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1180cfae0 con 0x7fb1180b5510 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb11e28c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb118161ce0 con 0x7fb118161900 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb117fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b4fa0 0x7fb1180c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb117fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b4fa0 0x7fb1180c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50326/0 (socket says 172.21.15.96:50326) 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb117fff640 1 -- 172.21.15.96:0/4211767402 learned_addr learned my addr 172.21.15.96:0/4211767402 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb11c829640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 0x7fb11815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb10ffff640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1180b5510 0x7fb11814b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb117fff640 1 -- 172.21.15.96:0/4211767402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 msgr2=0x7fb11815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb117fff640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 0x7fb11815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb117fff640 1 -- 172.21.15.96:0/4211767402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1180b5510 msgr2=0x7fb11814b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:43.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb117fff640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1180b5510 0x7fb11814b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb117fff640 1 -- 172.21.15.96:0/4211767402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11814df90 con 0x7fb1180b4fa0 2024-06-02T23:58:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb117fff640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b4fa0 0x7fb1180c9b60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb10800e990 tx=0x7fb10800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb1157fa640 1 -- 172.21.15.96:0/4211767402 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb108017070 con 0x7fb1180b4fa0 2024-06-02T23:58:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb1157fa640 1 -- 172.21.15.96:0/4211767402 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10800c940 con 0x7fb1180b4fa0 2024-06-02T23:58:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb11e28c640 1 -- 172.21.15.96:0/4211767402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1180cc330 con 0x7fb1180b4fa0 2024-06-02T23:58:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb1157fa640 1 -- 172.21.15.96:0/4211767402 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10800cd10 con 0x7fb1180b4fa0 2024-06-02T23:58:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.915+0000 7fb11e28c640 1 -- 172.21.15.96:0/4211767402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1180cc8f0 con 0x7fb1180b4fa0 2024-06-02T23:58:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.917+0000 7fb11e28c640 1 -- 172.21.15.96:0/4211767402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1180683e0 con 0x7fb1180b4fa0 2024-06-02T23:58:43.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.917+0000 7fb1157fa640 1 -- 172.21.15.96:0/4211767402 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) ==== 90669+0+0 (secure 0 0 0) 0x7fb10801a070 con 0x7fb1180b4fa0 2024-06-02T23:58:43.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.917+0000 7fb1157fa640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fb0f806bfe0 0x7fb0f806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:43.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.917+0000 7fb10ffff640 1 -- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fb0f806bfe0 msgr2=0x7fb0f806e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:43.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.918+0000 7fb1157fa640 1 -- 172.21.15.96:0/4211767402 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6876+0+0 (secure 0 0 0) 0x7fb10808b370 con 0x7fb1180b4fa0 2024-06-02T23:58:43.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.918+0000 7fb10ffff640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fb0f806bfe0 0x7fb0f806e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T23:58:43.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:43.922+0000 7fb1157fa640 1 -- 172.21.15.96:0/4211767402 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fb108058fc0 con 0x7fb1180b4fa0 2024-06-02T23:58:43.939 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:43.940+0000 7f30d6d24040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T23:58:44.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.119+0000 7fb10ffff640 1 -- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fb0f806bfe0 msgr2=0x7fb0f806e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6832/908493645 2024-06-02T23:58:44.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.119+0000 7fb10ffff640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fb0f806bfe0 0x7fb0f806e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T23:58:44.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.141+0000 7fb11e28c640 1 -- 172.21.15.96:0/4211767402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb1180d05e0 con 0x7fb1180b4fa0 2024-06-02T23:58:44.142 INFO:tasks.ceph.mon.a.smithi096.stderr:2024-06-02T23:58:44.142+0000 7f22ce064640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T23:58:44.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.143+0000 7fb1157fa640 1 -- 172.21.15.96:0/4211767402 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7fb10805d2c0 con 0x7fb1180b4fa0 2024-06-02T23:58:44.143 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-02T23:58:44.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 -- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fb0f806bfe0 msgr2=0x7fb0f806e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fb0f806bfe0 0x7fb0f806e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 -- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b4fa0 msgr2=0x7fb1180c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b4fa0 0x7fb1180c9b60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb10800e990 tx=0x7fb10800ed90 comp rx=0 tx=0).stop 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 -- 172.21.15.96:0/4211767402 shutdown_connections 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7fb0f806bfe0 0x7fb0f806e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb118161900 0x7fb11815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1180b5510 0x7fb11814b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 --2- 172.21.15.96:0/4211767402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1180b4fa0 0x7fb1180c9b60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 -- 172.21.15.96:0/4211767402 >> 172.21.15.96:0/4211767402 conn(0x7fb11809d3b0 msgr2=0x7fb118160b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 -- 172.21.15.96:0/4211767402 shutdown_connections 2024-06-02T23:58:44.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.146+0000 7fb11e28c640 1 -- 172.21.15.96:0/4211767402 wait complete. 2024-06-02T23:58:44.160 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-02T23:58:44.184 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2024-06-02T23:58:44.186 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:44.186+0000 7fb16f621040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:58:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.285+0000 7f118ec9e640 1 Processor -- start 2024-06-02T23:58:44.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.285+0000 7f118ec9e640 1 -- start start 2024-06-02T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118ec9e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11880b4640 0x7f11880b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118ec9e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11880b4b50 0x7f11880b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118ec9e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f11880d2630 0x7f11880d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118ec9e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f11880d4ff0 con 0x7f11880d2630 2024-06-02T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118ec9e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f11880b73e0 con 0x7f11880b4640 2024-06-02T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118ec9e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f11880cec60 con 0x7f11880b4b50 2024-06-02T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118d23b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f11880d2630 0x7f11880d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118d23b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f11880d2630 0x7f11880d2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50346/0 (socket says 172.21.15.96:50346) 2024-06-02T23:58:44.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118d23b640 1 -- 172.21.15.96:0/2913476189 learned_addr learned my addr 172.21.15.96:0/2913476189 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118d23b640 1 -- 172.21.15.96:0/2913476189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11880b4b50 msgr2=0x7f11880b4fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T23:58:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118d23b640 1 --2- 172.21.15.96:0/2913476189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11880b4b50 0x7f11880b4fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118d23b640 1 -- 172.21.15.96:0/2913476189 >> v2:172.21.15.162:3300/0 conn(0x7f11880b4640 msgr2=0x7f11880b6ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T23:58:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118d23b640 1 --2- 172.21.15.96:0/2913476189 >> v2:172.21.15.162:3300/0 conn(0x7f11880b4640 0x7f11880b6ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.286+0000 7f118d23b640 1 -- 172.21.15.96:0/2913476189 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11880d1fd0 con 0x7f11880d2630 2024-06-02T23:58:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.287+0000 7f118d23b640 1 --2- 172.21.15.96:0/2913476189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 0x7f11880d2ac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f118808c4c0 tx=0x7f118002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3209cf9f7c41332 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.287+0000 7f11877fe640 1 -- 172.21.15.96:0/2913476189 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180036070 con 0x7f11880d2630 2024-06-02T23:58:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.287+0000 7f11877fe640 1 -- 172.21.15.96:0/2913476189 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180031600 con 0x7f11880d2630 2024-06-02T23:58:44.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.287+0000 7f11877fe640 1 -- 172.21.15.96:0/2913476189 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118002ae60 con 0x7f11880d2630 2024-06-02T23:58:44.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.288+0000 7f118ec9e640 1 -- 172.21.15.96:0/2913476189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 msgr2=0x7f11880d2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:44.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.288+0000 7f118ec9e640 1 --2- 172.21.15.96:0/2913476189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 0x7f11880d2ac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f118808c4c0 tx=0x7f118002a640 comp rx=0 tx=0).stop 2024-06-02T23:58:44.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.288+0000 7f118ec9e640 1 -- 172.21.15.96:0/2913476189 shutdown_connections 2024-06-02T23:58:44.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.288+0000 7f118ec9e640 1 --2- 172.21.15.96:0/2913476189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 0x7f11880d2ac0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.288+0000 7f118ec9e640 1 --2- 172.21.15.96:0/2913476189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11880b4b50 0x7f11880b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.288+0000 7f118ec9e640 1 --2- 172.21.15.96:0/2913476189 >> v2:172.21.15.162:3300/0 conn(0x7f11880b4640 0x7f11880b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.288+0000 7f118ec9e640 1 -- 172.21.15.96:0/2913476189 >> 172.21.15.96:0/2913476189 conn(0x7f11880d4050 msgr2=0x7f11880d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.288+0000 7f118ec9e640 1 -- 172.21.15.96:0/2913476189 shutdown_connections 2024-06-02T23:58:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.288+0000 7f118ec9e640 1 -- 172.21.15.96:0/2913476189 wait complete. 2024-06-02T23:58:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.289+0000 7f118ec9e640 1 Processor -- start 2024-06-02T23:58:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.289+0000 7f118ec9e640 1 -- start start 2024-06-02T23:58:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118ec9e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11880b4640 0x7f11880b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118ec9e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11880b4b50 0x7f1188157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118ec9e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 0x7f11880cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118ec9e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f11880d13b0 con 0x7f11880d2630 2024-06-02T23:58:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118ec9e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f11880cef00 con 0x7f11880b4b50 2024-06-02T23:58:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118ec9e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f11880cf420 con 0x7f11880b4640 2024-06-02T23:58:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118d23b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 0x7f11880cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118d23b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 0x7f11880cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50350/0 (socket says 172.21.15.96:50350) 2024-06-02T23:58:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118d23b640 1 -- 172.21.15.96:0/3036822190 learned_addr learned my addr 172.21.15.96:0/3036822190 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:44.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f1187fff640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11880b4b50 0x7f1188157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118ca3a640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11880b4640 0x7f11880b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118d23b640 1 -- 172.21.15.96:0/3036822190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11880b4640 msgr2=0x7f11880b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118d23b640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11880b4640 0x7f11880b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118d23b640 1 -- 172.21.15.96:0/3036822190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11880b4b50 msgr2=0x7f1188157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118d23b640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11880b4b50 0x7f1188157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118d23b640 1 -- 172.21.15.96:0/3036822190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11880ccc30 con 0x7f11880d2630 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.290+0000 7f118ca3a640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11880b4640 0x7f11880b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.291+0000 7f118d23b640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 0x7f11880cc170 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f118002ac30 tx=0x7f1180004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.291+0000 7f11857fa640 1 -- 172.21.15.96:0/3036822190 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180036050 con 0x7f11880d2630 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.291+0000 7f118ec9e640 1 -- 172.21.15.96:0/3036822190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11880ccf10 con 0x7f11880d2630 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.291+0000 7f11857fa640 1 -- 172.21.15.96:0/3036822190 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180042070 con 0x7f11880d2630 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.291+0000 7f11857fa640 1 -- 172.21.15.96:0/3036822190 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11800094d0 con 0x7f11880d2630 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.291+0000 7f118ec9e640 1 -- 172.21.15.96:0/3036822190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11880b1030 con 0x7f11880d2630 2024-06-02T23:58:44.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.292+0000 7f118ec9e640 1 -- 172.21.15.96:0/3036822190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11880b1230 con 0x7f11880d2630 2024-06-02T23:58:44.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.292+0000 7f11857fa640 1 -- 172.21.15.96:0/3036822190 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) ==== 90669+0+0 (secure 0 0 0) 0x7f1180007990 con 0x7f11880d2630 2024-06-02T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.293+0000 7f11857fa640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f116c06bfe0 0x7f116c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.293+0000 7f11857fa640 1 -- 172.21.15.96:0/3036822190 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6918+0+0 (secure 0 0 0) 0x7f11800ac440 con 0x7f11880d2630 2024-06-02T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.293+0000 7f118ca3a640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f116c06bfe0 0x7f116c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.293+0000 7f118ca3a640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f116c06bfe0 0x7f116c06e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello connection peer type does not match what peer advertises 16 != 2 2024-06-02T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.293+0000 7f118ca3a640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f116c06bfe0 0x7f116c06e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.293+0000 7f11857fa640 1 -- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f116c06bfe0 msgr2=0x7f116c06e4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-06-02T23:58:44.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.293+0000 7f11857fa640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f116c06bfe0 0x7f116c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:44.301 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-06-02T23:58:44.301+0000 7fb16f621040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:58:44.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.301+0000 7f11857fa640 1 -- 172.21.15.96:0/3036822190 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f11880b1230 con 0x7f11880d2630 2024-06-02T23:58:44.356 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.356+0000 7f30d6d24040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T23:58:44.475 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.475+0000 7f30d6d24040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T23:58:44.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.485+0000 7f11857fa640 1 -- 172.21.15.96:0/3036822190 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 15) ==== 90209+0+0 (secure 0 0 0) 0x7f1180076520 con 0x7f11880d2630 2024-06-02T23:58:44.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:44.529+0000 7f118ec9e640 1 -- 172.21.15.96:0/3036822190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f11880683e0 con 0x7f11880d2630 2024-06-02T23:58:44.533 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.533+0000 7f305b59e640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:58:44.534 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.533+0000 7f305b59e640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:58:44.534 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.533+0000 7f305b59e640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:58:44.534 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.533+0000 7f305b59e640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:58:44.534 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.533+0000 7f305b59e640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:58:44.534 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.533+0000 7f3058598640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:58:44.534 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.533+0000 7f3058598640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:58:44.534 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.533+0000 7f3058598640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:58:44.534 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.533+0000 7f3058598640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:58:44.534 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-06-02T23:58:44.533+0000 7f3058598640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T23:58:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.145+0000 7f11857fa640 1 -- 172.21.15.96:0/3036822190 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7f118007a5b0 con 0x7f11880d2630 2024-06-02T23:58:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.147+0000 7f118ec9e640 1 -- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 msgr2=0x7f11880cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.147+0000 7f118ec9e640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 0x7f11880cc170 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f118002ac30 tx=0x7f1180004a40 comp rx=0 tx=0).stop 2024-06-02T23:58:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.148+0000 7f118ec9e640 1 -- 172.21.15.96:0/3036822190 shutdown_connections 2024-06-02T23:58:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.148+0000 7f118ec9e640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:6832/908493645,v1:172.21.15.96:6833/908493645] conn(0x7f116c06bfe0 0x7f116c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.148+0000 7f118ec9e640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11880d2630 0x7f11880cc170 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.148+0000 7f118ec9e640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11880b4b50 0x7f1188157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.148+0000 7f118ec9e640 1 --2- 172.21.15.96:0/3036822190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11880b4640 0x7f11880b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.148+0000 7f118ec9e640 1 -- 172.21.15.96:0/3036822190 >> 172.21.15.96:0/3036822190 conn(0x7f11880d4050 msgr2=0x7f11880b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.148+0000 7f118ec9e640 1 -- 172.21.15.96:0/3036822190 shutdown_connections 2024-06-02T23:58:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.148+0000 7f118ec9e640 1 -- 172.21.15.96:0/3036822190 wait complete. 2024-06-02T23:58:45.161 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-02T23:58:45.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.270+0000 7f1caa19e640 1 Processor -- start 2024-06-02T23:58:45.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.270+0000 7f1caa19e640 1 -- start start 2024-06-02T23:58:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.271+0000 7f1caa19e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca415bfa0 0x7f1ca406e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.271+0000 7f1caa19e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca4072460 con 0x7f1ca4155250 2024-06-02T23:58:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.271+0000 7f1caa19e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca415c4f0 con 0x7f1ca406ec60 2024-06-02T23:58:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.271+0000 7f1caa19e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca4072200 con 0x7f1ca415bfa0 2024-06-02T23:58:45.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.271+0000 7f1ca919c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1ca4155250 0x7f1ca4071af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:34836/0 (socket says 172.21.15.96:34836) 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.271+0000 7f1ca919c640 1 -- 172.21.15.96:0/3967330000 learned_addr learned my addr 172.21.15.96:0/3967330000 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339054882 0 0) 0x7f1ca4072460 con 0x7f1ca4155250 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1ca899b640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca415bfa0 0x7f1ca406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c90003520 con 0x7f1ca4155250 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1679420278 0 0) 0x7f1c90003520 con 0x7f1ca4155250 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca415bfa0 msgr2=0x7f1ca406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca415bfa0 0x7f1ca406e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 >> v1:172.21.15.162:6789/0 conn(0x7f1ca406ec60 legacy=0x7f1ca415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca415c7d0 con 0x7f1ca4155250 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f1ca0001690 con 0x7f1ca4155250 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 >> v1:172.21.15.96:6789/0 conn(0x7f1ca4155250 legacy=0x7f1ca4071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca415bfa0 0x7f1c900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c90003f60 0x7f1c90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c90004d40 0x7f1c900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca4072200 con 0x7f1c90004d40 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9000baa0 con 0x7f1c90003f60 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9000bca0 con 0x7f1ca415bfa0 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1ca999d640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c90004d40 0x7f1c900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1ca899b640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c90003f60 0x7f1c90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1ca919c640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca415bfa0 0x7f1c900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1ca999d640 1 -- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca415bfa0 msgr2=0x7f1c900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1ca999d640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca415bfa0 0x7f1c900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1ca999d640 1 -- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c90003f60 msgr2=0x7f1c90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1ca999d640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c90003f60 0x7f1c90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1ca999d640 1 -- 172.21.15.96:0/3967330000 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c90003520 con 0x7f1c90004d40 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.272+0000 7f1ca899b640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c90003f60 0x7f1c90004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.273+0000 7f1ca999d640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c90004d40 0x7f1c900051c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c001e50 tx=0x7f1c90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e1d32278540352 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.273+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c001a70 con 0x7f1c90004d40 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.273+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c003970 con 0x7f1c90004d40 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.273+0000 7f1c9bfff640 1 -- 172.21.15.96:0/3967330000 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c003d60 con 0x7f1c90004d40 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.274+0000 7f1caa19e640 1 -- 172.21.15.96:0/3967330000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c90004d40 msgr2=0x7f1c900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.274+0000 7f1caa19e640 1 --2- 172.21.15.96:0/3967330000 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c90004d40 0x7f1c900051c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c001e50 tx=0x7f1c90005830 comp rx=0 tx=0).stop 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.274+0000 7f1ca999d640 1 -- 172.21.15.96:0/3967330000 reap_dead start 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.274+0000 7f1caa19e640 1 -- 172.21.15.96:0/3967330000 shutdown_connections 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.274+0000 7f1caa19e640 1 -- 172.21.15.96:0/3967330000 >> 172.21.15.96:0/3967330000 conn(0x7f1ca406b3c0 msgr2=0x7f1ca406b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.274+0000 7f1caa19e640 1 -- 172.21.15.96:0/3967330000 shutdown_connections 2024-06-02T23:58:45.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.274+0000 7f1caa19e640 1 -- 172.21.15.96:0/3967330000 wait complete. 2024-06-02T23:58:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.275+0000 7f1caa19e640 1 Processor -- start 2024-06-02T23:58:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.275+0000 7f1caa19e640 1 -- start start 2024-06-02T23:58:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1caa19e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca4146c50 0x7f1ca4151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1caa19e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca4143fd0 0x7f1ca41f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1caa19e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca4151850 0x7f1ca41f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1caa19e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca406e720 con 0x7f1ca4151850 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1caa19e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca4155630 con 0x7f1ca4143fd0 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1caa19e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca406e8a0 con 0x7f1ca4146c50 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca999d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca4151850 0x7f1ca41f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca999d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca4151850 0x7f1ca41f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50474/0 (socket says 172.21.15.96:50474) 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca999d640 1 -- 172.21.15.96:0/3419572713 learned_addr learned my addr 172.21.15.96:0/3419572713 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca919c640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca4146c50 0x7f1ca4151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca899b640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca4143fd0 0x7f1ca41f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca999d640 1 -- 172.21.15.96:0/3419572713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca4146c50 msgr2=0x7f1ca4151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca999d640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca4146c50 0x7f1ca4151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca999d640 1 -- 172.21.15.96:0/3419572713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca4143fd0 msgr2=0x7f1ca41f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca999d640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca4143fd0 0x7f1ca41f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca999d640 1 -- 172.21.15.96:0/3419572713 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca4140c80 con 0x7f1ca4151850 2024-06-02T23:58:45.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.276+0000 7f1ca919c640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca4146c50 0x7f1ca4151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.277+0000 7f1ca999d640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca4151850 0x7f1ca41f5b50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c02a920 tx=0x7f1c9c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.277+0000 7f1c99ffb640 1 -- 172.21.15.96:0/3419572713 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c001a70 con 0x7f1ca4151850 2024-06-02T23:58:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.277+0000 7f1c99ffb640 1 -- 172.21.15.96:0/3419572713 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c040070 con 0x7f1ca4151850 2024-06-02T23:58:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.277+0000 7f1caa19e640 1 -- 172.21.15.96:0/3419572713 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca4140f20 con 0x7f1ca4151850 2024-06-02T23:58:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.277+0000 7f1c99ffb640 1 -- 172.21.15.96:0/3419572713 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c007db0 con 0x7f1ca4151850 2024-06-02T23:58:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.277+0000 7f1caa19e640 1 -- 172.21.15.96:0/3419572713 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca41414e0 con 0x7f1ca4151850 2024-06-02T23:58:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.278+0000 7f1caa19e640 1 -- 172.21.15.96:0/3419572713 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca4073f90 con 0x7f1ca4151850 2024-06-02T23:58:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.278+0000 7f1c99ffb640 1 -- 172.21.15.96:0/3419572713 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 15) ==== 90209+0+0 (secure 0 0 0) 0x7f1c9c03a070 con 0x7f1ca4151850 2024-06-02T23:58:45.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.279+0000 7f1c99ffb640 1 -- 172.21.15.96:0/3419572713 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 7305+0+0 (secure 0 0 0) 0x7f1c9c0aa710 con 0x7f1ca4151850 2024-06-02T23:58:45.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.283+0000 7f1c99ffb640 1 -- 172.21.15.96:0/3419572713 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1c9c078ed0 con 0x7f1ca4151850 2024-06-02T23:58:45.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.458+0000 7f1caa19e640 1 -- 172.21.15.96:0/3419572713 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1ca41416e0 con 0x7f1ca4151850 2024-06-02T23:58:45.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.489+0000 7f1c99ffb640 1 -- 172.21.15.96:0/3419572713 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 16) ==== 90336+0+0 (secure 0 0 0) 0x7f1c9c07dd10 con 0x7f1ca4151850 2024-06-02T23:58:45.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.490+0000 7f1c99ffb640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1c88072270 0x7f1c88074660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:45.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.491+0000 7f1ca919c640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1c88072270 0x7f1c88074660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:45.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:45.492+0000 7f1ca919c640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1c88072270 0x7f1c88074660 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0001eb0 tx=0x7f1ca0009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:46.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.146+0000 7f1c99ffb640 1 -- 172.21.15.96:0/3419572713 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) ==== 181+0+0 (secure 0 0 0) 0x7f1ca41416e0 con 0x7f1ca4151850 2024-06-02T23:58:46.147 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2024-06-02T23:58:46.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 -- 172.21.15.96:0/3419572713 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1c88072270 msgr2=0x7f1c88074660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1c88072270 0x7f1c88074660 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0001eb0 tx=0x7f1ca0009040 comp rx=0 tx=0).stop 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 -- 172.21.15.96:0/3419572713 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca4151850 msgr2=0x7f1ca41f5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca4151850 0x7f1ca41f5b50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c02a920 tx=0x7f1c9c0014a0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 -- 172.21.15.96:0/3419572713 shutdown_connections 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1c88072270 0x7f1c88074660 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ca4151850 0x7f1ca41f5b50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ca4143fd0 0x7f1ca41f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 --2- 172.21.15.96:0/3419572713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ca4146c50 0x7f1ca4151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 -- 172.21.15.96:0/3419572713 >> 172.21.15.96:0/3419572713 conn(0x7f1ca406b3c0 msgr2=0x7f1ca4071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 -- 172.21.15.96:0/3419572713 shutdown_connections 2024-06-02T23:58:46.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.149+0000 7f1caa19e640 1 -- 172.21.15.96:0/3419572713 wait complete. 2024-06-02T23:58:46.162 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-02T23:58:46.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.270+0000 7f30b809a640 1 Processor -- start 2024-06-02T23:58:46.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.270+0000 7f30b809a640 1 -- start start 2024-06-02T23:58:46.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.271+0000 7f30b809a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b006e7b0 0x7f30b0165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.271+0000 7f30b809a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b00af400 con 0x7f30b015e470 2024-06-02T23:58:46.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.271+0000 7f30b809a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b015e850 con 0x7f30b00cc480 2024-06-02T23:58:46.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.271+0000 7f30b809a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30b00cc990 con 0x7f30b006e7b0 2024-06-02T23:58:46.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.271+0000 7f30b5e36640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f30b015e470 0x7f30b00cb370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:34842/0 (socket says 172.21.15.96:34842) 2024-06-02T23:58:46.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.271+0000 7f30b5e36640 1 -- 172.21.15.96:0/3000599491 learned_addr learned my addr 172.21.15.96:0/3000599491 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:46.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.271+0000 7f30b6637640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b006e7b0 0x7f30b0165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.271+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4083163403 0 0) 0x7f30ac001110 con 0x7f30b015e470 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.271+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f309c005730 con 0x7f30b015e470 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1904190964 0 0) 0x7f309c005730 con 0x7f30b015e470 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b006e7b0 msgr2=0x7f30b0165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b006e7b0 0x7f30b0165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 >> v1:172.21.15.162:6789/0 conn(0x7f30b00cc480 legacy=0x7f30b006e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b00ccc70 con 0x7f30b015e470 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f30ac001860 con 0x7f30b015e470 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 >> v1:172.21.15.96:6789/0 conn(0x7f30b015e470 legacy=0x7f30b00cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b006e7b0 0x7f309c005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f309c006170 0x7f309c006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f309c006f50 0x7f309c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f30b00cc990 con 0x7f309c006f50 2024-06-02T23:58:46.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f309c00dcb0 con 0x7f309c006170 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f309c00deb0 con 0x7f30b006e7b0 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b6637640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f309c006f50 0x7f309c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b5e36640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b006e7b0 0x7f309c005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b5635640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f309c006170 0x7f309c006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b6637640 1 -- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b006e7b0 msgr2=0x7f309c005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b6637640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b006e7b0 0x7f309c005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b6637640 1 -- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f309c006170 msgr2=0x7f309c006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b6637640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f309c006170 0x7f309c006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.272+0000 7f30b6637640 1 -- 172.21.15.96:0/3000599491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c005730 con 0x7f309c006f50 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.273+0000 7f30b6637640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f309c006f50 0x7f309c0073d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009fc0 tx=0x7f309c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858253e4c89c820a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.273+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8009c10 con 0x7f309c006f50 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.273+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a8036070 con 0x7f309c006f50 2024-06-02T23:58:46.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.273+0000 7f30b4e34640 1 -- 172.21.15.96:0/3000599491 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8031880 con 0x7f309c006f50 2024-06-02T23:58:46.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.273+0000 7f30b809a640 1 -- 172.21.15.96:0/3000599491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f309c006f50 msgr2=0x7f309c0073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.273+0000 7f30b809a640 1 --2- 172.21.15.96:0/3000599491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f309c006f50 0x7f309c0073d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009fc0 tx=0x7f309c007a40 comp rx=0 tx=0).stop 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.273+0000 7f30b6637640 1 -- 172.21.15.96:0/3000599491 reap_dead start 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.274+0000 7f30b809a640 1 -- 172.21.15.96:0/3000599491 shutdown_connections 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.274+0000 7f30b809a640 1 -- 172.21.15.96:0/3000599491 >> 172.21.15.96:0/3000599491 conn(0x7f30b00b1a40 msgr2=0x7f30b00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.274+0000 7f30b809a640 1 -- 172.21.15.96:0/3000599491 shutdown_connections 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.274+0000 7f30b809a640 1 -- 172.21.15.96:0/3000599491 wait complete. 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.275+0000 7f30b809a640 1 Processor -- start 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.275+0000 7f30b809a640 1 -- start start 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.275+0000 7f30b809a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f309c006f50 0x7f30b00b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.275+0000 7f30b809a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00b3a40 0x7f30b00b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.275+0000 7f30b809a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b00b2a10 0x7f30b00b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.275+0000 7f30b809a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f30b00cd510 con 0x7f30b00b3a40 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.275+0000 7f30b809a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30b00cd230 con 0x7f309c006f50 2024-06-02T23:58:46.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.275+0000 7f30b809a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30b0071850 con 0x7f30b00b2a10 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b5635640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00b3a40 0x7f30b00b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b5635640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00b3a40 0x7f30b00b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50488/0 (socket says 172.21.15.96:50488) 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b5635640 1 -- 172.21.15.96:0/4050305449 learned_addr learned my addr 172.21.15.96:0/4050305449 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b5e36640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f309c006f50 0x7f30b00b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b6637640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b00b2a10 0x7f30b00b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b5635640 1 -- 172.21.15.96:0/4050305449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b00b2a10 msgr2=0x7f30b00b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b5635640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b00b2a10 0x7f30b00b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b5635640 1 -- 172.21.15.96:0/4050305449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f309c006f50 msgr2=0x7f30b00b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b5635640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f309c006f50 0x7f30b00b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b5635640 1 -- 172.21.15.96:0/4050305449 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b01f7a40 con 0x7f30b00b3a40 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b5635640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00b3a40 0x7f30b00b3ec0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f30a000e550 tx=0x7f30a000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30a67fc640 1 -- 172.21.15.96:0/4050305449 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a00052e0 con 0x7f30b00b3a40 2024-06-02T23:58:46.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30a67fc640 1 -- 172.21.15.96:0/4050305449 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a0018070 con 0x7f30b00b3a40 2024-06-02T23:58:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b809a640 1 -- 172.21.15.96:0/4050305449 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b01f7d20 con 0x7f30b00b3a40 2024-06-02T23:58:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30a67fc640 1 -- 172.21.15.96:0/4050305449 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0003810 con 0x7f30b00b3a40 2024-06-02T23:58:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.276+0000 7f30b809a640 1 -- 172.21.15.96:0/4050305449 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b01f82e0 con 0x7f30b00b3a40 2024-06-02T23:58:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.277+0000 7f30b809a640 1 -- 172.21.15.96:0/4050305449 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b015fa10 con 0x7f30b00b3a40 2024-06-02T23:58:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.278+0000 7f30a67fc640 1 -- 172.21.15.96:0/4050305449 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) ==== 90336+0+0 (secure 0 0 0) 0x7f30a00039b0 con 0x7f30b00b3a40 2024-06-02T23:58:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.278+0000 7f30a67fc640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f309406bcb0 0x7f309406e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.278+0000 7f30b5e36640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f309406bcb0 0x7f309406e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.278+0000 7f30a67fc640 1 -- 172.21.15.96:0/4050305449 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6867+0+0 (secure 0 0 0) 0x7f30a008ab30 con 0x7f30b00b3a40 2024-06-02T23:58:46.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.279+0000 7f30b5e36640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f309406bcb0 0x7f309406e170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0012b0 tx=0x7f30ac009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:46.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.283+0000 7f30a67fc640 1 -- 172.21.15.96:0/4050305449 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f30b015fa10 con 0x7f30b00b3a40 2024-06-02T23:58:46.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.468+0000 7f30b809a640 1 -- 172.21.15.96:0/4050305449 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f30b00cdf90 con 0x7f30b00b3a40 2024-06-02T23:58:46.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.798+0000 7f30a67fc640 1 -- 172.21.15.96:0/4050305449 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) ==== 169+0+0 (secure 0 0 0) 0x7f30a0059390 con 0x7f30b00b3a40 2024-06-02T23:58:46.798 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2024-06-02T23:58:46.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 -- 172.21.15.96:0/4050305449 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f309406bcb0 msgr2=0x7f309406e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.801 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f309406bcb0 0x7f309406e170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0012b0 tx=0x7f30ac009040 comp rx=0 tx=0).stop 2024-06-02T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 -- 172.21.15.96:0/4050305449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00b3a40 msgr2=0x7f30b00b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00b3a40 0x7f30b00b3ec0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f30a000e550 tx=0x7f30a000ea10 comp rx=0 tx=0).stop 2024-06-02T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 -- 172.21.15.96:0/4050305449 shutdown_connections 2024-06-02T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f309406bcb0 0x7f309406e170 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b00b2a10 0x7f30b00b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30b00b3a40 0x7f30b00b3ec0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 --2- 172.21.15.96:0/4050305449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f309c006f50 0x7f30b00b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 -- 172.21.15.96:0/4050305449 >> 172.21.15.96:0/4050305449 conn(0x7f30b00b1a40 msgr2=0x7f30b00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.801+0000 7f30b809a640 1 -- 172.21.15.96:0/4050305449 shutdown_connections 2024-06-02T23:58:46.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.802+0000 7f30b809a640 1 -- 172.21.15.96:0/4050305449 wait complete. 2024-06-02T23:58:46.813 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2024-06-02T23:58:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.916+0000 7fe8ab129640 1 Processor -- start 2024-06-02T23:58:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.916+0000 7fe8ab129640 1 -- start start 2024-06-02T23:58:46.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8ab129640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8a40d2d40 0x7fe8a40b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8ab129640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a40cec60 con 0x7fe8a40b4b50 2024-06-02T23:58:46.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8ab129640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a40d1fd0 con 0x7fe8a40b4640 2024-06-02T23:58:46.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8ab129640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a40d4ff0 con 0x7fe8a40d2d40 2024-06-02T23:58:46.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a3fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe8a40b4b50 0x7fe8a40d2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:34858/0 (socket says 172.21.15.96:34858) 2024-06-02T23:58:46.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a3fff640 1 -- 172.21.15.96:0/716085779 learned_addr learned my addr 172.21.15.96:0/716085779 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:46.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3234339215 0 0) 0x7fe8a40cec60 con 0x7fe8a40b4b50 2024-06-02T23:58:46.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe894003520 con 0x7fe8a40b4b50 2024-06-02T23:58:46.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a96c6640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8a40d2d40 0x7fe8a40b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 467887813 0 0) 0x7fe894003520 con 0x7fe8a40b4b50 2024-06-02T23:58:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8a40d2d40 msgr2=0x7fe8a40b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8a40d2d40 0x7fe8a40b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 >> v1:172.21.15.162:6789/0 conn(0x7fe8a40b4640 legacy=0x7fe8a40b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a40d4d10 con 0x7fe8a40b4b50 2024-06-02T23:58:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fe890001670 con 0x7fe8a40b4b50 2024-06-02T23:58:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 >> v1:172.21.15.96:6789/0 conn(0x7fe8a40b4b50 legacy=0x7fe8a40d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8940039e0 0x7fe894003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe894004800 0x7fe894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 0x7fe89400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe89400c180 con 0x7fe894005290 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe89400c330 con 0x7fe8940039e0 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe89400c530 con 0x7fe894004800 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.917+0000 7fe8a96c6640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8a40d2d40 0x7fe8a40b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.918+0000 7fe8a96c6640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 0x7fe89400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.918+0000 7fe8a8ec5640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8940039e0 0x7fe894003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.918+0000 7fe8a3fff640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe894004800 0x7fe894004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.918+0000 7fe8a96c6640 1 -- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe894004800 msgr2=0x7fe894004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.918+0000 7fe8a96c6640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe894004800 0x7fe894004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.918+0000 7fe8a96c6640 1 -- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8940039e0 msgr2=0x7fe894003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.918+0000 7fe8a96c6640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8940039e0 0x7fe894003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.918+0000 7fe8a96c6640 1 -- 172.21.15.96:0/716085779 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe894003520 con 0x7fe894005290 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.918+0000 7fe8a96c6640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 0x7fe89400b9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe8a408c6c0 tx=0x7fe894005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e3044b68d498b3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.919+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c030050 con 0x7fe894005290 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.919+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe89c003b90 con 0x7fe894005290 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.919+0000 7fe8a37fe640 1 -- 172.21.15.96:0/716085779 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89c009b50 con 0x7fe894005290 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.919+0000 7fe8ab129640 1 -- 172.21.15.96:0/716085779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 msgr2=0x7fe89400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.919+0000 7fe8ab129640 1 --2- 172.21.15.96:0/716085779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 0x7fe89400b9c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe8a408c6c0 tx=0x7fe894005830 comp rx=0 tx=0).stop 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.919+0000 7fe8a96c6640 1 -- 172.21.15.96:0/716085779 reap_dead start 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.919+0000 7fe8ab129640 1 -- 172.21.15.96:0/716085779 shutdown_connections 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.919+0000 7fe8ab129640 1 -- 172.21.15.96:0/716085779 >> 172.21.15.96:0/716085779 conn(0x7fe8a40d4050 msgr2=0x7fe8a40d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.919+0000 7fe8ab129640 1 -- 172.21.15.96:0/716085779 shutdown_connections 2024-06-02T23:58:46.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.919+0000 7fe8ab129640 1 -- 172.21.15.96:0/716085779 wait complete. 2024-06-02T23:58:46.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.920+0000 7fe8ab129640 1 Processor -- start 2024-06-02T23:58:46.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.920+0000 7fe8ab129640 1 -- start start 2024-06-02T23:58:46.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.921+0000 7fe8ab129640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 0x7fe8a41f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.921+0000 7fe8ab129640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a40b3130 0x7fe8a40cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.921+0000 7fe8ab129640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8a40cd3d0 0x7fe8a41f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.921+0000 7fe8ab129640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a40b5000 con 0x7fe894005290 2024-06-02T23:58:46.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.921+0000 7fe8ab129640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a40d13b0 con 0x7fe8a40b3130 2024-06-02T23:58:46.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.921+0000 7fe8ab129640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a40b5180 con 0x7fe8a40cd3d0 2024-06-02T23:58:46.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.921+0000 7fe8a8ec5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 0x7fe8a41f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.921+0000 7fe8a8ec5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 0x7fe8a41f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50524/0 (socket says 172.21.15.96:50524) 2024-06-02T23:58:46.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.921+0000 7fe8a8ec5640 1 -- 172.21.15.96:0/2214845306 learned_addr learned my addr 172.21.15.96:0/2214845306 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:46.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a3fff640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a40b3130 0x7fe8a40cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a8ec5640 1 -- 172.21.15.96:0/2214845306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8a40cd3d0 msgr2=0x7fe8a41f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a96c6640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8a40cd3d0 0x7fe8a41f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a8ec5640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8a40cd3d0 0x7fe8a41f7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a8ec5640 1 -- 172.21.15.96:0/2214845306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a40b3130 msgr2=0x7fe8a40cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:46.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a8ec5640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a40b3130 0x7fe8a40cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:46.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a8ec5640 1 -- 172.21.15.96:0/2214845306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a41f3cb0 con 0x7fe894005290 2024-06-02T23:58:46.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a3fff640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a40b3130 0x7fe8a40cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:46.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a8ec5640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 0x7fe8a41f3770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe89800f850 tx=0x7fe89800fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:46.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a17fa640 1 -- 172.21.15.96:0/2214845306 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89800fe40 con 0x7fe894005290 2024-06-02T23:58:46.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a17fa640 1 -- 172.21.15.96:0/2214845306 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe898018070 con 0x7fe894005290 2024-06-02T23:58:46.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8ab129640 1 -- 172.21.15.96:0/2214845306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a40b1880 con 0x7fe894005290 2024-06-02T23:58:46.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8a17fa640 1 -- 172.21.15.96:0/2214845306 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe89800d730 con 0x7fe894005290 2024-06-02T23:58:46.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.922+0000 7fe8ab129640 1 -- 172.21.15.96:0/2214845306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a40b1e40 con 0x7fe894005290 2024-06-02T23:58:46.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.923+0000 7fe8ab129640 1 -- 172.21.15.96:0/2214845306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a40683e0 con 0x7fe894005290 2024-06-02T23:58:46.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.924+0000 7fe8a17fa640 1 -- 172.21.15.96:0/2214845306 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) ==== 90336+0+0 (secure 0 0 0) 0x7fe89800d8d0 con 0x7fe894005290 2024-06-02T23:58:46.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.924+0000 7fe8a17fa640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fe88806bc80 0x7fe88806e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:46.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.924+0000 7fe8a3fff640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fe88806bc80 0x7fe88806e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:46.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.924+0000 7fe8a17fa640 1 -- 172.21.15.96:0/2214845306 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6424+0+0 (secure 0 0 0) 0x7fe89808abf0 con 0x7fe894005290 2024-06-02T23:58:46.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.924+0000 7fe8a3fff640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fe88806bc80 0x7fe88806e140 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe8900010e0 tx=0x7fe890009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:46.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:46.929+0000 7fe8a17fa640 1 -- 172.21.15.96:0/2214845306 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fe898091080 con 0x7fe894005290 2024-06-02T23:58:47.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.102+0000 7fe8ab129640 1 -- 172.21.15.96:0/2214845306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) -- 0x7fe8a40d2410 con 0x7fe894005290 2024-06-02T23:58:47.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.107+0000 7fe8a17fa640 1 -- 172.21.15.96:0/2214845306 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v13) ==== 115+0+0 (secure 0 0 0) 0x7fe8a41f3cb0 con 0x7fe894005290 2024-06-02T23:58:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.109+0000 7fe8ab129640 1 -- 172.21.15.96:0/2214845306 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fe88806bc80 msgr2=0x7fe88806e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.109+0000 7fe8ab129640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fe88806bc80 0x7fe88806e140 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe8900010e0 tx=0x7fe890009040 comp rx=0 tx=0).stop 2024-06-02T23:58:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.109+0000 7fe8ab129640 1 -- 172.21.15.96:0/2214845306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 msgr2=0x7fe8a41f3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.109+0000 7fe8ab129640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 0x7fe8a41f3770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe89800f850 tx=0x7fe89800fd10 comp rx=0 tx=0).stop 2024-06-02T23:58:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.110+0000 7fe8ab129640 1 -- 172.21.15.96:0/2214845306 shutdown_connections 2024-06-02T23:58:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.110+0000 7fe8ab129640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fe88806bc80 0x7fe88806e140 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.110+0000 7fe8ab129640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8a40cd3d0 0x7fe8a41f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.110+0000 7fe8ab129640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8a40b3130 0x7fe8a40cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.110+0000 7fe8ab129640 1 --2- 172.21.15.96:0/2214845306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe894005290 0x7fe8a41f3770 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.110+0000 7fe8ab129640 1 -- 172.21.15.96:0/2214845306 >> 172.21.15.96:0/2214845306 conn(0x7fe8a40d4050 msgr2=0x7fe8a40b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:47.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.110+0000 7fe8ab129640 1 -- 172.21.15.96:0/2214845306 shutdown_connections 2024-06-02T23:58:47.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.110+0000 7fe8ab129640 1 -- 172.21.15.96:0/2214845306 wait complete. 2024-06-02T23:58:47.121 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-06-02T23:58:47.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.224+0000 7f8ea84ee640 1 Processor -- start 2024-06-02T23:58:47.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.224+0000 7f8ea84ee640 1 -- start start 2024-06-02T23:58:47.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea84ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea015e530 0x7f8ea00cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea84ee640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8ea00cb2a0 0x7f8ea006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea84ee640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8ea006eb50 0x7f8ea015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea84ee640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f8ea006efa0 con 0x7f8ea00cb2a0 2024-06-02T23:58:47.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea84ee640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8ea00723e0 con 0x7f8ea006eb50 2024-06-02T23:58:47.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea84ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea00cb7b0 con 0x7f8ea015e530 2024-06-02T23:58:47.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea5a89640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8ea00cb2a0 0x7f8ea006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea5a89640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8ea00cb2a0 0x7f8ea006e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50540/0 (socket says 172.21.15.96:50540) 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea5a89640 1 -- 172.21.15.96:0/3682056363 learned_addr learned my addr 172.21.15.96:0/3682056363 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea6a8b640 1 --2- 172.21.15.96:0/3682056363 >> v2:172.21.15.162:3300/0 conn(0x7f8ea006eb50 0x7f8ea015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea5a89640 1 -- 172.21.15.96:0/3682056363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea015e530 msgr2=0x7f8ea00cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea5a89640 1 --2- 172.21.15.96:0/3682056363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea015e530 0x7f8ea00cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea5a89640 1 -- 172.21.15.96:0/3682056363 >> v2:172.21.15.162:3300/0 conn(0x7f8ea006eb50 msgr2=0x7f8ea015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea5a89640 1 --2- 172.21.15.96:0/3682056363 >> v2:172.21.15.162:3300/0 conn(0x7f8ea006eb50 0x7f8ea015ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea5a89640 1 -- 172.21.15.96:0/3682056363 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea0072680 con 0x7f8ea00cb2a0 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.225+0000 7f8ea6a8b640 1 --2- 172.21.15.96:0/3682056363 >> v2:172.21.15.162:3300/0 conn(0x7f8ea006eb50 0x7f8ea015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.226+0000 7f8ea5a89640 1 --2- 172.21.15.96:0/3682056363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00cb2a0 0x7f8ea006e610 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00cd7d0 tx=0x7f8e9002c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fc1854bd554c5b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:47.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.226+0000 7f8ea5288640 1 -- 172.21.15.96:0/3682056363 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90038070 con 0x7f8ea00cb2a0 2024-06-02T23:58:47.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.226+0000 7f8ea5288640 1 -- 172.21.15.96:0/3682056363 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e90031710 con 0x7f8ea00cb2a0 2024-06-02T23:58:47.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.226+0000 7f8ea5288640 1 -- 172.21.15.96:0/3682056363 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90031ae0 con 0x7f8ea00cb2a0 2024-06-02T23:58:47.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.227+0000 7f8ea84ee640 1 -- 172.21.15.96:0/3682056363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00cb2a0 msgr2=0x7f8ea006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.227+0000 7f8ea84ee640 1 --2- 172.21.15.96:0/3682056363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00cb2a0 0x7f8ea006e610 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00cd7d0 tx=0x7f8e9002c770 comp rx=0 tx=0).stop 2024-06-02T23:58:47.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.227+0000 7f8ea84ee640 1 -- 172.21.15.96:0/3682056363 shutdown_connections 2024-06-02T23:58:47.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.227+0000 7f8ea84ee640 1 --2- 172.21.15.96:0/3682056363 >> v2:172.21.15.162:3300/0 conn(0x7f8ea006eb50 0x7f8ea015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.227+0000 7f8ea84ee640 1 --2- 172.21.15.96:0/3682056363 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00cb2a0 0x7f8ea006e610 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.227+0000 7f8ea84ee640 1 --2- 172.21.15.96:0/3682056363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea015e530 0x7f8ea00cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.227+0000 7f8ea84ee640 1 -- 172.21.15.96:0/3682056363 >> 172.21.15.96:0/3682056363 conn(0x7f8ea00cfcb0 msgr2=0x7f8ea00d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:47.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.227+0000 7f8ea84ee640 1 -- 172.21.15.96:0/3682056363 shutdown_connections 2024-06-02T23:58:47.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.227+0000 7f8ea84ee640 1 -- 172.21.15.96:0/3682056363 wait complete. 2024-06-02T23:58:47.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.228+0000 7f8ea84ee640 1 Processor -- start 2024-06-02T23:58:47.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.228+0000 7f8ea84ee640 1 -- start start 2024-06-02T23:58:47.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea84ee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea006eb50 0x7f8ea014b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea84ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea00cb2a0 0x7f8ea00b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea84ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ea015e530 0x7f8ea00b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea84ee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea015e910 con 0x7f8ea006eb50 2024-06-02T23:58:47.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea84ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea0072c40 con 0x7f8ea015e530 2024-06-02T23:58:47.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea84ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea0073160 con 0x7f8ea00cb2a0 2024-06-02T23:58:47.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea628a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea006eb50 0x7f8ea014b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea628a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea006eb50 0x7f8ea014b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50544/0 (socket says 172.21.15.96:50544) 2024-06-02T23:58:47.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea628a640 1 -- 172.21.15.96:0/463104789 learned_addr learned my addr 172.21.15.96:0/463104789 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:47.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea628a640 1 -- 172.21.15.96:0/463104789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea00cb2a0 msgr2=0x7f8ea00b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea628a640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea00cb2a0 0x7f8ea00b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea628a640 1 -- 172.21.15.96:0/463104789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ea015e530 msgr2=0x7f8ea00b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea6a8b640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ea015e530 0x7f8ea00b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea628a640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ea015e530 0x7f8ea00b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea628a640 1 -- 172.21.15.96:0/463104789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea014b8d0 con 0x7f8ea006eb50 2024-06-02T23:58:47.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea6a8b640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ea015e530 0x7f8ea00b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:47.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea628a640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea006eb50 0x7f8ea014b390 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00b4d0 tx=0x7f8e9c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:47.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8e96ffd640 1 -- 172.21.15.96:0/463104789 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c014070 con 0x7f8ea006eb50 2024-06-02T23:58:47.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8e96ffd640 1 -- 172.21.15.96:0/463104789 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9c010870 con 0x7f8ea006eb50 2024-06-02T23:58:47.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea84ee640 1 -- 172.21.15.96:0/463104789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea00b4710 con 0x7f8ea006eb50 2024-06-02T23:58:47.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8e96ffd640 1 -- 172.21.15.96:0/463104789 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c010c60 con 0x7f8ea006eb50 2024-06-02T23:58:47.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.229+0000 7f8ea84ee640 1 -- 172.21.15.96:0/463104789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea00b4cd0 con 0x7f8ea006eb50 2024-06-02T23:58:47.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.230+0000 7f8ea84ee640 1 -- 172.21.15.96:0/463104789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea00683e0 con 0x7f8ea006eb50 2024-06-02T23:58:47.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.231+0000 7f8e96ffd640 1 -- 172.21.15.96:0/463104789 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) ==== 90442+0+0 (secure 0 0 0) 0x7f8e9c017070 con 0x7f8ea006eb50 2024-06-02T23:58:47.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.231+0000 7f8e96ffd640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8e8406bda0 0x7f8e8406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.231+0000 7f8e96ffd640 1 -- 172.21.15.96:0/463104789 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6424+0+0 (secure 0 0 0) 0x7f8e9c08ae10 con 0x7f8ea006eb50 2024-06-02T23:58:47.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.231+0000 7f8ea5a89640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8e8406bda0 0x7f8e8406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.232+0000 7f8ea5a89640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8e8406bda0 0x7f8e8406e260 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e90035000 tx=0x7f8e9002e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:47.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.236+0000 7f8e96ffd640 1 -- 172.21.15.96:0/463104789 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8ea014b8d0 con 0x7f8ea006eb50 2024-06-02T23:58:47.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.410+0000 7f8ea84ee640 1 -- 172.21.15.96:0/463104789 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8ea00b4ea0 con 0x7f8ea006eb50 2024-06-02T23:58:47.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.415+0000 7f8e96ffd640 1 -- 172.21.15.96:0/463104789 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) ==== 104+0+0 (secure 0 0 0) 0x7f8e9c0595d0 con 0x7f8ea006eb50 2024-06-02T23:58:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 -- 172.21.15.96:0/463104789 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8e8406bda0 msgr2=0x7f8e8406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8e8406bda0 0x7f8e8406e260 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e90035000 tx=0x7f8e9002e000 comp rx=0 tx=0).stop 2024-06-02T23:58:47.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 -- 172.21.15.96:0/463104789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea006eb50 msgr2=0x7f8ea014b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea006eb50 0x7f8ea014b390 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00b4d0 tx=0x7f8e9c00b990 comp rx=0 tx=0).stop 2024-06-02T23:58:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 -- 172.21.15.96:0/463104789 shutdown_connections 2024-06-02T23:58:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8e8406bda0 0x7f8e8406e260 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ea015e530 0x7f8ea00b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea00cb2a0 0x7f8ea00b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 --2- 172.21.15.96:0/463104789 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea006eb50 0x7f8ea014b390 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 -- 172.21.15.96:0/463104789 >> 172.21.15.96:0/463104789 conn(0x7f8ea00cfcb0 msgr2=0x7f8ea00cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 -- 172.21.15.96:0/463104789 shutdown_connections 2024-06-02T23:58:47.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.417+0000 7f8ea84ee640 1 -- 172.21.15.96:0/463104789 wait complete. 2024-06-02T23:58:47.428 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-06-02T23:58:47.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.538+0000 7f4c94abd640 1 Processor -- start 2024-06-02T23:58:47.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.538+0000 7f4c94abd640 1 -- start start 2024-06-02T23:58:47.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.539+0000 7f4c94abd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c9015e530 0x7f4c900cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.539+0000 7f4c94abd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4c9006ed20 0x7f4c900cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.539+0000 7f4c94abd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c900723e0 con 0x7f4c900cb2a0 2024-06-02T23:58:47.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.539+0000 7f4c94abd640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4c900cb7b0 con 0x7f4c9006ed20 2024-06-02T23:58:47.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.539+0000 7f4c94abd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4c90072680 con 0x7f4c9015e530 2024-06-02T23:58:47.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.540+0000 7f4c8ed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4c9006ed20 0x7f4c900cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.540+0000 7f4c8dd9b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4c900cb2a0 0x7f4c9006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:34864/0 (socket says 172.21.15.96:34864) 2024-06-02T23:58:47.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.540+0000 7f4c8dd9b640 1 -- 172.21.15.96:0/1401036871 learned_addr learned my addr 172.21.15.96:0/1401036871 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:47.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.540+0000 7f4c8e59c640 1 --2- 172.21.15.96:0/1401036871 >> v2:172.21.15.162:3300/0 conn(0x7f4c9015e530 0x7f4c900cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.540+0000 7f4c8ed9d640 1 -- 172.21.15.96:0/1401036871 >> v2:172.21.15.162:3300/0 conn(0x7f4c9015e530 msgr2=0x7f4c900cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:47.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.540+0000 7f4c8ed9d640 1 --2- 172.21.15.96:0/1401036871 >> v2:172.21.15.162:3300/0 conn(0x7f4c9015e530 0x7f4c900cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.540+0000 7f4c8ed9d640 1 -- 172.21.15.96:0/1401036871 >> v1:172.21.15.96:6789/0 conn(0x7f4c900cb2a0 legacy=0x7f4c9006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.540+0000 7f4c8ed9d640 1 -- 172.21.15.96:0/1401036871 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c90072960 con 0x7f4c9006ed20 2024-06-02T23:58:47.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.540+0000 7f4c8d59a640 1 -- 172.21.15.96:0/1401036871 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277812735 0 0) 0x7f4c900723e0 con 0x7f4c900cb2a0 2024-06-02T23:58:47.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.540+0000 7f4c8ed9d640 1 --2- 172.21.15.96:0/1401036871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c9006ed20 0x7f4c900cd880 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4c9006c940 tx=0x7f4c8802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abfdee20a84c27a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:47.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c8d59a640 1 -- 172.21.15.96:0/1401036871 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88007740 con 0x7f4c9006ed20 2024-06-02T23:58:47.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c8d59a640 1 -- 172.21.15.96:0/1401036871 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c880078e0 con 0x7f4c9006ed20 2024-06-02T23:58:47.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c8d59a640 1 -- 172.21.15.96:0/1401036871 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88007cb0 con 0x7f4c9006ed20 2024-06-02T23:58:47.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c94abd640 1 -- 172.21.15.96:0/1401036871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c9006ed20 msgr2=0x7f4c900cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c94abd640 1 --2- 172.21.15.96:0/1401036871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c9006ed20 0x7f4c900cd880 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4c9006c940 tx=0x7f4c8802a560 comp rx=0 tx=0).stop 2024-06-02T23:58:47.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c94abd640 1 -- 172.21.15.96:0/1401036871 shutdown_connections 2024-06-02T23:58:47.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c94abd640 1 --2- 172.21.15.96:0/1401036871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c9006ed20 0x7f4c900cd880 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c94abd640 1 --2- 172.21.15.96:0/1401036871 >> v2:172.21.15.162:3300/0 conn(0x7f4c9015e530 0x7f4c900cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c94abd640 1 -- 172.21.15.96:0/1401036871 >> 172.21.15.96:0/1401036871 conn(0x7f4c900cfcb0 msgr2=0x7f4c900d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:47.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c94abd640 1 -- 172.21.15.96:0/1401036871 shutdown_connections 2024-06-02T23:58:47.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.541+0000 7f4c94abd640 1 -- 172.21.15.96:0/1401036871 wait complete. 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c94abd640 1 Processor -- start 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c94abd640 1 -- start start 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c94abd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c9006ed20 0x7f4c900c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c94abd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c900cb2a0 0x7f4c901572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c94abd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c9015e530 0x7f4c901577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c94abd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4c90073160 con 0x7f4c900cb2a0 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c94abd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9015e910 con 0x7f4c9006ed20 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c94abd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9006d120 con 0x7f4c9015e530 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c8dd9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c900cb2a0 0x7f4c901572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c8dd9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c900cb2a0 0x7f4c901572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50552/0 (socket says 172.21.15.96:50552) 2024-06-02T23:58:47.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.543+0000 7f4c8dd9b640 1 -- 172.21.15.96:0/3882361734 learned_addr learned my addr 172.21.15.96:0/3882361734 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c8dd9b640 1 -- 172.21.15.96:0/3882361734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c9015e530 msgr2=0x7f4c901577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c8dd9b640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c9015e530 0x7f4c901577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c8e59c640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c9006ed20 0x7f4c900c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c8dd9b640 1 -- 172.21.15.96:0/3882361734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c9006ed20 msgr2=0x7f4c900c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c8dd9b640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c9006ed20 0x7f4c900c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c8dd9b640 1 -- 172.21.15.96:0/3882361734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c90153710 con 0x7f4c900cb2a0 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c8dd9b640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c900cb2a0 0x7f4c901572b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800c4d0 tx=0x7f4c7800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c86ffd640 1 -- 172.21.15.96:0/3882361734 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78017070 con 0x7f4c900cb2a0 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c86ffd640 1 -- 172.21.15.96:0/3882361734 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c78005d00 con 0x7f4c900cb2a0 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c94abd640 1 -- 172.21.15.96:0/3882361734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c901539f0 con 0x7f4c900cb2a0 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c86ffd640 1 -- 172.21.15.96:0/3882361734 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c780072b0 con 0x7f4c900cb2a0 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.544+0000 7f4c94abd640 1 -- 172.21.15.96:0/3882361734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c90153fb0 con 0x7f4c900cb2a0 2024-06-02T23:58:47.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.545+0000 7f4c94abd640 1 -- 172.21.15.96:0/3882361734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c90153490 con 0x7f4c900cb2a0 2024-06-02T23:58:47.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.545+0000 7f4c86ffd640 1 -- 172.21.15.96:0/3882361734 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) ==== 90442+0+0 (secure 0 0 0) 0x7f4c7801a070 con 0x7f4c900cb2a0 2024-06-02T23:58:47.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.546+0000 7f4c86ffd640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c7006bdd0 0x7f4c7006e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.546+0000 7f4c8e59c640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c7006bdd0 0x7f4c7006e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.546+0000 7f4c86ffd640 1 -- 172.21.15.96:0/3882361734 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6424+0+0 (secure 0 0 0) 0x7f4c7808a3b0 con 0x7f4c900cb2a0 2024-06-02T23:58:47.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.546+0000 7f4c8e59c640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c7006bdd0 0x7f4c7006e290 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c80006fd0 tx=0x7f4c80008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:47.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.550+0000 7f4c86ffd640 1 -- 172.21.15.96:0/3882361734 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4c90153490 con 0x7f4c900cb2a0 2024-06-02T23:58:47.727 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.727+0000 7f4c94abd640 1 -- 172.21.15.96:0/3882361734 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) -- 0x7f4c900683e0 con 0x7f4c900cb2a0 2024-06-02T23:58:47.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.730+0000 7f4c86ffd640 1 -- 172.21.15.96:0/3882361734 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f4c78058b70 con 0x7f4c900cb2a0 2024-06-02T23:58:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 -- 172.21.15.96:0/3882361734 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c7006bdd0 msgr2=0x7f4c7006e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c7006bdd0 0x7f4c7006e290 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c80006fd0 tx=0x7f4c80008040 comp rx=0 tx=0).stop 2024-06-02T23:58:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 -- 172.21.15.96:0/3882361734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c900cb2a0 msgr2=0x7f4c901572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c900cb2a0 0x7f4c901572b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800c4d0 tx=0x7f4c7800c990 comp rx=0 tx=0).stop 2024-06-02T23:58:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 -- 172.21.15.96:0/3882361734 shutdown_connections 2024-06-02T23:58:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c7006bdd0 0x7f4c7006e290 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c9015e530 0x7f4c901577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c900cb2a0 0x7f4c901572b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 --2- 172.21.15.96:0/3882361734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c9006ed20 0x7f4c900c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 -- 172.21.15.96:0/3882361734 >> 172.21.15.96:0/3882361734 conn(0x7f4c900cfcb0 msgr2=0x7f4c900cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 -- 172.21.15.96:0/3882361734 shutdown_connections 2024-06-02T23:58:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.732+0000 7f4c94abd640 1 -- 172.21.15.96:0/3882361734 wait complete. 2024-06-02T23:58:47.743 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2024-06-02T23:58:47.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.844+0000 7f047e058640 1 Processor -- start 2024-06-02T23:58:47.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.844+0000 7f047e058640 1 -- start start 2024-06-02T23:58:47.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f047e058640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0478144130 0x7f0478072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f047e058640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f04780cd150 0x7f047815e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f047e058640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04780cffb0 0x7f04780d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f047e058640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0478144510 con 0x7f04780cd150 2024-06-02T23:58:47.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f047e058640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f04780d0940 con 0x7f0478144130 2024-06-02T23:58:47.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f047e058640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f047815f240 con 0x7f04780cffb0 2024-06-02T23:58:47.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f0476ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f04780cd150 0x7f047815e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f0476ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f04780cd150 0x7f047815e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50560/0 (socket says 172.21.15.96:50560) 2024-06-02T23:58:47.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f0476ffd640 1 -- 172.21.15.96:0/1247261945 learned_addr learned my addr 172.21.15.96:0/1247261945 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:47.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f04777fe640 1 --2- 172.21.15.96:0/1247261945 >> v2:172.21.15.162:3300/0 conn(0x7f0478144130 0x7f0478072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f0477fff640 1 --2- 172.21.15.96:0/1247261945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04780cffb0 0x7f04780d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f0476ffd640 1 -- 172.21.15.96:0/1247261945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04780cffb0 msgr2=0x7f04780d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:47.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f0476ffd640 1 --2- 172.21.15.96:0/1247261945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04780cffb0 0x7f04780d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f0476ffd640 1 -- 172.21.15.96:0/1247261945 >> v2:172.21.15.162:3300/0 conn(0x7f0478144130 msgr2=0x7f0478072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:47.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f0476ffd640 1 --2- 172.21.15.96:0/1247261945 >> v2:172.21.15.162:3300/0 conn(0x7f0478144130 0x7f0478072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f0476ffd640 1 -- 172.21.15.96:0/1247261945 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047815f520 con 0x7f04780cd150 2024-06-02T23:58:47.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.845+0000 7f04777fe640 1 --2- 172.21.15.96:0/1247261945 >> v2:172.21.15.162:3300/0 conn(0x7f0478144130 0x7f0478072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:47.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.846+0000 7f0476ffd640 1 --2- 172.21.15.96:0/1247261945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04780cd150 0x7f047815e940 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f04780b5000 tx=0x7f046c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3184cedb467d24a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:47.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.846+0000 7f04767fc640 1 -- 172.21.15.96:0/1247261945 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c037070 con 0x7f04780cd150 2024-06-02T23:58:47.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.846+0000 7f04767fc640 1 -- 172.21.15.96:0/1247261945 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046c032440 con 0x7f04780cd150 2024-06-02T23:58:47.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.846+0000 7f04767fc640 1 -- 172.21.15.96:0/1247261945 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c032810 con 0x7f04780cd150 2024-06-02T23:58:47.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.847+0000 7f047e058640 1 -- 172.21.15.96:0/1247261945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04780cd150 msgr2=0x7f047815e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.847+0000 7f047e058640 1 --2- 172.21.15.96:0/1247261945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04780cd150 0x7f047815e940 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f04780b5000 tx=0x7f046c02a140 comp rx=0 tx=0).stop 2024-06-02T23:58:47.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.847+0000 7f047e058640 1 -- 172.21.15.96:0/1247261945 shutdown_connections 2024-06-02T23:58:47.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.847+0000 7f047e058640 1 --2- 172.21.15.96:0/1247261945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04780cffb0 0x7f04780d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.847+0000 7f047e058640 1 --2- 172.21.15.96:0/1247261945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04780cd150 0x7f047815e940 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.847+0000 7f047e058640 1 --2- 172.21.15.96:0/1247261945 >> v2:172.21.15.162:3300/0 conn(0x7f0478144130 0x7f0478072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.847+0000 7f047e058640 1 -- 172.21.15.96:0/1247261945 >> 172.21.15.96:0/1247261945 conn(0x7f047806b7b0 msgr2=0x7f047806bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:47.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.847+0000 7f047e058640 1 -- 172.21.15.96:0/1247261945 shutdown_connections 2024-06-02T23:58:47.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.847+0000 7f047e058640 1 -- 172.21.15.96:0/1247261945 wait complete. 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.848+0000 7f047e058640 1 Processor -- start 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.848+0000 7f047e058640 1 -- start start 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f047e058640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04780cd150 0x7f047813d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f047e058640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04780cffb0 0x7f047813ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f047e058640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0478144130 0x7f04781404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f047e058640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f04780b3c70 con 0x7f0478144130 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f047e058640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f04780b3990 con 0x7f04780cd150 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f047e058640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f04780cd5b0 con 0x7f04780cffb0 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f0477fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0478144130 0x7f04781404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f0477fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0478144130 0x7f04781404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50576/0 (socket says 172.21.15.96:50576) 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f0477fff640 1 -- 172.21.15.96:0/3812793630 learned_addr learned my addr 172.21.15.96:0/3812793630 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:47.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f04777fe640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04780cd150 0x7f047813d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f0476ffd640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04780cffb0 0x7f047813ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f0477fff640 1 -- 172.21.15.96:0/3812793630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04780cffb0 msgr2=0x7f047813ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f0477fff640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04780cffb0 0x7f047813ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f0477fff640 1 -- 172.21.15.96:0/3812793630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04780cd150 msgr2=0x7f047813d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f0477fff640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04780cd150 0x7f047813d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.849+0000 7f0477fff640 1 -- 172.21.15.96:0/3812793630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047813dba0 con 0x7f0478144130 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.850+0000 7f0477fff640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0478144130 0x7f04781404e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f047000ccf0 tx=0x7f047000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.850+0000 7f045ffff640 1 -- 172.21.15.96:0/3812793630 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470003b90 con 0x7f0478144130 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.850+0000 7f045ffff640 1 -- 172.21.15.96:0/3812793630 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0470003d30 con 0x7f0478144130 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.850+0000 7f047e058640 1 -- 172.21.15.96:0/3812793630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047815bf60 con 0x7f0478144130 2024-06-02T23:58:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.850+0000 7f045ffff640 1 -- 172.21.15.96:0/3812793630 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470004240 con 0x7f0478144130 2024-06-02T23:58:47.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.850+0000 7f047e058640 1 -- 172.21.15.96:0/3812793630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047815c520 con 0x7f0478144130 2024-06-02T23:58:47.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.851+0000 7f047e058640 1 -- 172.21.15.96:0/3812793630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047815cb30 con 0x7f0478144130 2024-06-02T23:58:47.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.851+0000 7f045ffff640 1 -- 172.21.15.96:0/3812793630 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) ==== 90442+0+0 (secure 0 0 0) 0x7f04700043e0 con 0x7f0478144130 2024-06-02T23:58:47.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.852+0000 7f045ffff640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f046406bda0 0x7f046406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:47.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.852+0000 7f045ffff640 1 -- 172.21.15.96:0/3812793630 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6424+0+0 (secure 0 0 0) 0x7f047008b9f0 con 0x7f0478144130 2024-06-02T23:58:47.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.852+0000 7f04777fe640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f046406bda0 0x7f046406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:47.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.852+0000 7f04777fe640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f046406bda0 0x7f046406e260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f046800ab60 tx=0x7f0468008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:47.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:47.856+0000 7f045ffff640 1 -- 172.21.15.96:0/3812793630 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f047813dba0 con 0x7f0478144130 2024-06-02T23:58:48.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.098+0000 7f047e058640 1 -- 172.21.15.96:0/3812793630 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) -- 0x7f04780683e0 con 0x7f0478144130 2024-06-02T23:58:48.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.836+0000 7f045ffff640 1 -- 172.21.15.96:0/3812793630 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v442) ==== 158+0+0 (secure 0 0 0) 0x7f047005a1b0 con 0x7f0478144130 2024-06-02T23:58:48.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.840+0000 7f047e058640 1 -- 172.21.15.96:0/3812793630 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f046406bda0 msgr2=0x7f046406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:48.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.840+0000 7f047e058640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f046406bda0 0x7f046406e260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f046800ab60 tx=0x7f0468008040 comp rx=0 tx=0).stop 2024-06-02T23:58:48.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.840+0000 7f047e058640 1 -- 172.21.15.96:0/3812793630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0478144130 msgr2=0x7f04781404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:48.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.840+0000 7f047e058640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0478144130 0x7f04781404e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f047000ccf0 tx=0x7f047000a660 comp rx=0 tx=0).stop 2024-06-02T23:58:48.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.841+0000 7f047e058640 1 -- 172.21.15.96:0/3812793630 shutdown_connections 2024-06-02T23:58:48.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.841+0000 7f047e058640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f046406bda0 0x7f046406e260 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:48.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.841+0000 7f047e058640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0478144130 0x7f04781404e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:48.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.841+0000 7f047e058640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04780cffb0 0x7f047813ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:48.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.841+0000 7f047e058640 1 --2- 172.21.15.96:0/3812793630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04780cd150 0x7f047813d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:48.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.841+0000 7f047e058640 1 -- 172.21.15.96:0/3812793630 >> 172.21.15.96:0/3812793630 conn(0x7f047806b7b0 msgr2=0x7f0478071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:48.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.842+0000 7f047e058640 1 -- 172.21.15.96:0/3812793630 shutdown_connections 2024-06-02T23:58:48.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.842+0000 7f047e058640 1 -- 172.21.15.96:0/3812793630 wait complete. 2024-06-02T23:58:48.856 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2024-06-02T23:58:48.857 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2024-06-02T23:58:48.857 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-06-02T23:58:48.857 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:58:48.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.962+0000 7f8b747c1640 1 Processor -- start 2024-06-02T23:58:48.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.962+0000 7f8b747c1640 1 -- start start 2024-06-02T23:58:48.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b747c1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b6c15c150 0x7f8b6c0b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:48.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b747c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c0d0a90 0x7f8b6c0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:48.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b747c1640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b6c06beb0 con 0x7f8b6c15c530 2024-06-02T23:58:48.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b747c1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8b6c06b3c0 con 0x7f8b6c15c150 2024-06-02T23:58:48.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b747c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6c0b00d0 con 0x7f8b6c0d0a90 2024-06-02T23:58:48.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b71d5c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f8b6c15c530 0x7f8b6c0d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:34880/0 (socket says 172.21.15.96:34880) 2024-06-02T23:58:48.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b71d5c640 1 -- 172.21.15.96:0/4254842109 learned_addr learned my addr 172.21.15.96:0/4254842109 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:48.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b72d5e640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c0d0a90 0x7f8b6c0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:48.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b7255d640 1 --2- 172.21.15.96:0/4254842109 >> v2:172.21.15.162:3300/0 conn(0x7f8b6c15c150 0x7f8b6c0b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1856532951 0 0) 0x7f8b6c06beb0 con 0x7f8b6c15c530 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.963+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b58003520 con 0x7f8b6c15c530 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3511568229 0 0) 0x7f8b58003520 con 0x7f8b6c15c530 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c0d0a90 msgr2=0x7f8b6c0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c0d0a90 0x7f8b6c0b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 >> v2:172.21.15.162:3300/0 conn(0x7f8b6c15c150 msgr2=0x7f8b6c0b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 --2- 172.21.15.96:0/4254842109 >> v2:172.21.15.162:3300/0 conn(0x7f8b6c15c150 0x7f8b6c0b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c06b610 con 0x7f8b6c15c530 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f8b5c001670 con 0x7f8b6c15c530 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 >> v1:172.21.15.96:6789/0 conn(0x7f8b6c15c530 legacy=0x7f8b6c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c0d0a90 0x7f8b580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:48.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b58003f30 0x7f8b58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b58004d40 0x7f8b580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c06b3c0 con 0x7f8b58004d40 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c0b00d0 con 0x7f8b58003f30 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5800baa0 con 0x7f8b6c0d0a90 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b72d5e640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b58004d40 0x7f8b580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b7255d640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c0d0a90 0x7f8b580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b71d5c640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b58003f30 0x7f8b58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b72d5e640 1 -- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c0d0a90 msgr2=0x7f8b580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b72d5e640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c0d0a90 0x7f8b580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b72d5e640 1 -- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b58003f30 msgr2=0x7f8b58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b72d5e640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b58003f30 0x7f8b58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.964+0000 7f8b72d5e640 1 -- 172.21.15.96:0/4254842109 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b58003520 con 0x7f8b58004d40 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.965+0000 7f8b72d5e640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b58004d40 0x7f8b580051c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009fc0 tx=0x7f8b58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a12a6d234dbc06 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:48.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.965+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64009c10 con 0x7f8b58004d40 2024-06-02T23:58:48.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.965+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b64036070 con 0x7f8b58004d40 2024-06-02T23:58:48.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.965+0000 7f8b7155b640 1 -- 172.21.15.96:0/4254842109 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64031880 con 0x7f8b58004d40 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.965+0000 7f8b747c1640 1 -- 172.21.15.96:0/4254842109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b58004d40 msgr2=0x7f8b580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.965+0000 7f8b747c1640 1 --2- 172.21.15.96:0/4254842109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b58004d40 0x7f8b580051c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009fc0 tx=0x7f8b58005830 comp rx=0 tx=0).stop 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.965+0000 7f8b72d5e640 1 -- 172.21.15.96:0/4254842109 reap_dead start 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.966+0000 7f8b747c1640 1 -- 172.21.15.96:0/4254842109 shutdown_connections 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.966+0000 7f8b747c1640 1 -- 172.21.15.96:0/4254842109 >> 172.21.15.96:0/4254842109 conn(0x7f8b6c0b1f80 msgr2=0x7f8b6c0b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.966+0000 7f8b747c1640 1 -- 172.21.15.96:0/4254842109 shutdown_connections 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.966+0000 7f8b747c1640 1 -- 172.21.15.96:0/4254842109 wait complete. 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.967+0000 7f8b747c1640 1 Processor -- start 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.967+0000 7f8b747c1640 1 -- start start 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b747c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b58004d40 0x7f8b6c0c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b747c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c06d830 0x7f8b6c06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b747c1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c0c9680 0x7f8b6c0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:48.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b747c1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c0b6030 con 0x7f8b6c0c9680 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b747c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c06bbd0 con 0x7f8b58004d40 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b747c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6c0b61b0 con 0x7f8b6c06d830 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b72d5e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c0c9680 0x7f8b6c0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b72d5e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c0c9680 0x7f8b6c0c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50592/0 (socket says 172.21.15.96:50592) 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b72d5e640 1 -- 172.21.15.96:0/1224612280 learned_addr learned my addr 172.21.15.96:0/1224612280 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b7255d640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b58004d40 0x7f8b6c0c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b71d5c640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c06d830 0x7f8b6c06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b72d5e640 1 -- 172.21.15.96:0/1224612280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c06d830 msgr2=0x7f8b6c06dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b72d5e640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c06d830 0x7f8b6c06dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b72d5e640 1 -- 172.21.15.96:0/1224612280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b58004d40 msgr2=0x7f8b6c0c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b72d5e640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b58004d40 0x7f8b6c0c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b72d5e640 1 -- 172.21.15.96:0/1224612280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6c1f1eb0 con 0x7f8b6c0c9680 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b72d5e640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c0c9680 0x7f8b6c0c9ae0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8b64033040 tx=0x7f8b64009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:48.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b62ffd640 1 -- 172.21.15.96:0/1224612280 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64009c10 con 0x7f8b6c0c9680 2024-06-02T23:58:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b62ffd640 1 -- 172.21.15.96:0/1224612280 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b64031db0 con 0x7f8b6c0c9680 2024-06-02T23:58:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b747c1640 1 -- 172.21.15.96:0/1224612280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6c0ca260 con 0x7f8b6c0c9680 2024-06-02T23:58:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b62ffd640 1 -- 172.21.15.96:0/1224612280 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b64003bd0 con 0x7f8b6c0c9680 2024-06-02T23:58:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.968+0000 7f8b747c1640 1 -- 172.21.15.96:0/1224612280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6c155f10 con 0x7f8b6c0c9680 2024-06-02T23:58:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.969+0000 7f8b747c1640 1 -- 172.21.15.96:0/1224612280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b6c0ad810 con 0x7f8b6c0c9680 2024-06-02T23:58:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.970+0000 7f8b62ffd640 1 -- 172.21.15.96:0/1224612280 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f8b64005d10 con 0x7f8b6c0c9680 2024-06-02T23:58:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.970+0000 7f8b62ffd640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8b5006be30 0x7f8b5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.970+0000 7f8b62ffd640 1 -- 172.21.15.96:0/1224612280 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6424+0+0 (secure 0 0 0) 0x7f8b640ac810 con 0x7f8b6c0c9680 2024-06-02T23:58:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.970+0000 7f8b7255d640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8b5006be30 0x7f8b5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:48.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.971+0000 7f8b7255d640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8b5006be30 0x7f8b5006e2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009c40 tx=0x7f8b68009190 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:48.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:48.975+0000 7f8b62ffd640 1 -- 172.21.15.96:0/1224612280 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8b6c0ad810 con 0x7f8b6c0c9680 2024-06-02T23:58:49.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.149+0000 7f8b747c1640 1 -- 172.21.15.96:0/1224612280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b6c0683e0 con 0x7f8b6c0c9680 2024-06-02T23:58:49.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.150+0000 7f8b62ffd640 1 -- 172.21.15.96:0/1224612280 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+14900 (secure 0 0 0) 0x7f8b6404a060 con 0x7f8b6c0c9680 2024-06-02T23:58:49.150 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:49.150 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":61,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:58:46.796837+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/2103859354":"2024-06-03T23:58:44.478952+0000","172.21.15.96:0/3223380814":"2024-06-03T23:58:44.478952+0000","172.21.15.96:0/2390098734":"2024-06-03T23:47:37.584660+0000","172.21.15.96:0/3440569408":"2024-06-03T23:58:44.478952+0000","172.21.15.96:0/1817078982":"2024-06-03T23:58:44.478952+0000","172.21.15.96:0/3528489863":"2024-06-03T23:58:44.478952+0000","172.21.15.96:6837/593845400":"2024-06-03T23:58:44.143124+0000","172.21.15.96:0/78106757":"2024-06-03T23:47:37.584660+0000","172.21.15.96:6833/908493645":"2024-06-03T23:58:44.478952+0000","172.21.15.96:6832/1776728888":"2024-06-03T23:47:37.584660+0000","172.21.15.96:6833/1776728888":"2024-06-03T23:47:37.584660+0000","172.21.15.96:0/3970369200":"2024-06-03T23:47:37.584660+0000","172.21.15.96:0/4099111729":"2024-06-03T23:58:44.478952+0000","172.21.15.96:0/1293902884":"2024-06-03T23:47:37.584660+0000","172.21.15.96:6836/593845400":"2024-06-03T23:58:44.143124+0000","172.21.15.96:0/1351662367":"2024-06-03T23:58:44.478952+0000","172.21.15.96:6832/908493645":"2024-06-03T23:58:44.478952+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":12,"length":1},{"begin":16,"length":1},{"begin":22,"length":1},{"begin":26,"length":1},{"begin":33,"length":1},{"begin":37,"length":1},{"begin":43,"length":1},{"begin":47,"length":1},{"begin":54,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":64,"length":1},{"begin":68,"length":1},{"begin":71,"length":2},{"begin":75,"length":1},{"begin":79,"length":1},{"begin":83,"length":1},{"begin":86,"length":1},{"begin":90,"length":1},{"begin":94,"length":1},{"begin":97,"length":1},{"begin":101,"length":2},{"begin":105,"length":1},{"begin":108,"length":1},{"begin":194,"length":28}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:58:49.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 -- 172.21.15.96:0/1224612280 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8b5006be30 msgr2=0x7f8b5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8b5006be30 0x7f8b5006e2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009c40 tx=0x7f8b68009190 comp rx=0 tx=0).stop 2024-06-02T23:58:49.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 -- 172.21.15.96:0/1224612280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c0c9680 msgr2=0x7f8b6c0c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c0c9680 0x7f8b6c0c9ae0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8b64033040 tx=0x7f8b64009750 comp rx=0 tx=0).stop 2024-06-02T23:58:49.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 -- 172.21.15.96:0/1224612280 shutdown_connections 2024-06-02T23:58:49.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f8b5006be30 0x7f8b5006e2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b6c0c9680 0x7f8b6c0c9ae0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b6c06d830 0x7f8b6c06dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 --2- 172.21.15.96:0/1224612280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b58004d40 0x7f8b6c0c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 -- 172.21.15.96:0/1224612280 >> 172.21.15.96:0/1224612280 conn(0x7f8b6c0b1f80 msgr2=0x7f8b6c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:49.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 -- 172.21.15.96:0/1224612280 shutdown_connections 2024-06-02T23:58:49.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.152+0000 7f8b747c1640 1 -- 172.21.15.96:0/1224612280 wait complete. 2024-06-02T23:58:49.163 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T23:46:14.025119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T23:58:49.163 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T23:58:49.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.266+0000 7fdb49ce7640 1 Processor -- start 2024-06-02T23:58:49.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.266+0000 7fdb49ce7640 1 -- start start 2024-06-02T23:58:49.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.267+0000 7fdb49ce7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdb4415fc40 0x7fdb44071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.267+0000 7fdb49ce7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdb440729e0 0x7fdb44160020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.267+0000 7fdb49ce7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb44160560 con 0x7fdb4406ec50 2024-06-02T23:58:49.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.267+0000 7fdb49ce7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fdb440718f0 con 0x7fdb440729e0 2024-06-02T23:58:49.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.267+0000 7fdb49ce7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdb44072fa0 con 0x7fdb4415fc40 2024-06-02T23:58:49.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.267+0000 7fdb3bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdb440729e0 0x7fdb44160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.267+0000 7fdb3bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fdb440729e0 0x7fdb44160020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50596/0 (socket says 172.21.15.96:50596) 2024-06-02T23:58:49.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.267+0000 7fdb3bfff640 1 -- 172.21.15.96:0/4062544485 learned_addr learned my addr 172.21.15.96:0/4062544485 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:49.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.267+0000 7fdb437fe640 1 --2- 172.21.15.96:0/4062544485 >> v2:172.21.15.162:3300/0 conn(0x7fdb4415fc40 0x7fdb44071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.268+0000 7fdb3bfff640 1 -- 172.21.15.96:0/4062544485 >> v2:172.21.15.162:3300/0 conn(0x7fdb4415fc40 msgr2=0x7fdb44071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:49.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.268+0000 7fdb3bfff640 1 --2- 172.21.15.96:0/4062544485 >> v2:172.21.15.162:3300/0 conn(0x7fdb4415fc40 0x7fdb44071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.268+0000 7fdb3bfff640 1 -- 172.21.15.96:0/4062544485 >> v1:172.21.15.162:6789/0 conn(0x7fdb4406ec50 legacy=0x7fdb440ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.268+0000 7fdb3bfff640 1 -- 172.21.15.96:0/4062544485 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb440712a0 con 0x7fdb440729e0 2024-06-02T23:58:49.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.268+0000 7fdb437fe640 1 --2- 172.21.15.96:0/4062544485 >> v2:172.21.15.162:3300/0 conn(0x7fdb4415fc40 0x7fdb44071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:49.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.268+0000 7fdb3bfff640 1 --2- 172.21.15.96:0/4062544485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb440729e0 0x7fdb44160020 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009870 tx=0x7fdb2c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b17f193158cb9c5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.268+0000 7fdb42ffd640 1 -- 172.21.15.96:0/4062544485 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c037070 con 0x7fdb440729e0 2024-06-02T23:58:49.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.269+0000 7fdb42ffd640 1 -- 172.21.15.96:0/4062544485 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2c032440 con 0x7fdb440729e0 2024-06-02T23:58:49.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.269+0000 7fdb42ffd640 1 -- 172.21.15.96:0/4062544485 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c032810 con 0x7fdb440729e0 2024-06-02T23:58:49.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.269+0000 7fdb49ce7640 1 -- 172.21.15.96:0/4062544485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb440729e0 msgr2=0x7fdb44160020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.269+0000 7fdb49ce7640 1 --2- 172.21.15.96:0/4062544485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb440729e0 0x7fdb44160020 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009870 tx=0x7fdb2c02a210 comp rx=0 tx=0).stop 2024-06-02T23:58:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.269+0000 7fdb49ce7640 1 -- 172.21.15.96:0/4062544485 shutdown_connections 2024-06-02T23:58:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.269+0000 7fdb49ce7640 1 --2- 172.21.15.96:0/4062544485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb440729e0 0x7fdb44160020 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.269+0000 7fdb49ce7640 1 --2- 172.21.15.96:0/4062544485 >> v2:172.21.15.162:3300/0 conn(0x7fdb4415fc40 0x7fdb44071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.269+0000 7fdb49ce7640 1 -- 172.21.15.96:0/4062544485 >> 172.21.15.96:0/4062544485 conn(0x7fdb440cfcb0 msgr2=0x7fdb440d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.269+0000 7fdb49ce7640 1 -- 172.21.15.96:0/4062544485 shutdown_connections 2024-06-02T23:58:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.269+0000 7fdb49ce7640 1 -- 172.21.15.96:0/4062544485 wait complete. 2024-06-02T23:58:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.270+0000 7fdb49ce7640 1 Processor -- start 2024-06-02T23:58:49.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.270+0000 7fdb49ce7640 1 -- start start 2024-06-02T23:58:49.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb49ce7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb4406ec50 0x7fdb4414fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb49ce7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb440729e0 0x7fdb4414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb49ce7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb4415fc40 0x7fdb440c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb49ce7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4406f240 con 0x7fdb4415fc40 2024-06-02T23:58:49.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb49ce7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4406f0c0 con 0x7fdb440729e0 2024-06-02T23:58:49.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb49ce7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb440caa10 con 0x7fdb4406ec50 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb43fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb4415fc40 0x7fdb440c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb43fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb4415fc40 0x7fdb440c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50612/0 (socket says 172.21.15.96:50612) 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb43fff640 1 -- 172.21.15.96:0/1739078148 learned_addr learned my addr 172.21.15.96:0/1739078148 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb3bfff640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb440729e0 0x7fdb4414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb43fff640 1 -- 172.21.15.96:0/1739078148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb4406ec50 msgr2=0x7fdb4414fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb43fff640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb4406ec50 0x7fdb4414fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb43fff640 1 -- 172.21.15.96:0/1739078148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb440729e0 msgr2=0x7fdb4414f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb43fff640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb440729e0 0x7fdb4414f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.271+0000 7fdb43fff640 1 -- 172.21.15.96:0/1739078148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb441f5c30 con 0x7fdb4415fc40 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.272+0000 7fdb43fff640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb4415fc40 0x7fdb440c9290 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00c730 tx=0x7fdb3c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.272+0000 7fdb40ff9640 1 -- 172.21.15.96:0/1739078148 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c003b90 con 0x7fdb4415fc40 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.272+0000 7fdb40ff9640 1 -- 172.21.15.96:0/1739078148 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb3c003d30 con 0x7fdb4415fc40 2024-06-02T23:58:49.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.272+0000 7fdb49ce7640 1 -- 172.21.15.96:0/1739078148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb441f5f10 con 0x7fdb4415fc40 2024-06-02T23:58:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.272+0000 7fdb40ff9640 1 -- 172.21.15.96:0/1739078148 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c005310 con 0x7fdb4415fc40 2024-06-02T23:58:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.272+0000 7fdb49ce7640 1 -- 172.21.15.96:0/1739078148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb441f64d0 con 0x7fdb4415fc40 2024-06-02T23:58:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.273+0000 7fdb49ce7640 1 -- 172.21.15.96:0/1739078148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb440b15e0 con 0x7fdb4415fc40 2024-06-02T23:58:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.273+0000 7fdb40ff9640 1 -- 172.21.15.96:0/1739078148 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fdb3c0056c0 con 0x7fdb4415fc40 2024-06-02T23:58:49.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.274+0000 7fdb40ff9640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fdb2406be30 0x7fdb2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.274+0000 7fdb40ff9640 1 -- 172.21.15.96:0/1739078148 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6424+0+0 (secure 0 0 0) 0x7fdb3c08b110 con 0x7fdb4415fc40 2024-06-02T23:58:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.274+0000 7fdb437fe640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fdb2406be30 0x7fdb2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.274+0000 7fdb437fe640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fdb2406be30 0x7fdb2406e2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb34006fd0 tx=0x7fdb34008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.278+0000 7fdb40ff9640 1 -- 172.21.15.96:0/1739078148 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fdb440b15e0 con 0x7fdb4415fc40 2024-06-02T23:58:49.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.451+0000 7fdb49ce7640 1 -- 172.21.15.96:0/1739078148 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdb440d0830 con 0x7fdb4415fc40 2024-06-02T23:58:49.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.451+0000 7fdb40ff9640 1 -- 172.21.15.96:0/1739078148 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) ==== 93+0+10 (secure 0 0 0) 0x7fdb440d0830 con 0x7fdb4415fc40 2024-06-02T23:58:49.451 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-06-02T23:58:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 -- 172.21.15.96:0/1739078148 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fdb2406be30 msgr2=0x7fdb2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fdb2406be30 0x7fdb2406e2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb34006fd0 tx=0x7fdb34008040 comp rx=0 tx=0).stop 2024-06-02T23:58:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 -- 172.21.15.96:0/1739078148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb4415fc40 msgr2=0x7fdb440c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb4415fc40 0x7fdb440c9290 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00c730 tx=0x7fdb3c00cbf0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 -- 172.21.15.96:0/1739078148 shutdown_connections 2024-06-02T23:58:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fdb2406be30 0x7fdb2406e2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb4415fc40 0x7fdb440c9290 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb440729e0 0x7fdb4414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 --2- 172.21.15.96:0/1739078148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb4406ec50 0x7fdb4414fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 -- 172.21.15.96:0/1739078148 >> 172.21.15.96:0/1739078148 conn(0x7fdb440cfcb0 msgr2=0x7fdb440ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:49.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 -- 172.21.15.96:0/1739078148 shutdown_connections 2024-06-02T23:58:49.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.453+0000 7fdb49ce7640 1 -- 172.21.15.96:0/1739078148 wait complete. 2024-06-02T23:58:49.464 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2024-06-02T23:58:49.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.564+0000 7fc2baeb2640 1 Processor -- start 2024-06-02T23:58:49.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.564+0000 7fc2baeb2640 1 -- start start 2024-06-02T23:58:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.565+0000 7fc2baeb2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc2b40b5510 0x7fc2b40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.565+0000 7fc2baeb2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2b40d4a90 con 0x7fc2b4161900 2024-06-02T23:58:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.565+0000 7fc2baeb2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2b40d4d70 con 0x7fc2b40d1120 2024-06-02T23:58:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.565+0000 7fc2baeb2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b40cf5c0 con 0x7fc2b40b5510 2024-06-02T23:58:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.565+0000 7fc2b944f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc2b40b5510 0x7fc2b40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.565+0000 7fc2b8c4e640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc2b4161900 0x7fc2b40d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:34882/0 (socket says 172.21.15.96:34882) 2024-06-02T23:58:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.565+0000 7fc2b8c4e640 1 -- 172.21.15.96:0/1929464960 learned_addr learned my addr 172.21.15.96:0/1929464960 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.566+0000 7fc2b944f640 1 -- 172.21.15.96:0/1929464960 >> v1:172.21.15.162:6789/0 conn(0x7fc2b40d1120 legacy=0x7fc2b40c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.566+0000 7fc2b944f640 1 -- 172.21.15.96:0/1929464960 >> v1:172.21.15.96:6789/0 conn(0x7fc2b4161900 legacy=0x7fc2b40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.566+0000 7fc2b944f640 1 -- 172.21.15.96:0/1929464960 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b40cf800 con 0x7fc2b40b5510 2024-06-02T23:58:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.566+0000 7fc2b37fe640 1 -- 172.21.15.96:0/1929464960 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024714495 0 0) 0x7fc2b40d4a90 con 0x7fc2b4161900 2024-06-02T23:58:49.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.566+0000 7fc2b944f640 1 --2- 172.21.15.96:0/1929464960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b40b5510 0x7fc2b40c82d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0097a0 tx=0x7fc2ac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbc1b23da43a48f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.566+0000 7fc2b37fe640 1 -- 172.21.15.96:0/1929464960 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac037070 con 0x7fc2b40b5510 2024-06-02T23:58:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.567+0000 7fc2b37fe640 1 -- 172.21.15.96:0/1929464960 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ac032440 con 0x7fc2b40b5510 2024-06-02T23:58:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.567+0000 7fc2b37fe640 1 -- 172.21.15.96:0/1929464960 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac032810 con 0x7fc2b40b5510 2024-06-02T23:58:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.567+0000 7fc2baeb2640 1 -- 172.21.15.96:0/1929464960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b40b5510 msgr2=0x7fc2b40c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.567+0000 7fc2baeb2640 1 --2- 172.21.15.96:0/1929464960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b40b5510 0x7fc2b40c82d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac0097a0 tx=0x7fc2ac02a1a0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.567+0000 7fc2baeb2640 1 -- 172.21.15.96:0/1929464960 shutdown_connections 2024-06-02T23:58:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.567+0000 7fc2baeb2640 1 --2- 172.21.15.96:0/1929464960 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b40b5510 0x7fc2b40c82d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.567+0000 7fc2baeb2640 1 -- 172.21.15.96:0/1929464960 >> 172.21.15.96:0/1929464960 conn(0x7fc2b409d3b0 msgr2=0x7fc2b40d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.567+0000 7fc2baeb2640 1 -- 172.21.15.96:0/1929464960 shutdown_connections 2024-06-02T23:58:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.567+0000 7fc2baeb2640 1 -- 172.21.15.96:0/1929464960 wait complete. 2024-06-02T23:58:49.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.568+0000 7fc2baeb2640 1 Processor -- start 2024-06-02T23:58:49.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.568+0000 7fc2baeb2640 1 -- start start 2024-06-02T23:58:49.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2baeb2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2b40b5510 0x7fc2b41564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2baeb2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b40d1120 0x7fc2b4157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2baeb2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b4161900 0x7fc2b41f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2baeb2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b40d4780 con 0x7fc2b4161900 2024-06-02T23:58:49.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2baeb2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b40caf70 con 0x7fc2b40b5510 2024-06-02T23:58:49.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2baeb2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b4161ce0 con 0x7fc2b40d1120 2024-06-02T23:58:49.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2b944f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b4161900 0x7fc2b41f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2b944f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b4161900 0x7fc2b41f40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50622/0 (socket says 172.21.15.96:50622) 2024-06-02T23:58:49.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2b944f640 1 -- 172.21.15.96:0/496487408 learned_addr learned my addr 172.21.15.96:0/496487408 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:49.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2b8c4e640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2b40b5510 0x7fc2b41564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2b3fff640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b40d1120 0x7fc2b4157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2b944f640 1 -- 172.21.15.96:0/496487408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b40d1120 msgr2=0x7fc2b4157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2b944f640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b40d1120 0x7fc2b4157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.569+0000 7fc2b944f640 1 -- 172.21.15.96:0/496487408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2b40b5510 msgr2=0x7fc2b41564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.570+0000 7fc2b944f640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2b40b5510 0x7fc2b41564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.570+0000 7fc2b944f640 1 -- 172.21.15.96:0/496487408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b4158440 con 0x7fc2b4161900 2024-06-02T23:58:49.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.570+0000 7fc2b3fff640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b40d1120 0x7fc2b4157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:49.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.570+0000 7fc2b944f640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b4161900 0x7fc2b41f40d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac035040 tx=0x7fc2ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.570+0000 7fc2b17fa640 1 -- 172.21.15.96:0/496487408 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac037050 con 0x7fc2b4161900 2024-06-02T23:58:49.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.570+0000 7fc2b17fa640 1 -- 172.21.15.96:0/496487408 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ac038040 con 0x7fc2b4161900 2024-06-02T23:58:49.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.570+0000 7fc2b17fa640 1 -- 172.21.15.96:0/496487408 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac004490 con 0x7fc2b4161900 2024-06-02T23:58:49.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.570+0000 7fc2baeb2640 1 -- 172.21.15.96:0/496487408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b4154c90 con 0x7fc2b4161900 2024-06-02T23:58:49.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.570+0000 7fc2baeb2640 1 -- 172.21.15.96:0/496487408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b40ccb20 con 0x7fc2b4161900 2024-06-02T23:58:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.571+0000 7fc2baeb2640 1 -- 172.21.15.96:0/496487408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b40683e0 con 0x7fc2b4161900 2024-06-02T23:58:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.571+0000 7fc2b17fa640 1 -- 172.21.15.96:0/496487408 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fc2ac030980 con 0x7fc2b4161900 2024-06-02T23:58:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.572+0000 7fc2b17fa640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc29406be30 0x7fc29406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.572+0000 7fc2b17fa640 1 -- 172.21.15.96:0/496487408 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6424+0+0 (secure 0 0 0) 0x7fc2ac0abca0 con 0x7fc2b4161900 2024-06-02T23:58:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.572+0000 7fc2b8c4e640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc29406be30 0x7fc29406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.572+0000 7fc2b8c4e640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc29406be30 0x7fc29406e2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40012e0 tx=0x7fc2a4005bf0 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.576+0000 7fc2b17fa640 1 -- 172.21.15.96:0/496487408 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc2ac032e20 con 0x7fc2b4161900 2024-06-02T23:58:49.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.819+0000 7fc2baeb2640 1 -- 172.21.15.96:0/496487408 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) -- 0x7fc2b40d41f0 con 0x7fc2b4161900 2024-06-02T23:58:49.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.838+0000 7fc2b17fa640 1 -- 172.21.15.96:0/496487408 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v443) ==== 157+0+0 (secure 0 0 0) 0x7fc2ac07a530 con 0x7fc2b4161900 2024-06-02T23:58:49.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 -- 172.21.15.96:0/496487408 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc29406be30 msgr2=0x7fc29406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc29406be30 0x7fc29406e2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40012e0 tx=0x7fc2a4005bf0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 -- 172.21.15.96:0/496487408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b4161900 msgr2=0x7fc2b41f40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b4161900 0x7fc2b41f40d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac035040 tx=0x7fc2ac0046c0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 -- 172.21.15.96:0/496487408 shutdown_connections 2024-06-02T23:58:49.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc29406be30 0x7fc29406e2f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b4161900 0x7fc2b41f40d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2b40d1120 0x7fc2b4157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 --2- 172.21.15.96:0/496487408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2b40b5510 0x7fc2b41564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 -- 172.21.15.96:0/496487408 >> 172.21.15.96:0/496487408 conn(0x7fc2b409d3b0 msgr2=0x7fc2b415ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:49.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 -- 172.21.15.96:0/496487408 shutdown_connections 2024-06-02T23:58:49.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.840+0000 7fc2baeb2640 1 -- 172.21.15.96:0/496487408 wait complete. 2024-06-02T23:58:49.851 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-06-02T23:58:49.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.952+0000 7f0e142ae640 1 Processor -- start 2024-06-02T23:58:49.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.952+0000 7f0e142ae640 1 -- start start 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.953+0000 7f0e142ae640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0e0c06eaa0 0x7f0e0c0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.953+0000 7f0e142ae640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e0c0723e0 con 0x7f0e0c15e530 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.953+0000 7f0e142ae640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e0c0cb7b0 con 0x7f0e0c06e610 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.953+0000 7f0e142ae640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0e0c072680 con 0x7f0e0c06eaa0 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.953+0000 7f0e1204a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f0e0c15e530 0x7f0e0c0cad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:34894/0 (socket says 172.21.15.96:34894) 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.953+0000 7f0e1204a640 1 -- 172.21.15.96:0/407503898 learned_addr learned my addr 172.21.15.96:0/407503898 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.953+0000 7f0e1284b640 1 --2- 172.21.15.96:0/407503898 >> v2:172.21.15.162:3300/0 conn(0x7f0e0c06eaa0 0x7f0e0c0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.953+0000 7f0e11048640 1 -- 172.21.15.96:0/407503898 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115521301 0 0) 0x7f0e0c0723e0 con 0x7f0e0c15e530 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.953+0000 7f0e11048640 1 -- 172.21.15.96:0/407503898 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0df8003520 con 0x7f0e0c15e530 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.954+0000 7f0e11048640 1 -- 172.21.15.96:0/407503898 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1843512186 0 0) 0x7f0e0c0cb7b0 con 0x7f0e0c06e610 2024-06-02T23:58:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.954+0000 7f0e11048640 1 -- 172.21.15.96:0/407503898 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e0c0723e0 con 0x7f0e0c06e610 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.954+0000 7f0e11048640 1 -- 172.21.15.96:0/407503898 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 266903204 0 0) 0x7f0df8003520 con 0x7f0e0c15e530 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.954+0000 7f0e1284b640 1 -- 172.21.15.96:0/407503898 >> v1:172.21.15.162:6789/0 conn(0x7f0e0c06e610 legacy=0x7f0e0c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.954+0000 7f0e1284b640 1 -- 172.21.15.96:0/407503898 >> v1:172.21.15.96:6789/0 conn(0x7f0e0c15e530 legacy=0x7f0e0c0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.954+0000 7f0e1284b640 1 -- 172.21.15.96:0/407503898 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0c072960 con 0x7f0e0c06eaa0 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.954+0000 7f0e1284b640 1 --2- 172.21.15.96:0/407503898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e0c06eaa0 0x7f0e0c0cdf90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009d90 tx=0x7f0e0402a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49bbe5277694c626 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.955+0000 7f0e11048640 1 -- 172.21.15.96:0/407503898 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08001670 con 0x7f0e0c06eaa0 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.955+0000 7f0e11048640 1 -- 172.21.15.96:0/407503898 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e04007540 con 0x7f0e0c06eaa0 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.955+0000 7f0e11048640 1 -- 172.21.15.96:0/407503898 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04007910 con 0x7f0e0c06eaa0 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.955+0000 7f0e142ae640 1 -- 172.21.15.96:0/407503898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e0c06eaa0 msgr2=0x7f0e0c0cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.955+0000 7f0e142ae640 1 --2- 172.21.15.96:0/407503898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e0c06eaa0 0x7f0e0c0cdf90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009d90 tx=0x7f0e0402a560 comp rx=0 tx=0).stop 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.955+0000 7f0e142ae640 1 -- 172.21.15.96:0/407503898 shutdown_connections 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.955+0000 7f0e142ae640 1 --2- 172.21.15.96:0/407503898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e0c06eaa0 0x7f0e0c0cdf90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.955+0000 7f0e142ae640 1 -- 172.21.15.96:0/407503898 >> 172.21.15.96:0/407503898 conn(0x7f0e0c0cfcb0 msgr2=0x7f0e0c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:49.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.955+0000 7f0e142ae640 1 -- 172.21.15.96:0/407503898 shutdown_connections 2024-06-02T23:58:49.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.955+0000 7f0e142ae640 1 -- 172.21.15.96:0/407503898 wait complete. 2024-06-02T23:58:49.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.956+0000 7f0e142ae640 1 Processor -- start 2024-06-02T23:58:49.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.956+0000 7f0e142ae640 1 -- start start 2024-06-02T23:58:49.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.957+0000 7f0e142ae640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e0c06e610 0x7f0e0c145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.957+0000 7f0e142ae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e0c06eaa0 0x7f0e0c1f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.957+0000 7f0e142ae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e0c15e530 0x7f0e0c143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.957+0000 7f0e142ae640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c073160 con 0x7f0e0c06e610 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.957+0000 7f0e142ae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c15e910 con 0x7f0e0c15e530 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.957+0000 7f0e142ae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0e0c06eeb0 con 0x7f0e0c06eaa0 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.957+0000 7f0e1204a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e0c06e610 0x7f0e0c145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.957+0000 7f0e1204a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e0c06e610 0x7f0e0c145ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50638/0 (socket says 172.21.15.96:50638) 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.957+0000 7f0e1204a640 1 -- 172.21.15.96:0/1665474429 learned_addr learned my addr 172.21.15.96:0/1665474429 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.957+0000 7f0e1284b640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e0c15e530 0x7f0e0c143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e11849640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e0c06eaa0 0x7f0e0c1f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e1204a640 1 -- 172.21.15.96:0/1665474429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e0c06eaa0 msgr2=0x7f0e0c1f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e1204a640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e0c06eaa0 0x7f0e0c1f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e1204a640 1 -- 172.21.15.96:0/1665474429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e0c15e530 msgr2=0x7f0e0c143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e1204a640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e0c15e530 0x7f0e0c143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e1204a640 1 -- 172.21.15.96:0/1665474429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0c1f2010 con 0x7f0e0c06e610 2024-06-02T23:58:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e1284b640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e0c15e530 0x7f0e0c143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e1204a640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e0c06e610 0x7f0e0c145ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800c520 tx=0x7f0e0800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e02ffd640 1 -- 172.21.15.96:0/1665474429 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08017070 con 0x7f0e0c06e610 2024-06-02T23:58:49.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e02ffd640 1 -- 172.21.15.96:0/1665474429 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e08005ce0 con 0x7f0e0c06e610 2024-06-02T23:58:49.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e02ffd640 1 -- 172.21.15.96:0/1665474429 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e080072b0 con 0x7f0e0c06e610 2024-06-02T23:58:49.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e142ae640 1 -- 172.21.15.96:0/1665474429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e0c0b4200 con 0x7f0e0c06e610 2024-06-02T23:58:49.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.958+0000 7f0e142ae640 1 -- 172.21.15.96:0/1665474429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e0c0b47c0 con 0x7f0e0c06e610 2024-06-02T23:58:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.959+0000 7f0e142ae640 1 -- 172.21.15.96:0/1665474429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e0c0683e0 con 0x7f0e0c06e610 2024-06-02T23:58:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.959+0000 7f0e02ffd640 1 -- 172.21.15.96:0/1665474429 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f0e0801a070 con 0x7f0e0c06e610 2024-06-02T23:58:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.960+0000 7f0e02ffd640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0df006be30 0x7f0df006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.960+0000 7f0e02ffd640 1 -- 172.21.15.96:0/1665474429 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6424+0+0 (secure 0 0 0) 0x7f0e0808a5a0 con 0x7f0e0c06e610 2024-06-02T23:58:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.960+0000 7f0e11849640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0df006be30 0x7f0df006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.960+0000 7f0e11849640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0df006be30 0x7f0df006e2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0ce770 tx=0x7f0dfc009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:49.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:49.964+0000 7f0e02ffd640 1 -- 172.21.15.96:0/1665474429 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0e08058c80 con 0x7f0e0c06e610 2024-06-02T23:58:50.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.140+0000 7f0e142ae640 1 -- 172.21.15.96:0/1665474429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0e0c15cf10 con 0x7f0e0c06e610 2024-06-02T23:58:50.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.146+0000 7f0e02ffd640 1 -- 172.21.15.96:0/1665474429 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f0e08058580 con 0x7f0e0c06e610 2024-06-02T23:58:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 -- 172.21.15.96:0/1665474429 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0df006be30 msgr2=0x7f0df006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0df006be30 0x7f0df006e2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0ce770 tx=0x7f0dfc009040 comp rx=0 tx=0).stop 2024-06-02T23:58:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 -- 172.21.15.96:0/1665474429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e0c06e610 msgr2=0x7f0e0c145ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e0c06e610 0x7f0e0c145ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800c520 tx=0x7f0e0800c9e0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 -- 172.21.15.96:0/1665474429 shutdown_connections 2024-06-02T23:58:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0df006be30 0x7f0df006e2f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e0c15e530 0x7f0e0c143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e0c06eaa0 0x7f0e0c1f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 --2- 172.21.15.96:0/1665474429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e0c06e610 0x7f0e0c145ad0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 -- 172.21.15.96:0/1665474429 >> 172.21.15.96:0/1665474429 conn(0x7f0e0c0cfcb0 msgr2=0x7f0e0c0c9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 -- 172.21.15.96:0/1665474429 shutdown_connections 2024-06-02T23:58:50.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.148+0000 7f0e142ae640 1 -- 172.21.15.96:0/1665474429 wait complete. 2024-06-02T23:58:50.159 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-06-02T23:58:50.159 DEBUG:teuthology.orchestra.run.smithi096:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T23:58:50.201 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-06-02T23:58:50.248 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-06-02T23:58:50.248 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:58:50.248 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:58:50.264 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17530 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T23:58:50.264 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:58:50.264 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:58:50.283 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056333,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16850 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T23:58:50.283 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-02T23:58:50.283 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:58:50.319 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17530 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-02T23:58:50.319 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T23:58:50.319 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T23:58:50.340 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056333,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16850 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-02T23:58:50.341 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-06-02T23:58:50.341 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:58:50.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.459+0000 7f240ea31640 1 Processor -- start 2024-06-02T23:58:50.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.459+0000 7f240ea31640 1 -- start start 2024-06-02T23:58:50.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.459+0000 7f240ea31640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f24080d1120 0x7f24080c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:50.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.459+0000 7f240ea31640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f24080b5510 0x7f24080c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:50.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.459+0000 7f240ea31640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24080d4a90 con 0x7f2408161900 2024-06-02T23:58:50.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.459+0000 7f240ea31640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f24080cf5c0 con 0x7f24080d1120 2024-06-02T23:58:50.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.459+0000 7f240ea31640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f24080caf70 con 0x7f24080b5510 2024-06-02T23:58:50.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.460+0000 7f24077fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f24080d1120 0x7f24080c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.460+0000 7f24077fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f24080d1120 0x7f24080c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50642/0 (socket says 172.21.15.96:50642) 2024-06-02T23:58:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.460+0000 7f24077fe640 1 -- 172.21.15.96:0/2712700161 learned_addr learned my addr 172.21.15.96:0/2712700161 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.460+0000 7f24077fe640 1 -- 172.21.15.96:0/2712700161 >> v2:172.21.15.162:3300/0 conn(0x7f24080b5510 msgr2=0x7f24080c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.460+0000 7f24077fe640 1 --2- 172.21.15.96:0/2712700161 >> v2:172.21.15.162:3300/0 conn(0x7f24080b5510 0x7f24080c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.460+0000 7f24077fe640 1 -- 172.21.15.96:0/2712700161 >> v1:172.21.15.162:6789/0 conn(0x7f2408161900 legacy=0x7f24080d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.460+0000 7f24077fe640 1 -- 172.21.15.96:0/2712700161 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24080d4d70 con 0x7f24080d1120 2024-06-02T23:58:50.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.460+0000 7f24077fe640 1 --2- 172.21.15.96:0/2712700161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080d1120 0x7f24080c7bc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f24080d33e0 tx=0x7f23fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fcecc81249303b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:50.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f2406ffd640 1 -- 172.21.15.96:0/2712700161 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc037070 con 0x7f24080d1120 2024-06-02T23:58:50.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f2406ffd640 1 -- 172.21.15.96:0/2712700161 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc032440 con 0x7f24080d1120 2024-06-02T23:58:50.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f2406ffd640 1 -- 172.21.15.96:0/2712700161 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc032810 con 0x7f24080d1120 2024-06-02T23:58:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f240ea31640 1 -- 172.21.15.96:0/2712700161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080d1120 msgr2=0x7f24080c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f240ea31640 1 --2- 172.21.15.96:0/2712700161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080d1120 0x7f24080c7bc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f24080d33e0 tx=0x7f23fc02a1a0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f240ea31640 1 -- 172.21.15.96:0/2712700161 shutdown_connections 2024-06-02T23:58:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f240ea31640 1 --2- 172.21.15.96:0/2712700161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24080d1120 0x7f24080c7bc0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f240ea31640 1 --2- 172.21.15.96:0/2712700161 >> v2:172.21.15.162:3300/0 conn(0x7f24080b5510 0x7f24080c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f240ea31640 1 -- 172.21.15.96:0/2712700161 >> 172.21.15.96:0/2712700161 conn(0x7f240809d3b0 msgr2=0x7f24080d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f240ea31640 1 -- 172.21.15.96:0/2712700161 shutdown_connections 2024-06-02T23:58:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.461+0000 7f240ea31640 1 -- 172.21.15.96:0/2712700161 wait complete. 2024-06-02T23:58:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.462+0000 7f240ea31640 1 Processor -- start 2024-06-02T23:58:50.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.463+0000 7f240ea31640 1 -- start start 2024-06-02T23:58:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.463+0000 7f240ea31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24080b5510 0x7f240814a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.463+0000 7f240ea31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24080d1120 0x7f2408147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.463+0000 7f240ea31640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2408161900 0x7f2408158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.463+0000 7f240ea31640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f24080d4780 con 0x7f2408161900 2024-06-02T23:58:50.465 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.463+0000 7f240ea31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24080cfae0 con 0x7f24080d1120 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.463+0000 7f240ea31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2408161ce0 con 0x7f24080b5510 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.463+0000 7f240cfce640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2408161900 0x7f2408158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.463+0000 7f240cfce640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2408161900 0x7f2408158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50648/0 (socket says 172.21.15.96:50648) 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.463+0000 7f240cfce640 1 -- 172.21.15.96:0/3419758190 learned_addr learned my addr 172.21.15.96:0/3419758190 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f24077fe640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24080d1120 0x7f2408147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f2407fff640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24080b5510 0x7f240814a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f240cfce640 1 -- 172.21.15.96:0/3419758190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24080b5510 msgr2=0x7f240814a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f240cfce640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24080b5510 0x7f240814a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f240cfce640 1 -- 172.21.15.96:0/3419758190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24080d1120 msgr2=0x7f2408147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f240cfce640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24080d1120 0x7f2408147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f240cfce640 1 -- 172.21.15.96:0/3419758190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2408159660 con 0x7f2408161900 2024-06-02T23:58:50.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f24077fe640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24080d1120 0x7f2408147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:50.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f240cfce640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2408161900 0x7f2408158df0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f240000b9a0 tx=0x7f240000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:50.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f2404ff9640 1 -- 172.21.15.96:0/3419758190 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400019070 con 0x7f2408161900 2024-06-02T23:58:50.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f2404ff9640 1 -- 172.21.15.96:0/3419758190 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240000cbc0 con 0x7f2408161900 2024-06-02T23:58:50.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f240ea31640 1 -- 172.21.15.96:0/3419758190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2408159940 con 0x7f2408161900 2024-06-02T23:58:50.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f2404ff9640 1 -- 172.21.15.96:0/3419758190 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400014440 con 0x7f2408161900 2024-06-02T23:58:50.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.464+0000 7f240ea31640 1 -- 172.21.15.96:0/3419758190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2408159f00 con 0x7f2408161900 2024-06-02T23:58:50.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.465+0000 7f240ea31640 1 -- 172.21.15.96:0/3419758190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24080683e0 con 0x7f2408161900 2024-06-02T23:58:50.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.465+0000 7f2404ff9640 1 -- 172.21.15.96:0/3419758190 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f240001c070 con 0x7f2408161900 2024-06-02T23:58:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.466+0000 7f2404ff9640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f23f406be60 0x7f23f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.466+0000 7f2407fff640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f23f406be60 0x7f23f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.466+0000 7f2404ff9640 1 -- 172.21.15.96:0/3419758190 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6424+0+0 (secure 0 0 0) 0x7f240008ae60 con 0x7f2408161900 2024-06-02T23:58:50.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.466+0000 7f2407fff640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f23f406be60 0x7f23f406e320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2408158be0 tx=0x7f23f8008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:50.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.471+0000 7f2404ff9640 1 -- 172.21.15.96:0/3419758190 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2400059540 con 0x7f2408161900 2024-06-02T23:58:50.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.678+0000 7f240ea31640 1 -- 172.21.15.96:0/3419758190 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24080d05e0 con 0x7f2408161900 2024-06-02T23:58:50.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.679+0000 7f2404ff9640 1 -- 172.21.15.96:0/3419758190 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3872 (secure 0 0 0) 0x7f2400058e40 con 0x7f2408161900 2024-06-02T23:58:50.679 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:50.679 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4613,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/980156426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":980156426},{"type":"v1","addr":"172.21.15.162:6833","nonce":980156426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4616,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1567915962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1567915962},{"type":"v1","addr":"172.21.15.162:6835","nonce":1567915962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4929,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2700846904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2700846904},{"type":"v1","addr":"172.21.15.96:6835","nonce":2700846904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5595,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6833/1647523089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":1647523089},{"type":"v1","addr":"172.21.15.96:6833","nonce":1647523089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-06-02T23:58:50.679 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 18 2024-06-02T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.680+0000 7f240ea31640 1 -- 172.21.15.96:0/3419758190 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f23f406be60 msgr2=0x7f23f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.680+0000 7f240ea31640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f23f406be60 0x7f23f406e320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2408158be0 tx=0x7f23f8008040 comp rx=0 tx=0).stop 2024-06-02T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.680+0000 7f240ea31640 1 -- 172.21.15.96:0/3419758190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2408161900 msgr2=0x7f2408158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.680+0000 7f240ea31640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2408161900 0x7f2408158df0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f240000b9a0 tx=0x7f240000be60 comp rx=0 tx=0).stop 2024-06-02T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.681+0000 7f240ea31640 1 -- 172.21.15.96:0/3419758190 shutdown_connections 2024-06-02T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.681+0000 7f240ea31640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f23f406be60 0x7f23f406e320 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.681+0000 7f240ea31640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2408161900 0x7f2408158df0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.681+0000 7f240ea31640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24080d1120 0x7f2408147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.681+0000 7f240ea31640 1 --2- 172.21.15.96:0/3419758190 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24080b5510 0x7f240814a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.681+0000 7f240ea31640 1 -- 172.21.15.96:0/3419758190 >> 172.21.15.96:0/3419758190 conn(0x7f240809d3b0 msgr2=0x7f240806c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:50.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.681+0000 7f240ea31640 1 -- 172.21.15.96:0/3419758190 shutdown_connections 2024-06-02T23:58:50.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:50.681+0000 7f240ea31640 1 -- 172.21.15.96:0/3419758190 wait complete. 2024-06-02T23:58:50.692 INFO:tasks.ceph.mds.a:Restarting daemon 2024-06-02T23:58:50.692 INFO:tasks.ceph.mds.a:Stopping old one... 2024-06-02T23:58:50.692 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-02T23:58:50.693 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:58:50.693 INFO:tasks.ceph.mds.c:Restarting daemon 2024-06-02T23:58:50.693 INFO:tasks.ceph.mds.c:Stopping old one... 2024-06-02T23:58:50.693 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-02T23:58:50.693 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:58:50.693 INFO:tasks.ceph.mds.b:Restarting daemon 2024-06-02T23:58:50.694 INFO:tasks.ceph.mds.b:Stopping old one... 2024-06-02T23:58:50.694 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-02T23:58:50.694 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:58:50.694 INFO:tasks.ceph.mds.d:Restarting daemon 2024-06-02T23:58:50.694 INFO:tasks.ceph.mds.d:Stopping old one... 2024-06-02T23:58:50.694 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-02T23:58:50.695 INFO:teuthology.orchestra.run:waiting for 300 2024-06-02T23:58:50.703 INFO:tasks.ceph.mds.c:Stopped 2024-06-02T23:58:50.703 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-06-02T23:58:50.706 INFO:tasks.ceph.mds.b:Stopped 2024-06-02T23:58:50.706 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-06-02T23:58:50.707 INFO:tasks.ceph.mds.d:Stopped 2024-06-02T23:58:50.707 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-06-02T23:58:50.745 INFO:tasks.ceph.mds.c:Started 2024-06-02T23:58:50.746 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:50.748 INFO:tasks.ceph.mds.b:Started 2024-06-02T23:58:50.748 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:50.749 INFO:tasks.ceph.mds.d:Started 2024-06-02T23:58:50.749 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:50.819 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2024-06-02T23:58:50.873 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-06-02T23:58:50.874 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-06-02T23:58:52.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-06-02T23:58:56.703 INFO:tasks.ceph.mds.a:Stopped 2024-06-02T23:58:56.703 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-06-02T23:58:56.706 INFO:tasks.ceph.mds.a:Started 2024-06-02T23:58:56.706 DEBUG:teuthology.parallel:result is None 2024-06-02T23:58:56.707 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-06-02T23:58:56.794 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-06-02T23:58:56.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.821+0000 7fc81adfb640 1 Processor -- start 2024-06-02T23:58:56.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.821+0000 7fc81adfb640 1 -- start start 2024-06-02T23:58:56.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.821+0000 7fc81adfb640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc814161900 0x7fc8140d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.821+0000 7fc81adfb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 0x7fc8140d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.821+0000 7fc81adfb640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8140d4a90 con 0x7fc8140b4fa0 2024-06-02T23:58:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.821+0000 7fc81adfb640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc8140cf5c0 con 0x7fc814161900 2024-06-02T23:58:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.821+0000 7fc81adfb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8140caf70 con 0x7fc8140b5510 2024-06-02T23:58:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.822+0000 7fc819398640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc8140b4fa0 0x7fc8140d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48576/0 (socket says 172.21.15.96:48576) 2024-06-02T23:58:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.822+0000 7fc819398640 1 -- 172.21.15.96:0/527575319 learned_addr learned my addr 172.21.15.96:0/527575319 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.822+0000 7fc813fff640 1 --2- 172.21.15.96:0/527575319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 0x7fc8140d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.822+0000 7fc818b97640 1 --2- 172.21.15.96:0/527575319 >> v2:172.21.15.162:3300/0 conn(0x7fc814161900 0x7fc8140d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:56.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.822+0000 7fc8137fe640 1 -- 172.21.15.96:0/527575319 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927905565 0 0) 0x7fc8140d4a90 con 0x7fc8140b4fa0 2024-06-02T23:58:56.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.822+0000 7fc8137fe640 1 -- 172.21.15.96:0/527575319 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc804003520 con 0x7fc8140b4fa0 2024-06-02T23:58:56.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.822+0000 7fc813fff640 1 -- 172.21.15.96:0/527575319 >> v2:172.21.15.162:3300/0 conn(0x7fc814161900 msgr2=0x7fc8140d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:56.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.822+0000 7fc813fff640 1 --2- 172.21.15.96:0/527575319 >> v2:172.21.15.162:3300/0 conn(0x7fc814161900 0x7fc8140d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:56.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.822+0000 7fc813fff640 1 -- 172.21.15.96:0/527575319 >> v1:172.21.15.96:6789/0 conn(0x7fc8140b4fa0 legacy=0x7fc8140d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:56.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.822+0000 7fc813fff640 1 -- 172.21.15.96:0/527575319 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8140d4d70 con 0x7fc8140b5510 2024-06-02T23:58:56.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.823+0000 7fc813fff640 1 --2- 172.21.15.96:0/527575319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 0x7fc8140d0f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8000097a0 tx=0x7fc80002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f57cc9dfd166179 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.823+0000 7fc8137fe640 1 -- 172.21.15.96:0/527575319 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800037070 con 0x7fc8140b5510 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.823+0000 7fc8137fe640 1 -- 172.21.15.96:0/527575319 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80002ae50 con 0x7fc8140b5510 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.823+0000 7fc8137fe640 1 -- 172.21.15.96:0/527575319 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800032660 con 0x7fc8140b5510 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.824+0000 7fc81adfb640 1 -- 172.21.15.96:0/527575319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 msgr2=0x7fc8140d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.824+0000 7fc81adfb640 1 --2- 172.21.15.96:0/527575319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 0x7fc8140d0f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8000097a0 tx=0x7fc80002a100 comp rx=0 tx=0).stop 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.824+0000 7fc81adfb640 1 -- 172.21.15.96:0/527575319 shutdown_connections 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.824+0000 7fc81adfb640 1 --2- 172.21.15.96:0/527575319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 0x7fc8140d0f50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.824+0000 7fc81adfb640 1 --2- 172.21.15.96:0/527575319 >> v2:172.21.15.162:3300/0 conn(0x7fc814161900 0x7fc8140d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.824+0000 7fc81adfb640 1 -- 172.21.15.96:0/527575319 >> 172.21.15.96:0/527575319 conn(0x7fc81409d3b0 msgr2=0x7fc8140d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.824+0000 7fc81adfb640 1 -- 172.21.15.96:0/527575319 shutdown_connections 2024-06-02T23:58:56.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.824+0000 7fc81adfb640 1 -- 172.21.15.96:0/527575319 wait complete. 2024-06-02T23:58:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.825+0000 7fc81adfb640 1 Processor -- start 2024-06-02T23:58:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.825+0000 7fc81adfb640 1 -- start start 2024-06-02T23:58:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc81adfb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8140b4fa0 0x7fc81415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc81adfb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 0x7fc8140cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc81adfb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc814161900 0x7fc8140cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc81adfb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140d4780 con 0x7fc814161900 2024-06-02T23:58:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc81adfb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140cfae0 con 0x7fc8140b4fa0 2024-06-02T23:58:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc81adfb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc814161ce0 con 0x7fc8140b5510 2024-06-02T23:58:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc819398640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc814161900 0x7fc8140cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:56.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc819398640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc814161900 0x7fc8140cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51198/0 (socket says 172.21.15.96:51198) 2024-06-02T23:58:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc819398640 1 -- 172.21.15.96:0/2302689276 learned_addr learned my addr 172.21.15.96:0/2302689276 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc813fff640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 0x7fc8140cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc819398640 1 -- 172.21.15.96:0/2302689276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 msgr2=0x7fc8140cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc819398640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 0x7fc8140cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc819398640 1 -- 172.21.15.96:0/2302689276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8140b4fa0 msgr2=0x7fc81415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc819398640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8140b4fa0 0x7fc81415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:56.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.826+0000 7fc819398640 1 -- 172.21.15.96:0/2302689276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8140cc2c0 con 0x7fc814161900 2024-06-02T23:58:56.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.827+0000 7fc819398640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc814161900 0x7fc8140cd600 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00cb70 tx=0x7fc80c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:56.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.827+0000 7fc8117fa640 1 -- 172.21.15.96:0/2302689276 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c017070 con 0x7fc814161900 2024-06-02T23:58:56.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.827+0000 7fc8117fa640 1 -- 172.21.15.96:0/2302689276 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80c00ad40 con 0x7fc814161900 2024-06-02T23:58:56.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.827+0000 7fc81adfb640 1 -- 172.21.15.96:0/2302689276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8140cc5a0 con 0x7fc814161900 2024-06-02T23:58:56.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.827+0000 7fc8117fa640 1 -- 172.21.15.96:0/2302689276 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c012620 con 0x7fc814161900 2024-06-02T23:58:56.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.827+0000 7fc81adfb640 1 -- 172.21.15.96:0/2302689276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8141f5190 con 0x7fc814161900 2024-06-02T23:58:56.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.828+0000 7fc81adfb640 1 -- 172.21.15.96:0/2302689276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8140683e0 con 0x7fc814161900 2024-06-02T23:58:56.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.828+0000 7fc8117fa640 1 -- 172.21.15.96:0/2302689276 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fc80c01a070 con 0x7fc814161900 2024-06-02T23:58:56.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.829+0000 7fc8117fa640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc7f806be30 0x7fc7f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:56.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.829+0000 7fc8117fa640 1 -- 172.21.15.96:0/2302689276 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5980+0+0 (secure 0 0 0) 0x7fc80c08ad50 con 0x7fc814161900 2024-06-02T23:58:56.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.829+0000 7fc818b97640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc7f806be30 0x7fc7f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:56.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.829+0000 7fc818b97640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc7f806be30 0x7fc7f806e2f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc808006a90 tx=0x7fc808006a20 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:56.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:56.833+0000 7fc8117fa640 1 -- 172.21.15.96:0/2302689276 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc80c08e030 con 0x7fc814161900 2024-06-02T23:58:57.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:57.018+0000 7fc81adfb640 1 -- 172.21.15.96:0/2302689276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc8140d05e0 con 0x7fc814161900 2024-06-02T23:58:58.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.551+0000 7fc8117fa640 1 -- 172.21.15.96:0/2302689276 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v66) ==== 97+0+0 (secure 0 0 0) 0x7fc80c059680 con 0x7fc814161900 2024-06-02T23:58:58.552 INFO:teuthology.orchestra.run.smithi096.stderr: removed all blocklist entries 2024-06-02T23:58:58.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.555+0000 7fc81adfb640 1 -- 172.21.15.96:0/2302689276 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc7f806be30 msgr2=0x7fc7f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:58.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.555+0000 7fc81adfb640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc7f806be30 0x7fc7f806e2f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc808006a90 tx=0x7fc808006a20 comp rx=0 tx=0).stop 2024-06-02T23:58:58.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.555+0000 7fc81adfb640 1 -- 172.21.15.96:0/2302689276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc814161900 msgr2=0x7fc8140cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:58.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.555+0000 7fc81adfb640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc814161900 0x7fc8140cd600 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00cb70 tx=0x7fc80c00a430 comp rx=0 tx=0).stop 2024-06-02T23:58:58.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.555+0000 7fc81adfb640 1 -- 172.21.15.96:0/2302689276 shutdown_connections 2024-06-02T23:58:58.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.556+0000 7fc81adfb640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc7f806be30 0x7fc7f806e2f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.556+0000 7fc81adfb640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc814161900 0x7fc8140cd600 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.556+0000 7fc81adfb640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140b5510 0x7fc8140cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.556+0000 7fc81adfb640 1 --2- 172.21.15.96:0/2302689276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8140b4fa0 0x7fc81415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.556+0000 7fc81adfb640 1 -- 172.21.15.96:0/2302689276 >> 172.21.15.96:0/2302689276 conn(0x7fc81409d3b0 msgr2=0x7fc8140b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.556+0000 7fc81adfb640 1 -- 172.21.15.96:0/2302689276 shutdown_connections 2024-06-02T23:58:58.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.556+0000 7fc81adfb640 1 -- 172.21.15.96:0/2302689276 wait complete. 2024-06-02T23:58:58.573 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-06-02T23:58:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.681+0000 7fab4ad63640 1 Processor -- start 2024-06-02T23:58:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.681+0000 7fab4ad63640 1 -- start start 2024-06-02T23:58:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab4ad63640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab440caba0 0x7fab4406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab4ad63640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4406ee70 con 0x7fab4406e650 2024-06-02T23:58:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab4ad63640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab440711b0 con 0x7fab4415a850 2024-06-02T23:58:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab4ad63640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab44071490 con 0x7fab440caba0 2024-06-02T23:58:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab49300640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fab4406e650 0x7fab44071f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48582/0 (socket says 172.21.15.96:48582) 2024-06-02T23:58:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab49300640 1 -- 172.21.15.96:0/1249320508 learned_addr learned my addr 172.21.15.96:0/1249320508 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677993913 0 0) 0x7fab4406ee70 con 0x7fab4406e650 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3bfff640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab440caba0 0x7fab4406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab2c003520 con 0x7fab4406e650 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3617535574 0 0) 0x7fab2c003520 con 0x7fab4406e650 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab440caba0 msgr2=0x7fab4406e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab440caba0 0x7fab4406e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 >> v1:172.21.15.162:6789/0 conn(0x7fab4415a850 legacy=0x7fab440ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab44071770 con 0x7fab4406e650 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7fab3c0019f0 con 0x7fab4406e650 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 >> v1:172.21.15.96:6789/0 conn(0x7fab4406e650 legacy=0x7fab44071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2c0039e0 0x7fab2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab2c004800 0x7fab2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.682+0000 7fab3b7fe640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab440caba0 0x7fab2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:58.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fab44071490 con 0x7fab2c004800 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c00bb30 con 0x7fab2c0039e0 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab2c00bd30 con 0x7fab440caba0 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab3bfff640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab2c004800 0x7fab2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab48aff640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2c0039e0 0x7fab2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab49300640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab440caba0 0x7fab2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab3bfff640 1 -- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab440caba0 msgr2=0x7fab2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab3bfff640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab440caba0 0x7fab2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab3bfff640 1 -- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2c0039e0 msgr2=0x7fab2c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab3bfff640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2c0039e0 0x7fab2c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab3bfff640 1 -- 172.21.15.96:0/1249320508 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2c003520 con 0x7fab2c004800 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.683+0000 7fab49300640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab440caba0 0x7fab2c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab3bfff640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab2c004800 0x7fab2c004c80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fab3400abb0 tx=0x7fab2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dda673243f1c0e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34037070 con 0x7fab2c004800 2024-06-02T23:58:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3402be50 con 0x7fab2c004800 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab3b7fe640 1 -- 172.21.15.96:0/1249320508 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3400a7b0 con 0x7fab2c004800 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab4ad63640 1 -- 172.21.15.96:0/1249320508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab2c004800 msgr2=0x7fab2c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab4ad63640 1 --2- 172.21.15.96:0/1249320508 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab2c004800 0x7fab2c004c80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fab3400abb0 tx=0x7fab2c005830 comp rx=0 tx=0).stop 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab49300640 1 -- 172.21.15.96:0/1249320508 reap_dead start 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab4ad63640 1 -- 172.21.15.96:0/1249320508 shutdown_connections 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab4ad63640 1 -- 172.21.15.96:0/1249320508 >> 172.21.15.96:0/1249320508 conn(0x7fab440cfc30 msgr2=0x7fab440d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab4ad63640 1 -- 172.21.15.96:0/1249320508 shutdown_connections 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.684+0000 7fab4ad63640 1 -- 172.21.15.96:0/1249320508 wait complete. 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.685+0000 7fab4ad63640 1 Processor -- start 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.685+0000 7fab4ad63640 1 -- start start 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.686+0000 7fab4ad63640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c004800 0x7fab44154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.686+0000 7fab4ad63640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440af940 0x7fab440afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.686+0000 7fab4ad63640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab440c8150 0x7fab440c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.686+0000 7fab4ad63640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fab4406e110 con 0x7fab440c8150 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.686+0000 7fab4ad63640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab4406eae0 con 0x7fab440af940 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.686+0000 7fab4ad63640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab4406e290 con 0x7fab2c004800 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.686+0000 7fab49300640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab440c8150 0x7fab440c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.686+0000 7fab49300640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab440c8150 0x7fab440c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51226/0 (socket says 172.21.15.96:51226) 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.686+0000 7fab49300640 1 -- 172.21.15.96:0/3927937101 learned_addr learned my addr 172.21.15.96:0/3927937101 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab3bfff640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440af940 0x7fab440afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab48aff640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c004800 0x7fab44154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab49300640 1 -- 172.21.15.96:0/3927937101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c004800 msgr2=0x7fab44154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab49300640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c004800 0x7fab44154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab49300640 1 -- 172.21.15.96:0/3927937101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440af940 msgr2=0x7fab440afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab49300640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440af940 0x7fab440afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab49300640 1 -- 172.21.15.96:0/3927937101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab44155530 con 0x7fab440c8150 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab3bfff640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440af940 0x7fab440afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab48aff640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c004800 0x7fab44154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab49300640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab440c8150 0x7fab440c85d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fab440b5d50 tx=0x7fab3c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab397fa640 1 -- 172.21.15.96:0/3927937101 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00eda0 con 0x7fab440c8150 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab397fa640 1 -- 172.21.15.96:0/3927937101 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c014430 con 0x7fab440c8150 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab4ad63640 1 -- 172.21.15.96:0/3927937101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab440c8e80 con 0x7fab440c8150 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab397fa640 1 -- 172.21.15.96:0/3927937101 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c014820 con 0x7fab440c8150 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.687+0000 7fab4ad63640 1 -- 172.21.15.96:0/3927937101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab440c9440 con 0x7fab440c8150 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.688+0000 7fab4ad63640 1 -- 172.21.15.96:0/3927937101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab440683e0 con 0x7fab440c8150 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.689+0000 7fab397fa640 1 -- 172.21.15.96:0/3927937101 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fab3c0149c0 con 0x7fab440c8150 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.689+0000 7fab397fa640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fab3006be30 0x7fab3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.689+0000 7fab397fa640 1 -- 172.21.15.96:0/3927937101 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5249+0+0 (secure 0 0 0) 0x7fab3c08ac40 con 0x7fab440c8150 2024-06-02T23:58:58.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.689+0000 7fab48aff640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fab3006be30 0x7fab3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:58.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.689+0000 7fab48aff640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fab3006be30 0x7fab3006e2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab400036b0 tx=0x7fab40009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:58.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.693+0000 7fab397fa640 1 -- 172.21.15.96:0/3927937101 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fab3c0597b0 con 0x7fab440c8150 2024-06-02T23:58:58.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.935+0000 7fab4ad63640 1 -- 172.21.15.96:0/3927937101 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fab440b3370 con 0x7fab440c8150 2024-06-02T23:58:58.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.935+0000 7fab397fa640 1 -- 172.21.15.96:0/3927937101 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7fab3c0590b0 con 0x7fab440c8150 2024-06-02T23:58:58.935 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_dump": [ 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.a", 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mv+yHEhAA5drjcpFFkuZtP9jn4RNKJg==", 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.936 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.b", 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1m7XM8HhAAKUlPE4OvGuBeKe6DGbkyHQ==", 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.937 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.c", 2024-06-02T23:58:58.938 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mVjKRGRAAC+vsd0hUCCQ/mOXFYGV5YA==", 2024-06-02T23:58:58.938 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.938 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:58:58.938 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-06-02T23:58:58.938 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-06-02T23:58:58.938 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.939 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.939 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.939 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.939 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.d", 2024-06-02T23:58:58.939 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1myBlaJRAAIjex3ET8YFlbLgoaY4JnKQ==", 2024-06-02T23:58:58.939 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.939 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:58:58.939 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-06-02T23:58:58.939 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.0", 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAcBF1mte+CChAAPDwA0vI0SJosZ3U0rWu1mA==", 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.1", 2024-06-02T23:58:58.940 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAfBF1m7PXNCBAAp/N/6XnBcejiNP+Gf4riJQ==", 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.2", 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAiBF1mJNZTBhAAO96HFWEr7FRUBPsfMIAyvQ==", 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.941 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.3", 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAlBF1mE3dFBBAAHQ/axJajuNqTcSyq3iuhzg==", 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.942 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.4", 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQArBF1mGCqhChAA2rAbXRqzMPrK0+00D7j+WA==", 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.5", 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAuBF1mj5VeCRAAwVs8J2MBZE6bXG4mW5g2Sg==", 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.943 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.6", 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAxBF1mYqZaBxAAiDIOH5xXTjT4+vj/u3MvNw==", 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.7", 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQA0BF1mpoCvBBAAJYKc3QKLtU3cT/zALs8RLg==", 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.944 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.0", 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mSH5jKRAAiBQXUb900fop4NegNAGVlQ==", 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow r", 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.945 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.1", 2024-06-02T23:58:58.946 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mBgQeMhAA/ozEWt5lxs+djJ0fv79MKQ==", 2024-06-02T23:58:58.946 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.946 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:58:58.946 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-06-02T23:58:58.946 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-06-02T23:58:58.946 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-06-02T23:58:58.946 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.946 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.946 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.946 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.2", 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mV+3yLhAAx/UoeSwIrsirjBB3auHGig==", 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.3", 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mGVOsNxAAmWB6RKMd/43AazTZCxqLYw==", 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2024-06-02T23:58:58.947 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2024-06-02T23:58:58.948 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2024-06-02T23:58:58.948 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2024-06-02T23:58:58.948 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.948 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.948 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.948 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.admin", 2024-06-02T23:58:58.948 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAXBF1m2XWUMhAAkwdF+qDWwDkH27QrjIRiVA==", 2024-06-02T23:58:58.948 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.948 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2024-06-02T23:58:58.948 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2024-06-02T23:58:58.949 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2024-06-02T23:58:58.949 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.949 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.949 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.949 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.950 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mgr.x", 2024-06-02T23:58:58.950 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mWkxYDxAAOgAEKD5eR7iDnKFLhTRz6Q==", 2024-06-02T23:58:58.950 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile mgr", 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mgr.y", 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQAYBF1mQ/aZCxAAV7Dado7gJa/pxz43da1eVw==", 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile mgr", 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.951 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:58.952 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-06-02T23:58:58.952 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:58:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.937+0000 7fab4ad63640 1 -- 172.21.15.96:0/3927937101 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fab3006be30 msgr2=0x7fab3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.937+0000 7fab4ad63640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fab3006be30 0x7fab3006e2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab400036b0 tx=0x7fab40009040 comp rx=0 tx=0).stop 2024-06-02T23:58:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.937+0000 7fab4ad63640 1 -- 172.21.15.96:0/3927937101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab440c8150 msgr2=0x7fab440c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.937+0000 7fab4ad63640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab440c8150 0x7fab440c85d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fab440b5d50 tx=0x7fab3c00e530 comp rx=0 tx=0).stop 2024-06-02T23:58:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.937+0000 7fab4ad63640 1 -- 172.21.15.96:0/3927937101 shutdown_connections 2024-06-02T23:58:58.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.937+0000 7fab4ad63640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fab3006be30 0x7fab3006e2f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.937+0000 7fab4ad63640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fab440c8150 0x7fab440c85d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.937+0000 7fab4ad63640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab440af940 0x7fab440afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.937+0000 7fab4ad63640 1 --2- 172.21.15.96:0/3927937101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c004800 0x7fab44154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.938+0000 7fab4ad63640 1 -- 172.21.15.96:0/3927937101 >> 172.21.15.96:0/3927937101 conn(0x7fab440cfc30 msgr2=0x7fab44157310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.938+0000 7fab4ad63640 1 -- 172.21.15.96:0/3927937101 shutdown_connections 2024-06-02T23:58:58.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:58.938+0000 7fab4ad63640 1 -- 172.21.15.96:0/3927937101 wait complete. 2024-06-02T23:58:58.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T23:58:59.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.053+0000 7f2863fff640 1 Processor -- start 2024-06-02T23:58:59.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.053+0000 7f2863fff640 1 -- start start 2024-06-02T23:58:59.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.054+0000 7f2863fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f28640d0b60 0x7f286415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.054+0000 7f2863fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f286406c770 0x7f286406cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.054+0000 7f2863fff640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28640d1190 con 0x7f28640ceba0 2024-06-02T23:58:59.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.054+0000 7f2863fff640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f28640d1470 con 0x7f28640d0b60 2024-06-02T23:58:59.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.054+0000 7f2863fff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f28640b1800 con 0x7f286406c770 2024-06-02T23:58:59.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.054+0000 7f2862ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f28640ceba0 0x7f286415d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48588/0 (socket says 172.21.15.96:48588) 2024-06-02T23:58:59.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.054+0000 7f2862ffd640 1 -- 172.21.15.96:0/470110050 learned_addr learned my addr 172.21.15.96:0/470110050 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f28627fc640 1 --2- 172.21.15.96:0/470110050 >> v2:172.21.15.162:3300/0 conn(0x7f28640d0b60 0x7f286415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f28637fe640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f286406c770 0x7f286406cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050067345 0 0) 0x7f28640d1190 con 0x7f28640ceba0 2024-06-02T23:58:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f284c003520 con 0x7f28640ceba0 2024-06-02T23:58:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2113907813 0 0) 0x7f284c003520 con 0x7f28640ceba0 2024-06-02T23:58:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f286406c770 msgr2=0x7f286406cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f286406c770 0x7f286406cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 >> v2:172.21.15.162:3300/0 conn(0x7f28640d0b60 msgr2=0x7f286415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 --2- 172.21.15.96:0/470110050 >> v2:172.21.15.162:3300/0 conn(0x7f28640d0b60 0x7f286415e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28640b1ae0 con 0x7f28640ceba0 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f2854001b70 con 0x7f28640ceba0 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 >> v1:172.21.15.96:6789/0 conn(0x7f28640ceba0 legacy=0x7f286415d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f286406c770 0x7f284c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f284c003fa0 0x7f284c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f284c004d40 0x7f284c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f28640d1470 con 0x7f284c004d40 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28640b1800 con 0x7f284c003fa0 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f284c00ba70 con 0x7f286406c770 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f28637fe640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f284c004d40 0x7f284c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f2862ffd640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f286406c770 0x7f284c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f28627fc640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f284c003fa0 0x7f284c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f28637fe640 1 -- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f286406c770 msgr2=0x7f284c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f28637fe640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f286406c770 0x7f284c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f28637fe640 1 -- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f284c003fa0 msgr2=0x7f284c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f28637fe640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f284c003fa0 0x7f284c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.055+0000 7f28637fe640 1 -- 172.21.15.96:0/470110050 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c003520 con 0x7f284c004d40 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.056+0000 7f28637fe640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f284c004d40 0x7f284c0051c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f285c009ac0 tx=0x7f284c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7427edd6027823b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.056+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c036070 con 0x7f284c004d40 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.056+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c031400 con 0x7f284c004d40 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.056+0000 7f2861ffb640 1 -- 172.21.15.96:0/470110050 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c009690 con 0x7f284c004d40 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.057+0000 7f2863fff640 1 -- 172.21.15.96:0/470110050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f284c004d40 msgr2=0x7f284c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.057+0000 7f2863fff640 1 --2- 172.21.15.96:0/470110050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f284c004d40 0x7f284c0051c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f285c009ac0 tx=0x7f284c005830 comp rx=0 tx=0).stop 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.057+0000 7f28637fe640 1 -- 172.21.15.96:0/470110050 reap_dead start 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.057+0000 7f2863fff640 1 -- 172.21.15.96:0/470110050 shutdown_connections 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.057+0000 7f2863fff640 1 -- 172.21.15.96:0/470110050 >> 172.21.15.96:0/470110050 conn(0x7f28640d1d70 msgr2=0x7f28640d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.057+0000 7f2863fff640 1 -- 172.21.15.96:0/470110050 shutdown_connections 2024-06-02T23:58:59.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.057+0000 7f2863fff640 1 -- 172.21.15.96:0/470110050 wait complete. 2024-06-02T23:58:59.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.058+0000 7f2863fff640 1 Processor -- start 2024-06-02T23:58:59.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.058+0000 7f2863fff640 1 -- start start 2024-06-02T23:58:59.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2863fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f286415cb40 0x7f286414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2863fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f286415cf20 0x7f286414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2863fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28641f3740 0x7f28641f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2863fff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f286415e630 con 0x7f286415cb40 2024-06-02T23:58:59.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2863fff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28640d2ac0 con 0x7f286415cf20 2024-06-02T23:58:59.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2863fff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f286415e7b0 con 0x7f28641f3740 2024-06-02T23:58:59.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2862ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f286415cb40 0x7f286414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2862ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f286415cb40 0x7f286414dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51232/0 (socket says 172.21.15.96:51232) 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2862ffd640 1 -- 172.21.15.96:0/614529372 learned_addr learned my addr 172.21.15.96:0/614529372 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2862ffd640 1 -- 172.21.15.96:0/614529372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28641f3740 msgr2=0x7f28641f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2862ffd640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28641f3740 0x7f28641f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2862ffd640 1 -- 172.21.15.96:0/614529372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f286415cf20 msgr2=0x7f286414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2862ffd640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f286415cf20 0x7f286414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2862ffd640 1 -- 172.21.15.96:0/614529372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286414ebb0 con 0x7f286415cb40 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.059+0000 7f2862ffd640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f286415cb40 0x7f286414dc80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f285400fc10 tx=0x7f285400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.060+0000 7f284b7fe640 1 -- 172.21.15.96:0/614529372 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285400dbb0 con 0x7f286415cb40 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.060+0000 7f284b7fe640 1 -- 172.21.15.96:0/614529372 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2854018070 con 0x7f286415cb40 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.060+0000 7f2863fff640 1 -- 172.21.15.96:0/614529372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286414e8d0 con 0x7f286415cb40 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.060+0000 7f284b7fe640 1 -- 172.21.15.96:0/614529372 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854005b20 con 0x7f286415cb40 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.060+0000 7f2863fff640 1 -- 172.21.15.96:0/614529372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286414bf70 con 0x7f286415cb40 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.061+0000 7f2863fff640 1 -- 172.21.15.96:0/614529372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286404f760 con 0x7f286415cb40 2024-06-02T23:58:59.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.061+0000 7f284b7fe640 1 -- 172.21.15.96:0/614529372 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f2854005cc0 con 0x7f286415cb40 2024-06-02T23:58:59.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.061+0000 7f284b7fe640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f285006be30 0x7f285006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.062+0000 7f28627fc640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f285006be30 0x7f285006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.062+0000 7f284b7fe640 1 -- 172.21.15.96:0/614529372 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5249+0+0 (secure 0 0 0) 0x7f285408b150 con 0x7f286415cb40 2024-06-02T23:58:59.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.062+0000 7f28627fc640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f285006be30 0x7f285006e2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2858006e80 tx=0x7f2858006df0 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.066+0000 7f284b7fe640 1 -- 172.21.15.96:0/614529372 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2854059cc0 con 0x7f286415cb40 2024-06-02T23:58:59.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.241+0000 7f2863fff640 1 -- 172.21.15.96:0/614529372 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f28640ce350 con 0x7f286415cb40 2024-06-02T23:58:59.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.241+0000 7f284b7fe640 1 -- 172.21.15.96:0/614529372 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v66) ==== 84+0+65 (secure 0 0 0) 0x7f28540595c0 con 0x7f286415cb40 2024-06-02T23:58:59.241 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:58:59.242 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-06-02T23:58:59.242 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-06-02T23:58:59.242 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2024-06-02T23:58:59.242 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2024-06-02T23:58:59.242 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:58:59.242 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-06-02T23:58:59.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 -- 172.21.15.96:0/614529372 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f285006be30 msgr2=0x7f285006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f285006be30 0x7f285006e2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2858006e80 tx=0x7f2858006df0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 -- 172.21.15.96:0/614529372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f286415cb40 msgr2=0x7f286414dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f286415cb40 0x7f286414dc80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f285400fc10 tx=0x7f285400d520 comp rx=0 tx=0).stop 2024-06-02T23:58:59.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 -- 172.21.15.96:0/614529372 shutdown_connections 2024-06-02T23:58:59.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f285006be30 0x7f285006e2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28641f3740 0x7f28641f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f286415cf20 0x7f286414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 --2- 172.21.15.96:0/614529372 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f286415cb40 0x7f286414dc80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 -- 172.21.15.96:0/614529372 >> 172.21.15.96:0/614529372 conn(0x7f28640d1d70 msgr2=0x7f28640b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:59.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 -- 172.21.15.96:0/614529372 shutdown_connections 2024-06-02T23:58:59.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.243+0000 7f2863fff640 1 -- 172.21.15.96:0/614529372 wait complete. 2024-06-02T23:58:59.254 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T23:58:59.255 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T23:58:59.322 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:58:59.325 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:58:59.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.359+0000 7fd917cae640 1 Processor -- start 2024-06-02T23:58:59.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.359+0000 7fd917cae640 1 -- start start 2024-06-02T23:58:59.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd917cae640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd910161900 0x7fd9100b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd917cae640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9100b52d0 con 0x7fd9100d0a60 2024-06-02T23:58:59.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd917cae640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9100cec10 con 0x7fd9100d2350 2024-06-02T23:58:59.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd917cae640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd9100cef20 con 0x7fd910161900 2024-06-02T23:58:59.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd915a4a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd910161900 0x7fd9100b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd915249640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd9100d0a60 0x7fd9100d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48592/0 (socket says 172.21.15.96:48592) 2024-06-02T23:58:59.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd915249640 1 -- 172.21.15.96:0/3740692222 learned_addr learned my addr 172.21.15.96:0/3740692222 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:59.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd915a4a640 1 -- 172.21.15.96:0/3740692222 >> v1:172.21.15.162:6789/0 conn(0x7fd9100d2350 legacy=0x7fd9100cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:59.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd915a4a640 1 -- 172.21.15.96:0/3740692222 >> v1:172.21.15.96:6789/0 conn(0x7fd9100d0a60 legacy=0x7fd9100d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd915a4a640 1 -- 172.21.15.96:0/3740692222 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9100d2820 con 0x7fd910161900 2024-06-02T23:58:59.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.360+0000 7fd914a48640 1 -- 172.21.15.96:0/3740692222 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745703136 0 0) 0x7fd9100b52d0 con 0x7fd9100d0a60 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.361+0000 7fd915a4a640 1 --2- 172.21.15.96:0/3740692222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd910161900 0x7fd9100b6ec0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0097a0 tx=0x7fd90c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6886c02e2b4ccac2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.361+0000 7fd914a48640 1 -- 172.21.15.96:0/3740692222 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c037070 con 0x7fd910161900 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.361+0000 7fd914a48640 1 -- 172.21.15.96:0/3740692222 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c032440 con 0x7fd910161900 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.361+0000 7fd914a48640 1 -- 172.21.15.96:0/3740692222 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c032810 con 0x7fd910161900 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.361+0000 7fd917cae640 1 -- 172.21.15.96:0/3740692222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd910161900 msgr2=0x7fd9100b6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.361+0000 7fd917cae640 1 --2- 172.21.15.96:0/3740692222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd910161900 0x7fd9100b6ec0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0097a0 tx=0x7fd90c02a1e0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.361+0000 7fd917cae640 1 -- 172.21.15.96:0/3740692222 shutdown_connections 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.361+0000 7fd917cae640 1 --2- 172.21.15.96:0/3740692222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd910161900 0x7fd9100b6ec0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.361+0000 7fd917cae640 1 -- 172.21.15.96:0/3740692222 >> 172.21.15.96:0/3740692222 conn(0x7fd91009d340 msgr2=0x7fd9100d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.362+0000 7fd917cae640 1 -- 172.21.15.96:0/3740692222 shutdown_connections 2024-06-02T23:58:59.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.362+0000 7fd917cae640 1 -- 172.21.15.96:0/3740692222 wait complete. 2024-06-02T23:58:59.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.363+0000 7fd917cae640 1 Processor -- start 2024-06-02T23:58:59.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.363+0000 7fd917cae640 1 -- start start 2024-06-02T23:58:59.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.363+0000 7fd917cae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9100d0a60 0x7fd9100c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.363+0000 7fd917cae640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9100d2350 0x7fd9100cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.363+0000 7fd917cae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd910161900 0x7fd9100cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.363+0000 7fd917cae640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd9100d2de0 con 0x7fd9100d2350 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.363+0000 7fd917cae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9100d30c0 con 0x7fd9100d0a60 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.363+0000 7fd917cae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd910161ce0 con 0x7fd910161900 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd915249640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9100d2350 0x7fd9100cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd915249640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9100d2350 0x7fd9100cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51248/0 (socket says 172.21.15.96:51248) 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd915249640 1 -- 172.21.15.96:0/2417109071 learned_addr learned my addr 172.21.15.96:0/2417109071 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd915a4a640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9100d0a60 0x7fd9100c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd91624b640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd910161900 0x7fd9100cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd915249640 1 -- 172.21.15.96:0/2417109071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd910161900 msgr2=0x7fd9100cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd915249640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd910161900 0x7fd9100cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd915249640 1 -- 172.21.15.96:0/2417109071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9100d0a60 msgr2=0x7fd9100c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd915249640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9100d0a60 0x7fd9100c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd915249640 1 -- 172.21.15.96:0/2417109071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9100ccce0 con 0x7fd9100d2350 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd91624b640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd910161900 0x7fd9100cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:58:59.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd915249640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9100d2350 0x7fd9100cc190 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd90000c430 tx=0x7fd90000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd9067fc640 1 -- 172.21.15.96:0/2417109071 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000074e0 con 0x7fd9100d2350 2024-06-02T23:58:59.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd9067fc640 1 -- 172.21.15.96:0/2417109071 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9000047e0 con 0x7fd9100d2350 2024-06-02T23:58:59.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd917cae640 1 -- 172.21.15.96:0/2417109071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9100ccfc0 con 0x7fd9100d2350 2024-06-02T23:58:59.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd9067fc640 1 -- 172.21.15.96:0/2417109071 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900004bd0 con 0x7fd9100d2350 2024-06-02T23:58:59.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.364+0000 7fd917cae640 1 -- 172.21.15.96:0/2417109071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9100cd580 con 0x7fd9100d2350 2024-06-02T23:58:59.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.365+0000 7fd917cae640 1 -- 172.21.15.96:0/2417109071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9100683e0 con 0x7fd9100d2350 2024-06-02T23:58:59.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.366+0000 7fd9067fc640 1 -- 172.21.15.96:0/2417109071 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fd900011070 con 0x7fd9100d2350 2024-06-02T23:58:59.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.366+0000 7fd9067fc640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd8f406be30 0x7fd8f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.366+0000 7fd9067fc640 1 -- 172.21.15.96:0/2417109071 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5249+0+0 (secure 0 0 0) 0x7fd90008a8b0 con 0x7fd9100d2350 2024-06-02T23:58:59.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.366+0000 7fd915a4a640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd8f406be30 0x7fd8f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.367+0000 7fd915a4a640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd8f406be30 0x7fd8f406e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd90c034000 tx=0x7fd90c02e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.370+0000 7fd9067fc640 1 -- 172.21.15.96:0/2417109071 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd9000594b0 con 0x7fd9100d2350 2024-06-02T23:58:59.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-06-02T23:58:59.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.544+0000 7fd917cae640 1 -- 172.21.15.96:0/2417109071 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd9100d0360 con 0x7fd9100d2350 2024-06-02T23:58:59.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.614+0000 7fd9067fc640 1 -- 172.21.15.96:0/2417109071 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v67) ==== 138+0+0 (secure 0 0 0) 0x7fd900058db0 con 0x7fd9100d2350 2024-06-02T23:58:59.615 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2024-06-02T23:58:59.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 -- 172.21.15.96:0/2417109071 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd8f406be30 msgr2=0x7fd8f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd8f406be30 0x7fd8f406e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd90c034000 tx=0x7fd90c02e000 comp rx=0 tx=0).stop 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 -- 172.21.15.96:0/2417109071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9100d2350 msgr2=0x7fd9100cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9100d2350 0x7fd9100cc190 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd90000c430 tx=0x7fd90000c8f0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 -- 172.21.15.96:0/2417109071 shutdown_connections 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd8f406be30 0x7fd8f406e2f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd910161900 0x7fd9100cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9100d2350 0x7fd9100cc190 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 --2- 172.21.15.96:0/2417109071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9100d0a60 0x7fd9100c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 -- 172.21.15.96:0/2417109071 >> 172.21.15.96:0/2417109071 conn(0x7fd91009d340 msgr2=0x7fd9100cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 -- 172.21.15.96:0/2417109071 shutdown_connections 2024-06-02T23:58:59.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.617+0000 7fd917cae640 1 -- 172.21.15.96:0/2417109071 wait complete. 2024-06-02T23:58:59.631 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T23:58:59.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.736+0000 7f5e437f9640 1 Processor -- start 2024-06-02T23:58:59.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.737+0000 7f5e437f9640 1 -- start start 2024-06-02T23:58:59.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.737+0000 7f5e437f9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5e3c15a510 0x7f5e3c0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.737+0000 7f5e437f9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5e3c15a8f0 0x7f5e3c0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.737+0000 7f5e437f9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e3c073200 con 0x7f5e3c072070 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.737+0000 7f5e437f9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f5e3c071030 con 0x7f5e3c15a8f0 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.737+0000 7f5e437f9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5e3c0712b0 con 0x7f5e3c15a510 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.738+0000 7f5e40d94640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5e3c15a8f0 0x7f5e3c0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.738+0000 7f5e41d96640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5e3c072070 0x7f5e3c0724e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48606/0 (socket says 172.21.15.96:48606) 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.738+0000 7f5e40d94640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5e3c15a8f0 0x7f5e3c0cdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51254/0 (socket says 172.21.15.96:51254) 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.738+0000 7f5e41d96640 1 -- 172.21.15.96:0/4092222891 learned_addr learned my addr 172.21.15.96:0/4092222891 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.738+0000 7f5e41595640 1 --2- 172.21.15.96:0/4092222891 >> v2:172.21.15.162:3300/0 conn(0x7f5e3c15a510 0x7f5e3c0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.738+0000 7f5e40d94640 1 -- 172.21.15.96:0/4092222891 >> v2:172.21.15.162:3300/0 conn(0x7f5e3c15a510 msgr2=0x7f5e3c0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.738+0000 7f5e40d94640 1 --2- 172.21.15.96:0/4092222891 >> v2:172.21.15.162:3300/0 conn(0x7f5e3c15a510 0x7f5e3c0cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.738+0000 7f5e40d94640 1 -- 172.21.15.96:0/4092222891 >> v1:172.21.15.96:6789/0 conn(0x7f5e3c072070 legacy=0x7f5e3c0724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.738+0000 7f5e40d94640 1 -- 172.21.15.96:0/4092222891 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c072bf0 con 0x7f5e3c15a8f0 2024-06-02T23:58:59.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.738+0000 7f5e3bfff640 1 -- 172.21.15.96:0/4092222891 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556489476 0 0) 0x7f5e3c073200 con 0x7f5e3c072070 2024-06-02T23:58:59.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e40d94640 1 --2- 172.21.15.96:0/4092222891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a8f0 0x7f5e3c0cdd90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c06c940 tx=0x7f5e3002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb5b62ba8c0405b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e3bfff640 1 -- 172.21.15.96:0/4092222891 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30037070 con 0x7f5e3c15a8f0 2024-06-02T23:58:59.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e3bfff640 1 -- 172.21.15.96:0/4092222891 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e30032440 con 0x7f5e3c15a8f0 2024-06-02T23:58:59.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e3bfff640 1 -- 172.21.15.96:0/4092222891 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3002ae60 con 0x7f5e3c15a8f0 2024-06-02T23:58:59.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e437f9640 1 -- 172.21.15.96:0/4092222891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a8f0 msgr2=0x7f5e3c0cdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e437f9640 1 --2- 172.21.15.96:0/4092222891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a8f0 0x7f5e3c0cdd90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c06c940 tx=0x7f5e3002a110 comp rx=0 tx=0).stop 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e437f9640 1 -- 172.21.15.96:0/4092222891 shutdown_connections 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e437f9640 1 --2- 172.21.15.96:0/4092222891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a8f0 0x7f5e3c0cdd90 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e437f9640 1 --2- 172.21.15.96:0/4092222891 >> v2:172.21.15.162:3300/0 conn(0x7f5e3c15a510 0x7f5e3c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e437f9640 1 -- 172.21.15.96:0/4092222891 >> 172.21.15.96:0/4092222891 conn(0x7f5e3c0cfcb0 msgr2=0x7f5e3c0d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e437f9640 1 -- 172.21.15.96:0/4092222891 shutdown_connections 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.739+0000 7f5e437f9640 1 -- 172.21.15.96:0/4092222891 wait complete. 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.740+0000 7f5e437f9640 1 Processor -- start 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.740+0000 7f5e437f9640 1 -- start start 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e437f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e3c072070 0x7f5e3c14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e437f9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a510 0x7f5e3c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e437f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e3c15a8f0 0x7f5e3c167d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e437f9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c071b50 con 0x7f5e3c15a510 2024-06-02T23:58:59.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e437f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c071870 con 0x7f5e3c15a8f0 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e437f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3c0ce2d0 con 0x7f5e3c072070 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e40d94640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a510 0x7f5e3c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e40d94640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a510 0x7f5e3c0b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51270/0 (socket says 172.21.15.96:51270) 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e40d94640 1 -- 172.21.15.96:0/3824946203 learned_addr learned my addr 172.21.15.96:0/3824946203 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e40d94640 1 -- 172.21.15.96:0/3824946203 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e3c072070 msgr2=0x7f5e3c14e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e40d94640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e3c072070 0x7f5e3c14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e40d94640 1 -- 172.21.15.96:0/3824946203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e3c15a8f0 msgr2=0x7f5e3c167d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.741+0000 7f5e40d94640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e3c15a8f0 0x7f5e3c167d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.742+0000 7f5e40d94640 1 -- 172.21.15.96:0/3824946203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c14da50 con 0x7f5e3c15a510 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.742+0000 7f5e40d94640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a510 0x7f5e3c0b4f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009890 tx=0x7f5e300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.742+0000 7f5e39ffb640 1 -- 172.21.15.96:0/3824946203 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30037040 con 0x7f5e3c15a510 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.742+0000 7f5e39ffb640 1 -- 172.21.15.96:0/3824946203 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e30042070 con 0x7f5e3c15a510 2024-06-02T23:58:59.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.742+0000 7f5e39ffb640 1 -- 172.21.15.96:0/3824946203 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30030bd0 con 0x7f5e3c15a510 2024-06-02T23:58:59.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.742+0000 7f5e437f9640 1 -- 172.21.15.96:0/3824946203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3c14dd30 con 0x7f5e3c15a510 2024-06-02T23:58:59.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.742+0000 7f5e437f9640 1 -- 172.21.15.96:0/3824946203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3c0af0e0 con 0x7f5e3c15a510 2024-06-02T23:58:59.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.743+0000 7f5e437f9640 1 -- 172.21.15.96:0/3824946203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3c0683e0 con 0x7f5e3c15a510 2024-06-02T23:58:59.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.744+0000 7f5e39ffb640 1 -- 172.21.15.96:0/3824946203 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f5e30047460 con 0x7f5e3c15a510 2024-06-02T23:58:59.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.744+0000 7f5e39ffb640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5e2806be60 0x7f5e2806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:58:59.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.744+0000 7f5e39ffb640 1 -- 172.21.15.96:0/3824946203 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5619+0+0 (secure 0 0 0) 0x7f5e300aba30 con 0x7f5e3c15a510 2024-06-02T23:58:59.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.744+0000 7f5e41595640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5e2806be60 0x7f5e2806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:58:59.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.745+0000 7f5e41595640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5e2806be60 0x7f5e2806e320 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c006fd0 tx=0x7f5e2c008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:58:59.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.749+0000 7f5e39ffb640 1 -- 172.21.15.96:0/3824946203 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5e30032e20 con 0x7f5e3c15a510 2024-06-02T23:58:59.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:58:59.927+0000 7f5e437f9640 1 -- 172.21.15.96:0/3824946203 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5e3c0c2fb0 con 0x7f5e3c15a510 2024-06-02T23:59:00.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.623+0000 7f5e39ffb640 1 -- 172.21.15.96:0/3824946203 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v68) ==== 170+0+0 (secure 0 0 0) 0x7f5e3007a390 con 0x7f5e3c15a510 2024-06-02T23:59:00.623 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2024-06-02T23:59:00.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.625+0000 7f5e437f9640 1 -- 172.21.15.96:0/3824946203 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5e2806be60 msgr2=0x7f5e2806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:00.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.625+0000 7f5e437f9640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5e2806be60 0x7f5e2806e320 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c006fd0 tx=0x7f5e2c008040 comp rx=0 tx=0).stop 2024-06-02T23:59:00.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.625+0000 7f5e437f9640 1 -- 172.21.15.96:0/3824946203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a510 msgr2=0x7f5e3c0b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:00.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.625+0000 7f5e437f9640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a510 0x7f5e3c0b4f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009890 tx=0x7f5e300046c0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.626+0000 7f5e437f9640 1 -- 172.21.15.96:0/3824946203 shutdown_connections 2024-06-02T23:59:00.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.626+0000 7f5e437f9640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5e2806be60 0x7f5e2806e320 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.626+0000 7f5e437f9640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e3c15a8f0 0x7f5e3c167d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.626+0000 7f5e437f9640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e3c15a510 0x7f5e3c0b4f70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.626+0000 7f5e437f9640 1 --2- 172.21.15.96:0/3824946203 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e3c072070 0x7f5e3c14e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.626+0000 7f5e437f9640 1 -- 172.21.15.96:0/3824946203 >> 172.21.15.96:0/3824946203 conn(0x7f5e3c0cfcb0 msgr2=0x7f5e3c06d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:00.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.626+0000 7f5e437f9640 1 -- 172.21.15.96:0/3824946203 shutdown_connections 2024-06-02T23:59:00.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.626+0000 7f5e437f9640 1 -- 172.21.15.96:0/3824946203 wait complete. 2024-06-02T23:59:00.646 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T23:59:00.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.749+0000 7f5105316640 1 Processor -- start 2024-06-02T23:59:00.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.749+0000 7f5105316640 1 -- start start 2024-06-02T23:59:00.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.749+0000 7f5105316640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f510015c1e0 0x7f51000d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:00.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.749+0000 7f5105316640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51000cda60 0x7f51000cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:00.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.749+0000 7f5105316640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510015c5c0 con 0x7f51000ce810 2024-06-02T23:59:00.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.749+0000 7f5105316640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f51000cf1c0 con 0x7f510015c1e0 2024-06-02T23:59:00.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.749+0000 7f5105316640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f51000b1840 con 0x7f51000cda60 2024-06-02T23:59:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.750+0000 7f50feffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f510015c1e0 0x7f51000d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.750+0000 7f50feffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f510015c1e0 0x7f51000d2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51284/0 (socket says 172.21.15.96:51284) 2024-06-02T23:59:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.750+0000 7f50feffd640 1 -- 172.21.15.96:0/640844826 learned_addr learned my addr 172.21.15.96:0/640844826 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.750+0000 7f50ff7fe640 1 --2- 172.21.15.96:0/640844826 >> v2:172.21.15.162:3300/0 conn(0x7f51000cda60 0x7f51000cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.750+0000 7f50feffd640 1 -- 172.21.15.96:0/640844826 >> v2:172.21.15.162:3300/0 conn(0x7f51000cda60 msgr2=0x7f51000cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.750+0000 7f50feffd640 1 --2- 172.21.15.96:0/640844826 >> v2:172.21.15.162:3300/0 conn(0x7f51000cda60 0x7f51000cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.750+0000 7f50feffd640 1 -- 172.21.15.96:0/640844826 >> v1:172.21.15.162:6789/0 conn(0x7f51000ce810 legacy=0x7f51000b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:00.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.750+0000 7f50feffd640 1 -- 172.21.15.96:0/640844826 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51000d0550 con 0x7f510015c1e0 2024-06-02T23:59:00.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f50feffd640 1 --2- 172.21.15.96:0/640844826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 0x7f51000d2960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f51000b1150 tx=0x7f50f002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e3b18f8bb07b62 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:00.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f50fdffb640 1 -- 172.21.15.96:0/640844826 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0036070 con 0x7f510015c1e0 2024-06-02T23:59:00.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f50fdffb640 1 -- 172.21.15.96:0/640844826 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f0031600 con 0x7f510015c1e0 2024-06-02T23:59:00.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f50fdffb640 1 -- 172.21.15.96:0/640844826 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f00319d0 con 0x7f510015c1e0 2024-06-02T23:59:00.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f5105316640 1 -- 172.21.15.96:0/640844826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 msgr2=0x7f51000d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:00.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f5105316640 1 --2- 172.21.15.96:0/640844826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 0x7f51000d2960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f51000b1150 tx=0x7f50f002a6a0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f5105316640 1 -- 172.21.15.96:0/640844826 shutdown_connections 2024-06-02T23:59:00.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f5105316640 1 --2- 172.21.15.96:0/640844826 >> v2:172.21.15.162:3300/0 conn(0x7f51000cda60 0x7f51000cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f5105316640 1 --2- 172.21.15.96:0/640844826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 0x7f51000d2960 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f5105316640 1 -- 172.21.15.96:0/640844826 >> 172.21.15.96:0/640844826 conn(0x7f51000d1e40 msgr2=0x7f51000d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:00.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f5105316640 1 -- 172.21.15.96:0/640844826 shutdown_connections 2024-06-02T23:59:00.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.751+0000 7f5105316640 1 -- 172.21.15.96:0/640844826 wait complete. 2024-06-02T23:59:00.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.753+0000 7f5105316640 1 Processor -- start 2024-06-02T23:59:00.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.753+0000 7f5105316640 1 -- start start 2024-06-02T23:59:00.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.753+0000 7f5105316640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000cda60 0x7f51001547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:00.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.753+0000 7f5105316640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51000ce810 0x7f510009f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.753+0000 7f5105316640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 0x7f510009c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.753+0000 7f5105316640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f51000d0b10 con 0x7f510015c1e0 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.753+0000 7f5105316640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51000cdef0 con 0x7f51000ce810 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.753+0000 7f5105316640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f51000d0df0 con 0x7f51000cda60 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50ff7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 0x7f510009c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50ff7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 0x7f510009c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51300/0 (socket says 172.21.15.96:51300) 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50ff7fe640 1 -- 172.21.15.96:0/3539644683 learned_addr learned my addr 172.21.15.96:0/3539644683 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50feffd640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000cda60 0x7f51001547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50fe7fc640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51000ce810 0x7f510009f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50ff7fe640 1 -- 172.21.15.96:0/3539644683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000cda60 msgr2=0x7f51001547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50ff7fe640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000cda60 0x7f51001547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50ff7fe640 1 -- 172.21.15.96:0/3539644683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51000ce810 msgr2=0x7f510009f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:00.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50ff7fe640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51000ce810 0x7f510009f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50ff7fe640 1 -- 172.21.15.96:0/3539644683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5100154ce0 con 0x7f510015c1e0 2024-06-02T23:59:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50ff7fe640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 0x7f510009c4c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f50f800e930 tx=0x7f50f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50e77fe640 1 -- 172.21.15.96:0/3539644683 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8017070 con 0x7f510015c1e0 2024-06-02T23:59:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50e77fe640 1 -- 172.21.15.96:0/3539644683 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f800c980 con 0x7f510015c1e0 2024-06-02T23:59:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f5105316640 1 -- 172.21.15.96:0/3539644683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510009e2e0 con 0x7f510015c1e0 2024-06-02T23:59:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f50e77fe640 1 -- 172.21.15.96:0/3539644683 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f800cd70 con 0x7f510015c1e0 2024-06-02T23:59:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.754+0000 7f5105316640 1 -- 172.21.15.96:0/3539644683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510009eb40 con 0x7f510015c1e0 2024-06-02T23:59:00.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.755+0000 7f5105316640 1 -- 172.21.15.96:0/3539644683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51000683e0 con 0x7f510015c1e0 2024-06-02T23:59:00.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.756+0000 7f50e77fe640 1 -- 172.21.15.96:0/3539644683 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f50f801a070 con 0x7f510015c1e0 2024-06-02T23:59:00.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.756+0000 7f50e77fe640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50ec06be60 0x7f50ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:00.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.756+0000 7f50feffd640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50ec06be60 0x7f50ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:00.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.756+0000 7f50e77fe640 1 -- 172.21.15.96:0/3539644683 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6001+0+0 (secure 0 0 0) 0x7f50f808af80 con 0x7f510015c1e0 2024-06-02T23:59:00.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.757+0000 7f50feffd640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50ec06be60 0x7f50ec06e320 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f50f0033000 tx=0x7f50f0009000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:00.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.761+0000 7f50e77fe640 1 -- 172.21.15.96:0/3539644683 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5100154ce0 con 0x7f510015c1e0 2024-06-02T23:59:00.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:00.970+0000 7f5105316640 1 -- 172.21.15.96:0/3539644683 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f51000b2150 con 0x7f510015c1e0 2024-06-02T23:59:01.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.624+0000 7f50e77fe640 1 -- 172.21.15.96:0/3539644683 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) ==== 172+0+0 (secure 0 0 0) 0x7f50f80598a0 con 0x7f510015c1e0 2024-06-02T23:59:01.625 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 7 and data pool 8 2024-06-02T23:59:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.626+0000 7f5105316640 1 -- 172.21.15.96:0/3539644683 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50ec06be60 msgr2=0x7f50ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50ec06be60 0x7f50ec06e320 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f50f0033000 tx=0x7f50f0009000 comp rx=0 tx=0).stop 2024-06-02T23:59:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 -- 172.21.15.96:0/3539644683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 msgr2=0x7f510009c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 0x7f510009c4c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f50f800e930 tx=0x7f50f800edf0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 -- 172.21.15.96:0/3539644683 shutdown_connections 2024-06-02T23:59:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50ec06be60 0x7f50ec06e320 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f510015c1e0 0x7f510009c4c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51000ce810 0x7f510009f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 --2- 172.21.15.96:0/3539644683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000cda60 0x7f51001547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 -- 172.21.15.96:0/3539644683 >> 172.21.15.96:0/3539644683 conn(0x7f51000d1e40 msgr2=0x7f51000af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:01.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 -- 172.21.15.96:0/3539644683 shutdown_connections 2024-06-02T23:59:01.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.627+0000 7f5105316640 1 -- 172.21.15.96:0/3539644683 wait complete. 2024-06-02T23:59:01.644 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:59:01.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.744+0000 7f50ed215640 1 Processor -- start 2024-06-02T23:59:01.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.744+0000 7f50ed215640 1 -- start start 2024-06-02T23:59:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50ed215640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50e8161900 0x7f50e80d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50ed215640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f50e80b4fa0 0x7f50e80d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50ed215640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e80d4a90 con 0x7f50e80b5510 2024-06-02T23:59:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50ed215640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f50e80cf5c0 con 0x7f50e8161900 2024-06-02T23:59:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50ed215640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f50e80caf70 con 0x7f50e80b4fa0 2024-06-02T23:59:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50e6d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50e8161900 0x7f50e80d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:01.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50e6d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f50e8161900 0x7f50e80d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51312/0 (socket says 172.21.15.96:51312) 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50e659c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f50e80b5510 0x7f50e80d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48616/0 (socket says 172.21.15.96:48616) 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50e6d9d640 1 -- 172.21.15.96:0/1203196889 learned_addr learned my addr 172.21.15.96:0/1203196889 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50e759e640 1 --2- 172.21.15.96:0/1203196889 >> v2:172.21.15.162:3300/0 conn(0x7f50e80b4fa0 0x7f50e80d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50e6d9d640 1 -- 172.21.15.96:0/1203196889 >> v2:172.21.15.162:3300/0 conn(0x7f50e80b4fa0 msgr2=0x7f50e80d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50e6d9d640 1 --2- 172.21.15.96:0/1203196889 >> v2:172.21.15.162:3300/0 conn(0x7f50e80b4fa0 0x7f50e80d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50e6d9d640 1 -- 172.21.15.96:0/1203196889 >> v1:172.21.15.96:6789/0 conn(0x7f50e80b5510 legacy=0x7f50e80d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50e5d9b640 1 -- 172.21.15.96:0/1203196889 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578785687 0 0) 0x7f50e80d4a90 con 0x7f50e80b5510 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.745+0000 7f50e6d9d640 1 -- 172.21.15.96:0/1203196889 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e80d4d70 con 0x7f50e8161900 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.746+0000 7f50e6d9d640 1 --2- 172.21.15.96:0/1203196889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 0x7f50e80d0a10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f50e80d39c0 tx=0x7f50d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3d3ea10ac4536f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.746+0000 7f50e5d9b640 1 -- 172.21.15.96:0/1203196889 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0037070 con 0x7f50e8161900 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.746+0000 7f50e5d9b640 1 -- 172.21.15.96:0/1203196889 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d0032440 con 0x7f50e8161900 2024-06-02T23:59:01.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.746+0000 7f50e5d9b640 1 -- 172.21.15.96:0/1203196889 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0032810 con 0x7f50e8161900 2024-06-02T23:59:01.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.747+0000 7f50ed215640 1 -- 172.21.15.96:0/1203196889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 msgr2=0x7f50e80d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.747+0000 7f50ed215640 1 --2- 172.21.15.96:0/1203196889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 0x7f50e80d0a10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f50e80d39c0 tx=0x7f50d002a1e0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.747+0000 7f50ed215640 1 -- 172.21.15.96:0/1203196889 shutdown_connections 2024-06-02T23:59:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.747+0000 7f50ed215640 1 --2- 172.21.15.96:0/1203196889 >> v2:172.21.15.162:3300/0 conn(0x7f50e80b4fa0 0x7f50e80d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.747+0000 7f50ed215640 1 --2- 172.21.15.96:0/1203196889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 0x7f50e80d0a10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.747+0000 7f50ed215640 1 -- 172.21.15.96:0/1203196889 >> 172.21.15.96:0/1203196889 conn(0x7f50e809d3b0 msgr2=0x7f50e80d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.747+0000 7f50ed215640 1 -- 172.21.15.96:0/1203196889 shutdown_connections 2024-06-02T23:59:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.747+0000 7f50ed215640 1 -- 172.21.15.96:0/1203196889 wait complete. 2024-06-02T23:59:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.748+0000 7f50ed215640 1 Processor -- start 2024-06-02T23:59:01.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.748+0000 7f50ed215640 1 -- start start 2024-06-02T23:59:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50ed215640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80b4fa0 0x7f50e814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50ed215640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80b5510 0x7f50e80b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50ed215640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 0x7f50e8157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:01.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50ed215640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f50e80d4780 con 0x7f50e8161900 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50ed215640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50e80cfae0 con 0x7f50e80b5510 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50ed215640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f50e8161ce0 con 0x7f50e80b4fa0 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50e759e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 0x7f50e8157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50e759e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 0x7f50e8157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51328/0 (socket says 172.21.15.96:51328) 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50e759e640 1 -- 172.21.15.96:0/3051259462 learned_addr learned my addr 172.21.15.96:0/3051259462 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50e659c640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80b5510 0x7f50e80b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50e6d9d640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80b4fa0 0x7f50e814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50e759e640 1 -- 172.21.15.96:0/3051259462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80b4fa0 msgr2=0x7f50e814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50e759e640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80b4fa0 0x7f50e814b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50e759e640 1 -- 172.21.15.96:0/3051259462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80b5510 msgr2=0x7f50e80b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50e759e640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80b5510 0x7f50e80b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.749+0000 7f50e759e640 1 -- 172.21.15.96:0/3051259462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e814bbe0 con 0x7f50e8161900 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.750+0000 7f50e759e640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 0x7f50e8157200 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f50e0007e70 tx=0x7f50e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:01.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.750+0000 7f50df7fe640 1 -- 172.21.15.96:0/3051259462 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0014620 con 0x7f50e8161900 2024-06-02T23:59:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.750+0000 7f50df7fe640 1 -- 172.21.15.96:0/3051259462 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e0019070 con 0x7f50e8161900 2024-06-02T23:59:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.750+0000 7f50ed215640 1 -- 172.21.15.96:0/3051259462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e81f4550 con 0x7f50e8161900 2024-06-02T23:59:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.750+0000 7f50df7fe640 1 -- 172.21.15.96:0/3051259462 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0014a20 con 0x7f50e8161900 2024-06-02T23:59:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.750+0000 7f50ed215640 1 -- 172.21.15.96:0/3051259462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e81f4b10 con 0x7f50e8161900 2024-06-02T23:59:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.751+0000 7f50ed215640 1 -- 172.21.15.96:0/3051259462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e80683e0 con 0x7f50e8161900 2024-06-02T23:59:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.751+0000 7f50df7fe640 1 -- 172.21.15.96:0/3051259462 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f50e0014bc0 con 0x7f50e8161900 2024-06-02T23:59:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.752+0000 7f50df7fe640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50c806be30 0x7f50c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.752+0000 7f50e6d9d640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50c806be30 0x7f50c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:01.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.752+0000 7f50df7fe640 1 -- 172.21.15.96:0/3051259462 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6101+0+0 (secure 0 0 0) 0x7f50e008b950 con 0x7f50e8161900 2024-06-02T23:59:01.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.752+0000 7f50e6d9d640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50c806be30 0x7f50c806e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f50d0034000 tx=0x7f50d002e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:01.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.756+0000 7f50df7fe640 1 -- 172.21.15.96:0/3051259462 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f50e814bbe0 con 0x7f50e8161900 2024-06-02T23:59:01.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.933+0000 7f50ed215640 1 -- 172.21.15.96:0/3051259462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50e806ceb0 con 0x7f50e8161900 2024-06-02T23:59:01.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.934+0000 7f50df7fe640 1 -- 172.21.15.96:0/3051259462 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16955 (secure 0 0 0) 0x7f50e005a0e0 con 0x7f50e8161900 2024-06-02T23:59:01.934 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:01.935 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":69,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:59:00.971947+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:58:59.564247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-06-02T23:58:59.946495+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:59:01.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 -- 172.21.15.96:0/3051259462 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50c806be30 msgr2=0x7f50c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50c806be30 0x7f50c806e2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f50d0034000 tx=0x7f50d002e000 comp rx=0 tx=0).stop 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 -- 172.21.15.96:0/3051259462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 msgr2=0x7f50e8157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 0x7f50e8157200 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f50e0007e70 tx=0x7f50e000e4b0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 -- 172.21.15.96:0/3051259462 shutdown_connections 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f50c806be30 0x7f50c806e2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50e8161900 0x7f50e8157200 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80b5510 0x7f50e80b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 --2- 172.21.15.96:0/3051259462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80b4fa0 0x7f50e814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 -- 172.21.15.96:0/3051259462 >> 172.21.15.96:0/3051259462 conn(0x7f50e809d3b0 msgr2=0x7f50e815f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 -- 172.21.15.96:0/3051259462 shutdown_connections 2024-06-02T23:59:01.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:01.936+0000 7f50ed215640 1 -- 172.21.15.96:0/3051259462 wait complete. 2024-06-02T23:59:01.948 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:59:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.046+0000 7f7b2089e640 1 Processor -- start 2024-06-02T23:59:02.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.047+0000 7f7b2089e640 1 -- start start 2024-06-02T23:59:02.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.047+0000 7f7b2089e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c161900 0x7f7b1c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.047+0000 7f7b2089e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1c0d2a60 con 0x7f7b1c0b4fa0 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.047+0000 7f7b2089e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1c0d4a90 con 0x7f7b1c0b5510 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.047+0000 7f7b2089e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c0cf5c0 con 0x7f7b1c161900 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1ad9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7b1c0b4fa0 0x7f7b1c0d2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48622/0 (socket says 172.21.15.96:48622) 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1ad9d640 1 -- 172.21.15.96:0/1358829339 learned_addr learned my addr 172.21.15.96:0/1358829339 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1a59c640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c161900 0x7f7b1c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2852338175 0 0) 0x7f7b1c0d2a60 con 0x7f7b1c0b4fa0 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b08003520 con 0x7f7b1c0b4fa0 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3926655265 0 0) 0x7f7b08003520 con 0x7f7b1c0b4fa0 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c161900 msgr2=0x7f7b1c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c161900 0x7f7b1c0d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 >> v1:172.21.15.162:6789/0 conn(0x7f7b1c0b5510 legacy=0x7f7b1c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c0d4d70 con 0x7f7b1c0b4fa0 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f7b140019f0 con 0x7f7b1c0b4fa0 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 >> v1:172.21.15.96:6789/0 conn(0x7f7b1c0b4fa0 legacy=0x7f7b1c0d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c161900 0x7f7b080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b08003f60 0x7f7b08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 0x7f7b080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c0cf5c0 con 0x7f7b08004d40 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0800bb50 con 0x7f7b08003f60 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0800bd50 con 0x7f7b1c161900 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1ad9d640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 0x7f7b080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b19d9b640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b08003f60 0x7f7b08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.048+0000 7f7b1a59c640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c161900 0x7f7b080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.049+0000 7f7b1ad9d640 1 -- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c161900 msgr2=0x7f7b080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.049+0000 7f7b1ad9d640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c161900 0x7f7b080039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.049+0000 7f7b1ad9d640 1 -- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b08003f60 msgr2=0x7f7b08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.049+0000 7f7b1ad9d640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b08003f60 0x7f7b08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.049+0000 7f7b1ad9d640 1 -- 172.21.15.96:0/1358829339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b08003520 con 0x7f7b08004d40 2024-06-02T23:59:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.049+0000 7f7b1ad9d640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 0x7f7b080051c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400a860 tx=0x7f7b08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66315e3ecdac82e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.050+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400a480 con 0x7f7b08004d40 2024-06-02T23:59:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.050+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1402f070 con 0x7f7b08004d40 2024-06-02T23:59:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.050+0000 7f7b1959a640 1 -- 172.21.15.96:0/1358829339 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1402bd00 con 0x7f7b08004d40 2024-06-02T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.050+0000 7f7b2089e640 1 -- 172.21.15.96:0/1358829339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 msgr2=0x7f7b080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.050+0000 7f7b2089e640 1 --2- 172.21.15.96:0/1358829339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 0x7f7b080051c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400a860 tx=0x7f7b08005830 comp rx=0 tx=0).stop 2024-06-02T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.050+0000 7f7b1ad9d640 1 -- 172.21.15.96:0/1358829339 reap_dead start 2024-06-02T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.050+0000 7f7b2089e640 1 -- 172.21.15.96:0/1358829339 shutdown_connections 2024-06-02T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.050+0000 7f7b2089e640 1 -- 172.21.15.96:0/1358829339 >> 172.21.15.96:0/1358829339 conn(0x7f7b1c09d3b0 msgr2=0x7f7b1c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:02.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.050+0000 7f7b2089e640 1 -- 172.21.15.96:0/1358829339 shutdown_connections 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.050+0000 7f7b2089e640 1 -- 172.21.15.96:0/1358829339 wait complete. 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.051+0000 7f7b2089e640 1 Processor -- start 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.052+0000 7f7b2089e640 1 -- start start 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.052+0000 7f7b2089e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 0x7f7b1c0b9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.052+0000 7f7b2089e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b1c0a1a90 0x7f7b1c0b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.052+0000 7f7b2089e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c0b7410 0x7f7b1c0b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.052+0000 7f7b2089e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c0cfae0 con 0x7f7b08004d40 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.052+0000 7f7b2089e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c0caf70 con 0x7f7b1c0a1a90 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.052+0000 7f7b2089e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1c0d4780 con 0x7f7b1c0b7410 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.052+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 0x7f7b1c0b9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.052+0000 7f7b1a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 0x7f7b1c0b9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51346/0 (socket says 172.21.15.96:51346) 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.052+0000 7f7b1a59c640 1 -- 172.21.15.96:0/4229527239 learned_addr learned my addr 172.21.15.96:0/4229527239 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:02.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b19d9b640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b1c0a1a90 0x7f7b1c0b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b1ad9d640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c0b7410 0x7f7b1c0b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b1a59c640 1 -- 172.21.15.96:0/4229527239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c0b7410 msgr2=0x7f7b1c0b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b1a59c640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c0b7410 0x7f7b1c0b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b1a59c640 1 -- 172.21.15.96:0/4229527239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b1c0a1a90 msgr2=0x7f7b1c0b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b1a59c640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b1c0a1a90 0x7f7b1c0b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b1a59c640 1 -- 172.21.15.96:0/4229527239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c0b9a90 con 0x7f7b08004d40 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b1ad9d640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c0b7410 0x7f7b1c0b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b1a59c640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 0x7f7b1c0b9550 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7b040119a0 tx=0x7f7b04011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b12ffd640 1 -- 172.21.15.96:0/4229527239 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0400faf0 con 0x7f7b08004d40 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b12ffd640 1 -- 172.21.15.96:0/4229527239 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0400fc90 con 0x7f7b08004d40 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b2089e640 1 -- 172.21.15.96:0/4229527239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c09fbf0 con 0x7f7b08004d40 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b12ffd640 1 -- 172.21.15.96:0/4229527239 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04014440 con 0x7f7b08004d40 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.053+0000 7f7b2089e640 1 -- 172.21.15.96:0/4229527239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c0a01b0 con 0x7f7b08004d40 2024-06-02T23:59:02.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.054+0000 7f7b2089e640 1 -- 172.21.15.96:0/4229527239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1c0683e0 con 0x7f7b08004d40 2024-06-02T23:59:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.054+0000 7f7b12ffd640 1 -- 172.21.15.96:0/4229527239 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f7b04012040 con 0x7f7b08004d40 2024-06-02T23:59:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.055+0000 7f7b12ffd640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7afc06be60 0x7f7afc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.055+0000 7f7b12ffd640 1 -- 172.21.15.96:0/4229527239 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6101+0+0 (secure 0 0 0) 0x7f7b0408b720 con 0x7f7b08004d40 2024-06-02T23:59:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.055+0000 7f7b19d9b640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7afc06be60 0x7f7afc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.055+0000 7f7b19d9b640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7afc06be60 0x7f7afc06e320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0b3f30 tx=0x7f7b0c009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:02.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.059+0000 7f7b12ffd640 1 -- 172.21.15.96:0/4229527239 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7b04019030 con 0x7f7b08004d40 2024-06-02T23:59:02.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.233+0000 7f7b2089e640 1 -- 172.21.15.96:0/4229527239 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b1c0d05e0 con 0x7f7b08004d40 2024-06-02T23:59:02.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.234+0000 7f7b12ffd640 1 -- 172.21.15.96:0/4229527239 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16955 (secure 0 0 0) 0x7f7b04059860 con 0x7f7b08004d40 2024-06-02T23:59:02.236 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:02.236 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":69,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:59:00.971947+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:58:59.564247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-06-02T23:58:59.946495+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.236+0000 7f7b2089e640 1 -- 172.21.15.96:0/4229527239 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7afc06be60 msgr2=0x7f7afc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.236+0000 7f7b2089e640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7afc06be60 0x7f7afc06e320 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0b3f30 tx=0x7f7b0c009040 comp rx=0 tx=0).stop 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.236+0000 7f7b2089e640 1 -- 172.21.15.96:0/4229527239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 msgr2=0x7f7b1c0b9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.236+0000 7f7b2089e640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 0x7f7b1c0b9550 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7b040119a0 tx=0x7f7b04011e60 comp rx=0 tx=0).stop 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.236+0000 7f7b2089e640 1 -- 172.21.15.96:0/4229527239 shutdown_connections 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.236+0000 7f7b2089e640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7afc06be60 0x7f7afc06e320 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.236+0000 7f7b2089e640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b1c0b7410 0x7f7b1c0b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.236+0000 7f7b2089e640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b1c0a1a90 0x7f7b1c0b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.236+0000 7f7b2089e640 1 --2- 172.21.15.96:0/4229527239 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b08004d40 0x7f7b1c0b9550 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.236+0000 7f7b2089e640 1 -- 172.21.15.96:0/4229527239 >> 172.21.15.96:0/4229527239 conn(0x7f7b1c09d3b0 msgr2=0x7f7b1c15ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.237+0000 7f7b2089e640 1 -- 172.21.15.96:0/4229527239 shutdown_connections 2024-06-02T23:59:02.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.237+0000 7f7b2089e640 1 -- 172.21.15.96:0/4229527239 wait complete. 2024-06-02T23:59:02.248 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T23:59:02.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.350+0000 7f261515a640 1 Processor -- start 2024-06-02T23:59:02.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.350+0000 7f261515a640 1 -- start start 2024-06-02T23:59:02.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.350+0000 7f261515a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f261015e530 0x7f26100cad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.350+0000 7f261515a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f26100cb2a0 0x7f261006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.350+0000 7f261515a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26100723e0 con 0x7f261006eb50 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.350+0000 7f261515a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f261006ef80 con 0x7f26100cb2a0 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.350+0000 7f261515a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f26100cb7b0 con 0x7f261015e530 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260e59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f26100cb2a0 0x7f261006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260e59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f26100cb2a0 0x7f261006e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51362/0 (socket says 172.21.15.96:51362) 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260e59c640 1 -- 172.21.15.96:0/1310847672 learned_addr learned my addr 172.21.15.96:0/1310847672 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260f59e640 1 --1- 172.21.15.96:0/1310847672 >> v1:172.21.15.96:6789/0 conn(0x7f261006eb50 0x7f261015ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48630/0 (socket says 172.21.15.96:48630) 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260ed9d640 1 --2- 172.21.15.96:0/1310847672 >> v2:172.21.15.162:3300/0 conn(0x7f261015e530 0x7f26100cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260e59c640 1 -- 172.21.15.96:0/1310847672 >> v2:172.21.15.162:3300/0 conn(0x7f261015e530 msgr2=0x7f26100cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:02.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260e59c640 1 --2- 172.21.15.96:0/1310847672 >> v2:172.21.15.162:3300/0 conn(0x7f261015e530 0x7f26100cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260e59c640 1 -- 172.21.15.96:0/1310847672 >> v1:172.21.15.96:6789/0 conn(0x7f261006eb50 legacy=0x7f261015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260dd9b640 1 -- 172.21.15.96:0/1310847672 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191310236 0 0) 0x7f26100723e0 con 0x7f261006eb50 2024-06-02T23:59:02.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260e59c640 1 -- 172.21.15.96:0/1310847672 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2610072680 con 0x7f26100cb2a0 2024-06-02T23:59:02.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.351+0000 7f260ed9d640 1 --2- 172.21.15.96:0/1310847672 >> v2:172.21.15.162:3300/0 conn(0x7f261015e530 0x7f26100cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:02.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f260e59c640 1 --2- 172.21.15.96:0/1310847672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26100cb2a0 0x7f261006e610 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f261006c940 tx=0x7f260402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707a94ebbda54a31 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:02.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f260dd9b640 1 -- 172.21.15.96:0/1310847672 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604037070 con 0x7f26100cb2a0 2024-06-02T23:59:02.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f260dd9b640 1 -- 172.21.15.96:0/1310847672 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2604032440 con 0x7f26100cb2a0 2024-06-02T23:59:02.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f260dd9b640 1 -- 172.21.15.96:0/1310847672 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604032810 con 0x7f26100cb2a0 2024-06-02T23:59:02.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f261515a640 1 -- 172.21.15.96:0/1310847672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26100cb2a0 msgr2=0x7f261006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f261515a640 1 --2- 172.21.15.96:0/1310847672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26100cb2a0 0x7f261006e610 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f261006c940 tx=0x7f260402a150 comp rx=0 tx=0).stop 2024-06-02T23:59:02.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f261515a640 1 -- 172.21.15.96:0/1310847672 shutdown_connections 2024-06-02T23:59:02.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f261515a640 1 --2- 172.21.15.96:0/1310847672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26100cb2a0 0x7f261006e610 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f261515a640 1 --2- 172.21.15.96:0/1310847672 >> v2:172.21.15.162:3300/0 conn(0x7f261015e530 0x7f26100cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f261515a640 1 -- 172.21.15.96:0/1310847672 >> 172.21.15.96:0/1310847672 conn(0x7f26100cfcb0 msgr2=0x7f26100d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:02.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f261515a640 1 -- 172.21.15.96:0/1310847672 shutdown_connections 2024-06-02T23:59:02.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.352+0000 7f261515a640 1 -- 172.21.15.96:0/1310847672 wait complete. 2024-06-02T23:59:02.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.354+0000 7f261515a640 1 Processor -- start 2024-06-02T23:59:02.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.354+0000 7f261515a640 1 -- start start 2024-06-02T23:59:02.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.354+0000 7f261515a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f261006eb50 0x7f26101f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f261515a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26100cb2a0 0x7f2610155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f261515a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261015e530 0x7f261006d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f261515a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f26100ce890 con 0x7f261015e530 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f261515a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2610072c40 con 0x7f26100cb2a0 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f261515a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f261015e910 con 0x7f261006eb50 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260f59e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261015e530 0x7f261006d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260f59e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261015e530 0x7f261006d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51366/0 (socket says 172.21.15.96:51366) 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260f59e640 1 -- 172.21.15.96:0/2182997245 learned_addr learned my addr 172.21.15.96:0/2182997245 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260ed9d640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f261006eb50 0x7f26101f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260e59c640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26100cb2a0 0x7f2610155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260f59e640 1 -- 172.21.15.96:0/2182997245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f261006eb50 msgr2=0x7f26101f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260f59e640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f261006eb50 0x7f26101f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260f59e640 1 -- 172.21.15.96:0/2182997245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26100cb2a0 msgr2=0x7f2610155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:02.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260f59e640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26100cb2a0 0x7f2610155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260f59e640 1 -- 172.21.15.96:0/2182997245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26100c6d80 con 0x7f261015e530 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260e59c640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26100cb2a0 0x7f2610155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f260f59e640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261015e530 0x7f261006d500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f260800c7a0 tx=0x7f260800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f25f77fe640 1 -- 172.21.15.96:0/2182997245 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608018070 con 0x7f261015e530 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f25f77fe640 1 -- 172.21.15.96:0/2182997245 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f260800a5e0 con 0x7f261015e530 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f261515a640 1 -- 172.21.15.96:0/2182997245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26100c7060 con 0x7f261015e530 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f25f77fe640 1 -- 172.21.15.96:0/2182997245 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260800aa10 con 0x7f261015e530 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.355+0000 7f261515a640 1 -- 172.21.15.96:0/2182997245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26101f5370 con 0x7f261015e530 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.356+0000 7f261515a640 1 -- 172.21.15.96:0/2182997245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26100683e0 con 0x7f261015e530 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.357+0000 7f25f77fe640 1 -- 172.21.15.96:0/2182997245 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f260801b070 con 0x7f261015e530 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.357+0000 7f25f77fe640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f25fc06be60 0x7f25fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.357+0000 7f260ed9d640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f25fc06be60 0x7f25fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.357+0000 7f25f77fe640 1 -- 172.21.15.96:0/2182997245 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6101+0+0 (secure 0 0 0) 0x7f260808a480 con 0x7f261015e530 2024-06-02T23:59:02.360 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.358+0000 7f260ed9d640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f25fc06be60 0x7f25fc06e320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26100c8cd0 tx=0x7f2600008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:02.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.362+0000 7f25f77fe640 1 -- 172.21.15.96:0/2182997245 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f26080586e0 con 0x7f261015e530 2024-06-02T23:59:02.560 INFO:tasks.ceph.mds.a.smithi096.stderr:2024-06-02T23:59:02.560+0000 7f286d4f8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T23:59:02.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:02.573+0000 7f261515a640 1 -- 172.21.15.96:0/2182997245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f261006cd40 con 0x7f261015e530 2024-06-02T23:59:03.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.572+0000 7f25f77fe640 1 -- 172.21.15.96:0/2182997245 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f260805c9e0 con 0x7f261015e530 2024-06-02T23:59:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 -- 172.21.15.96:0/2182997245 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f25fc06be60 msgr2=0x7f25fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f25fc06be60 0x7f25fc06e320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26100c8cd0 tx=0x7f2600008040 comp rx=0 tx=0).stop 2024-06-02T23:59:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 -- 172.21.15.96:0/2182997245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261015e530 msgr2=0x7f261006d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261015e530 0x7f261006d500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f260800c7a0 tx=0x7f260800cc60 comp rx=0 tx=0).stop 2024-06-02T23:59:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 -- 172.21.15.96:0/2182997245 shutdown_connections 2024-06-02T23:59:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f25fc06be60 0x7f25fc06e320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f261015e530 0x7f261006d500 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26100cb2a0 0x7f2610155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 --2- 172.21.15.96:0/2182997245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f261006eb50 0x7f26101f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 -- 172.21.15.96:0/2182997245 >> 172.21.15.96:0/2182997245 conn(0x7f26100cfcb0 msgr2=0x7f26100cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 -- 172.21.15.96:0/2182997245 shutdown_connections 2024-06-02T23:59:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.575+0000 7f261515a640 1 -- 172.21.15.96:0/2182997245 wait complete. 2024-06-02T23:59:03.589 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-06-02T23:59:03.589 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-06-02T23:59:03.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.697+0000 7efe4ad34640 1 Processor -- start 2024-06-02T23:59:03.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.698+0000 7efe4ad34640 1 -- start start 2024-06-02T23:59:03.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.698+0000 7efe4ad34640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efe440b4b50 0x7efe440b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:03.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.698+0000 7efe4ad34640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efe440d2630 0x7efe440d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:03.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.698+0000 7efe4ad34640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe440cec60 con 0x7efe440b4640 2024-06-02T23:59:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.698+0000 7efe4ad34640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7efe440d2fe0 con 0x7efe440d2630 2024-06-02T23:59:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.698+0000 7efe4ad34640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efe440d4ff0 con 0x7efe440b4b50 2024-06-02T23:59:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.699+0000 7efe492d1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efe440d2630 0x7efe440d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.699+0000 7efe492d1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efe440d2630 0x7efe440d2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44106/0 (socket says 172.21.15.96:44106) 2024-06-02T23:59:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.699+0000 7efe48ad0640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7efe440b4640 0x7efe440b6ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37300/0 (socket says 172.21.15.96:37300) 2024-06-02T23:59:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.699+0000 7efe492d1640 1 -- 172.21.15.96:0/2996829588 learned_addr learned my addr 172.21.15.96:0/2996829588 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.699+0000 7efe492d1640 1 -- 172.21.15.96:0/2996829588 >> v2:172.21.15.162:3300/0 conn(0x7efe440b4b50 msgr2=0x7efe440b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.699+0000 7efe492d1640 1 --2- 172.21.15.96:0/2996829588 >> v2:172.21.15.162:3300/0 conn(0x7efe440b4b50 0x7efe440b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.699+0000 7efe492d1640 1 -- 172.21.15.96:0/2996829588 >> v1:172.21.15.96:6789/0 conn(0x7efe440b4640 legacy=0x7efe440b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.699+0000 7efe492d1640 1 -- 172.21.15.96:0/2996829588 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe440d1fd0 con 0x7efe440d2630 2024-06-02T23:59:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.699+0000 7efe437fe640 1 -- 172.21.15.96:0/2996829588 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 734388372 0 0) 0x7efe440cec60 con 0x7efe440b4640 2024-06-02T23:59:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe492d1640 1 --2- 172.21.15.96:0/2996829588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440d2630 0x7efe440d2aa0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efe440d3d40 tx=0x7efe3c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e84fe8ae0b52353 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:03.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe437fe640 1 -- 172.21.15.96:0/2996829588 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c037070 con 0x7efe440d2630 2024-06-02T23:59:03.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe437fe640 1 -- 172.21.15.96:0/2996829588 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe3c032440 con 0x7efe440d2630 2024-06-02T23:59:03.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe437fe640 1 -- 172.21.15.96:0/2996829588 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c032810 con 0x7efe440d2630 2024-06-02T23:59:03.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe4ad34640 1 -- 172.21.15.96:0/2996829588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440d2630 msgr2=0x7efe440d2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe4ad34640 1 --2- 172.21.15.96:0/2996829588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440d2630 0x7efe440d2aa0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7efe440d3d40 tx=0x7efe3c02a150 comp rx=0 tx=0).stop 2024-06-02T23:59:03.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe4ad34640 1 -- 172.21.15.96:0/2996829588 shutdown_connections 2024-06-02T23:59:03.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe4ad34640 1 --2- 172.21.15.96:0/2996829588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440d2630 0x7efe440d2aa0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe4ad34640 1 --2- 172.21.15.96:0/2996829588 >> v2:172.21.15.162:3300/0 conn(0x7efe440b4b50 0x7efe440b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe4ad34640 1 -- 172.21.15.96:0/2996829588 >> 172.21.15.96:0/2996829588 conn(0x7efe440d4050 msgr2=0x7efe440d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:03.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe4ad34640 1 -- 172.21.15.96:0/2996829588 shutdown_connections 2024-06-02T23:59:03.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.700+0000 7efe4ad34640 1 -- 172.21.15.96:0/2996829588 wait complete. 2024-06-02T23:59:03.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.701+0000 7efe4ad34640 1 Processor -- start 2024-06-02T23:59:03.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.702+0000 7efe4ad34640 1 -- start start 2024-06-02T23:59:03.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.702+0000 7efe4ad34640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440b4640 0x7efe4415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:03.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.702+0000 7efe4ad34640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe440b4b50 0x7efe440b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.702+0000 7efe4ad34640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe440d2630 0x7efe4415fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.702+0000 7efe4ad34640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7efe440d13b0 con 0x7efe440b4640 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.702+0000 7efe4ad34640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe440cef00 con 0x7efe440b4b50 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.702+0000 7efe4ad34640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efe440cf420 con 0x7efe440d2630 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.702+0000 7efe48ad0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440b4640 0x7efe4415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.702+0000 7efe48ad0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440b4640 0x7efe4415c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44112/0 (socket says 172.21.15.96:44112) 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.702+0000 7efe48ad0640 1 -- 172.21.15.96:0/2394683556 learned_addr learned my addr 172.21.15.96:0/2394683556 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe43fff640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe440b4b50 0x7efe440b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe492d1640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe440d2630 0x7efe4415fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe48ad0640 1 -- 172.21.15.96:0/2394683556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe440d2630 msgr2=0x7efe4415fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe48ad0640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe440d2630 0x7efe4415fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe48ad0640 1 -- 172.21.15.96:0/2394683556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe440b4b50 msgr2=0x7efe440b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:03.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe48ad0640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe440b4b50 0x7efe440b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:03.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe48ad0640 1 -- 172.21.15.96:0/2394683556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe440b34a0 con 0x7efe440b4640 2024-06-02T23:59:03.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe48ad0640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440b4640 0x7efe4415c480 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c4d0 tx=0x7efe3400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:03.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe417fa640 1 -- 172.21.15.96:0/2394683556 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34018070 con 0x7efe440b4640 2024-06-02T23:59:03.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe417fa640 1 -- 172.21.15.96:0/2394683556 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe34007500 con 0x7efe440b4640 2024-06-02T23:59:03.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe4ad34640 1 -- 172.21.15.96:0/2394683556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4415efc0 con 0x7efe440b4640 2024-06-02T23:59:03.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe417fa640 1 -- 172.21.15.96:0/2394683556 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34004a20 con 0x7efe440b4640 2024-06-02T23:59:03.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.703+0000 7efe4ad34640 1 -- 172.21.15.96:0/2394683556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe440b7820 con 0x7efe440b4640 2024-06-02T23:59:03.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.704+0000 7efe4ad34640 1 -- 172.21.15.96:0/2394683556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe440cec20 con 0x7efe440b4640 2024-06-02T23:59:03.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.705+0000 7efe417fa640 1 -- 172.21.15.96:0/2394683556 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7efe3401b070 con 0x7efe440b4640 2024-06-02T23:59:03.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.705+0000 7efe417fa640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7efe3006be30 0x7efe3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:03.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.705+0000 7efe417fa640 1 -- 172.21.15.96:0/2394683556 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7efe3408a320 con 0x7efe440b4640 2024-06-02T23:59:03.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.705+0000 7efe43fff640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7efe3006be30 0x7efe3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:03.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.706+0000 7efe43fff640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7efe3006be30 0x7efe3006e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe440d1930 tx=0x7efe380094f0 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:03.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.709+0000 7efe417fa640 1 -- 172.21.15.96:0/2394683556 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7efe440cec20 con 0x7efe440b4640 2024-06-02T23:59:03.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:03.920+0000 7efe4ad34640 1 -- 172.21.15.96:0/2394683556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7efe440683e0 con 0x7efe440b4640 2024-06-02T23:59:04.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.583+0000 7efe417fa640 1 -- 172.21.15.96:0/2394683556 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7efe34058b40 con 0x7efe440b4640 2024-06-02T23:59:04.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 -- 172.21.15.96:0/2394683556 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7efe3006be30 msgr2=0x7efe3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7efe3006be30 0x7efe3006e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe440d1930 tx=0x7efe380094f0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 -- 172.21.15.96:0/2394683556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440b4640 msgr2=0x7efe4415c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440b4640 0x7efe4415c480 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c4d0 tx=0x7efe3400c990 comp rx=0 tx=0).stop 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 -- 172.21.15.96:0/2394683556 shutdown_connections 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7efe3006be30 0x7efe3006e2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe440d2630 0x7efe4415fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe440b4b50 0x7efe440b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 --2- 172.21.15.96:0/2394683556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe440b4640 0x7efe4415c480 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 -- 172.21.15.96:0/2394683556 >> 172.21.15.96:0/2394683556 conn(0x7efe440d4050 msgr2=0x7efe440d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 -- 172.21.15.96:0/2394683556 shutdown_connections 2024-06-02T23:59:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.586+0000 7efe4ad34640 1 -- 172.21.15.96:0/2394683556 wait complete. 2024-06-02T23:59:04.600 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-06-02T23:59:04.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:59:04.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.706+0000 7f42179c4640 1 Processor -- start 2024-06-02T23:59:04.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.706+0000 7f42179c4640 1 -- start start 2024-06-02T23:59:04.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f42179c4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4210155570 0x7f421006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:04.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f42179c4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f421006eb50 0x7f42100ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:04.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f42179c4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4210155950 con 0x7f42100cab60 2024-06-02T23:59:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f42179c4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f42100cb2e0 con 0x7f4210155570 2024-06-02T23:59:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f42179c4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f42100cb5c0 con 0x7f421006eb50 2024-06-02T23:59:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f4215760640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4210155570 0x7f421006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f4215f61640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f42100cab60 0x7f421015eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37304/0 (socket says 172.21.15.96:37304) 2024-06-02T23:59:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f4215f61640 1 -- 172.21.15.96:0/2544953791 learned_addr learned my addr 172.21.15.96:0/2544953791 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:59:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f4214f5f640 1 --2- 172.21.15.96:0/2544953791 >> v2:172.21.15.162:3300/0 conn(0x7f421006eb50 0x7f42100ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f4215760640 1 -- 172.21.15.96:0/2544953791 >> v2:172.21.15.162:3300/0 conn(0x7f421006eb50 msgr2=0x7f42100ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f4215760640 1 --2- 172.21.15.96:0/2544953791 >> v2:172.21.15.162:3300/0 conn(0x7f421006eb50 0x7f42100ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f4215760640 1 -- 172.21.15.96:0/2544953791 >> v1:172.21.15.96:6789/0 conn(0x7f42100cab60 legacy=0x7f421015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:04.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.707+0000 7f4215760640 1 -- 172.21.15.96:0/2544953791 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42100cb8a0 con 0x7f4210155570 2024-06-02T23:59:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.708+0000 7f4215760640 1 --2- 172.21.15.96:0/2544953791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4210155570 0x7f421006e610 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4210070b60 tx=0x7f420c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bb815325628c9d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.708+0000 7f4207fff640 1 -- 172.21.15.96:0/2544953791 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c037070 con 0x7f4210155570 2024-06-02T23:59:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.708+0000 7f4207fff640 1 -- 172.21.15.96:0/2544953791 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420c032440 con 0x7f4210155570 2024-06-02T23:59:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.708+0000 7f4207fff640 1 -- 172.21.15.96:0/2544953791 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c032810 con 0x7f4210155570 2024-06-02T23:59:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.708+0000 7f42179c4640 1 -- 172.21.15.96:0/2544953791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4210155570 msgr2=0x7f421006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.708+0000 7f42179c4640 1 --2- 172.21.15.96:0/2544953791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4210155570 0x7f421006e610 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4210070b60 tx=0x7f420c02a1a0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.709+0000 7f42179c4640 1 -- 172.21.15.96:0/2544953791 shutdown_connections 2024-06-02T23:59:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.709+0000 7f42179c4640 1 --2- 172.21.15.96:0/2544953791 >> v2:172.21.15.162:3300/0 conn(0x7f421006eb50 0x7f42100ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.709+0000 7f42179c4640 1 --2- 172.21.15.96:0/2544953791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4210155570 0x7f421006e610 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.709+0000 7f42179c4640 1 -- 172.21.15.96:0/2544953791 >> 172.21.15.96:0/2544953791 conn(0x7f42100cfc30 msgr2=0x7f42100d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:04.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.709+0000 7f42179c4640 1 -- 172.21.15.96:0/2544953791 shutdown_connections 2024-06-02T23:59:04.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.709+0000 7f42179c4640 1 -- 172.21.15.96:0/2544953791 wait complete. 2024-06-02T23:59:04.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.710+0000 7f42179c4640 1 Processor -- start 2024-06-02T23:59:04.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.710+0000 7f42179c4640 1 -- start start 2024-06-02T23:59:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.710+0000 7f42179c4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f421006eb50 0x7f421014c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.710+0000 7f42179c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42100cab60 0x7f42101518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.710+0000 7f42179c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4210155570 0x7f42100ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.710+0000 7f42179c4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f42100cafb0 con 0x7f421006eb50 2024-06-02T23:59:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.710+0000 7f42179c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42100717d0 con 0x7f4210155570 2024-06-02T23:59:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.710+0000 7f42179c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4210073030 con 0x7f42100cab60 2024-06-02T23:59:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4215760640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f421006eb50 0x7f421014c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4215760640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f421006eb50 0x7f421014c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44132/0 (socket says 172.21.15.96:44132) 2024-06-02T23:59:04.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4215760640 1 -- 172.21.15.96:0/3621504227 learned_addr learned my addr 172.21.15.96:0/3621504227 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4214f5f640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42100cab60 0x7f42101518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4215f61640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4210155570 0x7f42100ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4215760640 1 -- 172.21.15.96:0/3621504227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42100cab60 msgr2=0x7f42101518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4215760640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42100cab60 0x7f42101518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4215760640 1 -- 172.21.15.96:0/3621504227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4210155570 msgr2=0x7f42100ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4215760640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4210155570 0x7f42100ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4215760640 1 -- 172.21.15.96:0/3621504227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42100c7bf0 con 0x7f421006eb50 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4215760640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f421006eb50 0x7f421014c100 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f420c000c00 tx=0x7f420c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4205ffb640 1 -- 172.21.15.96:0/3621504227 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c037040 con 0x7f421006eb50 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4205ffb640 1 -- 172.21.15.96:0/3621504227 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420c042070 con 0x7f421006eb50 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f42179c4640 1 -- 172.21.15.96:0/3621504227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42100c7ed0 con 0x7f421006eb50 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f4205ffb640 1 -- 172.21.15.96:0/3621504227 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c030bd0 con 0x7f421006eb50 2024-06-02T23:59:04.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.711+0000 7f42179c4640 1 -- 172.21.15.96:0/3621504227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42101513a0 con 0x7f421006eb50 2024-06-02T23:59:04.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.712+0000 7f42179c4640 1 -- 172.21.15.96:0/3621504227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4210150ef0 con 0x7f421006eb50 2024-06-02T23:59:04.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.713+0000 7f4205ffb640 1 -- 172.21.15.96:0/3621504227 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f420c047460 con 0x7f421006eb50 2024-06-02T23:59:04.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.713+0000 7f4205ffb640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f41f406be60 0x7f41f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:04.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.714+0000 7f4205ffb640 1 -- 172.21.15.96:0/3621504227 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f420c0abbc0 con 0x7f421006eb50 2024-06-02T23:59:04.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.714+0000 7f4214f5f640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f41f406be60 0x7f41f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:04.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.714+0000 7f4214f5f640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f41f406be60 0x7f41f406e320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4210150010 tx=0x7f4200008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:04.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.718+0000 7f4205ffb640 1 -- 172.21.15.96:0/3621504227 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f420c032e20 con 0x7f421006eb50 2024-06-02T23:59:04.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.926+0000 7f42179c4640 1 -- 172.21.15.96:0/3621504227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42100683e0 con 0x7f421006eb50 2024-06-02T23:59:04.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.927+0000 7f4205ffb640 1 -- 172.21.15.96:0/3621504227 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5187 (secure 0 0 0) 0x7f420c07a3e0 con 0x7f421006eb50 2024-06-02T23:59:04.927 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:04.927 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2232659491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2232659491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2232659491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1347815459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1347815459},{"type":"v1","addr":"172.21.15.162:6833","nonce":1347815459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6833/2486518149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":2486518149},{"type":"v1","addr":"172.21.15.96:6833","nonce":2486518149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:59:00.972277+0000","modified":"2024-06-02T23:59:03.921466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5739":{"gid":5739,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6835/2309601772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2309601772},{"type":"v1","addr":"172.21.15.96:6835","nonce":2309601772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5739,"qdb_cluster":[5739]},"id":3}]} 2024-06-02T23:59:04.927 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 25 2024-06-02T23:59:04.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 -- 172.21.15.96:0/3621504227 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f41f406be60 msgr2=0x7f41f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f41f406be60 0x7f41f406e320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4210150010 tx=0x7f4200008040 comp rx=0 tx=0).stop 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 -- 172.21.15.96:0/3621504227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f421006eb50 msgr2=0x7f421014c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f421006eb50 0x7f421014c100 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f420c000c00 tx=0x7f420c0046c0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 -- 172.21.15.96:0/3621504227 shutdown_connections 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f41f406be60 0x7f41f406e320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4210155570 0x7f42100ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42100cab60 0x7f42101518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 --2- 172.21.15.96:0/3621504227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f421006eb50 0x7f421014c100 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 -- 172.21.15.96:0/3621504227 >> 172.21.15.96:0/3621504227 conn(0x7f42100cfc30 msgr2=0x7f42100afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 -- 172.21.15.96:0/3621504227 shutdown_connections 2024-06-02T23:59:04.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:04.929+0000 7f42179c4640 1 -- 172.21.15.96:0/3621504227 wait complete. 2024-06-02T23:59:04.940 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T23:59:05.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.040+0000 7f0c7ec5d640 1 Processor -- start 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.040+0000 7f0c7ec5d640 1 -- start start 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.041+0000 7f0c7ec5d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0c7816ae40 0x7f0c78071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.041+0000 7f0c7ec5d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c7806cee0 0x7f0c7816ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.041+0000 7f0c7ec5d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c780cbd20 con 0x7f0c7816efc0 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.041+0000 7f0c7ec5d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0c7816f410 con 0x7f0c7806cee0 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.041+0000 7f0c7ec5d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0c780cd800 con 0x7f0c7816ae40 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.041+0000 7f0c77fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c7806cee0 0x7f0c7816ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.041+0000 7f0c77fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c7806cee0 0x7f0c7816ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44136/0 (socket says 172.21.15.96:44136) 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.041+0000 7f0c77fff640 1 -- 172.21.15.96:0/4120570173 learned_addr learned my addr 172.21.15.96:0/4120570173 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.041+0000 7f0c7c9f9640 1 --2- 172.21.15.96:0/4120570173 >> v2:172.21.15.162:3300/0 conn(0x7f0c7816ae40 0x7f0c78071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.041+0000 7f0c777fe640 1 -- 172.21.15.96:0/4120570173 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 420285814 0 0) 0x7f0c780cbd20 con 0x7f0c7816efc0 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.066+0000 7f0c777fe640 1 -- 172.21.15.96:0/4120570173 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c60003500 con 0x7f0c7816efc0 2024-06-02T23:59:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.066+0000 7f0c77fff640 1 -- 172.21.15.96:0/4120570173 >> v2:172.21.15.162:3300/0 conn(0x7f0c7816ae40 msgr2=0x7f0c78071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:05.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.066+0000 7f0c77fff640 1 --2- 172.21.15.96:0/4120570173 >> v2:172.21.15.162:3300/0 conn(0x7f0c7816ae40 0x7f0c78071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.066+0000 7f0c77fff640 1 -- 172.21.15.96:0/4120570173 >> v1:172.21.15.96:6789/0 conn(0x7f0c7816efc0 legacy=0x7f0c780ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.066+0000 7f0c777fe640 1 -- 172.21.15.96:0/4120570173 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3749006825 0 0) 0x7f0c60003500 con 0x7f0c7816efc0 2024-06-02T23:59:05.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.066+0000 7f0c77fff640 1 -- 172.21.15.96:0/4120570173 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c780cda50 con 0x7f0c7806cee0 2024-06-02T23:59:05.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.067+0000 7f0c77fff640 1 --2- 172.21.15.96:0/4120570173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7806cee0 0x7f0c7816ea80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0c780694e0 tx=0x7f0c6c033010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8967a6c6c250215d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:05.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.067+0000 7f0c777fe640 1 -- 172.21.15.96:0/4120570173 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c039070 con 0x7f0c7806cee0 2024-06-02T23:59:05.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.067+0000 7f0c777fe640 1 -- 172.21.15.96:0/4120570173 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6c033aa0 con 0x7f0c7806cee0 2024-06-02T23:59:05.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.067+0000 7f0c777fe640 1 -- 172.21.15.96:0/4120570173 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c700019f0 con 0x7f0c7806cee0 2024-06-02T23:59:05.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.068+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/4120570173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7806cee0 msgr2=0x7f0c7816ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.068+0000 7f0c7ec5d640 1 --2- 172.21.15.96:0/4120570173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7806cee0 0x7f0c7816ea80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0c780694e0 tx=0x7f0c6c033010 comp rx=0 tx=0).stop 2024-06-02T23:59:05.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.068+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/4120570173 shutdown_connections 2024-06-02T23:59:05.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.068+0000 7f0c7ec5d640 1 --2- 172.21.15.96:0/4120570173 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7806cee0 0x7f0c7816ea80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.068+0000 7f0c7ec5d640 1 --2- 172.21.15.96:0/4120570173 >> v2:172.21.15.162:3300/0 conn(0x7f0c7816ae40 0x7f0c78071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.068+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/4120570173 >> 172.21.15.96:0/4120570173 conn(0x7f0c780cfc30 msgr2=0x7f0c780d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:05.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.068+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/4120570173 shutdown_connections 2024-06-02T23:59:05.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.068+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/4120570173 wait complete. 2024-06-02T23:59:05.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.069+0000 7f0c7ec5d640 1 Processor -- start 2024-06-02T23:59:05.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.069+0000 7f0c7ec5d640 1 -- start start 2024-06-02T23:59:05.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c7ec5d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c7806cee0 0x7f0c7816c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c7ec5d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7816ae40 0x7f0c78168eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c7ec5d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c7816efc0 0x7f0c781693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c7ec5d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7806d370 con 0x7f0c7816ae40 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c7ec5d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c780ce0a0 con 0x7f0c7816efc0 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c7ec5d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c780cb9b0 con 0x7f0c7806cee0 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c77fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7816ae40 0x7f0c78168eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c77fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7816ae40 0x7f0c78168eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44150/0 (socket says 172.21.15.96:44150) 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c77fff640 1 -- 172.21.15.96:0/2377744691 learned_addr learned my addr 172.21.15.96:0/2377744691 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c77fff640 1 -- 172.21.15.96:0/2377744691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c7806cee0 msgr2=0x7f0c7816c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c77fff640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c7806cee0 0x7f0c7816c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c77fff640 1 -- 172.21.15.96:0/2377744691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c7816efc0 msgr2=0x7f0c781693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c77fff640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c7816efc0 0x7f0c781693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c77fff640 1 -- 172.21.15.96:0/2377744691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c78201460 con 0x7f0c7816ae40 2024-06-02T23:59:05.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c77fff640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7816ae40 0x7f0c78168eb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c03f040 tx=0x7f0c6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c757fa640 1 -- 172.21.15.96:0/2377744691 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c04c070 con 0x7f0c7816ae40 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c757fa640 1 -- 172.21.15.96:0/2377744691 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6c048440 con 0x7f0c7816ae40 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/2377744691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c78201740 con 0x7f0c7816ae40 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.070+0000 7f0c757fa640 1 -- 172.21.15.96:0/2377744691 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c048810 con 0x7f0c7816ae40 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.071+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/2377744691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c7816ba70 con 0x7f0c7816ae40 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.071+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/2377744691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c780683e0 con 0x7f0c7816ae40 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.072+0000 7f0c757fa640 1 -- 172.21.15.96:0/2377744691 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f0c6c04f070 con 0x7f0c7816ae40 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.072+0000 7f0c757fa640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0c6406be30 0x7f0c6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.072+0000 7f0c757fa640 1 -- 172.21.15.96:0/2377744691 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f0c6c0b4640 con 0x7f0c7816ae40 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.072+0000 7f0c7c9f9640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0c6406be30 0x7f0c6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.073+0000 7f0c7c9f9640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0c6406be30 0x7f0c6406e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0c68005db0 tx=0x7f0c6800f040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:05.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.077+0000 7f0c757fa640 1 -- 172.21.15.96:0/2377744691 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0c6c082e60 con 0x7f0c7816ae40 2024-06-02T23:59:05.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.251+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/2377744691 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c780ca430 con 0x7f0c7816ae40 2024-06-02T23:59:05.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.252+0000 7f0c757fa640 1 -- 172.21.15.96:0/2377744691 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16942 (secure 0 0 0) 0x7f0c6c082760 con 0x7f0c7816ae40 2024-06-02T23:59:05.253 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:05.253 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":70,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-02T23:59:02.568774+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:58:59.564247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-06-02T23:58:59.946495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T23:59:05.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/2377744691 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0c6406be30 msgr2=0x7f0c6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0c6406be30 0x7f0c6406e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0c68005db0 tx=0x7f0c6800f040 comp rx=0 tx=0).stop 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/2377744691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7816ae40 msgr2=0x7f0c78168eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7816ae40 0x7f0c78168eb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c03f040 tx=0x7f0c6c0046c0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/2377744691 shutdown_connections 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0c6406be30 0x7f0c6406e2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c7816efc0 0x7f0c781693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c7816ae40 0x7f0c78168eb0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 --2- 172.21.15.96:0/2377744691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c7806cee0 0x7f0c7816c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/2377744691 >> 172.21.15.96:0/2377744691 conn(0x7f0c780cfc30 msgr2=0x7f0c7806d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/2377744691 shutdown_connections 2024-06-02T23:59:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.254+0000 7f0c7ec5d640 1 -- 172.21.15.96:0/2377744691 wait complete. 2024-06-02T23:59:05.265 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-02T23:59:05.266 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:59:05.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.365+0000 7fd67f872640 1 Processor -- start 2024-06-02T23:59:05.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.365+0000 7fd67f872640 1 -- start start 2024-06-02T23:59:05.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd67f872640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd67815f5e0 0x7fd678071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd67f872640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd67806f210 con 0x7fd6780cae00 2024-06-02T23:59:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd67f872640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd67806ef30 con 0x7fd67806ea70 2024-06-02T23:59:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd67f872640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd6780ca320 con 0x7fd67815f5e0 2024-06-02T23:59:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd67d60e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd67815f5e0 0x7fd678071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd67de0f640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd6780cae00 0x7fd6780cb210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37324/0 (socket says 172.21.15.96:37324) 2024-06-02T23:59:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd67de0f640 1 -- 172.21.15.96:0/2827203141 learned_addr learned my addr 172.21.15.96:0/2827203141 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:59:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd67d60e640 1 -- 172.21.15.96:0/2827203141 >> v1:172.21.15.162:6789/0 conn(0x7fd67806ea70 legacy=0x7fd678071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd67d60e640 1 -- 172.21.15.96:0/2827203141 >> v1:172.21.15.96:6789/0 conn(0x7fd6780cae00 legacy=0x7fd6780cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd67d60e640 1 -- 172.21.15.96:0/2827203141 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6780ca600 con 0x7fd67815f5e0 2024-06-02T23:59:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.366+0000 7fd66ffff640 1 -- 172.21.15.96:0/2827203141 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848799717 0 0) 0x7fd67806f210 con 0x7fd6780cae00 2024-06-02T23:59:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.367+0000 7fd67d60e640 1 --2- 172.21.15.96:0/2827203141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67815f5e0 0x7fd678071100 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd6740097a0 tx=0x7fd67402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5283aa073a1257e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.367+0000 7fd66ffff640 1 -- 172.21.15.96:0/2827203141 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674037070 con 0x7fd67815f5e0 2024-06-02T23:59:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.367+0000 7fd66ffff640 1 -- 172.21.15.96:0/2827203141 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd674032440 con 0x7fd67815f5e0 2024-06-02T23:59:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.367+0000 7fd66ffff640 1 -- 172.21.15.96:0/2827203141 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674032810 con 0x7fd67815f5e0 2024-06-02T23:59:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.368+0000 7fd67f872640 1 -- 172.21.15.96:0/2827203141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67815f5e0 msgr2=0x7fd678071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.368+0000 7fd67f872640 1 --2- 172.21.15.96:0/2827203141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67815f5e0 0x7fd678071100 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd6740097a0 tx=0x7fd67402a1e0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.368+0000 7fd67f872640 1 -- 172.21.15.96:0/2827203141 shutdown_connections 2024-06-02T23:59:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.368+0000 7fd67f872640 1 --2- 172.21.15.96:0/2827203141 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67815f5e0 0x7fd678071100 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.368+0000 7fd67f872640 1 -- 172.21.15.96:0/2827203141 >> 172.21.15.96:0/2827203141 conn(0x7fd6780cfc30 msgr2=0x7fd6780d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.368+0000 7fd67f872640 1 -- 172.21.15.96:0/2827203141 shutdown_connections 2024-06-02T23:59:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.368+0000 7fd67f872640 1 -- 172.21.15.96:0/2827203141 wait complete. 2024-06-02T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.369+0000 7fd67f872640 1 Processor -- start 2024-06-02T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.369+0000 7fd67f872640 1 -- start start 2024-06-02T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67f872640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67806ea70 0x7fd6780c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67f872640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6780cae00 0x7fd678152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67f872640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd67815f5e0 0x7fd6781510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67f872640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd6780731b0 con 0x7fd67806ea70 2024-06-02T23:59:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67f872640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd678073030 con 0x7fd67815f5e0 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67f872640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6780b2ac0 con 0x7fd6780cae00 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67d60e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67806ea70 0x7fd6780c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67d60e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67806ea70 0x7fd6780c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44168/0 (socket says 172.21.15.96:44168) 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67d60e640 1 -- 172.21.15.96:0/2145978241 learned_addr learned my addr 172.21.15.96:0/2145978241 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67d60e640 1 -- 172.21.15.96:0/2145978241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6780cae00 msgr2=0x7fd678152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67d60e640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6780cae00 0x7fd678152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67d60e640 1 -- 172.21.15.96:0/2145978241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd67815f5e0 msgr2=0x7fd6781510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67d60e640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd67815f5e0 0x7fd6781510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67d60e640 1 -- 172.21.15.96:0/2145978241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd678153700 con 0x7fd67806ea70 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.370+0000 7fd67d60e640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67806ea70 0x7fd6780c78d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd6740097a0 tx=0x7fd6740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.371+0000 7fd66dffb640 1 -- 172.21.15.96:0/2145978241 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674041070 con 0x7fd67806ea70 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.371+0000 7fd66dffb640 1 -- 172.21.15.96:0/2145978241 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67403c870 con 0x7fd67806ea70 2024-06-02T23:59:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.371+0000 7fd67f872640 1 -- 172.21.15.96:0/2145978241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6781539e0 con 0x7fd67806ea70 2024-06-02T23:59:05.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.371+0000 7fd66dffb640 1 -- 172.21.15.96:0/2145978241 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674037040 con 0x7fd67806ea70 2024-06-02T23:59:05.373 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.371+0000 7fd67f872640 1 -- 172.21.15.96:0/2145978241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd678153cc0 con 0x7fd67806ea70 2024-06-02T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.372+0000 7fd67f872640 1 -- 172.21.15.96:0/2145978241 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6780727a0 con 0x7fd67806ea70 2024-06-02T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.372+0000 7fd66dffb640 1 -- 172.21.15.96:0/2145978241 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fd674044070 con 0x7fd67806ea70 2024-06-02T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.373+0000 7fd66dffb640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd65c06be30 0x7fd65c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.373+0000 7fd66dffb640 1 -- 172.21.15.96:0/2145978241 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fd6740abc10 con 0x7fd67806ea70 2024-06-02T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.373+0000 7fd67ce0d640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd65c06be30 0x7fd65c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.374 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.373+0000 7fd67ce0d640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd65c06be30 0x7fd65c06e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6781527c0 tx=0x7fd6680079d0 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.377+0000 7fd66dffb640 1 -- 172.21.15.96:0/2145978241 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd6780727a0 con 0x7fd67806ea70 2024-06-02T23:59:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.547+0000 7fd67f872640 1 -- 172.21.15.96:0/2145978241 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6780683e0 con 0x7fd65c06be30 2024-06-02T23:59:05.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.553+0000 7fd66dffb640 1 -- 172.21.15.96:0/2145978241 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240001 (secure 0 0 0) 0x7fd6680529a0 con 0x7fd65c06be30 2024-06-02T23:59:05.556 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:05.557 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:59:05.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.556+0000 7fd67f872640 1 -- 172.21.15.96:0/2145978241 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd65c06be30 msgr2=0x7fd65c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.556+0000 7fd67f872640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd65c06be30 0x7fd65c06e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6781527c0 tx=0x7fd6680079d0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.556+0000 7fd67f872640 1 -- 172.21.15.96:0/2145978241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67806ea70 msgr2=0x7fd6780c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.556+0000 7fd67f872640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67806ea70 0x7fd6780c78d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd6740097a0 tx=0x7fd6740046c0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.556+0000 7fd67f872640 1 -- 172.21.15.96:0/2145978241 shutdown_connections 2024-06-02T23:59:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.556+0000 7fd67f872640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd65c06be30 0x7fd65c06e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.556+0000 7fd67f872640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd67815f5e0 0x7fd6781510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.556+0000 7fd67f872640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6780cae00 0x7fd678152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.556+0000 7fd67f872640 1 --2- 172.21.15.96:0/2145978241 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd67806ea70 0x7fd6780c78d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.556+0000 7fd67f872640 1 -- 172.21.15.96:0/2145978241 >> 172.21.15.96:0/2145978241 conn(0x7fd6780cfc30 msgr2=0x7fd6780b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.557+0000 7fd67f872640 1 -- 172.21.15.96:0/2145978241 shutdown_connections 2024-06-02T23:59:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.557+0000 7fd67f872640 1 -- 172.21.15.96:0/2145978241 wait complete. 2024-06-02T23:59:05.567 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-06-02T23:59:04.496215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319332,"kb_used_data":7408,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655388,"statfs":{"total":773094113280,"available":772767117312,"internally_reserved":0,"allocated":7585792,"data_stored":4371107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.880032"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.624220+0000","last_change":"2024-06-02T23:58:59.624220+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.624220+0000","last_undegraded":"2024-06-02T23:58:59.624220+0000","last_fullsized":"2024-06-02T23:58:59.624220+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.621010+0000","last_change":"2024-06-02T23:58:59.621010+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.621010+0000","last_undegraded":"2024-06-02T23:58:59.621010+0000","last_fullsized":"2024-06-02T23:58:59.621010+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620945+0000","last_change":"2024-06-02T23:58:59.620945+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620945+0000","last_undegraded":"2024-06-02T23:58:59.620945+0000","last_fullsized":"2024-06-02T23:58:59.620945+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620817+0000","last_change":"2024-06-02T23:58:59.620817+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620817+0000","last_undegraded":"2024-06-02T23:58:59.620817+0000","last_fullsized":"2024-06-02T23:58:59.620817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623373+0000","last_change":"2024-06-02T23:58:59.623373+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623373+0000","last_undegraded":"2024-06-02T23:58:59.623373+0000","last_fullsized":"2024-06-02T23:58:59.623373+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620743+0000","last_change":"2024-06-02T23:58:59.620743+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620743+0000","last_undegraded":"2024-06-02T23:58:59.620743+0000","last_fullsized":"2024-06-02T23:58:59.620743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623251+0000","last_change":"2024-06-02T23:58:59.623251+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623251+0000","last_undegraded":"2024-06-02T23:58:59.623251+0000","last_fullsized":"2024-06-02T23:58:59.623251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622738+0000","last_change":"2024-06-02T23:58:59.622738+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622738+0000","last_undegraded":"2024-06-02T23:58:59.622738+0000","last_fullsized":"2024-06-02T23:58:59.622738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623887+0000","last_change":"2024-06-02T23:58:59.623887+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623887+0000","last_undegraded":"2024-06-02T23:58:59.623887+0000","last_fullsized":"2024-06-02T23:58:59.623887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620781+0000","last_change":"2024-06-02T23:58:59.620781+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620781+0000","last_undegraded":"2024-06-02T23:58:59.620781+0000","last_fullsized":"2024-06-02T23:58:59.620781+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.624108+0000","last_change":"2024-06-02T23:58:59.624108+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.624108+0000","last_undegraded":"2024-06-02T23:58:59.624108+0000","last_fullsized":"2024-06-02T23:58:59.624108+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.619831+0000","last_change":"2024-06-02T23:58:59.619831+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.619831+0000","last_undegraded":"2024-06-02T23:58:59.619831+0000","last_fullsized":"2024-06-02T23:58:59.619831+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622654+0000","last_change":"2024-06-02T23:58:59.622654+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622654+0000","last_undegraded":"2024-06-02T23:58:59.622654+0000","last_fullsized":"2024-06-02T23:58:59.622654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623294+0000","last_change":"2024-06-02T23:58:59.623294+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623294+0000","last_undegraded":"2024-06-02T23:58:59.623294+0000","last_fullsized":"2024-06-02T23:58:59.623294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623283+0000","last_change":"2024-06-02T23:58:59.623283+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623283+0000","last_undegraded":"2024-06-02T23:58:59.623283+0000","last_fullsized":"2024-06-02T23:58:59.623283+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.619437+0000","last_change":"2024-06-02T23:58:59.619437+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.619437+0000","last_undegraded":"2024-06-02T23:58:59.619437+0000","last_fullsized":"2024-06-02T23:58:59.619437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622707+0000","last_change":"2024-06-02T23:58:59.622707+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622707+0000","last_undegraded":"2024-06-02T23:58:59.622707+0000","last_fullsized":"2024-06-02T23:58:59.622707+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620391+0000","last_change":"2024-06-02T23:58:59.620391+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620391+0000","last_undegraded":"2024-06-02T23:58:59.620391+0000","last_fullsized":"2024-06-02T23:58:59.620391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623495+0000","last_change":"2024-06-02T23:58:59.623495+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623495+0000","last_undegraded":"2024-06-02T23:58:59.623495+0000","last_fullsized":"2024-06-02T23:58:59.623495+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623867+0000","last_change":"2024-06-02T23:58:59.623867+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623867+0000","last_undegraded":"2024-06-02T23:58:59.623867+0000","last_fullsized":"2024-06-02T23:58:59.623867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620965+0000","last_change":"2024-06-02T23:58:59.620965+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620965+0000","last_undegraded":"2024-06-02T23:58:59.620965+0000","last_fullsized":"2024-06-02T23:58:59.620965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.619423+0000","last_change":"2024-06-02T23:58:59.619423+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.619423+0000","last_undegraded":"2024-06-02T23:58:59.619423+0000","last_fullsized":"2024-06-02T23:58:59.619423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622661+0000","last_change":"2024-06-02T23:58:59.622661+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622661+0000","last_undegraded":"2024-06-02T23:58:59.622661+0000","last_fullsized":"2024-06-02T23:58:59.622661+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620390+0000","last_change":"2024-06-02T23:58:59.620390+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620390+0000","last_undegraded":"2024-06-02T23:58:59.620390+0000","last_fullsized":"2024-06-02T23:58:59.620390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623366+0000","last_change":"2024-06-02T23:58:59.623366+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623366+0000","last_undegraded":"2024-06-02T23:58:59.623366+0000","last_fullsized":"2024-06-02T23:58:59.623366+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623585+0000","last_change":"2024-06-02T23:58:59.623585+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623585+0000","last_undegraded":"2024-06-02T23:58:59.623585+0000","last_fullsized":"2024-06-02T23:58:59.623585+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623140+0000","last_change":"2024-06-02T23:58:59.623140+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623140+0000","last_undegraded":"2024-06-02T23:58:59.623140+0000","last_fullsized":"2024-06-02T23:58:59.623140+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.618893+0000","last_change":"2024-06-02T23:58:59.618893+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.618893+0000","last_undegraded":"2024-06-02T23:58:59.618893+0000","last_fullsized":"2024-06-02T23:58:59.618893+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.618761+0000","last_change":"2024-06-02T23:58:59.618761+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.618761+0000","last_undegraded":"2024-06-02T23:58:59.618761+0000","last_fullsized":"2024-06-02T23:58:59.618761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620810+0000","last_change":"2024-06-02T23:58:59.620810+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620810+0000","last_undegraded":"2024-06-02T23:58:59.620810+0000","last_fullsized":"2024-06-02T23:58:59.620810+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.621630+0000","last_change":"2024-06-02T23:58:59.621630+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.621630+0000","last_undegraded":"2024-06-02T23:58:59.621630+0000","last_fullsized":"2024-06-02T23:58:59.621630+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622877+0000","last_change":"2024-06-02T23:58:59.622877+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622877+0000","last_undegraded":"2024-06-02T23:58:59.622877+0000","last_fullsized":"2024-06-02T23:58:59.622877+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":343,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-06-02T23:58:59.624672+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:58:59.624672+0000","last_peered":"2024-06-02T23:58:59.624672+0000","last_clean":"2024-06-02T23:58:59.624672+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:58:59.624672+0000","last_undegraded":"2024-06-02T23:58:59.624672+0000","last_fullsized":"2024-06-02T23:58:59.624672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54752,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317088,"statfs":{"total":96636764160,"available":96580698112,"internally_reserved":0,"allocated":1396736,"data_stored":990696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50016,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321824,"statfs":{"total":96636764160,"available":96585547776,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54180,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317660,"statfs":{"total":96636764160,"available":96581283840,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":778240,"data_stored":388075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":990696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:59:05.571 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:59:05.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.708+0000 7fbcc1563640 1 Processor -- start 2024-06-02T23:59:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.708+0000 7fbcc1563640 1 -- start start 2024-06-02T23:59:05.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.709+0000 7fbcc1563640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbcbc1620a0 0x7fbcbc162550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.709+0000 7fbcc1563640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcbc06da40 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.709+0000 7fbcc1563640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcbc0d1920 con 0x7fbcbc0b33f0 2024-06-02T23:59:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.709+0000 7fbcc1563640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fbcbc06d800 con 0x7fbcbc1620a0 2024-06-02T23:59:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.709+0000 7fbcbaffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fbcbc15e4a0 0x7fbcbc06d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37336/0 (socket says 172.21.15.96:37336) 2024-06-02T23:59:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.709+0000 7fbcbaffd640 1 -- 172.21.15.96:0/1147283611 learned_addr learned my addr 172.21.15.96:0/1147283611 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:59:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.709+0000 7fbcbb7fe640 1 --2- 172.21.15.96:0/1147283611 >> v2:172.21.15.96:3300/0 conn(0x7fbcbc1620a0 0x7fbcbc162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.710+0000 7fbcbb7fe640 1 -- 172.21.15.96:0/1147283611 >> v1:172.21.15.162:6789/0 conn(0x7fbcbc0b33f0 legacy=0x7fbcbc0d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.710+0000 7fbcbb7fe640 1 -- 172.21.15.96:0/1147283611 >> v1:172.21.15.96:6789/0 conn(0x7fbcbc15e4a0 legacy=0x7fbcbc06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.710+0000 7fbcb9ffb640 1 -- 172.21.15.96:0/1147283611 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336204755 0 0) 0x7fbcbc06da40 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.710+0000 7fbcbb7fe640 1 -- 172.21.15.96:0/1147283611 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc0d0450 con 0x7fbcbc1620a0 2024-06-02T23:59:05.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.710+0000 7fbcbb7fe640 1 --2- 172.21.15.96:0/1147283611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc1620a0 0x7fbcbc162550 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009d90 tx=0x7fbcb402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aef04c9f89448a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.710+0000 7fbcb9ffb640 1 -- 172.21.15.96:0/1147283611 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4007740 con 0x7fbcbc1620a0 2024-06-02T23:59:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.710+0000 7fbcb9ffb640 1 -- 172.21.15.96:0/1147283611 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb40078e0 con 0x7fbcbc1620a0 2024-06-02T23:59:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.710+0000 7fbcb9ffb640 1 -- 172.21.15.96:0/1147283611 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4007cb0 con 0x7fbcbc1620a0 2024-06-02T23:59:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.711+0000 7fbcc1563640 1 -- 172.21.15.96:0/1147283611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc1620a0 msgr2=0x7fbcbc162550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.711+0000 7fbcc1563640 1 --2- 172.21.15.96:0/1147283611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc1620a0 0x7fbcbc162550 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009d90 tx=0x7fbcb402a6a0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.711+0000 7fbcc1563640 1 -- 172.21.15.96:0/1147283611 shutdown_connections 2024-06-02T23:59:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.711+0000 7fbcc1563640 1 --2- 172.21.15.96:0/1147283611 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc1620a0 0x7fbcbc162550 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.711+0000 7fbcc1563640 1 -- 172.21.15.96:0/1147283611 >> 172.21.15.96:0/1147283611 conn(0x7fbcbc0d1e40 msgr2=0x7fbcbc0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.711+0000 7fbcc1563640 1 -- 172.21.15.96:0/1147283611 shutdown_connections 2024-06-02T23:59:05.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.711+0000 7fbcc1563640 1 -- 172.21.15.96:0/1147283611 wait complete. 2024-06-02T23:59:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.712+0000 7fbcc1563640 1 Processor -- start 2024-06-02T23:59:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.712+0000 7fbcc1563640 1 -- start start 2024-06-02T23:59:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcc1563640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcbc0b33f0 0x7fbcbc1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcc1563640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc15e4a0 0x7fbcbc15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcc1563640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcbc1620a0 0x7fbcbc15c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcc1563640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc0d0cf0 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcc1563640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc0d0a10 con 0x7fbcbc1620a0 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcc1563640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbcbc15e880 con 0x7fbcbc0b33f0 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcba7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc15e4a0 0x7fbcbc15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcba7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc15e4a0 0x7fbcbc15bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44186/0 (socket says 172.21.15.96:44186) 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcba7fc640 1 -- 172.21.15.96:0/4257779213 learned_addr learned my addr 172.21.15.96:0/4257779213 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcbaffd640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcbc0b33f0 0x7fbcbc1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcbb7fe640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcbc1620a0 0x7fbcbc15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcba7fc640 1 -- 172.21.15.96:0/4257779213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcbc0b33f0 msgr2=0x7fbcbc1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcba7fc640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcbc0b33f0 0x7fbcbc1523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcba7fc640 1 -- 172.21.15.96:0/4257779213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcbc1620a0 msgr2=0x7fbcbc15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcba7fc640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcbc1620a0 0x7fbcbc15c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcba7fc640 1 -- 172.21.15.96:0/4257779213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcbc153e30 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.713+0000 7fbcbaffd640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcbc0b33f0 0x7fbcbc1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:05.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.714+0000 7fbcba7fc640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc15e4a0 0x7fbcbc15bc40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000b3f0 tx=0x7fbcb000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.714+0000 7fbca37fe640 1 -- 172.21.15.96:0/4257779213 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0015020 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.714+0000 7fbca37fe640 1 -- 172.21.15.96:0/4257779213 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb0011830 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.714+0000 7fbcc1563640 1 -- 172.21.15.96:0/4257779213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcbc154110 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.714+0000 7fbca37fe640 1 -- 172.21.15.96:0/4257779213 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0011c20 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.714+0000 7fbcc1563640 1 -- 172.21.15.96:0/4257779213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcbc1546d0 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.715+0000 7fbcc1563640 1 -- 172.21.15.96:0/4257779213 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcbc0683e0 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.715+0000 7fbca37fe640 1 -- 172.21.15.96:0/4257779213 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fbcb0018020 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.716+0000 7fbca37fe640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fbca806be30 0x7fbca806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:05.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.716+0000 7fbca37fe640 1 -- 172.21.15.96:0/4257779213 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fbcb008af60 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.716+0000 7fbcbaffd640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fbca806be30 0x7fbca806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:05.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.716+0000 7fbcbaffd640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fbca806be30 0x7fbca806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbcac000f60 tx=0x7fbcac007ca0 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:05.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.720+0000 7fbca37fe640 1 -- 172.21.15.96:0/4257779213 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fbcb001f020 con 0x7fbcbc15e4a0 2024-06-02T23:59:05.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.888+0000 7fbcc1563640 1 -- 172.21.15.96:0/4257779213 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcbc06c0f0 con 0x7fbca806be30 2024-06-02T23:59:05.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.894+0000 7fbca37fe640 1 -- 172.21.15.96:0/4257779213 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240001 (secure 0 0 0) 0x7fbcbc06c0f0 con 0x7fbca806be30 2024-06-02T23:59:05.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:05.898 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:59:05.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 -- 172.21.15.96:0/4257779213 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fbca806be30 msgr2=0x7fbca806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fbca806be30 0x7fbca806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbcac000f60 tx=0x7fbcac007ca0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 -- 172.21.15.96:0/4257779213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc15e4a0 msgr2=0x7fbcbc15bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc15e4a0 0x7fbcbc15bc40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000b3f0 tx=0x7fbcb000b8b0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 -- 172.21.15.96:0/4257779213 shutdown_connections 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fbca806be30 0x7fbca806e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcbc1620a0 0x7fbcbc15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbcbc15e4a0 0x7fbcbc15bc40 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 --2- 172.21.15.96:0/4257779213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbcbc0b33f0 0x7fbcbc1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 -- 172.21.15.96:0/4257779213 >> 172.21.15.96:0/4257779213 conn(0x7fbcbc0d1e40 msgr2=0x7fbcbc0d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 -- 172.21.15.96:0/4257779213 shutdown_connections 2024-06-02T23:59:05.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:05.897+0000 7fbcc1563640 1 -- 172.21.15.96:0/4257779213 wait complete. 2024-06-02T23:59:05.908 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-06-02T23:59:04.496215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319332,"kb_used_data":7408,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655388,"statfs":{"total":773094113280,"available":772767117312,"internally_reserved":0,"allocated":7585792,"data_stored":4371107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.880032"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.624220+0000","last_change":"2024-06-02T23:58:59.624220+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.624220+0000","last_undegraded":"2024-06-02T23:58:59.624220+0000","last_fullsized":"2024-06-02T23:58:59.624220+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.621010+0000","last_change":"2024-06-02T23:58:59.621010+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.621010+0000","last_undegraded":"2024-06-02T23:58:59.621010+0000","last_fullsized":"2024-06-02T23:58:59.621010+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620945+0000","last_change":"2024-06-02T23:58:59.620945+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620945+0000","last_undegraded":"2024-06-02T23:58:59.620945+0000","last_fullsized":"2024-06-02T23:58:59.620945+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620817+0000","last_change":"2024-06-02T23:58:59.620817+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620817+0000","last_undegraded":"2024-06-02T23:58:59.620817+0000","last_fullsized":"2024-06-02T23:58:59.620817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623373+0000","last_change":"2024-06-02T23:58:59.623373+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623373+0000","last_undegraded":"2024-06-02T23:58:59.623373+0000","last_fullsized":"2024-06-02T23:58:59.623373+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620743+0000","last_change":"2024-06-02T23:58:59.620743+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620743+0000","last_undegraded":"2024-06-02T23:58:59.620743+0000","last_fullsized":"2024-06-02T23:58:59.620743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623251+0000","last_change":"2024-06-02T23:58:59.623251+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623251+0000","last_undegraded":"2024-06-02T23:58:59.623251+0000","last_fullsized":"2024-06-02T23:58:59.623251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622738+0000","last_change":"2024-06-02T23:58:59.622738+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622738+0000","last_undegraded":"2024-06-02T23:58:59.622738+0000","last_fullsized":"2024-06-02T23:58:59.622738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623887+0000","last_change":"2024-06-02T23:58:59.623887+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623887+0000","last_undegraded":"2024-06-02T23:58:59.623887+0000","last_fullsized":"2024-06-02T23:58:59.623887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620781+0000","last_change":"2024-06-02T23:58:59.620781+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620781+0000","last_undegraded":"2024-06-02T23:58:59.620781+0000","last_fullsized":"2024-06-02T23:58:59.620781+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.624108+0000","last_change":"2024-06-02T23:58:59.624108+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.624108+0000","last_undegraded":"2024-06-02T23:58:59.624108+0000","last_fullsized":"2024-06-02T23:58:59.624108+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.619831+0000","last_change":"2024-06-02T23:58:59.619831+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.619831+0000","last_undegraded":"2024-06-02T23:58:59.619831+0000","last_fullsized":"2024-06-02T23:58:59.619831+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622654+0000","last_change":"2024-06-02T23:58:59.622654+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622654+0000","last_undegraded":"2024-06-02T23:58:59.622654+0000","last_fullsized":"2024-06-02T23:58:59.622654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623294+0000","last_change":"2024-06-02T23:58:59.623294+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623294+0000","last_undegraded":"2024-06-02T23:58:59.623294+0000","last_fullsized":"2024-06-02T23:58:59.623294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623283+0000","last_change":"2024-06-02T23:58:59.623283+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623283+0000","last_undegraded":"2024-06-02T23:58:59.623283+0000","last_fullsized":"2024-06-02T23:58:59.623283+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.619437+0000","last_change":"2024-06-02T23:58:59.619437+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.619437+0000","last_undegraded":"2024-06-02T23:58:59.619437+0000","last_fullsized":"2024-06-02T23:58:59.619437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622707+0000","last_change":"2024-06-02T23:58:59.622707+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622707+0000","last_undegraded":"2024-06-02T23:58:59.622707+0000","last_fullsized":"2024-06-02T23:58:59.622707+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620391+0000","last_change":"2024-06-02T23:58:59.620391+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620391+0000","last_undegraded":"2024-06-02T23:58:59.620391+0000","last_fullsized":"2024-06-02T23:58:59.620391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623495+0000","last_change":"2024-06-02T23:58:59.623495+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623495+0000","last_undegraded":"2024-06-02T23:58:59.623495+0000","last_fullsized":"2024-06-02T23:58:59.623495+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623867+0000","last_change":"2024-06-02T23:58:59.623867+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623867+0000","last_undegraded":"2024-06-02T23:58:59.623867+0000","last_fullsized":"2024-06-02T23:58:59.623867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620965+0000","last_change":"2024-06-02T23:58:59.620965+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620965+0000","last_undegraded":"2024-06-02T23:58:59.620965+0000","last_fullsized":"2024-06-02T23:58:59.620965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.619423+0000","last_change":"2024-06-02T23:58:59.619423+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.619423+0000","last_undegraded":"2024-06-02T23:58:59.619423+0000","last_fullsized":"2024-06-02T23:58:59.619423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622661+0000","last_change":"2024-06-02T23:58:59.622661+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622661+0000","last_undegraded":"2024-06-02T23:58:59.622661+0000","last_fullsized":"2024-06-02T23:58:59.622661+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620390+0000","last_change":"2024-06-02T23:58:59.620390+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620390+0000","last_undegraded":"2024-06-02T23:58:59.620390+0000","last_fullsized":"2024-06-02T23:58:59.620390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623366+0000","last_change":"2024-06-02T23:58:59.623366+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623366+0000","last_undegraded":"2024-06-02T23:58:59.623366+0000","last_fullsized":"2024-06-02T23:58:59.623366+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623585+0000","last_change":"2024-06-02T23:58:59.623585+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623585+0000","last_undegraded":"2024-06-02T23:58:59.623585+0000","last_fullsized":"2024-06-02T23:58:59.623585+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623140+0000","last_change":"2024-06-02T23:58:59.623140+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623140+0000","last_undegraded":"2024-06-02T23:58:59.623140+0000","last_fullsized":"2024-06-02T23:58:59.623140+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.618893+0000","last_change":"2024-06-02T23:58:59.618893+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.618893+0000","last_undegraded":"2024-06-02T23:58:59.618893+0000","last_fullsized":"2024-06-02T23:58:59.618893+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.618761+0000","last_change":"2024-06-02T23:58:59.618761+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.618761+0000","last_undegraded":"2024-06-02T23:58:59.618761+0000","last_fullsized":"2024-06-02T23:58:59.618761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620810+0000","last_change":"2024-06-02T23:58:59.620810+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620810+0000","last_undegraded":"2024-06-02T23:58:59.620810+0000","last_fullsized":"2024-06-02T23:58:59.620810+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.621630+0000","last_change":"2024-06-02T23:58:59.621630+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.621630+0000","last_undegraded":"2024-06-02T23:58:59.621630+0000","last_fullsized":"2024-06-02T23:58:59.621630+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622877+0000","last_change":"2024-06-02T23:58:59.622877+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622877+0000","last_undegraded":"2024-06-02T23:58:59.622877+0000","last_fullsized":"2024-06-02T23:58:59.622877+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":343,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-06-02T23:58:59.624672+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:58:59.624672+0000","last_peered":"2024-06-02T23:58:59.624672+0000","last_clean":"2024-06-02T23:58:59.624672+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:58:59.624672+0000","last_undegraded":"2024-06-02T23:58:59.624672+0000","last_fullsized":"2024-06-02T23:58:59.624672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54752,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317088,"statfs":{"total":96636764160,"available":96580698112,"internally_reserved":0,"allocated":1396736,"data_stored":990696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50016,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321824,"statfs":{"total":96636764160,"available":96585547776,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54180,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317660,"statfs":{"total":96636764160,"available":96581283840,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":778240,"data_stored":388075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":990696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:59:05.912 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:59:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.047+0000 7f2c9e1ee640 1 Processor -- start 2024-06-02T23:59:06.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.048+0000 7f2c9e1ee640 1 -- start start 2024-06-02T23:59:06.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.048+0000 7f2c9e1ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c98161900 0x7f2c980d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.048+0000 7f2c9e1ee640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c980b5510 0x7f2c980d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.048+0000 7f2c9e1ee640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c980d4a90 con 0x7f2c980b4fa0 2024-06-02T23:59:06.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.048+0000 7f2c9e1ee640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2c980cf5c0 con 0x7f2c980b5510 2024-06-02T23:59:06.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.048+0000 7f2c9e1ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c980caf70 con 0x7f2c98161900 2024-06-02T23:59:06.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.048+0000 7f2c96ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c980b5510 0x7f2c980d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.048+0000 7f2c96ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2c980b5510 0x7f2c980d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44194/0 (socket says 172.21.15.96:44194) 2024-06-02T23:59:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.048+0000 7f2c96ffd640 1 -- 172.21.15.96:0/1803960772 learned_addr learned my addr 172.21.15.96:0/1803960772 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.049+0000 7f2c977fe640 1 --2- 172.21.15.96:0/1803960772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c98161900 0x7f2c980d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.049+0000 7f2c96ffd640 1 -- 172.21.15.96:0/1803960772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c98161900 msgr2=0x7f2c980d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.049+0000 7f2c96ffd640 1 --2- 172.21.15.96:0/1803960772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c98161900 0x7f2c980d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.049+0000 7f2c96ffd640 1 -- 172.21.15.96:0/1803960772 >> v1:172.21.15.162:6789/0 conn(0x7f2c980b4fa0 legacy=0x7f2c980d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.049+0000 7f2c96ffd640 1 -- 172.21.15.96:0/1803960772 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c980d4d70 con 0x7f2c980b5510 2024-06-02T23:59:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.049+0000 7f2c977fe640 1 --2- 172.21.15.96:0/1803960772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c98161900 0x7f2c980d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:06.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.049+0000 7f2c96ffd640 1 --2- 172.21.15.96:0/1803960772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980b5510 0x7f2c980d0f50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009870 tx=0x7f2c8002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd3e0513f0a055d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c967fc640 1 -- 172.21.15.96:0/1803960772 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80037070 con 0x7f2c980b5510 2024-06-02T23:59:06.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c967fc640 1 -- 172.21.15.96:0/1803960772 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c80032440 con 0x7f2c980b5510 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c967fc640 1 -- 172.21.15.96:0/1803960772 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80032810 con 0x7f2c980b5510 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1803960772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980b5510 msgr2=0x7f2c980d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c9e1ee640 1 --2- 172.21.15.96:0/1803960772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980b5510 0x7f2c980d0f50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009870 tx=0x7f2c8002a180 comp rx=0 tx=0).stop 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1803960772 shutdown_connections 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c9e1ee640 1 --2- 172.21.15.96:0/1803960772 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c980b5510 0x7f2c980d0f50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c9e1ee640 1 --2- 172.21.15.96:0/1803960772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c98161900 0x7f2c980d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1803960772 >> 172.21.15.96:0/1803960772 conn(0x7f2c9809d3b0 msgr2=0x7f2c980d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1803960772 shutdown_connections 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.050+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1803960772 wait complete. 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.051+0000 7f2c9e1ee640 1 Processor -- start 2024-06-02T23:59:06.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.052+0000 7f2c9e1ee640 1 -- start start 2024-06-02T23:59:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.052+0000 7f2c9e1ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c980b4fa0 0x7f2c980c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.052+0000 7f2c9e1ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c980b5510 0x7f2c98148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.052+0000 7f2c9e1ee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c98161900 0x7f2c981562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.052+0000 7f2c9e1ee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2c980d4780 con 0x7f2c98161900 2024-06-02T23:59:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.052+0000 7f2c9e1ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c980cfae0 con 0x7f2c980b4fa0 2024-06-02T23:59:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.052+0000 7f2c9e1ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c98161ce0 con 0x7f2c980b5510 2024-06-02T23:59:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.052+0000 7f2c97fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c98161900 0x7f2c981562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.052+0000 7f2c97fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c98161900 0x7f2c981562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44204/0 (socket says 172.21.15.96:44204) 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.052+0000 7f2c97fff640 1 -- 172.21.15.96:0/1141154968 learned_addr learned my addr 172.21.15.96:0/1141154968 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c96ffd640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c980b5510 0x7f2c98148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c97fff640 1 -- 172.21.15.96:0/1141154968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c980b5510 msgr2=0x7f2c98148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c97fff640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c980b5510 0x7f2c98148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c97fff640 1 -- 172.21.15.96:0/1141154968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c980b4fa0 msgr2=0x7f2c980c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c97fff640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c980b4fa0 0x7f2c980c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c97fff640 1 -- 172.21.15.96:0/1141154968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c980ccd60 con 0x7f2c98161900 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c97fff640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c98161900 0x7f2c981562b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c410 tx=0x7f2c9000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c8ffff640 1 -- 172.21.15.96:0/1141154968 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90011790 con 0x7f2c98161900 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c8ffff640 1 -- 172.21.15.96:0/1141154968 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c90017070 con 0x7f2c98161900 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1141154968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c980ccfd0 con 0x7f2c98161900 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c8ffff640 1 -- 172.21.15.96:0/1141154968 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90011b70 con 0x7f2c98161900 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.053+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1141154968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c980ca0a0 con 0x7f2c98161900 2024-06-02T23:59:06.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.054+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1141154968 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c980cd1a0 con 0x7f2c98161900 2024-06-02T23:59:06.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.055+0000 7f2c8ffff640 1 -- 172.21.15.96:0/1141154968 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f2c90011d10 con 0x7f2c98161900 2024-06-02T23:59:06.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.055+0000 7f2c8ffff640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2c7806be60 0x7f2c7806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.055+0000 7f2c8ffff640 1 -- 172.21.15.96:0/1141154968 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f2c9008ae60 con 0x7f2c98161900 2024-06-02T23:59:06.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.055+0000 7f2c977fe640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2c7806be60 0x7f2c7806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.057 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.055+0000 7f2c977fe640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2c7806be60 0x7f2c7806e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2c88008e00 tx=0x7f2c88008330 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.059+0000 7f2c8ffff640 1 -- 172.21.15.96:0/1141154968 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2c900595f0 con 0x7f2c98161900 2024-06-02T23:59:06.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.230+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1141154968 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c980683e0 con 0x7f2c7806be60 2024-06-02T23:59:06.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.236+0000 7f2c8ffff640 1 -- 172.21.15.96:0/1141154968 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240001 (secure 0 0 0) 0x7f2c980683e0 con 0x7f2c7806be60 2024-06-02T23:59:06.239 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:06.240 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:59:06.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1141154968 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2c7806be60 msgr2=0x7f2c7806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2c7806be60 0x7f2c7806e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2c88008e00 tx=0x7f2c88008330 comp rx=0 tx=0).stop 2024-06-02T23:59:06.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1141154968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c98161900 msgr2=0x7f2c981562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c98161900 0x7f2c981562b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c410 tx=0x7f2c9000c8d0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1141154968 shutdown_connections 2024-06-02T23:59:06.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2c7806be60 0x7f2c7806e320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c98161900 0x7f2c981562b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c980b5510 0x7f2c98148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 --2- 172.21.15.96:0/1141154968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c980b4fa0 0x7f2c980c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1141154968 >> 172.21.15.96:0/1141154968 conn(0x7f2c9809d3b0 msgr2=0x7f2c9806c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:06.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1141154968 shutdown_connections 2024-06-02T23:59:06.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.239+0000 7f2c9e1ee640 1 -- 172.21.15.96:0/1141154968 wait complete. 2024-06-02T23:59:06.250 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-06-02T23:59:04.496215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319332,"kb_used_data":7408,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655388,"statfs":{"total":773094113280,"available":772767117312,"internally_reserved":0,"allocated":7585792,"data_stored":4371107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.880032"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.624220+0000","last_change":"2024-06-02T23:58:59.624220+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.624220+0000","last_undegraded":"2024-06-02T23:58:59.624220+0000","last_fullsized":"2024-06-02T23:58:59.624220+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.621010+0000","last_change":"2024-06-02T23:58:59.621010+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.621010+0000","last_undegraded":"2024-06-02T23:58:59.621010+0000","last_fullsized":"2024-06-02T23:58:59.621010+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620945+0000","last_change":"2024-06-02T23:58:59.620945+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620945+0000","last_undegraded":"2024-06-02T23:58:59.620945+0000","last_fullsized":"2024-06-02T23:58:59.620945+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620817+0000","last_change":"2024-06-02T23:58:59.620817+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620817+0000","last_undegraded":"2024-06-02T23:58:59.620817+0000","last_fullsized":"2024-06-02T23:58:59.620817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623373+0000","last_change":"2024-06-02T23:58:59.623373+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623373+0000","last_undegraded":"2024-06-02T23:58:59.623373+0000","last_fullsized":"2024-06-02T23:58:59.623373+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620743+0000","last_change":"2024-06-02T23:58:59.620743+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620743+0000","last_undegraded":"2024-06-02T23:58:59.620743+0000","last_fullsized":"2024-06-02T23:58:59.620743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623251+0000","last_change":"2024-06-02T23:58:59.623251+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623251+0000","last_undegraded":"2024-06-02T23:58:59.623251+0000","last_fullsized":"2024-06-02T23:58:59.623251+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622738+0000","last_change":"2024-06-02T23:58:59.622738+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622738+0000","last_undegraded":"2024-06-02T23:58:59.622738+0000","last_fullsized":"2024-06-02T23:58:59.622738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623887+0000","last_change":"2024-06-02T23:58:59.623887+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623887+0000","last_undegraded":"2024-06-02T23:58:59.623887+0000","last_fullsized":"2024-06-02T23:58:59.623887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620781+0000","last_change":"2024-06-02T23:58:59.620781+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620781+0000","last_undegraded":"2024-06-02T23:58:59.620781+0000","last_fullsized":"2024-06-02T23:58:59.620781+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.624108+0000","last_change":"2024-06-02T23:58:59.624108+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.624108+0000","last_undegraded":"2024-06-02T23:58:59.624108+0000","last_fullsized":"2024-06-02T23:58:59.624108+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.619831+0000","last_change":"2024-06-02T23:58:59.619831+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.619831+0000","last_undegraded":"2024-06-02T23:58:59.619831+0000","last_fullsized":"2024-06-02T23:58:59.619831+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622654+0000","last_change":"2024-06-02T23:58:59.622654+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622654+0000","last_undegraded":"2024-06-02T23:58:59.622654+0000","last_fullsized":"2024-06-02T23:58:59.622654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623294+0000","last_change":"2024-06-02T23:58:59.623294+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623294+0000","last_undegraded":"2024-06-02T23:58:59.623294+0000","last_fullsized":"2024-06-02T23:58:59.623294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623283+0000","last_change":"2024-06-02T23:58:59.623283+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623283+0000","last_undegraded":"2024-06-02T23:58:59.623283+0000","last_fullsized":"2024-06-02T23:58:59.623283+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.619437+0000","last_change":"2024-06-02T23:58:59.619437+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.619437+0000","last_undegraded":"2024-06-02T23:58:59.619437+0000","last_fullsized":"2024-06-02T23:58:59.619437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622707+0000","last_change":"2024-06-02T23:58:59.622707+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622707+0000","last_undegraded":"2024-06-02T23:58:59.622707+0000","last_fullsized":"2024-06-02T23:58:59.622707+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620391+0000","last_change":"2024-06-02T23:58:59.620391+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620391+0000","last_undegraded":"2024-06-02T23:58:59.620391+0000","last_fullsized":"2024-06-02T23:58:59.620391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623495+0000","last_change":"2024-06-02T23:58:59.623495+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623495+0000","last_undegraded":"2024-06-02T23:58:59.623495+0000","last_fullsized":"2024-06-02T23:58:59.623495+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623867+0000","last_change":"2024-06-02T23:58:59.623867+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623867+0000","last_undegraded":"2024-06-02T23:58:59.623867+0000","last_fullsized":"2024-06-02T23:58:59.623867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620965+0000","last_change":"2024-06-02T23:58:59.620965+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620965+0000","last_undegraded":"2024-06-02T23:58:59.620965+0000","last_fullsized":"2024-06-02T23:58:59.620965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.619423+0000","last_change":"2024-06-02T23:58:59.619423+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.619423+0000","last_undegraded":"2024-06-02T23:58:59.619423+0000","last_fullsized":"2024-06-02T23:58:59.619423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622661+0000","last_change":"2024-06-02T23:58:59.622661+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622661+0000","last_undegraded":"2024-06-02T23:58:59.622661+0000","last_fullsized":"2024-06-02T23:58:59.622661+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620390+0000","last_change":"2024-06-02T23:58:59.620390+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620390+0000","last_undegraded":"2024-06-02T23:58:59.620390+0000","last_fullsized":"2024-06-02T23:58:59.620390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623366+0000","last_change":"2024-06-02T23:58:59.623366+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623366+0000","last_undegraded":"2024-06-02T23:58:59.623366+0000","last_fullsized":"2024-06-02T23:58:59.623366+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623585+0000","last_change":"2024-06-02T23:58:59.623585+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623585+0000","last_undegraded":"2024-06-02T23:58:59.623585+0000","last_fullsized":"2024-06-02T23:58:59.623585+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.623140+0000","last_change":"2024-06-02T23:58:59.623140+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.623140+0000","last_undegraded":"2024-06-02T23:58:59.623140+0000","last_fullsized":"2024-06-02T23:58:59.623140+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.618893+0000","last_change":"2024-06-02T23:58:59.618893+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.618893+0000","last_undegraded":"2024-06-02T23:58:59.618893+0000","last_fullsized":"2024-06-02T23:58:59.618893+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.618761+0000","last_change":"2024-06-02T23:58:59.618761+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.618761+0000","last_undegraded":"2024-06-02T23:58:59.618761+0000","last_fullsized":"2024-06-02T23:58:59.618761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.620810+0000","last_change":"2024-06-02T23:58:59.620810+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.620810+0000","last_undegraded":"2024-06-02T23:58:59.620810+0000","last_fullsized":"2024-06-02T23:58:59.620810+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.621630+0000","last_change":"2024-06-02T23:58:59.621630+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.621630+0000","last_undegraded":"2024-06-02T23:58:59.621630+0000","last_fullsized":"2024-06-02T23:58:59.621630+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-06-02T23:59:00.616029+0000","last_change":"2024-06-02T23:59:00.616029+0000","last_active":"2024-06-02T23:59:00.616029+0000","last_peered":"2024-06-02T23:59:00.616029+0000","last_clean":"2024-06-02T23:59:00.616029+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:59:00.616029+0000","last_undegraded":"2024-06-02T23:59:00.616029+0000","last_fullsized":"2024-06-02T23:59:00.616029+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-06-02T23:58:59.622877+0000","last_change":"2024-06-02T23:58:59.622877+0000","last_active":"2024-06-02T23:58:59.614390+0000","last_peered":"2024-06-02T23:58:59.614390+0000","last_clean":"2024-06-02T23:58:59.614390+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-06-02T23:58:59.622877+0000","last_undegraded":"2024-06-02T23:58:59.622877+0000","last_fullsized":"2024-06-02T23:58:59.622877+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":343,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-06-02T23:58:59.624672+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:58:59.624672+0000","last_peered":"2024-06-02T23:58:59.624672+0000","last_clean":"2024-06-02T23:58:59.624672+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:58:59.624672+0000","last_undegraded":"2024-06-02T23:58:59.624672+0000","last_fullsized":"2024-06-02T23:58:59.624672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54752,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317088,"statfs":{"total":96636764160,"available":96580698112,"internally_reserved":0,"allocated":1396736,"data_stored":990696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50016,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321824,"statfs":{"total":96636764160,"available":96585547776,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54180,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317660,"statfs":{"total":96636764160,"available":96581283840,"internally_reserved":0,"allocated":802816,"data_stored":400328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":778240,"data_stored":388075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1396736,"data_stored":990696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:59:06.254 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3f is not active+clean 2024-06-02T23:59:06.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.254 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-06-02T23:59:06.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.254 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3d is not active+clean 2024-06-02T23:59:06.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.254 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-06-02T23:59:06.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.254 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-06-02T23:59:06.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.255 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3a is not active+clean 2024-06-02T23:59:06.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.255 INFO:tasks.ceph.ceph_manager.ceph:PG 8.39 is not active+clean 2024-06-02T23:59:06.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.255 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-06-02T23:59:06.255 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.255 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-06-02T23:59:06.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.256 INFO:tasks.ceph.ceph_manager.ceph:PG 8.36 is not active+clean 2024-06-02T23:59:06.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.256 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-06-02T23:59:06.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.256 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-06-02T23:59:06.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.256 INFO:tasks.ceph.ceph_manager.ceph:PG 8.33 is not active+clean 2024-06-02T23:59:06.256 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.257 INFO:tasks.ceph.ceph_manager.ceph:PG 8.32 is not active+clean 2024-06-02T23:59:06.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.257 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-06-02T23:59:06.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.257 INFO:tasks.ceph.ceph_manager.ceph:PG 8.30 is not active+clean 2024-06-02T23:59:06.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.257 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2f is not active+clean 2024-06-02T23:59:06.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.257 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-06-02T23:59:06.257 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.258 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-06-02T23:59:06.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.258 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-06-02T23:59:06.258 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.258 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-06-02T23:59:06.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.259 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-06-02T23:59:06.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.259 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-06-02T23:59:06.259 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.260 INFO:tasks.ceph.ceph_manager.ceph:PG 8.28 is not active+clean 2024-06-02T23:59:06.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.260 INFO:tasks.ceph.ceph_manager.ceph:PG 8.27 is not active+clean 2024-06-02T23:59:06.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.260 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-06-02T23:59:06.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.260 INFO:tasks.ceph.ceph_manager.ceph:PG 8.25 is not active+clean 2024-06-02T23:59:06.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.260 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-06-02T23:59:06.260 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.261 INFO:tasks.ceph.ceph_manager.ceph:PG 8.23 is not active+clean 2024-06-02T23:59:06.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.261 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-06-02T23:59:06.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.261 INFO:tasks.ceph.ceph_manager.ceph:PG 8.21 is not active+clean 2024-06-02T23:59:06.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.261 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-06-02T23:59:06.261 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.262 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-06-02T23:59:06.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.262 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-06-02T23:59:06.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.624220+0000', 'last_change': '2024-06-02T23:58:59.624220+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.624220+0000', 'last_undegraded': '2024-06-02T23:58:59.624220+0000', 'last_fullsized': '2024-06-02T23:58:59.624220+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-02T23:59:06.262 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-06-02T23:59:06.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.262 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-06-02T23:59:06.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.621010+0000', 'last_change': '2024-06-02T23:58:59.621010+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.621010+0000', 'last_undegraded': '2024-06-02T23:58:59.621010+0000', 'last_fullsized': '2024-06-02T23:58:59.621010+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T23:59:06.262 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-06-02T23:59:06.262 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.620945+0000', 'last_change': '2024-06-02T23:58:59.620945+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.620945+0000', 'last_undegraded': '2024-06-02T23:58:59.620945+0000', 'last_fullsized': '2024-06-02T23:58:59.620945+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.620817+0000', 'last_change': '2024-06-02T23:58:59.620817+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.620817+0000', 'last_undegraded': '2024-06-02T23:58:59.620817+0000', 'last_fullsized': '2024-06-02T23:58:59.620817+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.623373+0000', 'last_change': '2024-06-02T23:58:59.623373+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.623373+0000', 'last_undegraded': '2024-06-02T23:58:59.623373+0000', 'last_fullsized': '2024-06-02T23:58:59.623373+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-06-02T23:59:06.263 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.620743+0000', 'last_change': '2024-06-02T23:58:59.620743+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.620743+0000', 'last_undegraded': '2024-06-02T23:58:59.620743+0000', 'last_fullsized': '2024-06-02T23:58:59.620743+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.623251+0000', 'last_change': '2024-06-02T23:58:59.623251+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.623251+0000', 'last_undegraded': '2024-06-02T23:58:59.623251+0000', 'last_fullsized': '2024-06-02T23:58:59.623251+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.622738+0000', 'last_change': '2024-06-02T23:58:59.622738+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.622738+0000', 'last_undegraded': '2024-06-02T23:58:59.622738+0000', 'last_fullsized': '2024-06-02T23:58:59.622738+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-06-02T23:59:06.264 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.623887+0000', 'last_change': '2024-06-02T23:58:59.623887+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.623887+0000', 'last_undegraded': '2024-06-02T23:58:59.623887+0000', 'last_fullsized': '2024-06-02T23:58:59.623887+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.620781+0000', 'last_change': '2024-06-02T23:58:59.620781+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.620781+0000', 'last_undegraded': '2024-06-02T23:58:59.620781+0000', 'last_fullsized': '2024-06-02T23:58:59.620781+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.624108+0000', 'last_change': '2024-06-02T23:58:59.624108+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.624108+0000', 'last_undegraded': '2024-06-02T23:58:59.624108+0000', 'last_fullsized': '2024-06-02T23:58:59.624108+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-06-02T23:59:06.265 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.266 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-06-02T23:59:06.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.619831+0000', 'last_change': '2024-06-02T23:58:59.619831+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.619831+0000', 'last_undegraded': '2024-06-02T23:58:59.619831+0000', 'last_fullsized': '2024-06-02T23:58:59.619831+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-02T23:59:06.266 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-06-02T23:59:06.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.266 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-06-02T23:59:06.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.622654+0000', 'last_change': '2024-06-02T23:58:59.622654+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.622654+0000', 'last_undegraded': '2024-06-02T23:58:59.622654+0000', 'last_fullsized': '2024-06-02T23:58:59.622654+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-02T23:59:06.266 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-06-02T23:59:06.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.266 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-06-02T23:59:06.266 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.623294+0000', 'last_change': '2024-06-02T23:58:59.623294+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.623294+0000', 'last_undegraded': '2024-06-02T23:58:59.623294+0000', 'last_fullsized': '2024-06-02T23:58:59.623294+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.623283+0000', 'last_change': '2024-06-02T23:58:59.623283+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.623283+0000', 'last_undegraded': '2024-06-02T23:58:59.623283+0000', 'last_fullsized': '2024-06-02T23:58:59.623283+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.619437+0000', 'last_change': '2024-06-02T23:58:59.619437+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.619437+0000', 'last_undegraded': '2024-06-02T23:58:59.619437+0000', 'last_fullsized': '2024-06-02T23:58:59.619437+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.267 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.622707+0000', 'last_change': '2024-06-02T23:58:59.622707+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.622707+0000', 'last_undegraded': '2024-06-02T23:58:59.622707+0000', 'last_fullsized': '2024-06-02T23:58:59.622707+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.620391+0000', 'last_change': '2024-06-02T23:58:59.620391+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.620391+0000', 'last_undegraded': '2024-06-02T23:58:59.620391+0000', 'last_fullsized': '2024-06-02T23:58:59.620391+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.623495+0000', 'last_change': '2024-06-02T23:58:59.623495+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.623495+0000', 'last_undegraded': '2024-06-02T23:58:59.623495+0000', 'last_fullsized': '2024-06-02T23:58:59.623495+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-06-02T23:59:06.268 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.623867+0000', 'last_change': '2024-06-02T23:58:59.623867+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.623867+0000', 'last_undegraded': '2024-06-02T23:58:59.623867+0000', 'last_fullsized': '2024-06-02T23:58:59.623867+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.620965+0000', 'last_change': '2024-06-02T23:58:59.620965+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.620965+0000', 'last_undegraded': '2024-06-02T23:58:59.620965+0000', 'last_fullsized': '2024-06-02T23:58:59.620965+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.619423+0000', 'last_change': '2024-06-02T23:58:59.619423+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.619423+0000', 'last_undegraded': '2024-06-02T23:58:59.619423+0000', 'last_fullsized': '2024-06-02T23:58:59.619423+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-02T23:59:06.269 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.622661+0000', 'last_change': '2024-06-02T23:58:59.622661+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.622661+0000', 'last_undegraded': '2024-06-02T23:58:59.622661+0000', 'last_fullsized': '2024-06-02T23:58:59.622661+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.620390+0000', 'last_change': '2024-06-02T23:58:59.620390+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.620390+0000', 'last_undegraded': '2024-06-02T23:58:59.620390+0000', 'last_fullsized': '2024-06-02T23:58:59.620390+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-06-02T23:59:06.270 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.623366+0000', 'last_change': '2024-06-02T23:58:59.623366+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.623366+0000', 'last_undegraded': '2024-06-02T23:58:59.623366+0000', 'last_fullsized': '2024-06-02T23:58:59.623366+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.623585+0000', 'last_change': '2024-06-02T23:58:59.623585+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.623585+0000', 'last_undegraded': '2024-06-02T23:58:59.623585+0000', 'last_fullsized': '2024-06-02T23:58:59.623585+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.623140+0000', 'last_change': '2024-06-02T23:58:59.623140+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.623140+0000', 'last_undegraded': '2024-06-02T23:58:59.623140+0000', 'last_fullsized': '2024-06-02T23:58:59.623140+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:PG 8.c is not active+clean 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.271 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-06-02T23:59:06.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.618893+0000', 'last_change': '2024-06-02T23:58:59.618893+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.618893+0000', 'last_undegraded': '2024-06-02T23:58:59.618893+0000', 'last_fullsized': '2024-06-02T23:58:59.618893+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-02T23:59:06.272 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-06-02T23:59:06.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.272 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-06-02T23:59:06.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.618761+0000', 'last_change': '2024-06-02T23:58:59.618761+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.618761+0000', 'last_undegraded': '2024-06-02T23:58:59.618761+0000', 'last_fullsized': '2024-06-02T23:58:59.618761+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-06-02T23:59:06.272 INFO:tasks.ceph.ceph_manager.ceph:PG 8.e is not active+clean 2024-06-02T23:59:06.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.272 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-06-02T23:59:06.272 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.620810+0000', 'last_change': '2024-06-02T23:58:59.620810+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.620810+0000', 'last_undegraded': '2024-06-02T23:58:59.620810+0000', 'last_fullsized': '2024-06-02T23:58:59.620810+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-06-02T23:59:06.272 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-06-02T23:59:06.273 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.273 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-06-02T23:59:06.273 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.621630+0000', 'last_change': '2024-06-02T23:58:59.621630+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.621630+0000', 'last_undegraded': '2024-06-02T23:58:59.621630+0000', 'last_fullsized': '2024-06-02T23:58:59.621630+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-06-02T23:59:06.273 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-06-02T23:59:06.273 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-06-02T23:59:00.616029+0000', 'last_change': '2024-06-02T23:59:00.616029+0000', 'last_active': '2024-06-02T23:59:00.616029+0000', 'last_peered': '2024-06-02T23:59:00.616029+0000', 'last_clean': '2024-06-02T23:59:00.616029+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:59:00.616029+0000', 'last_undegraded': '2024-06-02T23:59:00.616029+0000', 'last_fullsized': '2024-06-02T23:59:00.616029+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'last_clean_scrub_stamp': '2024-06-02T23:59:00.616029+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-06-02T23:59:06.273 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-06-02T23:59:06.273 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-06-02T23:58:59.622877+0000', 'last_change': '2024-06-02T23:58:59.622877+0000', 'last_active': '2024-06-02T23:58:59.614390+0000', 'last_peered': '2024-06-02T23:58:59.614390+0000', 'last_clean': '2024-06-02T23:58:59.614390+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-06-02T23:58:59.622877+0000', 'last_undegraded': '2024-06-02T23:58:59.622877+0000', 'last_fullsized': '2024-06-02T23:58:59.622877+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'last_clean_scrub_stamp': '2024-06-02T23:58:59.614390+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-06-02T23:59:06.274 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-06-02T23:59:06.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.388+0000 7f581377e640 1 Processor -- start 2024-06-02T23:59:06.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.388+0000 7f581377e640 1 -- start start 2024-06-02T23:59:06.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581377e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f580c144130 0x7f580c072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581377e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f580c0cffb0 0x7f580c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581377e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f580c0d0900 con 0x7f580c0cd150 2024-06-02T23:59:06.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581377e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f580c144510 con 0x7f580c144130 2024-06-02T23:59:06.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581377e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f580c15f240 con 0x7f580c0cffb0 2024-06-02T23:59:06.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581151a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f580c144130 0x7f580c072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581151a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f580c144130 0x7f580c072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44220/0 (socket says 172.21.15.96:44220) 2024-06-02T23:59:06.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581151a640 1 -- 172.21.15.96:0/3272136596 learned_addr learned my addr 172.21.15.96:0/3272136596 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:06.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f5811d1b640 1 --2- 172.21.15.96:0/3272136596 >> v2:172.21.15.162:3300/0 conn(0x7f580c0cffb0 0x7f580c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581151a640 1 -- 172.21.15.96:0/3272136596 >> v2:172.21.15.162:3300/0 conn(0x7f580c0cffb0 msgr2=0x7f580c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:06.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581151a640 1 --2- 172.21.15.96:0/3272136596 >> v2:172.21.15.162:3300/0 conn(0x7f580c0cffb0 0x7f580c0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581151a640 1 -- 172.21.15.96:0/3272136596 >> v1:172.21.15.162:6789/0 conn(0x7f580c0cd150 legacy=0x7f580c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f581151a640 1 -- 172.21.15.96:0/3272136596 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c15f520 con 0x7f580c144130 2024-06-02T23:59:06.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.389+0000 7f5811d1b640 1 --2- 172.21.15.96:0/3272136596 >> v2:172.21.15.162:3300/0 conn(0x7f580c0cffb0 0x7f580c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:06.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.390+0000 7f581151a640 1 --2- 172.21.15.96:0/3272136596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 0x7f580c072750 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f580c15e880 tx=0x7f580802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8eca2770b8ca646 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.390+0000 7f5803fff640 1 -- 172.21.15.96:0/3272136596 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808037070 con 0x7f580c144130 2024-06-02T23:59:06.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.390+0000 7f5803fff640 1 -- 172.21.15.96:0/3272136596 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5808032440 con 0x7f580c144130 2024-06-02T23:59:06.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.390+0000 7f5803fff640 1 -- 172.21.15.96:0/3272136596 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808032810 con 0x7f580c144130 2024-06-02T23:59:06.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.391+0000 7f581377e640 1 -- 172.21.15.96:0/3272136596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 msgr2=0x7f580c072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.391+0000 7f581377e640 1 --2- 172.21.15.96:0/3272136596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 0x7f580c072750 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f580c15e880 tx=0x7f580802a1e0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.391+0000 7f581377e640 1 -- 172.21.15.96:0/3272136596 shutdown_connections 2024-06-02T23:59:06.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.391+0000 7f581377e640 1 --2- 172.21.15.96:0/3272136596 >> v2:172.21.15.162:3300/0 conn(0x7f580c0cffb0 0x7f580c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.391+0000 7f581377e640 1 --2- 172.21.15.96:0/3272136596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 0x7f580c072750 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.391+0000 7f581377e640 1 -- 172.21.15.96:0/3272136596 >> 172.21.15.96:0/3272136596 conn(0x7f580c06b7b0 msgr2=0x7f580c06bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:06.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.391+0000 7f581377e640 1 -- 172.21.15.96:0/3272136596 shutdown_connections 2024-06-02T23:59:06.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.391+0000 7f581377e640 1 -- 172.21.15.96:0/3272136596 wait complete. 2024-06-02T23:59:06.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.392+0000 7f581377e640 1 Processor -- start 2024-06-02T23:59:06.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.392+0000 7f581377e640 1 -- start start 2024-06-02T23:59:06.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f581377e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f580c0cd150 0x7f580c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f581377e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f580c0cffb0 0x7f580c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f581377e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 0x7f580c1433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f581377e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f580c0b3c70 con 0x7f580c144130 2024-06-02T23:59:06.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f581377e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f580c0b3990 con 0x7f580c0cffb0 2024-06-02T23:59:06.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f581377e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f580c0cd530 con 0x7f580c0cd150 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5811d1b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 0x7f580c1433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5811d1b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 0x7f580c1433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44222/0 (socket says 172.21.15.96:44222) 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5811d1b640 1 -- 172.21.15.96:0/3430609468 learned_addr learned my addr 172.21.15.96:0/3430609468 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f581151a640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f580c0cd150 0x7f580c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5810d19640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f580c0cffb0 0x7f580c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5811d1b640 1 -- 172.21.15.96:0/3430609468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f580c0cd150 msgr2=0x7f580c15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5811d1b640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f580c0cd150 0x7f580c15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5811d1b640 1 -- 172.21.15.96:0/3430609468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f580c0cffb0 msgr2=0x7f580c15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5811d1b640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f580c0cffb0 0x7f580c15c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5811d1b640 1 -- 172.21.15.96:0/3430609468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c15cdf0 con 0x7f580c144130 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f581151a640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f580c0cd150 0x7f580c15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:06.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5811d1b640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 0x7f580c1433e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5804007ef0 tx=0x7f580400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5801ffb640 1 -- 172.21.15.96:0/3430609468 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580401a070 con 0x7f580c144130 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5801ffb640 1 -- 172.21.15.96:0/3430609468 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5804003b90 con 0x7f580c144130 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f581377e640 1 -- 172.21.15.96:0/3430609468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580c15d0d0 con 0x7f580c144130 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.393+0000 7f5801ffb640 1 -- 172.21.15.96:0/3430609468 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804004030 con 0x7f580c144130 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.394+0000 7f581377e640 1 -- 172.21.15.96:0/3430609468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f580c15d690 con 0x7f580c144130 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.395+0000 7f581377e640 1 -- 172.21.15.96:0/3430609468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580c15af50 con 0x7f580c144130 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.395+0000 7f5801ffb640 1 -- 172.21.15.96:0/3430609468 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f580401d070 con 0x7f580c144130 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.396+0000 7f5801ffb640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f57f006be30 0x7f57f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.396+0000 7f581151a640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f57f006be30 0x7f57f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.396+0000 7f5801ffb640 1 -- 172.21.15.96:0/3430609468 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f580408b210 con 0x7f580c144130 2024-06-02T23:59:06.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.396+0000 7f581151a640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f57f006be30 0x7f57f006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5808034000 tx=0x7f580802e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.400+0000 7f5801ffb640 1 -- 172.21.15.96:0/3430609468 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5804010070 con 0x7f580c144130 2024-06-02T23:59:06.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.644+0000 7f581377e640 1 -- 172.21.15.96:0/3430609468 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f580c0683e0 con 0x7f580c144130 2024-06-02T23:59:06.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.645+0000 7f5801ffb640 1 -- 172.21.15.96:0/3430609468 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7f58040593e0 con 0x7f580c144130 2024-06-02T23:59:06.645 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:06.645 INFO:teuthology.orchestra.run.smithi096.stdout:{"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":784,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":70,"num_osds":8,"num_up_osds":8,"osd_up_since":1717371973,"num_in_osds":8,"osd_in_since":1717371964,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":327389184,"bytes_avail":772766724096,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5739}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-06-02T23:48:39.611026+0000","services":{}},"progress_events":{}} 2024-06-02T23:59:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 -- 172.21.15.96:0/3430609468 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f57f006be30 msgr2=0x7f57f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f57f006be30 0x7f57f006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5808034000 tx=0x7f580802e000 comp rx=0 tx=0).stop 2024-06-02T23:59:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 -- 172.21.15.96:0/3430609468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 msgr2=0x7f580c1433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 0x7f580c1433e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5804007ef0 tx=0x7f580400d4a0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 -- 172.21.15.96:0/3430609468 shutdown_connections 2024-06-02T23:59:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f57f006be30 0x7f57f006e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f580c144130 0x7f580c1433e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f580c0cffb0 0x7f580c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 --2- 172.21.15.96:0/3430609468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f580c0cd150 0x7f580c15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 -- 172.21.15.96:0/3430609468 >> 172.21.15.96:0/3430609468 conn(0x7f580c06b7b0 msgr2=0x7f580c0b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:06.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 -- 172.21.15.96:0/3430609468 shutdown_connections 2024-06-02T23:59:06.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.647+0000 7f581377e640 1 -- 172.21.15.96:0/3430609468 wait complete. 2024-06-02T23:59:06.658 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-06-02T23:59:06.658 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:59:06.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.757+0000 7fd4fca38640 1 Processor -- start 2024-06-02T23:59:06.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.757+0000 7fd4fca38640 1 -- start start 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.758+0000 7fd4fca38640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f806ea70 0x7fd4f8071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.758+0000 7fd4fca38640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd4f80cae00 0x7fd4f80cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.758+0000 7fd4fca38640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f806f210 con 0x7fd4f815f5e0 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.758+0000 7fd4fca38640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f806ef30 con 0x7fd4f80cae00 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.758+0000 7fd4fca38640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f80ca320 con 0x7fd4f806ea70 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.758+0000 7fd4f6d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd4f80cae00 0x7fd4f80cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.758+0000 7fd4f6d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd4f80cae00 0x7fd4f80cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44238/0 (socket says 172.21.15.96:44238) 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.758+0000 7fd4f6d9d640 1 -- 172.21.15.96:0/1828421222 learned_addr learned my addr 172.21.15.96:0/1828421222 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.758+0000 7fd4f5d9b640 1 --2- 172.21.15.96:0/1828421222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f806ea70 0x7fd4f8071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.758+0000 7fd4f6d9d640 1 -- 172.21.15.96:0/1828421222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f806ea70 msgr2=0x7fd4f8071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.759+0000 7fd4f6d9d640 1 --2- 172.21.15.96:0/1828421222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f806ea70 0x7fd4f8071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.759+0000 7fd4f6d9d640 1 -- 172.21.15.96:0/1828421222 >> v1:172.21.15.162:6789/0 conn(0x7fd4f815f5e0 legacy=0x7fd4f8071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:06.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.759+0000 7fd4f6d9d640 1 -- 172.21.15.96:0/1828421222 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f80ca600 con 0x7fd4f80cae00 2024-06-02T23:59:06.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.759+0000 7fd4f5d9b640 1 --2- 172.21.15.96:0/1828421222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f806ea70 0x7fd4f8071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.759+0000 7fd4f6d9d640 1 --2- 172.21.15.96:0/1828421222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f80cae00 0x7fd4f80cb270 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0009e50 tx=0x7fd4f002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73947e1965753eac server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.759+0000 7fd4f559a640 1 -- 172.21.15.96:0/1828421222 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0036070 con 0x7fd4f80cae00 2024-06-02T23:59:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.759+0000 7fd4f559a640 1 -- 172.21.15.96:0/1828421222 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f0031600 con 0x7fd4f80cae00 2024-06-02T23:59:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.759+0000 7fd4f559a640 1 -- 172.21.15.96:0/1828421222 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00319d0 con 0x7fd4f80cae00 2024-06-02T23:59:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.760+0000 7fd4fca38640 1 -- 172.21.15.96:0/1828421222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f80cae00 msgr2=0x7fd4f80cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.760+0000 7fd4fca38640 1 --2- 172.21.15.96:0/1828421222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f80cae00 0x7fd4f80cb270 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0009e50 tx=0x7fd4f002a6c0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.760+0000 7fd4fca38640 1 -- 172.21.15.96:0/1828421222 shutdown_connections 2024-06-02T23:59:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.760+0000 7fd4fca38640 1 --2- 172.21.15.96:0/1828421222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f80cae00 0x7fd4f80cb270 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.760+0000 7fd4fca38640 1 --2- 172.21.15.96:0/1828421222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f806ea70 0x7fd4f8071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.761 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.760+0000 7fd4fca38640 1 -- 172.21.15.96:0/1828421222 >> 172.21.15.96:0/1828421222 conn(0x7fd4f80cfc30 msgr2=0x7fd4f80d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:06.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.760+0000 7fd4fca38640 1 -- 172.21.15.96:0/1828421222 shutdown_connections 2024-06-02T23:59:06.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.760+0000 7fd4fca38640 1 -- 172.21.15.96:0/1828421222 wait complete. 2024-06-02T23:59:06.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.761+0000 7fd4fca38640 1 Processor -- start 2024-06-02T23:59:06.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.761+0000 7fd4fca38640 1 -- start start 2024-06-02T23:59:06.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4fca38640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f806ea70 0x7fd4f8159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4fca38640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f80cae00 0x7fd4f80c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4fca38640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f815f5e0 0x7fd4f80c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4fca38640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f80731b0 con 0x7fd4f815f5e0 2024-06-02T23:59:06.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4fca38640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f8073030 con 0x7fd4f806ea70 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4fca38640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f80b2ac0 con 0x7fd4f80cae00 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4f6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f815f5e0 0x7fd4f80c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4f6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f815f5e0 0x7fd4f80c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44248/0 (socket says 172.21.15.96:44248) 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4f6d9d640 1 -- 172.21.15.96:0/2166353823 learned_addr learned my addr 172.21.15.96:0/2166353823 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4f5d9b640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f80cae00 0x7fd4f80c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4f659c640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f806ea70 0x7fd4f8159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4f6d9d640 1 -- 172.21.15.96:0/2166353823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f80cae00 msgr2=0x7fd4f80c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4f6d9d640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f80cae00 0x7fd4f80c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4f6d9d640 1 -- 172.21.15.96:0/2166353823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f806ea70 msgr2=0x7fd4f8159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.762+0000 7fd4f6d9d640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f806ea70 0x7fd4f8159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.763+0000 7fd4f6d9d640 1 -- 172.21.15.96:0/2166353823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f80c3570 con 0x7fd4f815f5e0 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.763+0000 7fd4f5d9b640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f80cae00 0x7fd4f80c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:06.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.763+0000 7fd4f659c640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f806ea70 0x7fd4f8159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:06.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.763+0000 7fd4f6d9d640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f815f5e0 0x7fd4f80c48f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0034040 tx=0x7fd4f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.763+0000 7fd4e6ffd640 1 -- 172.21.15.96:0/2166353823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0036050 con 0x7fd4f815f5e0 2024-06-02T23:59:06.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.763+0000 7fd4e6ffd640 1 -- 172.21.15.96:0/2166353823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f0042070 con 0x7fd4f815f5e0 2024-06-02T23:59:06.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.763+0000 7fd4fca38640 1 -- 172.21.15.96:0/2166353823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f80c3850 con 0x7fd4f815f5e0 2024-06-02T23:59:06.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.763+0000 7fd4e6ffd640 1 -- 172.21.15.96:0/2166353823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0009510 con 0x7fd4f815f5e0 2024-06-02T23:59:06.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.763+0000 7fd4fca38640 1 -- 172.21.15.96:0/2166353823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f80c3e10 con 0x7fd4f815f5e0 2024-06-02T23:59:06.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.764+0000 7fd4fca38640 1 -- 172.21.15.96:0/2166353823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f806da60 con 0x7fd4f815f5e0 2024-06-02T23:59:06.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.764+0000 7fd4e6ffd640 1 -- 172.21.15.96:0/2166353823 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fd4f0007bd0 con 0x7fd4f815f5e0 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.765+0000 7fd4e6ffd640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd4d806be30 0x7fd4d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.765+0000 7fd4e6ffd640 1 -- 172.21.15.96:0/2166353823 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fd4f00abf60 con 0x7fd4f815f5e0 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.765+0000 7fd4f659c640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd4d806be30 0x7fd4d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:06.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.765+0000 7fd4f659c640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd4d806be30 0x7fd4d806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800a830 tx=0x7fd4e8008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.769+0000 7fd4e6ffd640 1 -- 172.21.15.96:0/2166353823 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fd4f806da60 con 0x7fd4f815f5e0 2024-06-02T23:59:06.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.940+0000 7fd4fca38640 1 -- 172.21.15.96:0/2166353823 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4f80683e0 con 0x7fd4d806be30 2024-06-02T23:59:06.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.946+0000 7fd4e6ffd640 1 -- 172.21.15.96:0/2166353823 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251958 (secure 0 0 0) 0x7fd4f80683e0 con 0x7fd4d806be30 2024-06-02T23:59:06.948 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:06.949 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:59:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 -- 172.21.15.96:0/2166353823 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd4d806be30 msgr2=0x7fd4d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd4d806be30 0x7fd4d806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800a830 tx=0x7fd4e8008040 comp rx=0 tx=0).stop 2024-06-02T23:59:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 -- 172.21.15.96:0/2166353823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f815f5e0 msgr2=0x7fd4f80c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f815f5e0 0x7fd4f80c48f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0034040 tx=0x7fd4f0004a40 comp rx=0 tx=0).stop 2024-06-02T23:59:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 -- 172.21.15.96:0/2166353823 shutdown_connections 2024-06-02T23:59:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fd4d806be30 0x7fd4d806e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4f815f5e0 0x7fd4f80c48f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4f80cae00 0x7fd4f80c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 --2- 172.21.15.96:0/2166353823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4f806ea70 0x7fd4f8159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:06.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 -- 172.21.15.96:0/2166353823 >> 172.21.15.96:0/2166353823 conn(0x7fd4f80cfc30 msgr2=0x7fd4f80ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:06.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 -- 172.21.15.96:0/2166353823 shutdown_connections 2024-06-02T23:59:06.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:06.949+0000 7fd4fca38640 1 -- 172.21.15.96:0/2166353823 wait complete. 2024-06-02T23:59:06.960 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-06-02T23:59:06.496577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319716,"kb_used_data":7784,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655004,"statfs":{"total":773094113280,"available":772766724096,"internally_reserved":0,"allocated":7970816,"data_stored":4552388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001023"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059653+0000","last_change":"2024-06-02T23:59:01.586938+0000","last_active":"2024-06-02T23:59:03.059653+0000","last_peered":"2024-06-02T23:59:03.059653+0000","last_clean":"2024-06-02T23:59:03.059653+0000","last_became_active":"2024-06-02T23:59:01.586669+0000","last_became_peered":"2024-06-02T23:59:01.586669+0000","last_unstale":"2024-06-02T23:59:03.059653+0000","last_undegraded":"2024-06-02T23:59:03.059653+0000","last_fullsized":"2024-06-02T23:59:03.059653+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:32:12.883830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633382+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-02T23:59:02.633382+0000","last_peered":"2024-06-02T23:59:02.633382+0000","last_clean":"2024-06-02T23:59:02.633382+0000","last_became_active":"2024-06-02T23:59:01.582687+0000","last_became_peered":"2024-06-02T23:59:01.582687+0000","last_unstale":"2024-06-02T23:59:02.633382+0000","last_undegraded":"2024-06-02T23:59:02.633382+0000","last_fullsized":"2024-06-02T23:59:02.633382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630645+0000","last_change":"2024-06-02T23:59:01.586233+0000","last_active":"2024-06-02T23:59:02.630645+0000","last_peered":"2024-06-02T23:59:02.630645+0000","last_clean":"2024-06-02T23:59:02.630645+0000","last_became_active":"2024-06-02T23:59:01.586006+0000","last_became_peered":"2024-06-02T23:59:01.586006+0000","last_unstale":"2024-06-02T23:59:02.630645+0000","last_undegraded":"2024-06-02T23:59:02.630645+0000","last_fullsized":"2024-06-02T23:59:02.630645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633356+0000","last_change":"2024-06-02T23:59:01.587310+0000","last_active":"2024-06-02T23:59:02.633356+0000","last_peered":"2024-06-02T23:59:02.633356+0000","last_clean":"2024-06-02T23:59:02.633356+0000","last_became_active":"2024-06-02T23:59:01.586761+0000","last_became_peered":"2024-06-02T23:59:01.586761+0000","last_unstale":"2024-06-02T23:59:02.633356+0000","last_undegraded":"2024-06-02T23:59:02.633356+0000","last_fullsized":"2024-06-02T23:59:02.633356+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575897+0000","last_change":"2024-06-02T23:59:01.583800+0000","last_active":"2024-06-02T23:59:02.575897+0000","last_peered":"2024-06-02T23:59:02.575897+0000","last_clean":"2024-06-02T23:59:02.575897+0000","last_became_active":"2024-06-02T23:59:01.581028+0000","last_became_peered":"2024-06-02T23:59:01.581028+0000","last_unstale":"2024-06-02T23:59:02.575897+0000","last_undegraded":"2024-06-02T23:59:02.575897+0000","last_fullsized":"2024-06-02T23:59:02.575897+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:25:47.061955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060103+0000","last_change":"2024-06-02T23:59:01.587296+0000","last_active":"2024-06-02T23:59:03.060103+0000","last_peered":"2024-06-02T23:59:03.060103+0000","last_clean":"2024-06-02T23:59:03.060103+0000","last_became_active":"2024-06-02T23:59:01.586996+0000","last_became_peered":"2024-06-02T23:59:01.586996+0000","last_unstale":"2024-06-02T23:59:03.060103+0000","last_undegraded":"2024-06-02T23:59:03.060103+0000","last_fullsized":"2024-06-02T23:59:03.060103+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:56:54.953142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630308+0000","last_change":"2024-06-02T23:59:01.586195+0000","last_active":"2024-06-02T23:59:02.630308+0000","last_peered":"2024-06-02T23:59:02.630308+0000","last_clean":"2024-06-02T23:59:02.630308+0000","last_became_active":"2024-06-02T23:59:01.583488+0000","last_became_peered":"2024-06-02T23:59:01.583488+0000","last_unstale":"2024-06-02T23:59:02.630308+0000","last_undegraded":"2024-06-02T23:59:02.630308+0000","last_fullsized":"2024-06-02T23:59:02.630308+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:42:09.116457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060230+0000","last_change":"2024-06-02T23:59:01.588746+0000","last_active":"2024-06-02T23:59:03.060230+0000","last_peered":"2024-06-02T23:59:03.060230+0000","last_clean":"2024-06-02T23:59:03.060230+0000","last_became_active":"2024-06-02T23:59:01.588310+0000","last_became_peered":"2024-06-02T23:59:01.588310+0000","last_unstale":"2024-06-02T23:59:03.060230+0000","last_undegraded":"2024-06-02T23:59:03.060230+0000","last_fullsized":"2024-06-02T23:59:03.060230+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:56:25.974137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060308+0000","last_change":"2024-06-02T23:59:01.592959+0000","last_active":"2024-06-02T23:59:03.060308+0000","last_peered":"2024-06-02T23:59:03.060308+0000","last_clean":"2024-06-02T23:59:03.060308+0000","last_became_active":"2024-06-02T23:59:01.592704+0000","last_became_peered":"2024-06-02T23:59:01.592704+0000","last_unstale":"2024-06-02T23:59:03.060308+0000","last_undegraded":"2024-06-02T23:59:03.060308+0000","last_fullsized":"2024-06-02T23:59:03.060308+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:57:55.310878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059569+0000","last_change":"2024-06-02T23:59:01.589283+0000","last_active":"2024-06-02T23:59:03.059569+0000","last_peered":"2024-06-02T23:59:03.059569+0000","last_clean":"2024-06-02T23:59:03.059569+0000","last_became_active":"2024-06-02T23:59:01.588961+0000","last_became_peered":"2024-06-02T23:59:01.588961+0000","last_unstale":"2024-06-02T23:59:03.059569+0000","last_undegraded":"2024-06-02T23:59:03.059569+0000","last_fullsized":"2024-06-02T23:59:03.059569+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:09:42.099307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060255+0000","last_change":"2024-06-02T23:59:01.583139+0000","last_active":"2024-06-02T23:59:03.060255+0000","last_peered":"2024-06-02T23:59:03.060255+0000","last_clean":"2024-06-02T23:59:03.060255+0000","last_became_active":"2024-06-02T23:59:01.582876+0000","last_became_peered":"2024-06-02T23:59:01.582876+0000","last_unstale":"2024-06-02T23:59:03.060255+0000","last_undegraded":"2024-06-02T23:59:03.060255+0000","last_fullsized":"2024-06-02T23:59:03.060255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.666135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060765+0000","last_change":"2024-06-02T23:59:01.589336+0000","last_active":"2024-06-02T23:59:03.060765+0000","last_peered":"2024-06-02T23:59:03.060765+0000","last_clean":"2024-06-02T23:59:03.060765+0000","last_became_active":"2024-06-02T23:59:01.589067+0000","last_became_peered":"2024-06-02T23:59:01.589067+0000","last_unstale":"2024-06-02T23:59:03.060765+0000","last_undegraded":"2024-06-02T23:59:03.060765+0000","last_fullsized":"2024-06-02T23:59:03.060765+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:49:36.524901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060282+0000","last_change":"2024-06-02T23:59:01.591325+0000","last_active":"2024-06-02T23:59:03.060282+0000","last_peered":"2024-06-02T23:59:03.060282+0000","last_clean":"2024-06-02T23:59:03.060282+0000","last_became_active":"2024-06-02T23:59:01.590545+0000","last_became_peered":"2024-06-02T23:59:01.590545+0000","last_unstale":"2024-06-02T23:59:03.060282+0000","last_undegraded":"2024-06-02T23:59:03.060282+0000","last_fullsized":"2024-06-02T23:59:03.060282+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:17.184163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630430+0000","last_change":"2024-06-02T23:59:01.583413+0000","last_active":"2024-06-02T23:59:02.630430+0000","last_peered":"2024-06-02T23:59:02.630430+0000","last_clean":"2024-06-02T23:59:02.630430+0000","last_became_active":"2024-06-02T23:59:01.582568+0000","last_became_peered":"2024-06-02T23:59:01.582568+0000","last_unstale":"2024-06-02T23:59:02.630430+0000","last_undegraded":"2024-06-02T23:59:02.630430+0000","last_fullsized":"2024-06-02T23:59:02.630430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:45.895866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633100+0000","last_change":"2024-06-02T23:59:01.591575+0000","last_active":"2024-06-02T23:59:02.633100+0000","last_peered":"2024-06-02T23:59:02.633100+0000","last_clean":"2024-06-02T23:59:02.633100+0000","last_became_active":"2024-06-02T23:59:01.591265+0000","last_became_peered":"2024-06-02T23:59:01.591265+0000","last_unstale":"2024-06-02T23:59:02.633100+0000","last_undegraded":"2024-06-02T23:59:02.633100+0000","last_fullsized":"2024-06-02T23:59:02.633100+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059944+0000","last_change":"2024-06-02T23:59:01.590700+0000","last_active":"2024-06-02T23:59:03.059944+0000","last_peered":"2024-06-02T23:59:03.059944+0000","last_clean":"2024-06-02T23:59:03.059944+0000","last_became_active":"2024-06-02T23:59:01.590445+0000","last_became_peered":"2024-06-02T23:59:01.590445+0000","last_unstale":"2024-06-02T23:59:03.059944+0000","last_undegraded":"2024-06-02T23:59:03.059944+0000","last_fullsized":"2024-06-02T23:59:03.059944+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:31.933956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630857+0000","last_change":"2024-06-02T23:59:01.587034+0000","last_active":"2024-06-02T23:59:02.630857+0000","last_peered":"2024-06-02T23:59:02.630857+0000","last_clean":"2024-06-02T23:59:02.630857+0000","last_became_active":"2024-06-02T23:59:01.586784+0000","last_became_peered":"2024-06-02T23:59:01.586784+0000","last_unstale":"2024-06-02T23:59:02.630857+0000","last_undegraded":"2024-06-02T23:59:02.630857+0000","last_fullsized":"2024-06-02T23:59:02.630857+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:10.502903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633429+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-02T23:59:02.633429+0000","last_peered":"2024-06-02T23:59:02.633429+0000","last_clean":"2024-06-02T23:59:02.633429+0000","last_became_active":"2024-06-02T23:59:01.582680+0000","last_became_peered":"2024-06-02T23:59:01.582680+0000","last_unstale":"2024-06-02T23:59:02.633429+0000","last_undegraded":"2024-06-02T23:59:02.633429+0000","last_fullsized":"2024-06-02T23:59:02.633429+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630692+0000","last_change":"2024-06-02T23:59:01.582684+0000","last_active":"2024-06-02T23:59:02.630692+0000","last_peered":"2024-06-02T23:59:02.630692+0000","last_clean":"2024-06-02T23:59:02.630692+0000","last_became_active":"2024-06-02T23:59:01.582422+0000","last_became_peered":"2024-06-02T23:59:01.582422+0000","last_unstale":"2024-06-02T23:59:02.630692+0000","last_undegraded":"2024-06-02T23:59:02.630692+0000","last_fullsized":"2024-06-02T23:59:02.630692+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:06.674997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060298+0000","last_change":"2024-06-02T23:59:01.591052+0000","last_active":"2024-06-02T23:59:03.060298+0000","last_peered":"2024-06-02T23:59:03.060298+0000","last_clean":"2024-06-02T23:59:03.060298+0000","last_became_active":"2024-06-02T23:59:01.590601+0000","last_became_peered":"2024-06-02T23:59:01.590601+0000","last_unstale":"2024-06-02T23:59:03.060298+0000","last_undegraded":"2024-06-02T23:59:03.060298+0000","last_fullsized":"2024-06-02T23:59:03.060298+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:29:55.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060108+0000","last_change":"2024-06-02T23:59:01.593871+0000","last_active":"2024-06-02T23:59:03.060108+0000","last_peered":"2024-06-02T23:59:03.060108+0000","last_clean":"2024-06-02T23:59:03.060108+0000","last_became_active":"2024-06-02T23:59:01.593596+0000","last_became_peered":"2024-06-02T23:59:01.593596+0000","last_unstale":"2024-06-02T23:59:03.060108+0000","last_undegraded":"2024-06-02T23:59:03.060108+0000","last_fullsized":"2024-06-02T23:59:03.060108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:35:33.955552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059702+0000","last_change":"2024-06-02T23:59:01.587899+0000","last_active":"2024-06-02T23:59:03.059702+0000","last_peered":"2024-06-02T23:59:03.059702+0000","last_clean":"2024-06-02T23:59:03.059702+0000","last_became_active":"2024-06-02T23:59:01.587641+0000","last_became_peered":"2024-06-02T23:59:01.587641+0000","last_unstale":"2024-06-02T23:59:03.059702+0000","last_undegraded":"2024-06-02T23:59:03.059702+0000","last_fullsized":"2024-06-02T23:59:03.059702+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:24:09.334139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059577+0000","last_change":"2024-06-02T23:59:01.584645+0000","last_active":"2024-06-02T23:59:03.059577+0000","last_peered":"2024-06-02T23:59:03.059577+0000","last_clean":"2024-06-02T23:59:03.059577+0000","last_became_active":"2024-06-02T23:59:01.584358+0000","last_became_peered":"2024-06-02T23:59:01.584358+0000","last_unstale":"2024-06-02T23:59:03.059577+0000","last_undegraded":"2024-06-02T23:59:03.059577+0000","last_fullsized":"2024-06-02T23:59:03.059577+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:31:25.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630261+0000","last_change":"2024-06-02T23:59:01.583175+0000","last_active":"2024-06-02T23:59:02.630261+0000","last_peered":"2024-06-02T23:59:02.630261+0000","last_clean":"2024-06-02T23:59:02.630261+0000","last_became_active":"2024-06-02T23:59:01.582904+0000","last_became_peered":"2024-06-02T23:59:01.582904+0000","last_unstale":"2024-06-02T23:59:02.630261+0000","last_undegraded":"2024-06-02T23:59:02.630261+0000","last_fullsized":"2024-06-02T23:59:02.630261+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:56:06.478241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630856+0000","last_change":"2024-06-02T23:59:01.591616+0000","last_active":"2024-06-02T23:59:02.630856+0000","last_peered":"2024-06-02T23:59:02.630856+0000","last_clean":"2024-06-02T23:59:02.630856+0000","last_became_active":"2024-06-02T23:59:01.589760+0000","last_became_peered":"2024-06-02T23:59:01.589760+0000","last_unstale":"2024-06-02T23:59:02.630856+0000","last_undegraded":"2024-06-02T23:59:02.630856+0000","last_fullsized":"2024-06-02T23:59:02.630856+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:29.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059749+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-02T23:59:03.059749+0000","last_peered":"2024-06-02T23:59:03.059749+0000","last_clean":"2024-06-02T23:59:03.059749+0000","last_became_active":"2024-06-02T23:59:01.585010+0000","last_became_peered":"2024-06-02T23:59:01.585010+0000","last_unstale":"2024-06-02T23:59:03.059749+0000","last_undegraded":"2024-06-02T23:59:03.059749+0000","last_fullsized":"2024-06-02T23:59:03.059749+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:50:01.657005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060416+0000","last_change":"2024-06-02T23:59:01.593067+0000","last_active":"2024-06-02T23:59:03.060416+0000","last_peered":"2024-06-02T23:59:03.060416+0000","last_clean":"2024-06-02T23:59:03.060416+0000","last_became_active":"2024-06-02T23:59:01.592789+0000","last_became_peered":"2024-06-02T23:59:01.592789+0000","last_unstale":"2024-06-02T23:59:03.060416+0000","last_undegraded":"2024-06-02T23:59:03.060416+0000","last_fullsized":"2024-06-02T23:59:03.060416+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:25:47.061955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060387+0000","last_change":"2024-06-02T23:59:01.591460+0000","last_active":"2024-06-02T23:59:03.060387+0000","last_peered":"2024-06-02T23:59:03.060387+0000","last_clean":"2024-06-02T23:59:03.060387+0000","last_became_active":"2024-06-02T23:59:01.590827+0000","last_became_peered":"2024-06-02T23:59:01.590827+0000","last_unstale":"2024-06-02T23:59:03.060387+0000","last_undegraded":"2024-06-02T23:59:03.060387+0000","last_fullsized":"2024-06-02T23:59:03.060387+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:27.044276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630396+0000","last_change":"2024-06-02T23:59:01.589715+0000","last_active":"2024-06-02T23:59:02.630396+0000","last_peered":"2024-06-02T23:59:02.630396+0000","last_clean":"2024-06-02T23:59:02.630396+0000","last_became_active":"2024-06-02T23:59:01.589456+0000","last_became_peered":"2024-06-02T23:59:01.589456+0000","last_unstale":"2024-06-02T23:59:02.630396+0000","last_undegraded":"2024-06-02T23:59:02.630396+0000","last_fullsized":"2024-06-02T23:59:02.630396+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:36.510898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633107+0000","last_change":"2024-06-02T23:59:01.589048+0000","last_active":"2024-06-02T23:59:02.633107+0000","last_peered":"2024-06-02T23:59:02.633107+0000","last_clean":"2024-06-02T23:59:02.633107+0000","last_became_active":"2024-06-02T23:59:01.588773+0000","last_became_peered":"2024-06-02T23:59:01.588773+0000","last_unstale":"2024-06-02T23:59:02.633107+0000","last_undegraded":"2024-06-02T23:59:02.633107+0000","last_fullsized":"2024-06-02T23:59:02.633107+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630395+0000","last_change":"2024-06-02T23:59:01.586433+0000","last_active":"2024-06-02T23:59:02.630395+0000","last_peered":"2024-06-02T23:59:02.630395+0000","last_clean":"2024-06-02T23:59:02.630395+0000","last_became_active":"2024-06-02T23:59:01.585466+0000","last_became_peered":"2024-06-02T23:59:01.585466+0000","last_unstale":"2024-06-02T23:59:02.630395+0000","last_undegraded":"2024-06-02T23:59:02.630395+0000","last_fullsized":"2024-06-02T23:59:02.630395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:24:38.083153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576665+0000","last_change":"2024-06-02T23:59:01.586007+0000","last_active":"2024-06-02T23:59:02.576665+0000","last_peered":"2024-06-02T23:59:02.576665+0000","last_clean":"2024-06-02T23:59:02.576665+0000","last_became_active":"2024-06-02T23:59:01.585721+0000","last_became_peered":"2024-06-02T23:59:01.585721+0000","last_unstale":"2024-06-02T23:59:02.576665+0000","last_undegraded":"2024-06-02T23:59:02.576665+0000","last_fullsized":"2024-06-02T23:59:02.576665+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:50:41.714294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.632891+0000","last_change":"2024-06-02T23:59:01.582009+0000","last_active":"2024-06-02T23:59:02.632891+0000","last_peered":"2024-06-02T23:59:02.632891+0000","last_clean":"2024-06-02T23:59:02.632891+0000","last_became_active":"2024-06-02T23:59:01.581438+0000","last_became_peered":"2024-06-02T23:59:01.581438+0000","last_unstale":"2024-06-02T23:59:02.632891+0000","last_undegraded":"2024-06-02T23:59:02.632891+0000","last_fullsized":"2024-06-02T23:59:02.632891+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"69'4","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060187+0000","last_change":"2024-06-02T23:59:00.647990+0000","last_active":"2024-06-02T23:59:03.060187+0000","last_peered":"2024-06-02T23:59:03.060187+0000","last_clean":"2024-06-02T23:59:03.060187+0000","last_became_active":"2024-06-02T23:59:00.647031+0000","last_became_peered":"2024-06-02T23:59:00.647031+0000","last_unstale":"2024-06-02T23:59:03.060187+0000","last_undegraded":"2024-06-02T23:59:03.060187+0000","last_fullsized":"2024-06-02T23:59:03.060187+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:19:44.864617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576622+0000","last_change":"2024-06-02T23:59:01.587104+0000","last_active":"2024-06-02T23:59:02.576622+0000","last_peered":"2024-06-02T23:59:02.576622+0000","last_clean":"2024-06-02T23:59:02.576622+0000","last_became_active":"2024-06-02T23:59:01.586813+0000","last_became_peered":"2024-06-02T23:59:01.586813+0000","last_unstale":"2024-06-02T23:59:02.576622+0000","last_undegraded":"2024-06-02T23:59:02.576622+0000","last_fullsized":"2024-06-02T23:59:02.576622+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:10:37.679556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059625+0000","last_change":"2024-06-02T23:59:00.638860+0000","last_active":"2024-06-02T23:59:03.059625+0000","last_peered":"2024-06-02T23:59:03.059625+0000","last_clean":"2024-06-02T23:59:03.059625+0000","last_became_active":"2024-06-02T23:59:00.638579+0000","last_became_peered":"2024-06-02T23:59:00.638579+0000","last_unstale":"2024-06-02T23:59:03.059625+0000","last_undegraded":"2024-06-02T23:59:03.059625+0000","last_fullsized":"2024-06-02T23:59:03.059625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:57:25.113202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060234+0000","last_change":"2024-06-02T23:59:01.593795+0000","last_active":"2024-06-02T23:59:03.060234+0000","last_peered":"2024-06-02T23:59:03.060234+0000","last_clean":"2024-06-02T23:59:03.060234+0000","last_became_active":"2024-06-02T23:59:01.593506+0000","last_became_peered":"2024-06-02T23:59:01.593506+0000","last_unstale":"2024-06-02T23:59:03.060234+0000","last_undegraded":"2024-06-02T23:59:03.060234+0000","last_fullsized":"2024-06-02T23:59:03.060234+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:51.301800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060456+0000","last_change":"2024-06-02T23:59:00.648871+0000","last_active":"2024-06-02T23:59:03.060456+0000","last_peered":"2024-06-02T23:59:03.060456+0000","last_clean":"2024-06-02T23:59:03.060456+0000","last_became_active":"2024-06-02T23:59:00.648667+0000","last_became_peered":"2024-06-02T23:59:00.648667+0000","last_unstale":"2024-06-02T23:59:03.060456+0000","last_undegraded":"2024-06-02T23:59:03.060456+0000","last_fullsized":"2024-06-02T23:59:03.060456+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:11:50.234565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060693+0000","last_change":"2024-06-02T23:59:01.585466+0000","last_active":"2024-06-02T23:59:03.060693+0000","last_peered":"2024-06-02T23:59:03.060693+0000","last_clean":"2024-06-02T23:59:03.060693+0000","last_became_active":"2024-06-02T23:59:01.585127+0000","last_became_peered":"2024-06-02T23:59:01.585127+0000","last_unstale":"2024-06-02T23:59:03.060693+0000","last_undegraded":"2024-06-02T23:59:03.060693+0000","last_fullsized":"2024-06-02T23:59:03.060693+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:23:32.778002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576698+0000","last_change":"2024-06-02T23:59:00.642417+0000","last_active":"2024-06-02T23:59:02.576698+0000","last_peered":"2024-06-02T23:59:02.576698+0000","last_clean":"2024-06-02T23:59:02.576698+0000","last_became_active":"2024-06-02T23:59:00.642182+0000","last_became_peered":"2024-06-02T23:59:00.642182+0000","last_unstale":"2024-06-02T23:59:02.576698+0000","last_undegraded":"2024-06-02T23:59:02.576698+0000","last_fullsized":"2024-06-02T23:59:02.576698+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:48.372998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575665+0000","last_change":"2024-06-02T23:59:01.589753+0000","last_active":"2024-06-02T23:59:02.575665+0000","last_peered":"2024-06-02T23:59:02.575665+0000","last_clean":"2024-06-02T23:59:02.575665+0000","last_became_active":"2024-06-02T23:59:01.588602+0000","last_became_peered":"2024-06-02T23:59:01.588602+0000","last_unstale":"2024-06-02T23:59:02.575665+0000","last_undegraded":"2024-06-02T23:59:02.575665+0000","last_fullsized":"2024-06-02T23:59:02.575665+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:17.184163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630342+0000","last_change":"2024-06-02T23:59:00.641231+0000","last_active":"2024-06-02T23:59:02.630342+0000","last_peered":"2024-06-02T23:59:02.630342+0000","last_clean":"2024-06-02T23:59:02.630342+0000","last_became_active":"2024-06-02T23:59:00.640963+0000","last_became_peered":"2024-06-02T23:59:00.640963+0000","last_unstale":"2024-06-02T23:59:02.630342+0000","last_undegraded":"2024-06-02T23:59:02.630342+0000","last_fullsized":"2024-06-02T23:59:02.630342+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.148246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633271+0000","last_change":"2024-06-02T23:59:01.591548+0000","last_active":"2024-06-02T23:59:02.633271+0000","last_peered":"2024-06-02T23:59:02.633271+0000","last_clean":"2024-06-02T23:59:02.633271+0000","last_became_active":"2024-06-02T23:59:01.591198+0000","last_became_peered":"2024-06-02T23:59:01.591198+0000","last_unstale":"2024-06-02T23:59:02.633271+0000","last_undegraded":"2024-06-02T23:59:02.633271+0000","last_fullsized":"2024-06-02T23:59:02.633271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575887+0000","last_change":"2024-06-02T23:59:00.649120+0000","last_active":"2024-06-02T23:59:02.575887+0000","last_peered":"2024-06-02T23:59:02.575887+0000","last_clean":"2024-06-02T23:59:02.575887+0000","last_became_active":"2024-06-02T23:59:00.648839+0000","last_became_peered":"2024-06-02T23:59:00.648839+0000","last_unstale":"2024-06-02T23:59:02.575887+0000","last_undegraded":"2024-06-02T23:59:02.575887+0000","last_fullsized":"2024-06-02T23:59:02.575887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:52:08.529881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059989+0000","last_change":"2024-06-02T23:59:01.585288+0000","last_active":"2024-06-02T23:59:03.059989+0000","last_peered":"2024-06-02T23:59:03.059989+0000","last_clean":"2024-06-02T23:59:03.059989+0000","last_became_active":"2024-06-02T23:59:01.584971+0000","last_became_peered":"2024-06-02T23:59:01.584971+0000","last_unstale":"2024-06-02T23:59:03.059989+0000","last_undegraded":"2024-06-02T23:59:03.059989+0000","last_fullsized":"2024-06-02T23:59:03.059989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:54:54.767840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060129+0000","last_change":"2024-06-02T23:59:00.648200+0000","last_active":"2024-06-02T23:59:03.060129+0000","last_peered":"2024-06-02T23:59:03.060129+0000","last_clean":"2024-06-02T23:59:03.060129+0000","last_became_active":"2024-06-02T23:59:00.647175+0000","last_became_peered":"2024-06-02T23:59:00.647175+0000","last_unstale":"2024-06-02T23:59:03.060129+0000","last_undegraded":"2024-06-02T23:59:03.060129+0000","last_fullsized":"2024-06-02T23:59:03.060129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:34:43.239731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633315+0000","last_change":"2024-06-02T23:59:01.593060+0000","last_active":"2024-06-02T23:59:02.633315+0000","last_peered":"2024-06-02T23:59:02.633315+0000","last_clean":"2024-06-02T23:59:02.633315+0000","last_became_active":"2024-06-02T23:59:01.592710+0000","last_became_peered":"2024-06-02T23:59:01.592710+0000","last_unstale":"2024-06-02T23:59:02.633315+0000","last_undegraded":"2024-06-02T23:59:02.633315+0000","last_fullsized":"2024-06-02T23:59:02.633315+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:06.674997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630204+0000","last_change":"2024-06-02T23:59:00.647400+0000","last_active":"2024-06-02T23:59:02.630204+0000","last_peered":"2024-06-02T23:59:02.630204+0000","last_clean":"2024-06-02T23:59:02.630204+0000","last_became_active":"2024-06-02T23:59:00.647210+0000","last_became_peered":"2024-06-02T23:59:00.647210+0000","last_unstale":"2024-06-02T23:59:02.630204+0000","last_undegraded":"2024-06-02T23:59:02.630204+0000","last_fullsized":"2024-06-02T23:59:02.630204+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:13.009966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575384+0000","last_change":"2024-06-02T23:59:01.587444+0000","last_active":"2024-06-02T23:59:02.575384+0000","last_peered":"2024-06-02T23:59:02.575384+0000","last_clean":"2024-06-02T23:59:02.575384+0000","last_became_active":"2024-06-02T23:59:01.587190+0000","last_became_peered":"2024-06-02T23:59:01.587190+0000","last_unstale":"2024-06-02T23:59:02.575384+0000","last_undegraded":"2024-06-02T23:59:02.575384+0000","last_fullsized":"2024-06-02T23:59:02.575384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:56:54.953142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633174+0000","last_change":"2024-06-02T23:59:00.637111+0000","last_active":"2024-06-02T23:59:02.633174+0000","last_peered":"2024-06-02T23:59:02.633174+0000","last_clean":"2024-06-02T23:59:02.633174+0000","last_became_active":"2024-06-02T23:59:00.636815+0000","last_became_peered":"2024-06-02T23:59:00.636815+0000","last_unstale":"2024-06-02T23:59:02.633174+0000","last_undegraded":"2024-06-02T23:59:02.633174+0000","last_fullsized":"2024-06-02T23:59:02.633174+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:52:39.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576726+0000","last_change":"2024-06-02T23:59:01.585862+0000","last_active":"2024-06-02T23:59:02.576726+0000","last_peered":"2024-06-02T23:59:02.576726+0000","last_clean":"2024-06-02T23:59:02.576726+0000","last_became_active":"2024-06-02T23:59:01.585128+0000","last_became_peered":"2024-06-02T23:59:01.585128+0000","last_unstale":"2024-06-02T23:59:02.576726+0000","last_undegraded":"2024-06-02T23:59:02.576726+0000","last_fullsized":"2024-06-02T23:59:02.576726+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:28:18.588571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575858+0000","last_change":"2024-06-02T23:59:00.644991+0000","last_active":"2024-06-02T23:59:02.575858+0000","last_peered":"2024-06-02T23:59:02.575858+0000","last_clean":"2024-06-02T23:59:02.575858+0000","last_became_active":"2024-06-02T23:59:00.644759+0000","last_became_peered":"2024-06-02T23:59:00.644759+0000","last_unstale":"2024-06-02T23:59:02.575858+0000","last_undegraded":"2024-06-02T23:59:02.575858+0000","last_fullsized":"2024-06-02T23:59:02.575858+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:26.313713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630475+0000","last_change":"2024-06-02T23:59:01.590250+0000","last_active":"2024-06-02T23:59:02.630475+0000","last_peered":"2024-06-02T23:59:02.630475+0000","last_clean":"2024-06-02T23:59:02.630475+0000","last_became_active":"2024-06-02T23:59:01.589942+0000","last_became_peered":"2024-06-02T23:59:01.589942+0000","last_unstale":"2024-06-02T23:59:02.630475+0000","last_undegraded":"2024-06-02T23:59:02.630475+0000","last_fullsized":"2024-06-02T23:59:02.630475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"69'3","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633356+0000","last_change":"2024-06-02T23:59:00.644405+0000","last_active":"2024-06-02T23:59:02.633356+0000","last_peered":"2024-06-02T23:59:02.633356+0000","last_clean":"2024-06-02T23:59:02.633356+0000","last_became_active":"2024-06-02T23:59:00.643978+0000","last_became_peered":"2024-06-02T23:59:00.643978+0000","last_unstale":"2024-06-02T23:59:02.633356+0000","last_undegraded":"2024-06-02T23:59:02.633356+0000","last_fullsized":"2024-06-02T23:59:02.633356+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:16:38.404329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575831+0000","last_change":"2024-06-02T23:59:01.574661+0000","last_active":"2024-06-02T23:59:02.575831+0000","last_peered":"2024-06-02T23:59:02.575831+0000","last_clean":"2024-06-02T23:59:02.575831+0000","last_became_active":"2024-06-02T23:59:01.574347+0000","last_became_peered":"2024-06-02T23:59:01.574347+0000","last_unstale":"2024-06-02T23:59:02.575831+0000","last_undegraded":"2024-06-02T23:59:02.575831+0000","last_fullsized":"2024-06-02T23:59:02.575831+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:24.094731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"69'6","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060810+0000","last_change":"2024-06-02T23:59:00.638966+0000","last_active":"2024-06-02T23:59:03.060810+0000","last_peered":"2024-06-02T23:59:03.060810+0000","last_clean":"2024-06-02T23:59:03.060810+0000","last_became_active":"2024-06-02T23:59:00.638716+0000","last_became_peered":"2024-06-02T23:59:00.638716+0000","last_unstale":"2024-06-02T23:59:03.060810+0000","last_undegraded":"2024-06-02T23:59:03.060810+0000","last_fullsized":"2024-06-02T23:59:03.060810+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:28.207234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576597+0000","last_change":"2024-06-02T23:59:01.584960+0000","last_active":"2024-06-02T23:59:02.576597+0000","last_peered":"2024-06-02T23:59:02.576597+0000","last_clean":"2024-06-02T23:59:02.576597+0000","last_became_active":"2024-06-02T23:59:01.584575+0000","last_became_peered":"2024-06-02T23:59:01.584575+0000","last_unstale":"2024-06-02T23:59:02.576597+0000","last_undegraded":"2024-06-02T23:59:02.576597+0000","last_fullsized":"2024-06-02T23:59:02.576597+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:00:08.310863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630456+0000","last_change":"2024-06-02T23:59:00.645893+0000","last_active":"2024-06-02T23:59:02.630456+0000","last_peered":"2024-06-02T23:59:02.630456+0000","last_clean":"2024-06-02T23:59:02.630456+0000","last_became_active":"2024-06-02T23:59:00.645639+0000","last_became_peered":"2024-06-02T23:59:00.645639+0000","last_unstale":"2024-06-02T23:59:02.630456+0000","last_undegraded":"2024-06-02T23:59:02.630456+0000","last_fullsized":"2024-06-02T23:59:02.630456+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:01:07.347079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630792+0000","last_change":"2024-06-02T23:59:01.589530+0000","last_active":"2024-06-02T23:59:02.630792+0000","last_peered":"2024-06-02T23:59:02.630792+0000","last_clean":"2024-06-02T23:59:02.630792+0000","last_became_active":"2024-06-02T23:59:01.589024+0000","last_became_peered":"2024-06-02T23:59:01.589024+0000","last_unstale":"2024-06-02T23:59:02.630792+0000","last_undegraded":"2024-06-02T23:59:02.630792+0000","last_fullsized":"2024-06-02T23:59:02.630792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060154+0000","last_change":"2024-06-02T23:59:00.647783+0000","last_active":"2024-06-02T23:59:03.060154+0000","last_peered":"2024-06-02T23:59:03.060154+0000","last_clean":"2024-06-02T23:59:03.060154+0000","last_became_active":"2024-06-02T23:59:00.647500+0000","last_became_peered":"2024-06-02T23:59:00.647500+0000","last_unstale":"2024-06-02T23:59:03.060154+0000","last_undegraded":"2024-06-02T23:59:03.060154+0000","last_fullsized":"2024-06-02T23:59:03.060154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:55:32.977530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059939+0000","last_change":"2024-06-02T23:59:01.582611+0000","last_active":"2024-06-02T23:59:03.059939+0000","last_peered":"2024-06-02T23:59:03.059939+0000","last_clean":"2024-06-02T23:59:03.059939+0000","last_became_active":"2024-06-02T23:59:01.582343+0000","last_became_peered":"2024-06-02T23:59:01.582343+0000","last_unstale":"2024-06-02T23:59:03.059939+0000","last_undegraded":"2024-06-02T23:59:03.059939+0000","last_fullsized":"2024-06-02T23:59:03.059939+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:34:05.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633194+0000","last_change":"2024-06-02T23:59:00.648669+0000","last_active":"2024-06-02T23:59:02.633194+0000","last_peered":"2024-06-02T23:59:02.633194+0000","last_clean":"2024-06-02T23:59:02.633194+0000","last_became_active":"2024-06-02T23:59:00.647777+0000","last_became_peered":"2024-06-02T23:59:00.647777+0000","last_unstale":"2024-06-02T23:59:02.633194+0000","last_undegraded":"2024-06-02T23:59:02.633194+0000","last_fullsized":"2024-06-02T23:59:02.633194+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:05:23.931542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630773+0000","last_change":"2024-06-02T23:59:01.593580+0000","last_active":"2024-06-02T23:59:02.630773+0000","last_peered":"2024-06-02T23:59:02.630773+0000","last_clean":"2024-06-02T23:59:02.630773+0000","last_became_active":"2024-06-02T23:59:01.593303+0000","last_became_peered":"2024-06-02T23:59:01.593303+0000","last_unstale":"2024-06-02T23:59:02.630773+0000","last_undegraded":"2024-06-02T23:59:02.630773+0000","last_fullsized":"2024-06-02T23:59:02.630773+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"69'8","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060399+0000","last_change":"2024-06-02T23:59:00.645230+0000","last_active":"2024-06-02T23:59:03.060399+0000","last_peered":"2024-06-02T23:59:03.060399+0000","last_clean":"2024-06-02T23:59:03.060399+0000","last_became_active":"2024-06-02T23:59:00.644964+0000","last_became_peered":"2024-06-02T23:59:00.644964+0000","last_unstale":"2024-06-02T23:59:03.060399+0000","last_undegraded":"2024-06-02T23:59:03.060399+0000","last_fullsized":"2024-06-02T23:59:03.060399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:05.673357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060354+0000","last_change":"2024-06-02T23:59:01.582894+0000","last_active":"2024-06-02T23:59:03.060354+0000","last_peered":"2024-06-02T23:59:03.060354+0000","last_clean":"2024-06-02T23:59:03.060354+0000","last_became_active":"2024-06-02T23:59:01.581160+0000","last_became_peered":"2024-06-02T23:59:01.581160+0000","last_unstale":"2024-06-02T23:59:03.060354+0000","last_undegraded":"2024-06-02T23:59:03.060354+0000","last_fullsized":"2024-06-02T23:59:03.060354+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:52:00.630032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630887+0000","last_change":"2024-06-02T23:59:00.644263+0000","last_active":"2024-06-02T23:59:02.630887+0000","last_peered":"2024-06-02T23:59:02.630887+0000","last_clean":"2024-06-02T23:59:02.630887+0000","last_became_active":"2024-06-02T23:59:00.644014+0000","last_became_peered":"2024-06-02T23:59:00.644014+0000","last_unstale":"2024-06-02T23:59:02.630887+0000","last_undegraded":"2024-06-02T23:59:02.630887+0000","last_fullsized":"2024-06-02T23:59:02.630887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:40:21.019637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059891+0000","last_change":"2024-06-02T23:59:01.593089+0000","last_active":"2024-06-02T23:59:03.059891+0000","last_peered":"2024-06-02T23:59:03.059891+0000","last_clean":"2024-06-02T23:59:03.059891+0000","last_became_active":"2024-06-02T23:59:01.592800+0000","last_became_peered":"2024-06-02T23:59:01.592800+0000","last_unstale":"2024-06-02T23:59:03.059891+0000","last_undegraded":"2024-06-02T23:59:03.059891+0000","last_fullsized":"2024-06-02T23:59:03.059891+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:07.188102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060377+0000","last_change":"2024-06-02T23:59:00.636429+0000","last_active":"2024-06-02T23:59:03.060377+0000","last_peered":"2024-06-02T23:59:03.060377+0000","last_clean":"2024-06-02T23:59:03.060377+0000","last_became_active":"2024-06-02T23:59:00.636161+0000","last_became_peered":"2024-06-02T23:59:00.636161+0000","last_unstale":"2024-06-02T23:59:03.060377+0000","last_undegraded":"2024-06-02T23:59:03.060377+0000","last_fullsized":"2024-06-02T23:59:03.060377+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:45:33.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575559+0000","last_change":"2024-06-02T23:59:01.588676+0000","last_active":"2024-06-02T23:59:02.575559+0000","last_peered":"2024-06-02T23:59:02.575559+0000","last_clean":"2024-06-02T23:59:02.575559+0000","last_became_active":"2024-06-02T23:59:01.588372+0000","last_became_peered":"2024-06-02T23:59:01.588372+0000","last_unstale":"2024-06-02T23:59:02.575559+0000","last_undegraded":"2024-06-02T23:59:02.575559+0000","last_fullsized":"2024-06-02T23:59:02.575559+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:29:13.698815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060272+0000","last_change":"2024-06-02T23:59:00.646728+0000","last_active":"2024-06-02T23:59:03.060272+0000","last_peered":"2024-06-02T23:59:03.060272+0000","last_clean":"2024-06-02T23:59:03.060272+0000","last_became_active":"2024-06-02T23:59:00.646290+0000","last_became_peered":"2024-06-02T23:59:00.646290+0000","last_unstale":"2024-06-02T23:59:03.060272+0000","last_undegraded":"2024-06-02T23:59:03.060272+0000","last_fullsized":"2024-06-02T23:59:03.060272+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:55.805472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060408+0000","last_change":"2024-06-02T23:59:01.590261+0000","last_active":"2024-06-02T23:59:03.060408+0000","last_peered":"2024-06-02T23:59:03.060408+0000","last_clean":"2024-06-02T23:59:03.060408+0000","last_became_active":"2024-06-02T23:59:01.590016+0000","last_became_peered":"2024-06-02T23:59:01.590016+0000","last_unstale":"2024-06-02T23:59:03.060408+0000","last_undegraded":"2024-06-02T23:59:03.060408+0000","last_fullsized":"2024-06-02T23:59:03.060408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:24.094731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060367+0000","last_change":"2024-06-02T23:59:00.647565+0000","last_active":"2024-06-02T23:59:03.060367+0000","last_peered":"2024-06-02T23:59:03.060367+0000","last_clean":"2024-06-02T23:59:03.060367+0000","last_became_active":"2024-06-02T23:59:00.647144+0000","last_became_peered":"2024-06-02T23:59:00.647144+0000","last_unstale":"2024-06-02T23:59:03.060367+0000","last_undegraded":"2024-06-02T23:59:03.060367+0000","last_fullsized":"2024-06-02T23:59:03.060367+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:14.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576913+0000","last_change":"2024-06-02T23:59:01.579062+0000","last_active":"2024-06-02T23:59:02.576913+0000","last_peered":"2024-06-02T23:59:02.576913+0000","last_clean":"2024-06-02T23:59:02.576913+0000","last_became_active":"2024-06-02T23:59:01.578711+0000","last_became_peered":"2024-06-02T23:59:01.578711+0000","last_unstale":"2024-06-02T23:59:02.576913+0000","last_undegraded":"2024-06-02T23:59:02.576913+0000","last_fullsized":"2024-06-02T23:59:02.576913+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:10.046785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060453+0000","last_change":"2024-06-02T23:59:00.638071+0000","last_active":"2024-06-02T23:59:03.060453+0000","last_peered":"2024-06-02T23:59:03.060453+0000","last_clean":"2024-06-02T23:59:03.060453+0000","last_became_active":"2024-06-02T23:59:00.637806+0000","last_became_peered":"2024-06-02T23:59:00.637806+0000","last_unstale":"2024-06-02T23:59:03.060453+0000","last_undegraded":"2024-06-02T23:59:03.060453+0000","last_fullsized":"2024-06-02T23:59:03.060453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:25.851075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060302+0000","last_change":"2024-06-02T23:59:01.591902+0000","last_active":"2024-06-02T23:59:03.060302+0000","last_peered":"2024-06-02T23:59:03.060302+0000","last_clean":"2024-06-02T23:59:03.060302+0000","last_became_active":"2024-06-02T23:59:01.590949+0000","last_became_peered":"2024-06-02T23:59:01.590949+0000","last_unstale":"2024-06-02T23:59:03.060302+0000","last_undegraded":"2024-06-02T23:59:03.060302+0000","last_fullsized":"2024-06-02T23:59:03.060302+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:11.888454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059756+0000","last_change":"2024-06-02T23:59:00.640128+0000","last_active":"2024-06-02T23:59:03.059756+0000","last_peered":"2024-06-02T23:59:03.059756+0000","last_clean":"2024-06-02T23:59:03.059756+0000","last_became_active":"2024-06-02T23:59:00.639852+0000","last_became_peered":"2024-06-02T23:59:00.639852+0000","last_unstale":"2024-06-02T23:59:03.059756+0000","last_undegraded":"2024-06-02T23:59:03.059756+0000","last_fullsized":"2024-06-02T23:59:03.059756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:07.421496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630719+0000","last_change":"2024-06-02T23:59:01.588002+0000","last_active":"2024-06-02T23:59:02.630719+0000","last_peered":"2024-06-02T23:59:02.630719+0000","last_clean":"2024-06-02T23:59:02.630719+0000","last_became_active":"2024-06-02T23:59:01.587734+0000","last_became_peered":"2024-06-02T23:59:01.587734+0000","last_unstale":"2024-06-02T23:59:02.630719+0000","last_undegraded":"2024-06-02T23:59:02.630719+0000","last_fullsized":"2024-06-02T23:59:02.630719+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630363+0000","last_change":"2024-06-02T23:59:00.643318+0000","last_active":"2024-06-02T23:59:02.630363+0000","last_peered":"2024-06-02T23:59:02.630363+0000","last_clean":"2024-06-02T23:59:02.630363+0000","last_became_active":"2024-06-02T23:59:00.643062+0000","last_became_peered":"2024-06-02T23:59:00.643062+0000","last_unstale":"2024-06-02T23:59:02.630363+0000","last_undegraded":"2024-06-02T23:59:02.630363+0000","last_fullsized":"2024-06-02T23:59:02.630363+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:25:50.830339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059792+0000","last_change":"2024-06-02T23:59:01.586699+0000","last_active":"2024-06-02T23:59:03.059792+0000","last_peered":"2024-06-02T23:59:03.059792+0000","last_clean":"2024-06-02T23:59:03.059792+0000","last_became_active":"2024-06-02T23:59:01.586401+0000","last_became_peered":"2024-06-02T23:59:01.586401+0000","last_unstale":"2024-06-02T23:59:03.059792+0000","last_undegraded":"2024-06-02T23:59:03.059792+0000","last_fullsized":"2024-06-02T23:59:03.059792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:12:10.532874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059357+0000","last_change":"2024-06-02T23:59:00.635754+0000","last_active":"2024-06-02T23:59:03.059357+0000","last_peered":"2024-06-02T23:59:03.059357+0000","last_clean":"2024-06-02T23:59:03.059357+0000","last_became_active":"2024-06-02T23:59:00.635444+0000","last_became_peered":"2024-06-02T23:59:00.635444+0000","last_unstale":"2024-06-02T23:59:03.059357+0000","last_undegraded":"2024-06-02T23:59:03.059357+0000","last_fullsized":"2024-06-02T23:59:03.059357+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:54:08.565345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576770+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-02T23:59:02.576770+0000","last_peered":"2024-06-02T23:59:02.576770+0000","last_clean":"2024-06-02T23:59:02.576770+0000","last_became_active":"2024-06-02T23:59:01.584978+0000","last_became_peered":"2024-06-02T23:59:01.584978+0000","last_unstale":"2024-06-02T23:59:02.576770+0000","last_undegraded":"2024-06-02T23:59:02.576770+0000","last_fullsized":"2024-06-02T23:59:02.576770+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:21:15.601996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060142+0000","last_change":"2024-06-02T23:59:00.647401+0000","last_active":"2024-06-02T23:59:03.060142+0000","last_peered":"2024-06-02T23:59:03.060142+0000","last_clean":"2024-06-02T23:59:03.060142+0000","last_became_active":"2024-06-02T23:59:00.647038+0000","last_became_peered":"2024-06-02T23:59:00.647038+0000","last_unstale":"2024-06-02T23:59:03.060142+0000","last_undegraded":"2024-06-02T23:59:03.060142+0000","last_fullsized":"2024-06-02T23:59:03.060142+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:49:28.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060231+0000","last_change":"2024-06-02T23:59:01.587184+0000","last_active":"2024-06-02T23:59:03.060231+0000","last_peered":"2024-06-02T23:59:03.060231+0000","last_clean":"2024-06-02T23:59:03.060231+0000","last_became_active":"2024-06-02T23:59:01.586774+0000","last_became_peered":"2024-06-02T23:59:01.586774+0000","last_unstale":"2024-06-02T23:59:03.060231+0000","last_undegraded":"2024-06-02T23:59:03.060231+0000","last_fullsized":"2024-06-02T23:59:03.060231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:29:13.698815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633402+0000","last_change":"2024-06-02T23:59:00.641736+0000","last_active":"2024-06-02T23:59:02.633402+0000","last_peered":"2024-06-02T23:59:02.633402+0000","last_clean":"2024-06-02T23:59:02.633402+0000","last_became_active":"2024-06-02T23:59:00.640889+0000","last_became_peered":"2024-06-02T23:59:00.640889+0000","last_unstale":"2024-06-02T23:59:02.633402+0000","last_undegraded":"2024-06-02T23:59:02.633402+0000","last_fullsized":"2024-06-02T23:59:02.633402+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:35.892006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060768+0000","last_change":"2024-06-02T23:59:01.589758+0000","last_active":"2024-06-02T23:59:03.060768+0000","last_peered":"2024-06-02T23:59:03.060768+0000","last_clean":"2024-06-02T23:59:03.060768+0000","last_became_active":"2024-06-02T23:59:01.588438+0000","last_became_peered":"2024-06-02T23:59:01.588438+0000","last_unstale":"2024-06-02T23:59:03.060768+0000","last_undegraded":"2024-06-02T23:59:03.060768+0000","last_fullsized":"2024-06-02T23:59:03.060768+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:19.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630499+0000","last_change":"2024-06-02T23:59:00.644933+0000","last_active":"2024-06-02T23:59:02.630499+0000","last_peered":"2024-06-02T23:59:02.630499+0000","last_clean":"2024-06-02T23:59:02.630499+0000","last_became_active":"2024-06-02T23:59:00.644680+0000","last_became_peered":"2024-06-02T23:59:00.644680+0000","last_unstale":"2024-06-02T23:59:02.630499+0000","last_undegraded":"2024-06-02T23:59:02.630499+0000","last_fullsized":"2024-06-02T23:59:02.630499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:10:07.936871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630520+0000","last_change":"2024-06-02T23:59:01.589967+0000","last_active":"2024-06-02T23:59:02.630520+0000","last_peered":"2024-06-02T23:59:02.630520+0000","last_clean":"2024-06-02T23:59:02.630520+0000","last_became_active":"2024-06-02T23:59:01.589146+0000","last_became_peered":"2024-06-02T23:59:01.589146+0000","last_unstale":"2024-06-02T23:59:02.630520+0000","last_undegraded":"2024-06-02T23:59:02.630520+0000","last_fullsized":"2024-06-02T23:59:02.630520+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060737+0000","last_change":"2024-06-02T23:59:00.642493+0000","last_active":"2024-06-02T23:59:03.060737+0000","last_peered":"2024-06-02T23:59:03.060737+0000","last_clean":"2024-06-02T23:59:03.060737+0000","last_became_active":"2024-06-02T23:59:00.642225+0000","last_became_peered":"2024-06-02T23:59:00.642225+0000","last_unstale":"2024-06-02T23:59:03.060737+0000","last_undegraded":"2024-06-02T23:59:03.060737+0000","last_fullsized":"2024-06-02T23:59:03.060737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:09.501263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576841+0000","last_change":"2024-06-02T23:59:01.584170+0000","last_active":"2024-06-02T23:59:02.576841+0000","last_peered":"2024-06-02T23:59:02.576841+0000","last_clean":"2024-06-02T23:59:02.576841+0000","last_became_active":"2024-06-02T23:59:01.583901+0000","last_became_peered":"2024-06-02T23:59:01.583901+0000","last_unstale":"2024-06-02T23:59:02.576841+0000","last_undegraded":"2024-06-02T23:59:02.576841+0000","last_fullsized":"2024-06-02T23:59:02.576841+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:22:32.595470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059878+0000","last_change":"2024-06-02T23:59:00.644379+0000","last_active":"2024-06-02T23:59:03.059878+0000","last_peered":"2024-06-02T23:59:03.059878+0000","last_clean":"2024-06-02T23:59:03.059878+0000","last_became_active":"2024-06-02T23:59:00.644115+0000","last_became_peered":"2024-06-02T23:59:00.644115+0000","last_unstale":"2024-06-02T23:59:03.059878+0000","last_undegraded":"2024-06-02T23:59:03.059878+0000","last_fullsized":"2024-06-02T23:59:03.059878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:01.768574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630683+0000","last_change":"2024-06-02T23:59:01.587439+0000","last_active":"2024-06-02T23:59:02.630683+0000","last_peered":"2024-06-02T23:59:02.630683+0000","last_clean":"2024-06-02T23:59:02.630683+0000","last_became_active":"2024-06-02T23:59:01.587147+0000","last_became_peered":"2024-06-02T23:59:01.587147+0000","last_unstale":"2024-06-02T23:59:02.630683+0000","last_undegraded":"2024-06-02T23:59:02.630683+0000","last_fullsized":"2024-06-02T23:59:02.630683+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575375+0000","last_change":"2024-06-02T23:59:00.643747+0000","last_active":"2024-06-02T23:59:02.575375+0000","last_peered":"2024-06-02T23:59:02.575375+0000","last_clean":"2024-06-02T23:59:02.575375+0000","last_became_active":"2024-06-02T23:59:00.643445+0000","last_became_peered":"2024-06-02T23:59:00.643445+0000","last_unstale":"2024-06-02T23:59:02.575375+0000","last_undegraded":"2024-06-02T23:59:02.575375+0000","last_fullsized":"2024-06-02T23:59:02.575375+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:14:32.146732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060508+0000","last_change":"2024-06-02T23:59:01.583225+0000","last_active":"2024-06-02T23:59:03.060508+0000","last_peered":"2024-06-02T23:59:03.060508+0000","last_clean":"2024-06-02T23:59:03.060508+0000","last_became_active":"2024-06-02T23:59:01.582821+0000","last_became_peered":"2024-06-02T23:59:01.582821+0000","last_unstale":"2024-06-02T23:59:03.060508+0000","last_undegraded":"2024-06-02T23:59:03.060508+0000","last_fullsized":"2024-06-02T23:59:03.060508+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:39:34.474565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576930+0000","last_change":"2024-06-02T23:59:00.644323+0000","last_active":"2024-06-02T23:59:02.576930+0000","last_peered":"2024-06-02T23:59:02.576930+0000","last_clean":"2024-06-02T23:59:02.576930+0000","last_became_active":"2024-06-02T23:59:00.643711+0000","last_became_peered":"2024-06-02T23:59:00.643711+0000","last_unstale":"2024-06-02T23:59:02.576930+0000","last_undegraded":"2024-06-02T23:59:02.576930+0000","last_fullsized":"2024-06-02T23:59:02.576930+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:14.457408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060046+0000","last_change":"2024-06-02T23:59:01.587791+0000","last_active":"2024-06-02T23:59:03.060046+0000","last_peered":"2024-06-02T23:59:03.060046+0000","last_clean":"2024-06-02T23:59:03.060046+0000","last_became_active":"2024-06-02T23:59:01.587445+0000","last_became_peered":"2024-06-02T23:59:01.587445+0000","last_unstale":"2024-06-02T23:59:03.060046+0000","last_undegraded":"2024-06-02T23:59:03.060046+0000","last_fullsized":"2024-06-02T23:59:03.060046+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:11:51.236204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630776+0000","last_change":"2024-06-02T23:59:00.644532+0000","last_active":"2024-06-02T23:59:02.630776+0000","last_peered":"2024-06-02T23:59:02.630776+0000","last_clean":"2024-06-02T23:59:02.630776+0000","last_became_active":"2024-06-02T23:59:00.644293+0000","last_became_peered":"2024-06-02T23:59:00.644293+0000","last_unstale":"2024-06-02T23:59:02.630776+0000","last_undegraded":"2024-06-02T23:59:02.630776+0000","last_fullsized":"2024-06-02T23:59:02.630776+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:38.716399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":349,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.632828+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:59:02.632828+0000","last_peered":"2024-06-02T23:59:02.632828+0000","last_clean":"2024-06-02T23:59:02.632828+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:59:02.632828+0000","last_undegraded":"2024-06-02T23:59:02.632828+0000","last_fullsized":"2024-06-02T23:59:02.632828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575006,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54796,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317044,"statfs":{"total":96636764160,"available":96580653056,"internally_reserved":0,"allocated":1441792,"data_stored":1011346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575006,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":421506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50052,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321788,"statfs":{"total":96636764160,"available":96585510912,"internally_reserved":0,"allocated":839680,"data_stored":420854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":843776,"data_stored":421436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":856064,"data_stored":422488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575006,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54228,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317612,"statfs":{"total":96636764160,"available":96581234688,"internally_reserved":0,"allocated":851968,"data_stored":422466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":421014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1441792,"data_stored":1011278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:59:09.965 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T23:59:10.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.077+0000 7f2a04eee640 1 Processor -- start 2024-06-02T23:59:10.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.077+0000 7f2a04eee640 1 -- start start 2024-06-02T23:59:10.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f2a04eee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 0x7f2a000c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f2a04eee640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a000b5510 0x7f2a000c8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f2a04eee640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a000d4a90 con 0x7f2a00161900 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f2a04eee640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2a000cf5c0 con 0x7f2a000b5510 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f2a04eee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a000caf70 con 0x7f2a000d1120 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f29fed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2a000b5510 0x7f2a000c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f29fe59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f2a00161900 0x7f2a000d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37340/0 (socket says 172.21.15.96:37340) 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f29fe59c640 1 -- 172.21.15.96:0/2113792914 learned_addr learned my addr 172.21.15.96:0/2113792914 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f29fdd9b640 1 --2- 172.21.15.96:0/2113792914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 0x7f2a000c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f29fed9d640 1 -- 172.21.15.96:0/2113792914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 msgr2=0x7f2a000c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f29fed9d640 1 --2- 172.21.15.96:0/2113792914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 0x7f2a000c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f29fed9d640 1 -- 172.21.15.96:0/2113792914 >> v1:172.21.15.96:6789/0 conn(0x7f2a00161900 legacy=0x7f2a000d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f29fd59a640 1 -- 172.21.15.96:0/2113792914 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1442814041 0 0) 0x7f2a000d4a90 con 0x7f2a00161900 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f29fed9d640 1 -- 172.21.15.96:0/2113792914 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a000d4d70 con 0x7f2a000b5510 2024-06-02T23:59:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.078+0000 7f29fdd9b640 1 --2- 172.21.15.96:0/2113792914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 0x7f2a000c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:10.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.079+0000 7f29fed9d640 1 --2- 172.21.15.96:0/2113792914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a000b5510 0x7f2a000c8100 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009d90 tx=0x7f29f002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d3fcd001a6ce3f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.079+0000 7f29fd59a640 1 -- 172.21.15.96:0/2113792914 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0031600 con 0x7f2a000b5510 2024-06-02T23:59:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.079+0000 7f29fd59a640 1 -- 172.21.15.96:0/2113792914 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f00317a0 con 0x7f2a000b5510 2024-06-02T23:59:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.079+0000 7f29fd59a640 1 -- 172.21.15.96:0/2113792914 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0031b70 con 0x7f2a000b5510 2024-06-02T23:59:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.080+0000 7f2a04eee640 1 -- 172.21.15.96:0/2113792914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a000b5510 msgr2=0x7f2a000c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.080+0000 7f2a04eee640 1 --2- 172.21.15.96:0/2113792914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a000b5510 0x7f2a000c8100 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009d90 tx=0x7f29f002a5d0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.080+0000 7f2a04eee640 1 -- 172.21.15.96:0/2113792914 shutdown_connections 2024-06-02T23:59:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.080+0000 7f2a04eee640 1 --2- 172.21.15.96:0/2113792914 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a000b5510 0x7f2a000c8100 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.080+0000 7f2a04eee640 1 --2- 172.21.15.96:0/2113792914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 0x7f2a000c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.080+0000 7f2a04eee640 1 -- 172.21.15.96:0/2113792914 >> 172.21.15.96:0/2113792914 conn(0x7f2a0009d3b0 msgr2=0x7f2a000d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.080+0000 7f2a04eee640 1 -- 172.21.15.96:0/2113792914 shutdown_connections 2024-06-02T23:59:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.080+0000 7f2a04eee640 1 -- 172.21.15.96:0/2113792914 wait complete. 2024-06-02T23:59:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.081+0000 7f2a04eee640 1 Processor -- start 2024-06-02T23:59:10.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.081+0000 7f2a04eee640 1 -- start start 2024-06-02T23:59:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f2a04eee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a000b5510 0x7f2a000cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f2a04eee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 0x7f2a001f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f2a04eee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a00161900 0x7f2a000b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f2a04eee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2a000d4780 con 0x7f2a00161900 2024-06-02T23:59:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f2a04eee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a000cfae0 con 0x7f2a000b5510 2024-06-02T23:59:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f2a04eee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a00161ce0 con 0x7f2a000d1120 2024-06-02T23:59:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fed9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a00161900 0x7f2a000b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fed9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a00161900 0x7f2a000b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44270/0 (socket says 172.21.15.96:44270) 2024-06-02T23:59:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fed9d640 1 -- 172.21.15.96:0/2797991310 learned_addr learned my addr 172.21.15.96:0/2797991310 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fdd9b640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 0x7f2a001f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fe59c640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a000b5510 0x7f2a000cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fed9d640 1 -- 172.21.15.96:0/2797991310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 msgr2=0x7f2a001f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fed9d640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 0x7f2a001f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fed9d640 1 -- 172.21.15.96:0/2797991310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a000b5510 msgr2=0x7f2a000cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fed9d640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a000b5510 0x7f2a000cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fed9d640 1 -- 172.21.15.96:0/2797991310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a001f4f10 con 0x7f2a00161900 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.082+0000 7f29fed9d640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a00161900 0x7f2a000b58f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009eb0 tx=0x7f29f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.083+0000 7f29f6ffd640 1 -- 172.21.15.96:0/2797991310 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0040070 con 0x7f2a00161900 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.083+0000 7f29f6ffd640 1 -- 172.21.15.96:0/2797991310 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f0030b60 con 0x7f2a00161900 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.083+0000 7f2a04eee640 1 -- 172.21.15.96:0/2797991310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a001f4950 con 0x7f2a00161900 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.083+0000 7f29f6ffd640 1 -- 172.21.15.96:0/2797991310 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0009450 con 0x7f2a00161900 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.083+0000 7f2a04eee640 1 -- 172.21.15.96:0/2797991310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a000cc230 con 0x7f2a00161900 2024-06-02T23:59:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.084+0000 7f2a04eee640 1 -- 172.21.15.96:0/2797991310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a000683e0 con 0x7f2a00161900 2024-06-02T23:59:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.084+0000 7f29f6ffd640 1 -- 172.21.15.96:0/2797991310 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f29f0039040 con 0x7f2a00161900 2024-06-02T23:59:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.085+0000 7f29f6ffd640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f29e006be30 0x7f29e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.085+0000 7f29f6ffd640 1 -- 172.21.15.96:0/2797991310 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f29f00ac700 con 0x7f2a00161900 2024-06-02T23:59:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.085+0000 7f29fe59c640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f29e006be30 0x7f29e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.085+0000 7f29fe59c640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f29e006be30 0x7f29e006e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29f8000f60 tx=0x7f29f8007c00 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:10.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.089+0000 7f29f6ffd640 1 -- 172.21.15.96:0/2797991310 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f29f007af20 con 0x7f2a00161900 2024-06-02T23:59:10.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.261+0000 7f2a04eee640 1 -- 172.21.15.96:0/2797991310 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a000d2a00 con 0x7f29e006be30 2024-06-02T23:59:10.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.267+0000 7f29f6ffd640 1 -- 172.21.15.96:0/2797991310 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251958 (secure 0 0 0) 0x7f2a000d2a00 con 0x7f29e006be30 2024-06-02T23:59:10.270 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:10.271 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-02T23:59:10.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 -- 172.21.15.96:0/2797991310 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f29e006be30 msgr2=0x7f29e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f29e006be30 0x7f29e006e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29f8000f60 tx=0x7f29f8007c00 comp rx=0 tx=0).stop 2024-06-02T23:59:10.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 -- 172.21.15.96:0/2797991310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a00161900 msgr2=0x7f2a000b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a00161900 0x7f2a000b58f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009eb0 tx=0x7f29f0004a40 comp rx=0 tx=0).stop 2024-06-02T23:59:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 -- 172.21.15.96:0/2797991310 shutdown_connections 2024-06-02T23:59:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f29e006be30 0x7f29e006e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a00161900 0x7f2a000b58f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a000d1120 0x7f2a001f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 --2- 172.21.15.96:0/2797991310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a000b5510 0x7f2a000cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 -- 172.21.15.96:0/2797991310 >> 172.21.15.96:0/2797991310 conn(0x7f2a0009d3b0 msgr2=0x7f2a000d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 -- 172.21.15.96:0/2797991310 shutdown_connections 2024-06-02T23:59:10.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.270+0000 7f2a04eee640 1 -- 172.21.15.96:0/2797991310 wait complete. 2024-06-02T23:59:10.281 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-06-02T23:59:08.497039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319716,"kb_used_data":7784,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655004,"statfs":{"total":773094113280,"available":772766724096,"internally_reserved":0,"allocated":7970816,"data_stored":4552388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.871906"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059653+0000","last_change":"2024-06-02T23:59:01.586938+0000","last_active":"2024-06-02T23:59:03.059653+0000","last_peered":"2024-06-02T23:59:03.059653+0000","last_clean":"2024-06-02T23:59:03.059653+0000","last_became_active":"2024-06-02T23:59:01.586669+0000","last_became_peered":"2024-06-02T23:59:01.586669+0000","last_unstale":"2024-06-02T23:59:03.059653+0000","last_undegraded":"2024-06-02T23:59:03.059653+0000","last_fullsized":"2024-06-02T23:59:03.059653+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:32:12.883830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633382+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-02T23:59:02.633382+0000","last_peered":"2024-06-02T23:59:02.633382+0000","last_clean":"2024-06-02T23:59:02.633382+0000","last_became_active":"2024-06-02T23:59:01.582687+0000","last_became_peered":"2024-06-02T23:59:01.582687+0000","last_unstale":"2024-06-02T23:59:02.633382+0000","last_undegraded":"2024-06-02T23:59:02.633382+0000","last_fullsized":"2024-06-02T23:59:02.633382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630645+0000","last_change":"2024-06-02T23:59:01.586233+0000","last_active":"2024-06-02T23:59:02.630645+0000","last_peered":"2024-06-02T23:59:02.630645+0000","last_clean":"2024-06-02T23:59:02.630645+0000","last_became_active":"2024-06-02T23:59:01.586006+0000","last_became_peered":"2024-06-02T23:59:01.586006+0000","last_unstale":"2024-06-02T23:59:02.630645+0000","last_undegraded":"2024-06-02T23:59:02.630645+0000","last_fullsized":"2024-06-02T23:59:02.630645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633356+0000","last_change":"2024-06-02T23:59:01.587310+0000","last_active":"2024-06-02T23:59:02.633356+0000","last_peered":"2024-06-02T23:59:02.633356+0000","last_clean":"2024-06-02T23:59:02.633356+0000","last_became_active":"2024-06-02T23:59:01.586761+0000","last_became_peered":"2024-06-02T23:59:01.586761+0000","last_unstale":"2024-06-02T23:59:02.633356+0000","last_undegraded":"2024-06-02T23:59:02.633356+0000","last_fullsized":"2024-06-02T23:59:02.633356+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575897+0000","last_change":"2024-06-02T23:59:01.583800+0000","last_active":"2024-06-02T23:59:02.575897+0000","last_peered":"2024-06-02T23:59:02.575897+0000","last_clean":"2024-06-02T23:59:02.575897+0000","last_became_active":"2024-06-02T23:59:01.581028+0000","last_became_peered":"2024-06-02T23:59:01.581028+0000","last_unstale":"2024-06-02T23:59:02.575897+0000","last_undegraded":"2024-06-02T23:59:02.575897+0000","last_fullsized":"2024-06-02T23:59:02.575897+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:25:47.061955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060103+0000","last_change":"2024-06-02T23:59:01.587296+0000","last_active":"2024-06-02T23:59:03.060103+0000","last_peered":"2024-06-02T23:59:03.060103+0000","last_clean":"2024-06-02T23:59:03.060103+0000","last_became_active":"2024-06-02T23:59:01.586996+0000","last_became_peered":"2024-06-02T23:59:01.586996+0000","last_unstale":"2024-06-02T23:59:03.060103+0000","last_undegraded":"2024-06-02T23:59:03.060103+0000","last_fullsized":"2024-06-02T23:59:03.060103+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:56:54.953142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630308+0000","last_change":"2024-06-02T23:59:01.586195+0000","last_active":"2024-06-02T23:59:02.630308+0000","last_peered":"2024-06-02T23:59:02.630308+0000","last_clean":"2024-06-02T23:59:02.630308+0000","last_became_active":"2024-06-02T23:59:01.583488+0000","last_became_peered":"2024-06-02T23:59:01.583488+0000","last_unstale":"2024-06-02T23:59:02.630308+0000","last_undegraded":"2024-06-02T23:59:02.630308+0000","last_fullsized":"2024-06-02T23:59:02.630308+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:42:09.116457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060230+0000","last_change":"2024-06-02T23:59:01.588746+0000","last_active":"2024-06-02T23:59:03.060230+0000","last_peered":"2024-06-02T23:59:03.060230+0000","last_clean":"2024-06-02T23:59:03.060230+0000","last_became_active":"2024-06-02T23:59:01.588310+0000","last_became_peered":"2024-06-02T23:59:01.588310+0000","last_unstale":"2024-06-02T23:59:03.060230+0000","last_undegraded":"2024-06-02T23:59:03.060230+0000","last_fullsized":"2024-06-02T23:59:03.060230+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:56:25.974137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060308+0000","last_change":"2024-06-02T23:59:01.592959+0000","last_active":"2024-06-02T23:59:03.060308+0000","last_peered":"2024-06-02T23:59:03.060308+0000","last_clean":"2024-06-02T23:59:03.060308+0000","last_became_active":"2024-06-02T23:59:01.592704+0000","last_became_peered":"2024-06-02T23:59:01.592704+0000","last_unstale":"2024-06-02T23:59:03.060308+0000","last_undegraded":"2024-06-02T23:59:03.060308+0000","last_fullsized":"2024-06-02T23:59:03.060308+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:57:55.310878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059569+0000","last_change":"2024-06-02T23:59:01.589283+0000","last_active":"2024-06-02T23:59:03.059569+0000","last_peered":"2024-06-02T23:59:03.059569+0000","last_clean":"2024-06-02T23:59:03.059569+0000","last_became_active":"2024-06-02T23:59:01.588961+0000","last_became_peered":"2024-06-02T23:59:01.588961+0000","last_unstale":"2024-06-02T23:59:03.059569+0000","last_undegraded":"2024-06-02T23:59:03.059569+0000","last_fullsized":"2024-06-02T23:59:03.059569+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:09:42.099307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060255+0000","last_change":"2024-06-02T23:59:01.583139+0000","last_active":"2024-06-02T23:59:03.060255+0000","last_peered":"2024-06-02T23:59:03.060255+0000","last_clean":"2024-06-02T23:59:03.060255+0000","last_became_active":"2024-06-02T23:59:01.582876+0000","last_became_peered":"2024-06-02T23:59:01.582876+0000","last_unstale":"2024-06-02T23:59:03.060255+0000","last_undegraded":"2024-06-02T23:59:03.060255+0000","last_fullsized":"2024-06-02T23:59:03.060255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.666135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060765+0000","last_change":"2024-06-02T23:59:01.589336+0000","last_active":"2024-06-02T23:59:03.060765+0000","last_peered":"2024-06-02T23:59:03.060765+0000","last_clean":"2024-06-02T23:59:03.060765+0000","last_became_active":"2024-06-02T23:59:01.589067+0000","last_became_peered":"2024-06-02T23:59:01.589067+0000","last_unstale":"2024-06-02T23:59:03.060765+0000","last_undegraded":"2024-06-02T23:59:03.060765+0000","last_fullsized":"2024-06-02T23:59:03.060765+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:49:36.524901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060282+0000","last_change":"2024-06-02T23:59:01.591325+0000","last_active":"2024-06-02T23:59:03.060282+0000","last_peered":"2024-06-02T23:59:03.060282+0000","last_clean":"2024-06-02T23:59:03.060282+0000","last_became_active":"2024-06-02T23:59:01.590545+0000","last_became_peered":"2024-06-02T23:59:01.590545+0000","last_unstale":"2024-06-02T23:59:03.060282+0000","last_undegraded":"2024-06-02T23:59:03.060282+0000","last_fullsized":"2024-06-02T23:59:03.060282+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:17.184163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630430+0000","last_change":"2024-06-02T23:59:01.583413+0000","last_active":"2024-06-02T23:59:02.630430+0000","last_peered":"2024-06-02T23:59:02.630430+0000","last_clean":"2024-06-02T23:59:02.630430+0000","last_became_active":"2024-06-02T23:59:01.582568+0000","last_became_peered":"2024-06-02T23:59:01.582568+0000","last_unstale":"2024-06-02T23:59:02.630430+0000","last_undegraded":"2024-06-02T23:59:02.630430+0000","last_fullsized":"2024-06-02T23:59:02.630430+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:45.895866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633100+0000","last_change":"2024-06-02T23:59:01.591575+0000","last_active":"2024-06-02T23:59:02.633100+0000","last_peered":"2024-06-02T23:59:02.633100+0000","last_clean":"2024-06-02T23:59:02.633100+0000","last_became_active":"2024-06-02T23:59:01.591265+0000","last_became_peered":"2024-06-02T23:59:01.591265+0000","last_unstale":"2024-06-02T23:59:02.633100+0000","last_undegraded":"2024-06-02T23:59:02.633100+0000","last_fullsized":"2024-06-02T23:59:02.633100+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059944+0000","last_change":"2024-06-02T23:59:01.590700+0000","last_active":"2024-06-02T23:59:03.059944+0000","last_peered":"2024-06-02T23:59:03.059944+0000","last_clean":"2024-06-02T23:59:03.059944+0000","last_became_active":"2024-06-02T23:59:01.590445+0000","last_became_peered":"2024-06-02T23:59:01.590445+0000","last_unstale":"2024-06-02T23:59:03.059944+0000","last_undegraded":"2024-06-02T23:59:03.059944+0000","last_fullsized":"2024-06-02T23:59:03.059944+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:31.933956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630857+0000","last_change":"2024-06-02T23:59:01.587034+0000","last_active":"2024-06-02T23:59:02.630857+0000","last_peered":"2024-06-02T23:59:02.630857+0000","last_clean":"2024-06-02T23:59:02.630857+0000","last_became_active":"2024-06-02T23:59:01.586784+0000","last_became_peered":"2024-06-02T23:59:01.586784+0000","last_unstale":"2024-06-02T23:59:02.630857+0000","last_undegraded":"2024-06-02T23:59:02.630857+0000","last_fullsized":"2024-06-02T23:59:02.630857+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:10.502903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633429+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-02T23:59:02.633429+0000","last_peered":"2024-06-02T23:59:02.633429+0000","last_clean":"2024-06-02T23:59:02.633429+0000","last_became_active":"2024-06-02T23:59:01.582680+0000","last_became_peered":"2024-06-02T23:59:01.582680+0000","last_unstale":"2024-06-02T23:59:02.633429+0000","last_undegraded":"2024-06-02T23:59:02.633429+0000","last_fullsized":"2024-06-02T23:59:02.633429+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630692+0000","last_change":"2024-06-02T23:59:01.582684+0000","last_active":"2024-06-02T23:59:02.630692+0000","last_peered":"2024-06-02T23:59:02.630692+0000","last_clean":"2024-06-02T23:59:02.630692+0000","last_became_active":"2024-06-02T23:59:01.582422+0000","last_became_peered":"2024-06-02T23:59:01.582422+0000","last_unstale":"2024-06-02T23:59:02.630692+0000","last_undegraded":"2024-06-02T23:59:02.630692+0000","last_fullsized":"2024-06-02T23:59:02.630692+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:06.674997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060298+0000","last_change":"2024-06-02T23:59:01.591052+0000","last_active":"2024-06-02T23:59:03.060298+0000","last_peered":"2024-06-02T23:59:03.060298+0000","last_clean":"2024-06-02T23:59:03.060298+0000","last_became_active":"2024-06-02T23:59:01.590601+0000","last_became_peered":"2024-06-02T23:59:01.590601+0000","last_unstale":"2024-06-02T23:59:03.060298+0000","last_undegraded":"2024-06-02T23:59:03.060298+0000","last_fullsized":"2024-06-02T23:59:03.060298+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:29:55.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060108+0000","last_change":"2024-06-02T23:59:01.593871+0000","last_active":"2024-06-02T23:59:03.060108+0000","last_peered":"2024-06-02T23:59:03.060108+0000","last_clean":"2024-06-02T23:59:03.060108+0000","last_became_active":"2024-06-02T23:59:01.593596+0000","last_became_peered":"2024-06-02T23:59:01.593596+0000","last_unstale":"2024-06-02T23:59:03.060108+0000","last_undegraded":"2024-06-02T23:59:03.060108+0000","last_fullsized":"2024-06-02T23:59:03.060108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:35:33.955552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059702+0000","last_change":"2024-06-02T23:59:01.587899+0000","last_active":"2024-06-02T23:59:03.059702+0000","last_peered":"2024-06-02T23:59:03.059702+0000","last_clean":"2024-06-02T23:59:03.059702+0000","last_became_active":"2024-06-02T23:59:01.587641+0000","last_became_peered":"2024-06-02T23:59:01.587641+0000","last_unstale":"2024-06-02T23:59:03.059702+0000","last_undegraded":"2024-06-02T23:59:03.059702+0000","last_fullsized":"2024-06-02T23:59:03.059702+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:24:09.334139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059577+0000","last_change":"2024-06-02T23:59:01.584645+0000","last_active":"2024-06-02T23:59:03.059577+0000","last_peered":"2024-06-02T23:59:03.059577+0000","last_clean":"2024-06-02T23:59:03.059577+0000","last_became_active":"2024-06-02T23:59:01.584358+0000","last_became_peered":"2024-06-02T23:59:01.584358+0000","last_unstale":"2024-06-02T23:59:03.059577+0000","last_undegraded":"2024-06-02T23:59:03.059577+0000","last_fullsized":"2024-06-02T23:59:03.059577+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:31:25.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630261+0000","last_change":"2024-06-02T23:59:01.583175+0000","last_active":"2024-06-02T23:59:02.630261+0000","last_peered":"2024-06-02T23:59:02.630261+0000","last_clean":"2024-06-02T23:59:02.630261+0000","last_became_active":"2024-06-02T23:59:01.582904+0000","last_became_peered":"2024-06-02T23:59:01.582904+0000","last_unstale":"2024-06-02T23:59:02.630261+0000","last_undegraded":"2024-06-02T23:59:02.630261+0000","last_fullsized":"2024-06-02T23:59:02.630261+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:56:06.478241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630856+0000","last_change":"2024-06-02T23:59:01.591616+0000","last_active":"2024-06-02T23:59:02.630856+0000","last_peered":"2024-06-02T23:59:02.630856+0000","last_clean":"2024-06-02T23:59:02.630856+0000","last_became_active":"2024-06-02T23:59:01.589760+0000","last_became_peered":"2024-06-02T23:59:01.589760+0000","last_unstale":"2024-06-02T23:59:02.630856+0000","last_undegraded":"2024-06-02T23:59:02.630856+0000","last_fullsized":"2024-06-02T23:59:02.630856+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:29.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059749+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-02T23:59:03.059749+0000","last_peered":"2024-06-02T23:59:03.059749+0000","last_clean":"2024-06-02T23:59:03.059749+0000","last_became_active":"2024-06-02T23:59:01.585010+0000","last_became_peered":"2024-06-02T23:59:01.585010+0000","last_unstale":"2024-06-02T23:59:03.059749+0000","last_undegraded":"2024-06-02T23:59:03.059749+0000","last_fullsized":"2024-06-02T23:59:03.059749+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:50:01.657005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060416+0000","last_change":"2024-06-02T23:59:01.593067+0000","last_active":"2024-06-02T23:59:03.060416+0000","last_peered":"2024-06-02T23:59:03.060416+0000","last_clean":"2024-06-02T23:59:03.060416+0000","last_became_active":"2024-06-02T23:59:01.592789+0000","last_became_peered":"2024-06-02T23:59:01.592789+0000","last_unstale":"2024-06-02T23:59:03.060416+0000","last_undegraded":"2024-06-02T23:59:03.060416+0000","last_fullsized":"2024-06-02T23:59:03.060416+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:25:47.061955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060387+0000","last_change":"2024-06-02T23:59:01.591460+0000","last_active":"2024-06-02T23:59:03.060387+0000","last_peered":"2024-06-02T23:59:03.060387+0000","last_clean":"2024-06-02T23:59:03.060387+0000","last_became_active":"2024-06-02T23:59:01.590827+0000","last_became_peered":"2024-06-02T23:59:01.590827+0000","last_unstale":"2024-06-02T23:59:03.060387+0000","last_undegraded":"2024-06-02T23:59:03.060387+0000","last_fullsized":"2024-06-02T23:59:03.060387+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:27.044276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630396+0000","last_change":"2024-06-02T23:59:01.589715+0000","last_active":"2024-06-02T23:59:02.630396+0000","last_peered":"2024-06-02T23:59:02.630396+0000","last_clean":"2024-06-02T23:59:02.630396+0000","last_became_active":"2024-06-02T23:59:01.589456+0000","last_became_peered":"2024-06-02T23:59:01.589456+0000","last_unstale":"2024-06-02T23:59:02.630396+0000","last_undegraded":"2024-06-02T23:59:02.630396+0000","last_fullsized":"2024-06-02T23:59:02.630396+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:36.510898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633107+0000","last_change":"2024-06-02T23:59:01.589048+0000","last_active":"2024-06-02T23:59:02.633107+0000","last_peered":"2024-06-02T23:59:02.633107+0000","last_clean":"2024-06-02T23:59:02.633107+0000","last_became_active":"2024-06-02T23:59:01.588773+0000","last_became_peered":"2024-06-02T23:59:01.588773+0000","last_unstale":"2024-06-02T23:59:02.633107+0000","last_undegraded":"2024-06-02T23:59:02.633107+0000","last_fullsized":"2024-06-02T23:59:02.633107+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630395+0000","last_change":"2024-06-02T23:59:01.586433+0000","last_active":"2024-06-02T23:59:02.630395+0000","last_peered":"2024-06-02T23:59:02.630395+0000","last_clean":"2024-06-02T23:59:02.630395+0000","last_became_active":"2024-06-02T23:59:01.585466+0000","last_became_peered":"2024-06-02T23:59:01.585466+0000","last_unstale":"2024-06-02T23:59:02.630395+0000","last_undegraded":"2024-06-02T23:59:02.630395+0000","last_fullsized":"2024-06-02T23:59:02.630395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:24:38.083153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576665+0000","last_change":"2024-06-02T23:59:01.586007+0000","last_active":"2024-06-02T23:59:02.576665+0000","last_peered":"2024-06-02T23:59:02.576665+0000","last_clean":"2024-06-02T23:59:02.576665+0000","last_became_active":"2024-06-02T23:59:01.585721+0000","last_became_peered":"2024-06-02T23:59:01.585721+0000","last_unstale":"2024-06-02T23:59:02.576665+0000","last_undegraded":"2024-06-02T23:59:02.576665+0000","last_fullsized":"2024-06-02T23:59:02.576665+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:50:41.714294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.632891+0000","last_change":"2024-06-02T23:59:01.582009+0000","last_active":"2024-06-02T23:59:02.632891+0000","last_peered":"2024-06-02T23:59:02.632891+0000","last_clean":"2024-06-02T23:59:02.632891+0000","last_became_active":"2024-06-02T23:59:01.581438+0000","last_became_peered":"2024-06-02T23:59:01.581438+0000","last_unstale":"2024-06-02T23:59:02.632891+0000","last_undegraded":"2024-06-02T23:59:02.632891+0000","last_fullsized":"2024-06-02T23:59:02.632891+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"69'4","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060187+0000","last_change":"2024-06-02T23:59:00.647990+0000","last_active":"2024-06-02T23:59:03.060187+0000","last_peered":"2024-06-02T23:59:03.060187+0000","last_clean":"2024-06-02T23:59:03.060187+0000","last_became_active":"2024-06-02T23:59:00.647031+0000","last_became_peered":"2024-06-02T23:59:00.647031+0000","last_unstale":"2024-06-02T23:59:03.060187+0000","last_undegraded":"2024-06-02T23:59:03.060187+0000","last_fullsized":"2024-06-02T23:59:03.060187+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:19:44.864617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576622+0000","last_change":"2024-06-02T23:59:01.587104+0000","last_active":"2024-06-02T23:59:02.576622+0000","last_peered":"2024-06-02T23:59:02.576622+0000","last_clean":"2024-06-02T23:59:02.576622+0000","last_became_active":"2024-06-02T23:59:01.586813+0000","last_became_peered":"2024-06-02T23:59:01.586813+0000","last_unstale":"2024-06-02T23:59:02.576622+0000","last_undegraded":"2024-06-02T23:59:02.576622+0000","last_fullsized":"2024-06-02T23:59:02.576622+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:10:37.679556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059625+0000","last_change":"2024-06-02T23:59:00.638860+0000","last_active":"2024-06-02T23:59:03.059625+0000","last_peered":"2024-06-02T23:59:03.059625+0000","last_clean":"2024-06-02T23:59:03.059625+0000","last_became_active":"2024-06-02T23:59:00.638579+0000","last_became_peered":"2024-06-02T23:59:00.638579+0000","last_unstale":"2024-06-02T23:59:03.059625+0000","last_undegraded":"2024-06-02T23:59:03.059625+0000","last_fullsized":"2024-06-02T23:59:03.059625+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:57:25.113202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060234+0000","last_change":"2024-06-02T23:59:01.593795+0000","last_active":"2024-06-02T23:59:03.060234+0000","last_peered":"2024-06-02T23:59:03.060234+0000","last_clean":"2024-06-02T23:59:03.060234+0000","last_became_active":"2024-06-02T23:59:01.593506+0000","last_became_peered":"2024-06-02T23:59:01.593506+0000","last_unstale":"2024-06-02T23:59:03.060234+0000","last_undegraded":"2024-06-02T23:59:03.060234+0000","last_fullsized":"2024-06-02T23:59:03.060234+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:51.301800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060456+0000","last_change":"2024-06-02T23:59:00.648871+0000","last_active":"2024-06-02T23:59:03.060456+0000","last_peered":"2024-06-02T23:59:03.060456+0000","last_clean":"2024-06-02T23:59:03.060456+0000","last_became_active":"2024-06-02T23:59:00.648667+0000","last_became_peered":"2024-06-02T23:59:00.648667+0000","last_unstale":"2024-06-02T23:59:03.060456+0000","last_undegraded":"2024-06-02T23:59:03.060456+0000","last_fullsized":"2024-06-02T23:59:03.060456+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:11:50.234565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060693+0000","last_change":"2024-06-02T23:59:01.585466+0000","last_active":"2024-06-02T23:59:03.060693+0000","last_peered":"2024-06-02T23:59:03.060693+0000","last_clean":"2024-06-02T23:59:03.060693+0000","last_became_active":"2024-06-02T23:59:01.585127+0000","last_became_peered":"2024-06-02T23:59:01.585127+0000","last_unstale":"2024-06-02T23:59:03.060693+0000","last_undegraded":"2024-06-02T23:59:03.060693+0000","last_fullsized":"2024-06-02T23:59:03.060693+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:23:32.778002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576698+0000","last_change":"2024-06-02T23:59:00.642417+0000","last_active":"2024-06-02T23:59:02.576698+0000","last_peered":"2024-06-02T23:59:02.576698+0000","last_clean":"2024-06-02T23:59:02.576698+0000","last_became_active":"2024-06-02T23:59:00.642182+0000","last_became_peered":"2024-06-02T23:59:00.642182+0000","last_unstale":"2024-06-02T23:59:02.576698+0000","last_undegraded":"2024-06-02T23:59:02.576698+0000","last_fullsized":"2024-06-02T23:59:02.576698+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:48.372998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575665+0000","last_change":"2024-06-02T23:59:01.589753+0000","last_active":"2024-06-02T23:59:02.575665+0000","last_peered":"2024-06-02T23:59:02.575665+0000","last_clean":"2024-06-02T23:59:02.575665+0000","last_became_active":"2024-06-02T23:59:01.588602+0000","last_became_peered":"2024-06-02T23:59:01.588602+0000","last_unstale":"2024-06-02T23:59:02.575665+0000","last_undegraded":"2024-06-02T23:59:02.575665+0000","last_fullsized":"2024-06-02T23:59:02.575665+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:17.184163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630342+0000","last_change":"2024-06-02T23:59:00.641231+0000","last_active":"2024-06-02T23:59:02.630342+0000","last_peered":"2024-06-02T23:59:02.630342+0000","last_clean":"2024-06-02T23:59:02.630342+0000","last_became_active":"2024-06-02T23:59:00.640963+0000","last_became_peered":"2024-06-02T23:59:00.640963+0000","last_unstale":"2024-06-02T23:59:02.630342+0000","last_undegraded":"2024-06-02T23:59:02.630342+0000","last_fullsized":"2024-06-02T23:59:02.630342+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.148246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633271+0000","last_change":"2024-06-02T23:59:01.591548+0000","last_active":"2024-06-02T23:59:02.633271+0000","last_peered":"2024-06-02T23:59:02.633271+0000","last_clean":"2024-06-02T23:59:02.633271+0000","last_became_active":"2024-06-02T23:59:01.591198+0000","last_became_peered":"2024-06-02T23:59:01.591198+0000","last_unstale":"2024-06-02T23:59:02.633271+0000","last_undegraded":"2024-06-02T23:59:02.633271+0000","last_fullsized":"2024-06-02T23:59:02.633271+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575887+0000","last_change":"2024-06-02T23:59:00.649120+0000","last_active":"2024-06-02T23:59:02.575887+0000","last_peered":"2024-06-02T23:59:02.575887+0000","last_clean":"2024-06-02T23:59:02.575887+0000","last_became_active":"2024-06-02T23:59:00.648839+0000","last_became_peered":"2024-06-02T23:59:00.648839+0000","last_unstale":"2024-06-02T23:59:02.575887+0000","last_undegraded":"2024-06-02T23:59:02.575887+0000","last_fullsized":"2024-06-02T23:59:02.575887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:52:08.529881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059989+0000","last_change":"2024-06-02T23:59:01.585288+0000","last_active":"2024-06-02T23:59:03.059989+0000","last_peered":"2024-06-02T23:59:03.059989+0000","last_clean":"2024-06-02T23:59:03.059989+0000","last_became_active":"2024-06-02T23:59:01.584971+0000","last_became_peered":"2024-06-02T23:59:01.584971+0000","last_unstale":"2024-06-02T23:59:03.059989+0000","last_undegraded":"2024-06-02T23:59:03.059989+0000","last_fullsized":"2024-06-02T23:59:03.059989+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:54:54.767840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060129+0000","last_change":"2024-06-02T23:59:00.648200+0000","last_active":"2024-06-02T23:59:03.060129+0000","last_peered":"2024-06-02T23:59:03.060129+0000","last_clean":"2024-06-02T23:59:03.060129+0000","last_became_active":"2024-06-02T23:59:00.647175+0000","last_became_peered":"2024-06-02T23:59:00.647175+0000","last_unstale":"2024-06-02T23:59:03.060129+0000","last_undegraded":"2024-06-02T23:59:03.060129+0000","last_fullsized":"2024-06-02T23:59:03.060129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:34:43.239731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633315+0000","last_change":"2024-06-02T23:59:01.593060+0000","last_active":"2024-06-02T23:59:02.633315+0000","last_peered":"2024-06-02T23:59:02.633315+0000","last_clean":"2024-06-02T23:59:02.633315+0000","last_became_active":"2024-06-02T23:59:01.592710+0000","last_became_peered":"2024-06-02T23:59:01.592710+0000","last_unstale":"2024-06-02T23:59:02.633315+0000","last_undegraded":"2024-06-02T23:59:02.633315+0000","last_fullsized":"2024-06-02T23:59:02.633315+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:06.674997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630204+0000","last_change":"2024-06-02T23:59:00.647400+0000","last_active":"2024-06-02T23:59:02.630204+0000","last_peered":"2024-06-02T23:59:02.630204+0000","last_clean":"2024-06-02T23:59:02.630204+0000","last_became_active":"2024-06-02T23:59:00.647210+0000","last_became_peered":"2024-06-02T23:59:00.647210+0000","last_unstale":"2024-06-02T23:59:02.630204+0000","last_undegraded":"2024-06-02T23:59:02.630204+0000","last_fullsized":"2024-06-02T23:59:02.630204+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:13.009966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575384+0000","last_change":"2024-06-02T23:59:01.587444+0000","last_active":"2024-06-02T23:59:02.575384+0000","last_peered":"2024-06-02T23:59:02.575384+0000","last_clean":"2024-06-02T23:59:02.575384+0000","last_became_active":"2024-06-02T23:59:01.587190+0000","last_became_peered":"2024-06-02T23:59:01.587190+0000","last_unstale":"2024-06-02T23:59:02.575384+0000","last_undegraded":"2024-06-02T23:59:02.575384+0000","last_fullsized":"2024-06-02T23:59:02.575384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:56:54.953142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633174+0000","last_change":"2024-06-02T23:59:00.637111+0000","last_active":"2024-06-02T23:59:02.633174+0000","last_peered":"2024-06-02T23:59:02.633174+0000","last_clean":"2024-06-02T23:59:02.633174+0000","last_became_active":"2024-06-02T23:59:00.636815+0000","last_became_peered":"2024-06-02T23:59:00.636815+0000","last_unstale":"2024-06-02T23:59:02.633174+0000","last_undegraded":"2024-06-02T23:59:02.633174+0000","last_fullsized":"2024-06-02T23:59:02.633174+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:52:39.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576726+0000","last_change":"2024-06-02T23:59:01.585862+0000","last_active":"2024-06-02T23:59:02.576726+0000","last_peered":"2024-06-02T23:59:02.576726+0000","last_clean":"2024-06-02T23:59:02.576726+0000","last_became_active":"2024-06-02T23:59:01.585128+0000","last_became_peered":"2024-06-02T23:59:01.585128+0000","last_unstale":"2024-06-02T23:59:02.576726+0000","last_undegraded":"2024-06-02T23:59:02.576726+0000","last_fullsized":"2024-06-02T23:59:02.576726+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:28:18.588571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575858+0000","last_change":"2024-06-02T23:59:00.644991+0000","last_active":"2024-06-02T23:59:02.575858+0000","last_peered":"2024-06-02T23:59:02.575858+0000","last_clean":"2024-06-02T23:59:02.575858+0000","last_became_active":"2024-06-02T23:59:00.644759+0000","last_became_peered":"2024-06-02T23:59:00.644759+0000","last_unstale":"2024-06-02T23:59:02.575858+0000","last_undegraded":"2024-06-02T23:59:02.575858+0000","last_fullsized":"2024-06-02T23:59:02.575858+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:26.313713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630475+0000","last_change":"2024-06-02T23:59:01.590250+0000","last_active":"2024-06-02T23:59:02.630475+0000","last_peered":"2024-06-02T23:59:02.630475+0000","last_clean":"2024-06-02T23:59:02.630475+0000","last_became_active":"2024-06-02T23:59:01.589942+0000","last_became_peered":"2024-06-02T23:59:01.589942+0000","last_unstale":"2024-06-02T23:59:02.630475+0000","last_undegraded":"2024-06-02T23:59:02.630475+0000","last_fullsized":"2024-06-02T23:59:02.630475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"69'3","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633356+0000","last_change":"2024-06-02T23:59:00.644405+0000","last_active":"2024-06-02T23:59:02.633356+0000","last_peered":"2024-06-02T23:59:02.633356+0000","last_clean":"2024-06-02T23:59:02.633356+0000","last_became_active":"2024-06-02T23:59:00.643978+0000","last_became_peered":"2024-06-02T23:59:00.643978+0000","last_unstale":"2024-06-02T23:59:02.633356+0000","last_undegraded":"2024-06-02T23:59:02.633356+0000","last_fullsized":"2024-06-02T23:59:02.633356+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:16:38.404329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575831+0000","last_change":"2024-06-02T23:59:01.574661+0000","last_active":"2024-06-02T23:59:02.575831+0000","last_peered":"2024-06-02T23:59:02.575831+0000","last_clean":"2024-06-02T23:59:02.575831+0000","last_became_active":"2024-06-02T23:59:01.574347+0000","last_became_peered":"2024-06-02T23:59:01.574347+0000","last_unstale":"2024-06-02T23:59:02.575831+0000","last_undegraded":"2024-06-02T23:59:02.575831+0000","last_fullsized":"2024-06-02T23:59:02.575831+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:24.094731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"69'6","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060810+0000","last_change":"2024-06-02T23:59:00.638966+0000","last_active":"2024-06-02T23:59:03.060810+0000","last_peered":"2024-06-02T23:59:03.060810+0000","last_clean":"2024-06-02T23:59:03.060810+0000","last_became_active":"2024-06-02T23:59:00.638716+0000","last_became_peered":"2024-06-02T23:59:00.638716+0000","last_unstale":"2024-06-02T23:59:03.060810+0000","last_undegraded":"2024-06-02T23:59:03.060810+0000","last_fullsized":"2024-06-02T23:59:03.060810+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:28.207234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576597+0000","last_change":"2024-06-02T23:59:01.584960+0000","last_active":"2024-06-02T23:59:02.576597+0000","last_peered":"2024-06-02T23:59:02.576597+0000","last_clean":"2024-06-02T23:59:02.576597+0000","last_became_active":"2024-06-02T23:59:01.584575+0000","last_became_peered":"2024-06-02T23:59:01.584575+0000","last_unstale":"2024-06-02T23:59:02.576597+0000","last_undegraded":"2024-06-02T23:59:02.576597+0000","last_fullsized":"2024-06-02T23:59:02.576597+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:00:08.310863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630456+0000","last_change":"2024-06-02T23:59:00.645893+0000","last_active":"2024-06-02T23:59:02.630456+0000","last_peered":"2024-06-02T23:59:02.630456+0000","last_clean":"2024-06-02T23:59:02.630456+0000","last_became_active":"2024-06-02T23:59:00.645639+0000","last_became_peered":"2024-06-02T23:59:00.645639+0000","last_unstale":"2024-06-02T23:59:02.630456+0000","last_undegraded":"2024-06-02T23:59:02.630456+0000","last_fullsized":"2024-06-02T23:59:02.630456+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:01:07.347079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630792+0000","last_change":"2024-06-02T23:59:01.589530+0000","last_active":"2024-06-02T23:59:02.630792+0000","last_peered":"2024-06-02T23:59:02.630792+0000","last_clean":"2024-06-02T23:59:02.630792+0000","last_became_active":"2024-06-02T23:59:01.589024+0000","last_became_peered":"2024-06-02T23:59:01.589024+0000","last_unstale":"2024-06-02T23:59:02.630792+0000","last_undegraded":"2024-06-02T23:59:02.630792+0000","last_fullsized":"2024-06-02T23:59:02.630792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060154+0000","last_change":"2024-06-02T23:59:00.647783+0000","last_active":"2024-06-02T23:59:03.060154+0000","last_peered":"2024-06-02T23:59:03.060154+0000","last_clean":"2024-06-02T23:59:03.060154+0000","last_became_active":"2024-06-02T23:59:00.647500+0000","last_became_peered":"2024-06-02T23:59:00.647500+0000","last_unstale":"2024-06-02T23:59:03.060154+0000","last_undegraded":"2024-06-02T23:59:03.060154+0000","last_fullsized":"2024-06-02T23:59:03.060154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:55:32.977530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059939+0000","last_change":"2024-06-02T23:59:01.582611+0000","last_active":"2024-06-02T23:59:03.059939+0000","last_peered":"2024-06-02T23:59:03.059939+0000","last_clean":"2024-06-02T23:59:03.059939+0000","last_became_active":"2024-06-02T23:59:01.582343+0000","last_became_peered":"2024-06-02T23:59:01.582343+0000","last_unstale":"2024-06-02T23:59:03.059939+0000","last_undegraded":"2024-06-02T23:59:03.059939+0000","last_fullsized":"2024-06-02T23:59:03.059939+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:34:05.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633194+0000","last_change":"2024-06-02T23:59:00.648669+0000","last_active":"2024-06-02T23:59:02.633194+0000","last_peered":"2024-06-02T23:59:02.633194+0000","last_clean":"2024-06-02T23:59:02.633194+0000","last_became_active":"2024-06-02T23:59:00.647777+0000","last_became_peered":"2024-06-02T23:59:00.647777+0000","last_unstale":"2024-06-02T23:59:02.633194+0000","last_undegraded":"2024-06-02T23:59:02.633194+0000","last_fullsized":"2024-06-02T23:59:02.633194+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:05:23.931542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630773+0000","last_change":"2024-06-02T23:59:01.593580+0000","last_active":"2024-06-02T23:59:02.630773+0000","last_peered":"2024-06-02T23:59:02.630773+0000","last_clean":"2024-06-02T23:59:02.630773+0000","last_became_active":"2024-06-02T23:59:01.593303+0000","last_became_peered":"2024-06-02T23:59:01.593303+0000","last_unstale":"2024-06-02T23:59:02.630773+0000","last_undegraded":"2024-06-02T23:59:02.630773+0000","last_fullsized":"2024-06-02T23:59:02.630773+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"69'8","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060399+0000","last_change":"2024-06-02T23:59:00.645230+0000","last_active":"2024-06-02T23:59:03.060399+0000","last_peered":"2024-06-02T23:59:03.060399+0000","last_clean":"2024-06-02T23:59:03.060399+0000","last_became_active":"2024-06-02T23:59:00.644964+0000","last_became_peered":"2024-06-02T23:59:00.644964+0000","last_unstale":"2024-06-02T23:59:03.060399+0000","last_undegraded":"2024-06-02T23:59:03.060399+0000","last_fullsized":"2024-06-02T23:59:03.060399+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:05.673357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060354+0000","last_change":"2024-06-02T23:59:01.582894+0000","last_active":"2024-06-02T23:59:03.060354+0000","last_peered":"2024-06-02T23:59:03.060354+0000","last_clean":"2024-06-02T23:59:03.060354+0000","last_became_active":"2024-06-02T23:59:01.581160+0000","last_became_peered":"2024-06-02T23:59:01.581160+0000","last_unstale":"2024-06-02T23:59:03.060354+0000","last_undegraded":"2024-06-02T23:59:03.060354+0000","last_fullsized":"2024-06-02T23:59:03.060354+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:52:00.630032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630887+0000","last_change":"2024-06-02T23:59:00.644263+0000","last_active":"2024-06-02T23:59:02.630887+0000","last_peered":"2024-06-02T23:59:02.630887+0000","last_clean":"2024-06-02T23:59:02.630887+0000","last_became_active":"2024-06-02T23:59:00.644014+0000","last_became_peered":"2024-06-02T23:59:00.644014+0000","last_unstale":"2024-06-02T23:59:02.630887+0000","last_undegraded":"2024-06-02T23:59:02.630887+0000","last_fullsized":"2024-06-02T23:59:02.630887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:40:21.019637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059891+0000","last_change":"2024-06-02T23:59:01.593089+0000","last_active":"2024-06-02T23:59:03.059891+0000","last_peered":"2024-06-02T23:59:03.059891+0000","last_clean":"2024-06-02T23:59:03.059891+0000","last_became_active":"2024-06-02T23:59:01.592800+0000","last_became_peered":"2024-06-02T23:59:01.592800+0000","last_unstale":"2024-06-02T23:59:03.059891+0000","last_undegraded":"2024-06-02T23:59:03.059891+0000","last_fullsized":"2024-06-02T23:59:03.059891+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:07.188102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060377+0000","last_change":"2024-06-02T23:59:00.636429+0000","last_active":"2024-06-02T23:59:03.060377+0000","last_peered":"2024-06-02T23:59:03.060377+0000","last_clean":"2024-06-02T23:59:03.060377+0000","last_became_active":"2024-06-02T23:59:00.636161+0000","last_became_peered":"2024-06-02T23:59:00.636161+0000","last_unstale":"2024-06-02T23:59:03.060377+0000","last_undegraded":"2024-06-02T23:59:03.060377+0000","last_fullsized":"2024-06-02T23:59:03.060377+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:45:33.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575559+0000","last_change":"2024-06-02T23:59:01.588676+0000","last_active":"2024-06-02T23:59:02.575559+0000","last_peered":"2024-06-02T23:59:02.575559+0000","last_clean":"2024-06-02T23:59:02.575559+0000","last_became_active":"2024-06-02T23:59:01.588372+0000","last_became_peered":"2024-06-02T23:59:01.588372+0000","last_unstale":"2024-06-02T23:59:02.575559+0000","last_undegraded":"2024-06-02T23:59:02.575559+0000","last_fullsized":"2024-06-02T23:59:02.575559+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:29:13.698815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060272+0000","last_change":"2024-06-02T23:59:00.646728+0000","last_active":"2024-06-02T23:59:03.060272+0000","last_peered":"2024-06-02T23:59:03.060272+0000","last_clean":"2024-06-02T23:59:03.060272+0000","last_became_active":"2024-06-02T23:59:00.646290+0000","last_became_peered":"2024-06-02T23:59:00.646290+0000","last_unstale":"2024-06-02T23:59:03.060272+0000","last_undegraded":"2024-06-02T23:59:03.060272+0000","last_fullsized":"2024-06-02T23:59:03.060272+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:55.805472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060408+0000","last_change":"2024-06-02T23:59:01.590261+0000","last_active":"2024-06-02T23:59:03.060408+0000","last_peered":"2024-06-02T23:59:03.060408+0000","last_clean":"2024-06-02T23:59:03.060408+0000","last_became_active":"2024-06-02T23:59:01.590016+0000","last_became_peered":"2024-06-02T23:59:01.590016+0000","last_unstale":"2024-06-02T23:59:03.060408+0000","last_undegraded":"2024-06-02T23:59:03.060408+0000","last_fullsized":"2024-06-02T23:59:03.060408+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:24.094731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060367+0000","last_change":"2024-06-02T23:59:00.647565+0000","last_active":"2024-06-02T23:59:03.060367+0000","last_peered":"2024-06-02T23:59:03.060367+0000","last_clean":"2024-06-02T23:59:03.060367+0000","last_became_active":"2024-06-02T23:59:00.647144+0000","last_became_peered":"2024-06-02T23:59:00.647144+0000","last_unstale":"2024-06-02T23:59:03.060367+0000","last_undegraded":"2024-06-02T23:59:03.060367+0000","last_fullsized":"2024-06-02T23:59:03.060367+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:14.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576913+0000","last_change":"2024-06-02T23:59:01.579062+0000","last_active":"2024-06-02T23:59:02.576913+0000","last_peered":"2024-06-02T23:59:02.576913+0000","last_clean":"2024-06-02T23:59:02.576913+0000","last_became_active":"2024-06-02T23:59:01.578711+0000","last_became_peered":"2024-06-02T23:59:01.578711+0000","last_unstale":"2024-06-02T23:59:02.576913+0000","last_undegraded":"2024-06-02T23:59:02.576913+0000","last_fullsized":"2024-06-02T23:59:02.576913+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:10.046785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060453+0000","last_change":"2024-06-02T23:59:00.638071+0000","last_active":"2024-06-02T23:59:03.060453+0000","last_peered":"2024-06-02T23:59:03.060453+0000","last_clean":"2024-06-02T23:59:03.060453+0000","last_became_active":"2024-06-02T23:59:00.637806+0000","last_became_peered":"2024-06-02T23:59:00.637806+0000","last_unstale":"2024-06-02T23:59:03.060453+0000","last_undegraded":"2024-06-02T23:59:03.060453+0000","last_fullsized":"2024-06-02T23:59:03.060453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:25.851075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060302+0000","last_change":"2024-06-02T23:59:01.591902+0000","last_active":"2024-06-02T23:59:03.060302+0000","last_peered":"2024-06-02T23:59:03.060302+0000","last_clean":"2024-06-02T23:59:03.060302+0000","last_became_active":"2024-06-02T23:59:01.590949+0000","last_became_peered":"2024-06-02T23:59:01.590949+0000","last_unstale":"2024-06-02T23:59:03.060302+0000","last_undegraded":"2024-06-02T23:59:03.060302+0000","last_fullsized":"2024-06-02T23:59:03.060302+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:11.888454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059756+0000","last_change":"2024-06-02T23:59:00.640128+0000","last_active":"2024-06-02T23:59:03.059756+0000","last_peered":"2024-06-02T23:59:03.059756+0000","last_clean":"2024-06-02T23:59:03.059756+0000","last_became_active":"2024-06-02T23:59:00.639852+0000","last_became_peered":"2024-06-02T23:59:00.639852+0000","last_unstale":"2024-06-02T23:59:03.059756+0000","last_undegraded":"2024-06-02T23:59:03.059756+0000","last_fullsized":"2024-06-02T23:59:03.059756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:07.421496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630719+0000","last_change":"2024-06-02T23:59:01.588002+0000","last_active":"2024-06-02T23:59:02.630719+0000","last_peered":"2024-06-02T23:59:02.630719+0000","last_clean":"2024-06-02T23:59:02.630719+0000","last_became_active":"2024-06-02T23:59:01.587734+0000","last_became_peered":"2024-06-02T23:59:01.587734+0000","last_unstale":"2024-06-02T23:59:02.630719+0000","last_undegraded":"2024-06-02T23:59:02.630719+0000","last_fullsized":"2024-06-02T23:59:02.630719+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630363+0000","last_change":"2024-06-02T23:59:00.643318+0000","last_active":"2024-06-02T23:59:02.630363+0000","last_peered":"2024-06-02T23:59:02.630363+0000","last_clean":"2024-06-02T23:59:02.630363+0000","last_became_active":"2024-06-02T23:59:00.643062+0000","last_became_peered":"2024-06-02T23:59:00.643062+0000","last_unstale":"2024-06-02T23:59:02.630363+0000","last_undegraded":"2024-06-02T23:59:02.630363+0000","last_fullsized":"2024-06-02T23:59:02.630363+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:25:50.830339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059792+0000","last_change":"2024-06-02T23:59:01.586699+0000","last_active":"2024-06-02T23:59:03.059792+0000","last_peered":"2024-06-02T23:59:03.059792+0000","last_clean":"2024-06-02T23:59:03.059792+0000","last_became_active":"2024-06-02T23:59:01.586401+0000","last_became_peered":"2024-06-02T23:59:01.586401+0000","last_unstale":"2024-06-02T23:59:03.059792+0000","last_undegraded":"2024-06-02T23:59:03.059792+0000","last_fullsized":"2024-06-02T23:59:03.059792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:12:10.532874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059357+0000","last_change":"2024-06-02T23:59:00.635754+0000","last_active":"2024-06-02T23:59:03.059357+0000","last_peered":"2024-06-02T23:59:03.059357+0000","last_clean":"2024-06-02T23:59:03.059357+0000","last_became_active":"2024-06-02T23:59:00.635444+0000","last_became_peered":"2024-06-02T23:59:00.635444+0000","last_unstale":"2024-06-02T23:59:03.059357+0000","last_undegraded":"2024-06-02T23:59:03.059357+0000","last_fullsized":"2024-06-02T23:59:03.059357+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:54:08.565345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576770+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-02T23:59:02.576770+0000","last_peered":"2024-06-02T23:59:02.576770+0000","last_clean":"2024-06-02T23:59:02.576770+0000","last_became_active":"2024-06-02T23:59:01.584978+0000","last_became_peered":"2024-06-02T23:59:01.584978+0000","last_unstale":"2024-06-02T23:59:02.576770+0000","last_undegraded":"2024-06-02T23:59:02.576770+0000","last_fullsized":"2024-06-02T23:59:02.576770+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:21:15.601996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060142+0000","last_change":"2024-06-02T23:59:00.647401+0000","last_active":"2024-06-02T23:59:03.060142+0000","last_peered":"2024-06-02T23:59:03.060142+0000","last_clean":"2024-06-02T23:59:03.060142+0000","last_became_active":"2024-06-02T23:59:00.647038+0000","last_became_peered":"2024-06-02T23:59:00.647038+0000","last_unstale":"2024-06-02T23:59:03.060142+0000","last_undegraded":"2024-06-02T23:59:03.060142+0000","last_fullsized":"2024-06-02T23:59:03.060142+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:49:28.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060231+0000","last_change":"2024-06-02T23:59:01.587184+0000","last_active":"2024-06-02T23:59:03.060231+0000","last_peered":"2024-06-02T23:59:03.060231+0000","last_clean":"2024-06-02T23:59:03.060231+0000","last_became_active":"2024-06-02T23:59:01.586774+0000","last_became_peered":"2024-06-02T23:59:01.586774+0000","last_unstale":"2024-06-02T23:59:03.060231+0000","last_undegraded":"2024-06-02T23:59:03.060231+0000","last_fullsized":"2024-06-02T23:59:03.060231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:29:13.698815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.633402+0000","last_change":"2024-06-02T23:59:00.641736+0000","last_active":"2024-06-02T23:59:02.633402+0000","last_peered":"2024-06-02T23:59:02.633402+0000","last_clean":"2024-06-02T23:59:02.633402+0000","last_became_active":"2024-06-02T23:59:00.640889+0000","last_became_peered":"2024-06-02T23:59:00.640889+0000","last_unstale":"2024-06-02T23:59:02.633402+0000","last_undegraded":"2024-06-02T23:59:02.633402+0000","last_fullsized":"2024-06-02T23:59:02.633402+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:35.892006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060768+0000","last_change":"2024-06-02T23:59:01.589758+0000","last_active":"2024-06-02T23:59:03.060768+0000","last_peered":"2024-06-02T23:59:03.060768+0000","last_clean":"2024-06-02T23:59:03.060768+0000","last_became_active":"2024-06-02T23:59:01.588438+0000","last_became_peered":"2024-06-02T23:59:01.588438+0000","last_unstale":"2024-06-02T23:59:03.060768+0000","last_undegraded":"2024-06-02T23:59:03.060768+0000","last_fullsized":"2024-06-02T23:59:03.060768+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:19.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630499+0000","last_change":"2024-06-02T23:59:00.644933+0000","last_active":"2024-06-02T23:59:02.630499+0000","last_peered":"2024-06-02T23:59:02.630499+0000","last_clean":"2024-06-02T23:59:02.630499+0000","last_became_active":"2024-06-02T23:59:00.644680+0000","last_became_peered":"2024-06-02T23:59:00.644680+0000","last_unstale":"2024-06-02T23:59:02.630499+0000","last_undegraded":"2024-06-02T23:59:02.630499+0000","last_fullsized":"2024-06-02T23:59:02.630499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:10:07.936871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630520+0000","last_change":"2024-06-02T23:59:01.589967+0000","last_active":"2024-06-02T23:59:02.630520+0000","last_peered":"2024-06-02T23:59:02.630520+0000","last_clean":"2024-06-02T23:59:02.630520+0000","last_became_active":"2024-06-02T23:59:01.589146+0000","last_became_peered":"2024-06-02T23:59:01.589146+0000","last_unstale":"2024-06-02T23:59:02.630520+0000","last_undegraded":"2024-06-02T23:59:02.630520+0000","last_fullsized":"2024-06-02T23:59:02.630520+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060737+0000","last_change":"2024-06-02T23:59:00.642493+0000","last_active":"2024-06-02T23:59:03.060737+0000","last_peered":"2024-06-02T23:59:03.060737+0000","last_clean":"2024-06-02T23:59:03.060737+0000","last_became_active":"2024-06-02T23:59:00.642225+0000","last_became_peered":"2024-06-02T23:59:00.642225+0000","last_unstale":"2024-06-02T23:59:03.060737+0000","last_undegraded":"2024-06-02T23:59:03.060737+0000","last_fullsized":"2024-06-02T23:59:03.060737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:09.501263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576841+0000","last_change":"2024-06-02T23:59:01.584170+0000","last_active":"2024-06-02T23:59:02.576841+0000","last_peered":"2024-06-02T23:59:02.576841+0000","last_clean":"2024-06-02T23:59:02.576841+0000","last_became_active":"2024-06-02T23:59:01.583901+0000","last_became_peered":"2024-06-02T23:59:01.583901+0000","last_unstale":"2024-06-02T23:59:02.576841+0000","last_undegraded":"2024-06-02T23:59:02.576841+0000","last_fullsized":"2024-06-02T23:59:02.576841+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:22:32.595470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.059878+0000","last_change":"2024-06-02T23:59:00.644379+0000","last_active":"2024-06-02T23:59:03.059878+0000","last_peered":"2024-06-02T23:59:03.059878+0000","last_clean":"2024-06-02T23:59:03.059878+0000","last_became_active":"2024-06-02T23:59:00.644115+0000","last_became_peered":"2024-06-02T23:59:00.644115+0000","last_unstale":"2024-06-02T23:59:03.059878+0000","last_undegraded":"2024-06-02T23:59:03.059878+0000","last_fullsized":"2024-06-02T23:59:03.059878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:01.768574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630683+0000","last_change":"2024-06-02T23:59:01.587439+0000","last_active":"2024-06-02T23:59:02.630683+0000","last_peered":"2024-06-02T23:59:02.630683+0000","last_clean":"2024-06-02T23:59:02.630683+0000","last_became_active":"2024-06-02T23:59:01.587147+0000","last_became_peered":"2024-06-02T23:59:01.587147+0000","last_unstale":"2024-06-02T23:59:02.630683+0000","last_undegraded":"2024-06-02T23:59:02.630683+0000","last_fullsized":"2024-06-02T23:59:02.630683+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.575375+0000","last_change":"2024-06-02T23:59:00.643747+0000","last_active":"2024-06-02T23:59:02.575375+0000","last_peered":"2024-06-02T23:59:02.575375+0000","last_clean":"2024-06-02T23:59:02.575375+0000","last_became_active":"2024-06-02T23:59:00.643445+0000","last_became_peered":"2024-06-02T23:59:00.643445+0000","last_unstale":"2024-06-02T23:59:02.575375+0000","last_undegraded":"2024-06-02T23:59:02.575375+0000","last_fullsized":"2024-06-02T23:59:02.575375+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:14:32.146732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060508+0000","last_change":"2024-06-02T23:59:01.583225+0000","last_active":"2024-06-02T23:59:03.060508+0000","last_peered":"2024-06-02T23:59:03.060508+0000","last_clean":"2024-06-02T23:59:03.060508+0000","last_became_active":"2024-06-02T23:59:01.582821+0000","last_became_peered":"2024-06-02T23:59:01.582821+0000","last_unstale":"2024-06-02T23:59:03.060508+0000","last_undegraded":"2024-06-02T23:59:03.060508+0000","last_fullsized":"2024-06-02T23:59:03.060508+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:39:34.474565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.576930+0000","last_change":"2024-06-02T23:59:00.644323+0000","last_active":"2024-06-02T23:59:02.576930+0000","last_peered":"2024-06-02T23:59:02.576930+0000","last_clean":"2024-06-02T23:59:02.576930+0000","last_became_active":"2024-06-02T23:59:00.643711+0000","last_became_peered":"2024-06-02T23:59:00.643711+0000","last_unstale":"2024-06-02T23:59:02.576930+0000","last_undegraded":"2024-06-02T23:59:02.576930+0000","last_fullsized":"2024-06-02T23:59:02.576930+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:14.457408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:03.060046+0000","last_change":"2024-06-02T23:59:01.587791+0000","last_active":"2024-06-02T23:59:03.060046+0000","last_peered":"2024-06-02T23:59:03.060046+0000","last_clean":"2024-06-02T23:59:03.060046+0000","last_became_active":"2024-06-02T23:59:01.587445+0000","last_became_peered":"2024-06-02T23:59:01.587445+0000","last_unstale":"2024-06-02T23:59:03.060046+0000","last_undegraded":"2024-06-02T23:59:03.060046+0000","last_fullsized":"2024-06-02T23:59:03.060046+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:11:51.236204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.630776+0000","last_change":"2024-06-02T23:59:00.644532+0000","last_active":"2024-06-02T23:59:02.630776+0000","last_peered":"2024-06-02T23:59:02.630776+0000","last_clean":"2024-06-02T23:59:02.630776+0000","last_became_active":"2024-06-02T23:59:00.644293+0000","last_became_peered":"2024-06-02T23:59:00.644293+0000","last_unstale":"2024-06-02T23:59:02.630776+0000","last_undegraded":"2024-06-02T23:59:02.630776+0000","last_fullsized":"2024-06-02T23:59:02.630776+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:38.716399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":349,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-06-02T23:59:02.632828+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-02T23:59:02.632828+0000","last_peered":"2024-06-02T23:59:02.632828+0000","last_clean":"2024-06-02T23:59:02.632828+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-02T23:59:02.632828+0000","last_undegraded":"2024-06-02T23:59:02.632828+0000","last_fullsized":"2024-06-02T23:59:02.632828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575006,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54796,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317044,"statfs":{"total":96636764160,"available":96580653056,"internally_reserved":0,"allocated":1441792,"data_stored":1011346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575006,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":421506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50052,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321788,"statfs":{"total":96636764160,"available":96585510912,"internally_reserved":0,"allocated":839680,"data_stored":420854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":843776,"data_stored":421436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":856064,"data_stored":422488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575006,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54228,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317612,"statfs":{"total":96636764160,"available":96581234688,"internally_reserved":0,"allocated":851968,"data_stored":422466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":847872,"data_stored":421014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1441792,"data_stored":1011278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T23:59:10.285 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-02T23:59:10.286 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-06-02T23:59:10.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.428+0000 7f1466fd5640 1 Processor -- start 2024-06-02T23:59:10.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.428+0000 7f1466fd5640 1 -- start start 2024-06-02T23:59:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.428+0000 7f1466fd5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f146015fc40 0x7f1460071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.428+0000 7f1466fd5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600729e0 0x7f1460160020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.428+0000 7f1466fd5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1460160560 con 0x7f146006ec50 2024-06-02T23:59:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.428+0000 7f1466fd5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f14600718f0 con 0x7f146015fc40 2024-06-02T23:59:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.428+0000 7f1466fd5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1460072fa0 con 0x7f14600729e0 2024-06-02T23:59:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.429+0000 7f1464d71640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f146015fc40 0x7f1460071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.429+0000 7f1465572640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f146006ec50 0x7f14600ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37352/0 (socket says 172.21.15.96:37352) 2024-06-02T23:59:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.429+0000 7f1465572640 1 -- 172.21.15.96:0/3787623273 learned_addr learned my addr 172.21.15.96:0/3787623273 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:59:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.429+0000 7f1464d71640 1 -- 172.21.15.96:0/3787623273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600729e0 msgr2=0x7f1460160020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-02T23:59:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.429+0000 7f1464d71640 1 --2- 172.21.15.96:0/3787623273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600729e0 0x7f1460160020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.429+0000 7f1464d71640 1 -- 172.21.15.96:0/3787623273 >> v1:172.21.15.96:6789/0 conn(0x7f146006ec50 legacy=0x7f14600ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.429+0000 7f145f7fe640 1 -- 172.21.15.96:0/3787623273 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79550423 0 0) 0x7f1460160560 con 0x7f146006ec50 2024-06-02T23:59:10.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.429+0000 7f1464d71640 1 -- 172.21.15.96:0/3787623273 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14600712a0 con 0x7f146015fc40 2024-06-02T23:59:10.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f1464d71640 1 --2- 172.21.15.96:0/3787623273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015fc40 0x7f1460071d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f14540097a0 tx=0x7f145402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6761fdc4073058f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:10.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f145f7fe640 1 -- 172.21.15.96:0/3787623273 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454037070 con 0x7f146015fc40 2024-06-02T23:59:10.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f145f7fe640 1 -- 172.21.15.96:0/3787623273 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1454032440 con 0x7f146015fc40 2024-06-02T23:59:10.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f145f7fe640 1 -- 172.21.15.96:0/3787623273 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454032810 con 0x7f146015fc40 2024-06-02T23:59:10.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f1466fd5640 1 -- 172.21.15.96:0/3787623273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015fc40 msgr2=0x7f1460071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f1466fd5640 1 --2- 172.21.15.96:0/3787623273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015fc40 0x7f1460071d80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f14540097a0 tx=0x7f145402a1a0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f1466fd5640 1 -- 172.21.15.96:0/3787623273 shutdown_connections 2024-06-02T23:59:10.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f1466fd5640 1 --2- 172.21.15.96:0/3787623273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600729e0 0x7f1460160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f1466fd5640 1 --2- 172.21.15.96:0/3787623273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146015fc40 0x7f1460071d80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f1466fd5640 1 -- 172.21.15.96:0/3787623273 >> 172.21.15.96:0/3787623273 conn(0x7f14600cfcb0 msgr2=0x7f14600d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:10.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f1466fd5640 1 -- 172.21.15.96:0/3787623273 shutdown_connections 2024-06-02T23:59:10.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.430+0000 7f1466fd5640 1 -- 172.21.15.96:0/3787623273 wait complete. 2024-06-02T23:59:10.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.431+0000 7f1466fd5640 1 Processor -- start 2024-06-02T23:59:10.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.431+0000 7f1466fd5640 1 -- start start 2024-06-02T23:59:10.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.432+0000 7f1466fd5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146006ec50 0x7f14600c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.432+0000 7f1466fd5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600729e0 0x7f1460143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.432+0000 7f1466fd5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f146015fc40 0x7f14600c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.432+0000 7f1466fd5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f146006f240 con 0x7f146006ec50 2024-06-02T23:59:10.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.432+0000 7f1466fd5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f146006f0c0 con 0x7f146015fc40 2024-06-02T23:59:10.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.432+0000 7f1466fd5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14600caa10 con 0x7f14600729e0 2024-06-02T23:59:10.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.432+0000 7f1464d71640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146006ec50 0x7f14600c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.432+0000 7f1464d71640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146006ec50 0x7f14600c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44280/0 (socket says 172.21.15.96:44280) 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.432+0000 7f1464d71640 1 -- 172.21.15.96:0/1685512194 learned_addr learned my addr 172.21.15.96:0/1685512194 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f1464d71640 1 -- 172.21.15.96:0/1685512194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600729e0 msgr2=0x7f1460143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f1464d71640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600729e0 0x7f1460143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f1464d71640 1 -- 172.21.15.96:0/1685512194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f146015fc40 msgr2=0x7f14600c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f1464d71640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f146015fc40 0x7f14600c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f1464d71640 1 -- 172.21.15.96:0/1685512194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1460144240 con 0x7f146006ec50 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f1464d71640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146006ec50 0x7f14600c6240 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f14540098c0 tx=0x7f14540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f145d7fa640 1 -- 172.21.15.96:0/1685512194 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454037040 con 0x7f146006ec50 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f145d7fa640 1 -- 172.21.15.96:0/1685512194 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1454042070 con 0x7f146006ec50 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f145d7fa640 1 -- 172.21.15.96:0/1685512194 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454030a50 con 0x7f146006ec50 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f1466fd5640 1 -- 172.21.15.96:0/1685512194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1460144520 con 0x7f146006ec50 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.433+0000 7f1466fd5640 1 -- 172.21.15.96:0/1685512194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14600c6780 con 0x7f146006ec50 2024-06-02T23:59:10.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.434+0000 7f1466fd5640 1 -- 172.21.15.96:0/1685512194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14600683e0 con 0x7f146006ec50 2024-06-02T23:59:10.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.434+0000 7f145d7fa640 1 -- 172.21.15.96:0/1685512194 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f1454030bf0 con 0x7f146006ec50 2024-06-02T23:59:10.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.435+0000 7f145d7fa640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f144406be30 0x7f144406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.435+0000 7f145ffff640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f144406be30 0x7f144406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.435+0000 7f145d7fa640 1 -- 172.21.15.96:0/1685512194 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f14540abac0 con 0x7f146006ec50 2024-06-02T23:59:10.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.435+0000 7f145ffff640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f144406be30 0x7f144406e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f146015ac40 tx=0x7f144c006c40 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:10.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.439+0000 7f145d7fa640 1 -- 172.21.15.96:0/1685512194 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1454045360 con 0x7f146006ec50 2024-06-02T23:59:10.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.683+0000 7f1466fd5640 1 -- 172.21.15.96:0/1685512194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1460071f20 con 0x7f146006ec50 2024-06-02T23:59:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.687+0000 7f145d7fa640 1 -- 172.21.15.96:0/1685512194 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f145407a2e0 con 0x7f146006ec50 2024-06-02T23:59:10.687 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-06-02T23:59:10.688 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQAYBF1mSH5jKRAAiBQXUb900fop4NegNAGVlQ== 2024-06-02T23:59:10.688 INFO:teuthology.orchestra.run.smithi096.stdout: caps mds = "allow" 2024-06-02T23:59:10.688 INFO:teuthology.orchestra.run.smithi096.stdout: caps mon = "allow r" 2024-06-02T23:59:10.688 INFO:teuthology.orchestra.run.smithi096.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-06-02T23:59:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:updated caps for client.0 2024-06-02T23:59:10.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 -- 172.21.15.96:0/1685512194 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f144406be30 msgr2=0x7f144406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f144406be30 0x7f144406e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f146015ac40 tx=0x7f144c006c40 comp rx=0 tx=0).stop 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 -- 172.21.15.96:0/1685512194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146006ec50 msgr2=0x7f14600c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146006ec50 0x7f14600c6240 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f14540098c0 tx=0x7f14540046c0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 -- 172.21.15.96:0/1685512194 shutdown_connections 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f144406be30 0x7f144406e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f146015fc40 0x7f14600c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14600729e0 0x7f1460143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 --2- 172.21.15.96:0/1685512194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f146006ec50 0x7f14600c6240 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 -- 172.21.15.96:0/1685512194 >> 172.21.15.96:0/1685512194 conn(0x7f14600cfcb0 msgr2=0x7f14600d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 -- 172.21.15.96:0/1685512194 shutdown_connections 2024-06-02T23:59:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.689+0000 7f1466fd5640 1 -- 172.21.15.96:0/1685512194 wait complete. 2024-06-02T23:59:10.700 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T23:59:10.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.799+0000 7f3894b4f640 1 Processor -- start 2024-06-02T23:59:10.799 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.799+0000 7f3894b4f640 1 -- start start 2024-06-02T23:59:10.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f3894b4f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3890155570 0x7f389006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f3894b4f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38900cad30 0x7f3890072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f3894b4f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3890155950 con 0x7f389006eb50 2024-06-02T23:59:10.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f3894b4f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f38900cb2e0 con 0x7f3890155570 2024-06-02T23:59:10.802 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f3894b4f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f38900cb5c0 con 0x7f38900cad30 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f388e59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3890155570 0x7f389006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f388e59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3890155570 0x7f389006e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44284/0 (socket says 172.21.15.96:44284) 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f388e59c640 1 -- 172.21.15.96:0/1322857719 learned_addr learned my addr 172.21.15.96:0/1322857719 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f388ed9d640 1 --2- 172.21.15.96:0/1322857719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38900cad30 0x7f3890072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f388e59c640 1 -- 172.21.15.96:0/1322857719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38900cad30 msgr2=0x7f3890072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f388e59c640 1 --2- 172.21.15.96:0/1322857719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38900cad30 0x7f3890072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f388e59c640 1 -- 172.21.15.96:0/1322857719 >> v1:172.21.15.162:6789/0 conn(0x7f389006eb50 legacy=0x7f38900ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.800+0000 7f388e59c640 1 -- 172.21.15.96:0/1322857719 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38900cb8a0 con 0x7f3890155570 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.801+0000 7f388e59c640 1 --2- 172.21.15.96:0/1322857719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3890155570 0x7f389006e610 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f388000bb10 tx=0x7f388002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661ee85655d4dbda server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.801+0000 7f388dd9b640 1 -- 172.21.15.96:0/1322857719 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880036020 con 0x7f3890155570 2024-06-02T23:59:10.803 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.801+0000 7f388dd9b640 1 -- 172.21.15.96:0/1322857719 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3880032820 con 0x7f3890155570 2024-06-02T23:59:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.801+0000 7f388dd9b640 1 -- 172.21.15.96:0/1322857719 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880032bf0 con 0x7f3890155570 2024-06-02T23:59:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.802+0000 7f3894b4f640 1 -- 172.21.15.96:0/1322857719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3890155570 msgr2=0x7f389006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.802+0000 7f3894b4f640 1 --2- 172.21.15.96:0/1322857719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3890155570 0x7f389006e610 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f388000bb10 tx=0x7f388002c920 comp rx=0 tx=0).stop 2024-06-02T23:59:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.802+0000 7f3894b4f640 1 -- 172.21.15.96:0/1322857719 shutdown_connections 2024-06-02T23:59:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.802+0000 7f3894b4f640 1 --2- 172.21.15.96:0/1322857719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38900cad30 0x7f3890072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.802+0000 7f3894b4f640 1 --2- 172.21.15.96:0/1322857719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3890155570 0x7f389006e610 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.802+0000 7f3894b4f640 1 -- 172.21.15.96:0/1322857719 >> 172.21.15.96:0/1322857719 conn(0x7f38900cfc30 msgr2=0x7f38900d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.802+0000 7f3894b4f640 1 -- 172.21.15.96:0/1322857719 shutdown_connections 2024-06-02T23:59:10.804 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.802+0000 7f3894b4f640 1 -- 172.21.15.96:0/1322857719 wait complete. 2024-06-02T23:59:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.803+0000 7f3894b4f640 1 Processor -- start 2024-06-02T23:59:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.803+0000 7f3894b4f640 1 -- start start 2024-06-02T23:59:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f3894b4f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f389006eb50 0x7f389015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f3894b4f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38900cad30 0x7f389015d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f3894b4f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3890155570 0x7f38901f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f3894b4f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f3890072560 con 0x7f389006eb50 2024-06-02T23:59:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f3894b4f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38900717d0 con 0x7f38900cad30 2024-06-02T23:59:10.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f3894b4f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f38900726e0 con 0x7f3890155570 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f389006eb50 0x7f389015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f389006eb50 0x7f389015ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44286/0 (socket says 172.21.15.96:44286) 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388e59c640 1 -- 172.21.15.96:0/917251491 learned_addr learned my addr 172.21.15.96:0/917251491 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388ed9d640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3890155570 0x7f38901f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f3887fff640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38900cad30 0x7f389015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388e59c640 1 -- 172.21.15.96:0/917251491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3890155570 msgr2=0x7f38901f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388e59c640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3890155570 0x7f38901f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388e59c640 1 -- 172.21.15.96:0/917251491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38900cad30 msgr2=0x7f389015d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388e59c640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38900cad30 0x7f389015d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388e59c640 1 -- 172.21.15.96:0/917251491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38901f4270 con 0x7f389006eb50 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388ed9d640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3890155570 0x7f38901f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:10.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f3887fff640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38900cad30 0x7f389015d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:10.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.804+0000 7f388e59c640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f389006eb50 0x7f389015ed90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f388002c960 tx=0x7f38800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:10.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.805+0000 7f3886ffd640 1 -- 172.21.15.96:0/917251491 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880036040 con 0x7f389006eb50 2024-06-02T23:59:10.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.805+0000 7f3886ffd640 1 -- 172.21.15.96:0/917251491 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388003bd60 con 0x7f389006eb50 2024-06-02T23:59:10.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.805+0000 7f3894b4f640 1 -- 172.21.15.96:0/917251491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389015f400 con 0x7f389006eb50 2024-06-02T23:59:10.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.805+0000 7f3886ffd640 1 -- 172.21.15.96:0/917251491 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880045610 con 0x7f389006eb50 2024-06-02T23:59:10.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.805+0000 7f3894b4f640 1 -- 172.21.15.96:0/917251491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389015c970 con 0x7f389006eb50 2024-06-02T23:59:10.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.806+0000 7f3894b4f640 1 -- 172.21.15.96:0/917251491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38900683e0 con 0x7f389006eb50 2024-06-02T23:59:10.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.806+0000 7f3886ffd640 1 -- 172.21.15.96:0/917251491 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f388004c060 con 0x7f389006eb50 2024-06-02T23:59:10.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.806+0000 7f3886ffd640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f387006be60 0x7f387006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:10.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.806+0000 7f3886ffd640 1 -- 172.21.15.96:0/917251491 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f38800ae170 con 0x7f389006eb50 2024-06-02T23:59:10.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.806+0000 7f3887fff640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f387006be60 0x7f387006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:10.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.807+0000 7f3887fff640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f387006be60 0x7f387006e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f38900cbed0 tx=0x7f3878009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:10.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:10.811+0000 7f3886ffd640 1 -- 172.21.15.96:0/917251491 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f3880040070 con 0x7f389006eb50 2024-06-02T23:59:11.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.018+0000 7f3894b4f640 1 -- 172.21.15.96:0/917251491 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38900c9b10 con 0x7f389006eb50 2024-06-02T23:59:11.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.019+0000 7f3886ffd640 1 -- 172.21.15.96:0/917251491 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5187 (secure 0 0 0) 0x7f388002f070 con 0x7f389006eb50 2024-06-02T23:59:11.019 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-02T23:59:11.019 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2232659491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2232659491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2232659491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1347815459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1347815459},{"type":"v1","addr":"172.21.15.162:6833","nonce":1347815459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6833/2486518149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":2486518149},{"type":"v1","addr":"172.21.15.96:6833","nonce":2486518149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:59:00.972277+0000","modified":"2024-06-02T23:59:03.921466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5739":{"gid":5739,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6835/2309601772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2309601772},{"type":"v1","addr":"172.21.15.96:6835","nonce":2309601772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5739,"qdb_cluster":[5739]},"id":3}]} 2024-06-02T23:59:11.019 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 25 2024-06-02T23:59:11.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 -- 172.21.15.96:0/917251491 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f387006be60 msgr2=0x7f387006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f387006be60 0x7f387006e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f38900cbed0 tx=0x7f3878009040 comp rx=0 tx=0).stop 2024-06-02T23:59:11.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 -- 172.21.15.96:0/917251491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f389006eb50 msgr2=0x7f389015ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f389006eb50 0x7f389015ed90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f388002c960 tx=0x7f38800046c0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 -- 172.21.15.96:0/917251491 shutdown_connections 2024-06-02T23:59:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f387006be60 0x7f387006e320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3890155570 0x7f38901f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38900cad30 0x7f389015d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 --2- 172.21.15.96:0/917251491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f389006eb50 0x7f389015ed90 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 -- 172.21.15.96:0/917251491 >> 172.21.15.96:0/917251491 conn(0x7f38900cfc30 msgr2=0x7f38900cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 -- 172.21.15.96:0/917251491 shutdown_connections 2024-06-02T23:59:11.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.021+0000 7f3894b4f640 1 -- 172.21.15.96:0/917251491 wait complete. 2024-06-02T23:59:11.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-02T23:59:00.972277+0000', 'modified': '2024-06-02T23:59:03.921466+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5739}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5739': {'gid': 5739, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.96:6835/2309601772', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6834', 'nonce': 2309601772}, {'type': 'v1', 'addr': '172.21.15.96:6835', 'nonce': 2309601772}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5739, 'qdb_cluster': [5739]} 2024-06-02T23:59:11.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-02T23:59:11.436 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-06-02T23:59:11.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.537+0000 7fcf6fb89640 1 Processor -- start 2024-06-02T23:59:11.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.538+0000 7fcf6fb89640 1 -- start start 2024-06-02T23:59:11.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.538+0000 7fcf6fb89640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf68155570 0x7fcf6806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.538+0000 7fcf6fb89640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcf6806eb50 0x7fcf680ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.538+0000 7fcf6fb89640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcf680cab60 0x7fcf6815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.538+0000 7fcf6fb89640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6806efb0 con 0x7fcf680cab60 2024-06-02T23:59:11.539 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.538+0000 7fcf6fb89640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcf68155950 con 0x7fcf6806eb50 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.538+0000 7fcf6fb89640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680cb2e0 con 0x7fcf68155570 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.539+0000 7fcf6e126640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcf680cab60 0x7fcf6815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.539+0000 7fcf6e126640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcf680cab60 0x7fcf6815eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44294/0 (socket says 172.21.15.96:44294) 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.539+0000 7fcf6e126640 1 -- 172.21.15.96:0/710286655 learned_addr learned my addr 172.21.15.96:0/710286655 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.539+0000 7fcf6d925640 1 --2- 172.21.15.96:0/710286655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf68155570 0x7fcf6806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.539+0000 7fcf6d124640 1 --2- 172.21.15.96:0/710286655 >> v2:172.21.15.162:3300/0 conn(0x7fcf6806eb50 0x7fcf680ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.539+0000 7fcf6e126640 1 -- 172.21.15.96:0/710286655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf68155570 msgr2=0x7fcf6806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.539+0000 7fcf6e126640 1 --2- 172.21.15.96:0/710286655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf68155570 0x7fcf6806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.539+0000 7fcf6e126640 1 -- 172.21.15.96:0/710286655 >> v2:172.21.15.162:3300/0 conn(0x7fcf6806eb50 msgr2=0x7fcf680ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.539+0000 7fcf6e126640 1 --2- 172.21.15.96:0/710286655 >> v2:172.21.15.162:3300/0 conn(0x7fcf6806eb50 0x7fcf680ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.539+0000 7fcf6e126640 1 -- 172.21.15.96:0/710286655 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf680cb5c0 con 0x7fcf680cab60 2024-06-02T23:59:11.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6e126640 1 --2- 172.21.15.96:0/710286655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf680cab60 0x7fcf6815eab0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcf6806ca30 tx=0x7fcf6002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df853e31cb5b899 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6c923640 1 -- 172.21.15.96:0/710286655 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60036070 con 0x7fcf680cab60 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6c923640 1 -- 172.21.15.96:0/710286655 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf60031600 con 0x7fcf680cab60 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6c923640 1 -- 172.21.15.96:0/710286655 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf600319d0 con 0x7fcf680cab60 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6fb89640 1 -- 172.21.15.96:0/710286655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf680cab60 msgr2=0x7fcf6815eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6fb89640 1 --2- 172.21.15.96:0/710286655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf680cab60 0x7fcf6815eab0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcf6806ca30 tx=0x7fcf6002a6a0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6fb89640 1 -- 172.21.15.96:0/710286655 shutdown_connections 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6fb89640 1 --2- 172.21.15.96:0/710286655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf680cab60 0x7fcf6815eab0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6fb89640 1 --2- 172.21.15.96:0/710286655 >> v2:172.21.15.162:3300/0 conn(0x7fcf6806eb50 0x7fcf680ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6fb89640 1 --2- 172.21.15.96:0/710286655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf68155570 0x7fcf6806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6fb89640 1 -- 172.21.15.96:0/710286655 >> 172.21.15.96:0/710286655 conn(0x7fcf680cfc30 msgr2=0x7fcf680d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6fb89640 1 -- 172.21.15.96:0/710286655 shutdown_connections 2024-06-02T23:59:11.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.540+0000 7fcf6fb89640 1 -- 172.21.15.96:0/710286655 wait complete. 2024-06-02T23:59:11.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6fb89640 1 Processor -- start 2024-06-02T23:59:11.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6fb89640 1 -- start start 2024-06-02T23:59:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6fb89640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf6806eb50 0x7fcf681e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6fb89640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf680cab60 0x7fcf68150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6fb89640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf68155570 0x7fcf68151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6fb89640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680caff0 con 0x7fcf68155570 2024-06-02T23:59:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6fb89640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68071b00 con 0x7fcf680cab60 2024-06-02T23:59:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6fb89640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680717d0 con 0x7fcf6806eb50 2024-06-02T23:59:11.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6e126640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf68155570 0x7fcf68151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6e126640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf68155570 0x7fcf68151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44306/0 (socket says 172.21.15.96:44306) 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6e126640 1 -- 172.21.15.96:0/1005081568 learned_addr learned my addr 172.21.15.96:0/1005081568 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6d925640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf6806eb50 0x7fcf681e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.542+0000 7fcf6d124640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf680cab60 0x7fcf68150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf6e126640 1 -- 172.21.15.96:0/1005081568 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf6806eb50 msgr2=0x7fcf681e6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf6e126640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf6806eb50 0x7fcf681e6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf6e126640 1 -- 172.21.15.96:0/1005081568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf680cab60 msgr2=0x7fcf68150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf6e126640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf680cab60 0x7fcf68150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf6e126640 1 -- 172.21.15.96:0/1005081568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf681e5b40 con 0x7fcf68155570 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf6e126640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf68155570 0x7fcf68151f00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcf60034040 tx=0x7fcf60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf5a7fc640 1 -- 172.21.15.96:0/1005081568 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60041020 con 0x7fcf68155570 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf5a7fc640 1 -- 172.21.15.96:0/1005081568 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf600077a0 con 0x7fcf68155570 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf5a7fc640 1 -- 172.21.15.96:0/1005081568 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60036040 con 0x7fcf68155570 2024-06-02T23:59:11.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf6fb89640 1 -- 172.21.15.96:0/1005081568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf681e5e20 con 0x7fcf68155570 2024-06-02T23:59:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.543+0000 7fcf6fb89640 1 -- 172.21.15.96:0/1005081568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf681e63e0 con 0x7fcf68155570 2024-06-02T23:59:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.544+0000 7fcf5a7fc640 1 -- 172.21.15.96:0/1005081568 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fcf60044020 con 0x7fcf68155570 2024-06-02T23:59:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.545+0000 7fcf5a7fc640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcf4c06be30 0x7fcf4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.545+0000 7fcf5a7fc640 1 -- 172.21.15.96:0/1005081568 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fcf600abc00 con 0x7fcf68155570 2024-06-02T23:59:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.545+0000 7fcf6d925640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcf4c06be30 0x7fcf4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.545+0000 7fcf6d925640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcf4c06be30 0x7fcf4c06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c006fd0 tx=0x7fcf5c008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:11.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.546+0000 7fcf72972740 1 Processor -- start 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.546+0000 7fcf72972740 1 -- start start 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf72972740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb7623c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf72972740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623a0e0 0x55eb7623ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf72972740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7620c960 0x55eb76210170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf72972740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55eb76175740 con 0x55eb76239d00 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf72972740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55eb76113a80 con 0x55eb7620c960 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf72972740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55eb76171700 con 0x55eb7623a0e0 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6d925640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb7623c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6d925640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb7623c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44322/0 (socket says 172.21.15.96:44322) 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6d925640 1 -- 172.21.15.96:0/2998770548 learned_addr learned my addr 172.21.15.96:0/2998770548 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6d124640 1 --2- 172.21.15.96:0/2998770548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623a0e0 0x55eb7623ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6e126640 1 --2- 172.21.15.96:0/2998770548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7620c960 0x55eb76210170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6d925640 1 -- 172.21.15.96:0/2998770548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623a0e0 msgr2=0x55eb7623ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6d925640 1 --2- 172.21.15.96:0/2998770548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623a0e0 0x55eb7623ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6d925640 1 -- 172.21.15.96:0/2998770548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7620c960 msgr2=0x55eb76210170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6d925640 1 --2- 172.21.15.96:0/2998770548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7620c960 0x55eb76210170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6d925640 1 -- 172.21.15.96:0/2998770548 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb7613efb0 con 0x55eb76239d00 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6e126640 1 --2- 172.21.15.96:0/2998770548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7620c960 0x55eb76210170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf6d925640 1 --2- 172.21.15.96:0/2998770548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb7623c510 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c007fd0 tx=0x7fcf5c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf073351e79200f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf4b7fe640 1 -- 172.21.15.96:0/2998770548 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c01c050 con 0x55eb76239d00 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf4b7fe640 1 -- 172.21.15.96:0/2998770548 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5c026070 con 0x55eb76239d00 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.547+0000 7fcf4b7fe640 1 -- 172.21.15.96:0/2998770548 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c021440 con 0x55eb76239d00 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.548+0000 7fcf72972740 1 -- 172.21.15.96:0/2998770548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 msgr2=0x55eb7623c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.548+0000 7fcf72972740 1 --2- 172.21.15.96:0/2998770548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb7623c510 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c007fd0 tx=0x7fcf5c013000 comp rx=0 tx=0).stop 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.548+0000 7fcf72972740 1 -- 172.21.15.96:0/2998770548 shutdown_connections 2024-06-02T23:59:11.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.548+0000 7fcf72972740 1 --2- 172.21.15.96:0/2998770548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7620c960 0x55eb76210170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.548+0000 7fcf72972740 1 --2- 172.21.15.96:0/2998770548 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623a0e0 0x55eb7623ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.548+0000 7fcf72972740 1 --2- 172.21.15.96:0/2998770548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb7623c510 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.548+0000 7fcf72972740 1 -- 172.21.15.96:0/2998770548 >> 172.21.15.96:0/2998770548 conn(0x55eb7620ebd0 msgr2=0x55eb76257510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.548+0000 7fcf72972740 1 -- 172.21.15.96:0/2998770548 shutdown_connections 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.548+0000 7fcf72972740 1 -- 172.21.15.96:0/2998770548 wait complete. 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.549+0000 7fcf72972740 1 -- start start 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.549+0000 7fcf72972740 1 Processor -- start 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf72972740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb76236300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf72972740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 0x55eb7625c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf72972740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623f130 0x55eb7625aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf72972740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55eb76211d80 con 0x55eb76239d00 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf72972740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55eb760fec30 con 0x55eb7623a0e0 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf72972740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55eb76212060 con 0x55eb7623f130 2024-06-02T23:59:11.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf72972740 10 client.0 _ll_register_callbacks cb 0x55eb761307f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf6d925640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb76236300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf6d925640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb76236300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44336/0 (socket says 172.21.15.96:44336) 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf6d925640 1 -- 172.21.15.96:0/1142551164 learned_addr learned my addr 172.21.15.96:0/1142551164 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf6e126640 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623f130 0x55eb7625aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf6d925640 1 -- 172.21.15.96:0/1142551164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623f130 msgr2=0x55eb7625aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf6d925640 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623f130 0x55eb7625aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf6d925640 1 -- 172.21.15.96:0/1142551164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 msgr2=0x55eb7625c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf6d925640 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 0x55eb7625c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf6d925640 1 -- 172.21.15.96:0/1142551164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb75e892d0 con 0x55eb76239d00 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf6d925640 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb76236300 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c011010 tx=0x7fcf5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f813716ba8d20ce server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1142551164 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c005da0 con 0x55eb76239d00 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1142551164 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fcf5c006050 con 0x55eb76239d00 2024-06-02T23:59:11.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.550+0000 7fcf72972740 1 -- 172.21.15.96:0/1142551164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf5c026070 con 0x55eb76239d00 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1142551164 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcf5c01c030 con 0x55eb76239d00 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf72972740 10 client.5904 fetch_fsmap learned FSMap version 25 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf72972740 1 -- 172.21.15.96:0/1142551164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55eb75f536b0 con 0x55eb76239d00 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1142551164 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5c026070 con 0x55eb76239d00 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1142551164 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7fcf5c006250 con 0x55eb76239d00 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf72972740 10 client.5904 fetch_fsmap finished waiting for FSMap version 25 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf72972740 10 client.5904 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf72972740 20 client.5904 populate_metadata read hostname 'smithi096' 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf72972740 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.96:6834/2309601772,v1:172.21.15.96:6835/2309601772] conn(0x55eb7623d8b0 0x55eb7623dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf72972740 4 client.5904 mds_command: new command op to 5739 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf72972740 1 -- 172.21.15.96:0/1142551164 --> [v2:172.21.15.96:6834/2309601772,v1:172.21.15.96:6835/2309601772] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb76182e70 con 0x55eb7623d8b0 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf6d124640 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.96:6834/2309601772,v1:172.21.15.96:6835/2309601772] conn(0x55eb7623d8b0 0x55eb7623dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf48ff9640 10 client.5904 ms_handle_connect on v2:172.21.15.96:6834/2309601772 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.551+0000 7fcf6d124640 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.96:6834/2309601772,v1:172.21.15.96:6835/2309601772] conn(0x55eb7623d8b0 0x55eb7623dc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d5ec09f99f70509 server_cookie=fd2e8a388032b3ab in_seq=0 out_seq=0 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1142551164 <== mds.0 v2:172.21.15.96:6834/2309601772 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55eb76182e70 con 0x55eb7623d8b0 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf48ff9640 10 client.5904 handle_command_reply: tid=0 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 client.5904 shutdown 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 -- 172.21.15.96:0/1142551164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 msgr2=0x55eb76236300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb76236300 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c011010 tx=0x7fcf5c004730 comp rx=0 tx=0).stop 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 -- 172.21.15.96:0/1142551164 shutdown_connections 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623f130 0x55eb7625aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.96:6834/2309601772,v1:172.21.15.96:6835/2309601772] conn(0x55eb7623d8b0 0x55eb7623dc90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 0x55eb7625c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 --2- 172.21.15.96:0/1142551164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb76236300 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf48ff9640 0 client.5904 ms_handle_reset on v2:172.21.15.96:6834/2309601772 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 -- 172.21.15.96:0/1142551164 >> 172.21.15.96:0/1142551164 conn(0x55eb7620c960 msgr2=0x55eb762550c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 -- 172.21.15.96:0/1142551164 shutdown_connections 2024-06-02T23:59:11.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 1 -- 172.21.15.96:0/1142551164 wait complete. 2024-06-02T23:59:11.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.552+0000 7fcf72972740 20 client.5904 trim_cache size 0 max 16384 2024-06-02T23:59:11.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.571+0000 7fcf72972740 1 Processor -- start 2024-06-02T23:59:11.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.571+0000 7fcf72972740 1 -- start start 2024-06-02T23:59:11.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf72972740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb76239d00 0x55eb7627bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf72972740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 0x55eb7623fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf72972740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb7623f130 0x55eb7620cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf72972740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcf681ffdc0 con 0x55eb7623f130 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf72972740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680c8200 con 0x55eb7623a0e0 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf72972740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcf681ff770 con 0x55eb76239d00 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf6e126640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb7623f130 0x55eb7620cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf6e126640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb7623f130 0x55eb7620cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44338/0 (socket says 172.21.15.96:44338) 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf6e126640 1 -- 172.21.15.96:0/2382188573 learned_addr learned my addr 172.21.15.96:0/2382188573 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf6e126640 1 -- 172.21.15.96:0/2382188573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb76239d00 msgr2=0x55eb7627bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf6e126640 1 --2- 172.21.15.96:0/2382188573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb76239d00 0x55eb7627bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf6e126640 1 -- 172.21.15.96:0/2382188573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 msgr2=0x55eb7623fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf6e126640 1 --2- 172.21.15.96:0/2382188573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 0x55eb7623fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf6e126640 1 -- 172.21.15.96:0/2382188573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb76259da0 con 0x55eb7623f130 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf6e126640 1 --2- 172.21.15.96:0/2382188573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb7623f130 0x55eb7620cee0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcf600073c0 tx=0x7fcf60079710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d49bfc6548ac27 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf4affd640 1 -- 172.21.15.96:0/2382188573 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60079db0 con 0x55eb7623f130 2024-06-02T23:59:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf4affd640 1 -- 172.21.15.96:0/2382188573 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf600a8070 con 0x55eb7623f130 2024-06-02T23:59:11.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.572+0000 7fcf4affd640 1 -- 172.21.15.96:0/2382188573 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6007e0b0 con 0x55eb7623f130 2024-06-02T23:59:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 -- 172.21.15.96:0/2382188573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb7623f130 msgr2=0x55eb7620cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 --2- 172.21.15.96:0/2382188573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb7623f130 0x55eb7620cee0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcf600073c0 tx=0x7fcf60079710 comp rx=0 tx=0).stop 2024-06-02T23:59:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 -- 172.21.15.96:0/2382188573 shutdown_connections 2024-06-02T23:59:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 --2- 172.21.15.96:0/2382188573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb7623f130 0x55eb7620cee0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 --2- 172.21.15.96:0/2382188573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 0x55eb7623fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 --2- 172.21.15.96:0/2382188573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb76239d00 0x55eb7627bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 -- 172.21.15.96:0/2382188573 >> 172.21.15.96:0/2382188573 conn(0x55eb7620c960 msgr2=0x55eb7620b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 -- 172.21.15.96:0/2382188573 shutdown_connections 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 -- 172.21.15.96:0/2382188573 wait complete. 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 -- start start 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.573+0000 7fcf72972740 1 Processor -- start 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.574+0000 7fcf72972740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb762d5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.574+0000 7fcf72972740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 0x55eb7620cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.574+0000 7fcf72972740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623f130 0x55eb7620d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.574+0000 7fcf72972740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x55eb76236c60 con 0x55eb76239d00 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.574+0000 7fcf72972740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55eb76258ad0 con 0x55eb7623a0e0 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.574+0000 7fcf72972740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55eb76259b50 con 0x55eb7623f130 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.574+0000 7fcf72972740 10 client.0 _ll_register_callbacks cb 0x7fcf5c004110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.574+0000 7fcf6d925640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb762d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.574+0000 7fcf6d925640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb762d5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44340/0 (socket says 172.21.15.96:44340) 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.574+0000 7fcf6d925640 1 -- 172.21.15.96:0/1512634312 learned_addr learned my addr 172.21.15.96:0/1512634312 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf6d925640 1 -- 172.21.15.96:0/1512634312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623f130 msgr2=0x55eb7620d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf6d925640 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623f130 0x55eb7620d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf6d925640 1 -- 172.21.15.96:0/1512634312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 msgr2=0x55eb7620cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf6d925640 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 0x55eb7620cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf6d925640 1 -- 172.21.15.96:0/1512634312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb76255f90 con 0x55eb76239d00 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf6d925640 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb762d5ab0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c006140 tx=0x7fcf5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e801a2cbe7f1da server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1512634312 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0062a0 con 0x55eb76239d00 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1512634312 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fcf5c022c80 con 0x55eb76239d00 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf72972740 1 -- 172.21.15.96:0/1512634312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf600a8070 con 0x55eb76239d00 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1512634312 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcf5c003610 con 0x55eb76239d00 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf72972740 10 client.5910 fetch_fsmap learned FSMap version 25 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf72972740 1 -- 172.21.15.96:0/1512634312 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55eb76238090 con 0x55eb76239d00 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1512634312 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf600a8070 con 0x55eb76239d00 2024-06-02T23:59:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1512634312 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7fcf5c0037b0 con 0x55eb76239d00 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf72972740 10 client.5910 fetch_fsmap finished waiting for FSMap version 25 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf72972740 10 client.5910 resolve_mds: resolved name 'a' to daemon mds.a 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf72972740 20 client.5910 populate_metadata read hostname 'smithi096' 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf72972740 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.96:6834/2309601772,v1:172.21.15.96:6835/2309601772] conn(0x55eb76237bf0 0x55eb7623dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf72972740 4 client.5910 mds_command: new command op to 5739 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf72972740 1 -- 172.21.15.96:0/1512634312 --> [v2:172.21.15.96:6834/2309601772,v1:172.21.15.96:6835/2309601772] -- command(tid 0: {"prefix": "status"}) -- 0x55eb762123d0 con 0x55eb76237bf0 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.575+0000 7fcf6d124640 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.96:6834/2309601772,v1:172.21.15.96:6835/2309601772] conn(0x55eb76237bf0 0x55eb7623dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf48ff9640 10 client.5910 ms_handle_connect on v2:172.21.15.96:6834/2309601772 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf6d124640 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.96:6834/2309601772,v1:172.21.15.96:6835/2309601772] conn(0x55eb76237bf0 0x55eb7623dc90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a53022ef61cd1cb7 server_cookie=e312351ff476764e in_seq=0 out_seq=0 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf48ff9640 1 -- 172.21.15.96:0/1512634312 <== mds.0 v2:172.21.15.96:6834/2309601772 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55eb762123d0 con 0x55eb76237bf0 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf48ff9640 10 client.5910 handle_command_reply: tid=0 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 client.5910 shutdown 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 -- 172.21.15.96:0/1512634312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 msgr2=0x55eb762d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb762d5ab0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c006140 tx=0x7fcf5c0046c0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 -- 172.21.15.96:0/1512634312 shutdown_connections 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55eb7623f130 0x55eb7620d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.96:6834/2309601772,v1:172.21.15.96:6835/2309601772] conn(0x55eb76237bf0 0x55eb7623dc90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb7623a0e0 0x55eb7620cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 --2- 172.21.15.96:0/1512634312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55eb76239d00 0x55eb762d5ab0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf48ff9640 0 client.5910 ms_handle_reset on v2:172.21.15.96:6834/2309601772 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 -- 172.21.15.96:0/1512634312 >> 172.21.15.96:0/1512634312 conn(0x55eb7620c960 msgr2=0x55eb7625f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 -- 172.21.15.96:0/1512634312 shutdown_connections 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 1 -- 172.21.15.96:0/1512634312 wait complete. 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.576+0000 7fcf72972740 20 client.5910 trim_cache size 0 max 16384 2024-06-02T23:59:11.582 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "83723afd-2657-4b93-818a-1e4b19cab42f", 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 5739, 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 9.9511371309999994, 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 25, 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 70, 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 70, 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 14.783008586999999 2024-06-02T23:59:11.583 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:59:11.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 -- 172.21.15.96:0/1005081568 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcf4c06be30 msgr2=0x7fcf4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcf4c06be30 0x7fcf4c06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c006fd0 tx=0x7fcf5c008040 comp rx=0 tx=0).stop 2024-06-02T23:59:11.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 -- 172.21.15.96:0/1005081568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf68155570 msgr2=0x7fcf68151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf68155570 0x7fcf68151f00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcf60034040 tx=0x7fcf60004a40 comp rx=0 tx=0).stop 2024-06-02T23:59:11.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 -- 172.21.15.96:0/1005081568 shutdown_connections 2024-06-02T23:59:11.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcf4c06be30 0x7fcf4c06e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf68155570 0x7fcf68151f00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf680cab60 0x7fcf68150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 --2- 172.21.15.96:0/1005081568 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf6806eb50 0x7fcf681e6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 -- 172.21.15.96:0/1005081568 >> 172.21.15.96:0/1005081568 conn(0x7fcf680cfc30 msgr2=0x7fcf6815b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:11.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 -- 172.21.15.96:0/1005081568 shutdown_connections 2024-06-02T23:59:11.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.577+0000 7fcf6fb89640 1 -- 172.21.15.96:0/1005081568 wait complete. 2024-06-02T23:59:11.588 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-06-02T23:59:11.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.687+0000 7f243594f640 1 Processor -- start 2024-06-02T23:59:11.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.688+0000 7f243594f640 1 -- start start 2024-06-02T23:59:11.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.688+0000 7f243594f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f24300d13d0 0x7f2430168e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.688+0000 7f243594f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24300b3640 con 0x7f24300b4be0 2024-06-02T23:59:11.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.688+0000 7f243594f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24300cc580 con 0x7f24300ce610 2024-06-02T23:59:11.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.688+0000 7f243594f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2430161c60 con 0x7f24300d13d0 2024-06-02T23:59:11.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.688+0000 7f242e7fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f24300b4be0 0x7f24300d0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37356/0 (socket says 172.21.15.96:37356) 2024-06-02T23:59:11.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.688+0000 7f242e7fc640 1 -- 172.21.15.96:0/734534639 learned_addr learned my addr 172.21.15.96:0/734534639 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-02T23:59:11.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242f7fe640 1 --2- 172.21.15.96:0/734534639 >> v2:172.21.15.162:3300/0 conn(0x7f24300d13d0 0x7f2430168e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565332908 0 0) 0x7f24300b3640 con 0x7f24300b4be0 2024-06-02T23:59:11.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2418003520 con 0x7f24300b4be0 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3214051210 0 0) 0x7f2418003520 con 0x7f24300b4be0 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 >> v2:172.21.15.162:3300/0 conn(0x7f24300d13d0 msgr2=0x7f2430168e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 --2- 172.21.15.96:0/734534639 >> v2:172.21.15.162:3300/0 conn(0x7f24300d13d0 0x7f2430168e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 >> v1:172.21.15.162:6789/0 conn(0x7f24300ce610 legacy=0x7f24300ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24300cc860 con 0x7f24300b4be0 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f24240019f0 con 0x7f24300b4be0 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 >> v1:172.21.15.96:6789/0 conn(0x7f24300b4be0 legacy=0x7f24300d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24180039b0 0x7f2418003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2418004800 0x7f2418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24180051c0 0x7f241800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2430161c60 con 0x7f2418004800 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f241800c060 con 0x7f24180051c0 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f241800c260 con 0x7f24180039b0 2024-06-02T23:59:11.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242e7fc640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2418004800 0x7f2418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242effd640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24180039b0 0x7f2418003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242f7fe640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24180051c0 0x7f241800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242e7fc640 1 -- 172.21.15.96:0/734534639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24180039b0 msgr2=0x7f2418003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242e7fc640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24180039b0 0x7f2418003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242e7fc640 1 -- 172.21.15.96:0/734534639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24180051c0 msgr2=0x7f241800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242e7fc640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24180051c0 0x7f241800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242e7fc640 1 -- 172.21.15.96:0/734534639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2418003520 con 0x7f2418004800 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242f7fe640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24180051c0 0x7f241800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.689+0000 7f242f7fe640 1 -- 172.21.15.96:0/734534639 reap_dead start 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.690+0000 7f242e7fc640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2418004800 0x7f2418004c80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f242400a850 tx=0x7f2418005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd11913f2484722 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.690+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242400a4a0 con 0x7f2418004800 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.690+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242402f070 con 0x7f2418004800 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.690+0000 7f242dffb640 1 -- 172.21.15.96:0/734534639 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242402bcf0 con 0x7f2418004800 2024-06-02T23:59:11.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.691+0000 7f243594f640 1 -- 172.21.15.96:0/734534639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2418004800 msgr2=0x7f2418004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.691+0000 7f243594f640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2418004800 0x7f2418004c80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f242400a850 tx=0x7f2418005830 comp rx=0 tx=0).stop 2024-06-02T23:59:11.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.691+0000 7f243594f640 1 -- 172.21.15.96:0/734534639 shutdown_connections 2024-06-02T23:59:11.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.691+0000 7f243594f640 1 --2- 172.21.15.96:0/734534639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2418004800 0x7f2418004c80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.691+0000 7f243594f640 1 -- 172.21.15.96:0/734534639 >> 172.21.15.96:0/734534639 conn(0x7f24300d1d90 msgr2=0x7f24300d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:11.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.691+0000 7f243594f640 1 -- 172.21.15.96:0/734534639 shutdown_connections 2024-06-02T23:59:11.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.691+0000 7f243594f640 1 -- 172.21.15.96:0/734534639 wait complete. 2024-06-02T23:59:11.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.692+0000 7f243594f640 1 Processor -- start 2024-06-02T23:59:11.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.692+0000 7f243594f640 1 -- start start 2024-06-02T23:59:11.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f243594f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2418004800 0x7f2430157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f243594f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24300b3640 0x7f24300b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f243594f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f243015a3c0 0x7f243015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f243594f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f24300cce20 con 0x7f24300b3640 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f243594f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24300d0cc0 con 0x7f243015a3c0 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f243594f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f24300d0e40 con 0x7f2418004800 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f242e7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24300b3640 0x7f24300b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f242e7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24300b3640 0x7f24300b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44366/0 (socket says 172.21.15.96:44366) 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f242e7fc640 1 -- 172.21.15.96:0/2166712649 learned_addr learned my addr 172.21.15.96:0/2166712649 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f242e7fc640 1 -- 172.21.15.96:0/2166712649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2418004800 msgr2=0x7f2430157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f242e7fc640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2418004800 0x7f2430157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f242e7fc640 1 -- 172.21.15.96:0/2166712649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f243015a3c0 msgr2=0x7f243015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f242e7fc640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f243015a3c0 0x7f243015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f242e7fc640 1 -- 172.21.15.96:0/2166712649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243015ad60 con 0x7f24300b3640 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f242e7fc640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24300b3640 0x7f24300b3ac0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f242402b500 tx=0x7f242402d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f2417fff640 1 -- 172.21.15.96:0/2166712649 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424045070 con 0x7f24300b3640 2024-06-02T23:59:11.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f2417fff640 1 -- 172.21.15.96:0/2166712649 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2424040680 con 0x7f24300b3640 2024-06-02T23:59:11.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.693+0000 7f2417fff640 1 -- 172.21.15.96:0/2166712649 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424040a70 con 0x7f24300b3640 2024-06-02T23:59:11.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.694+0000 7f243594f640 1 -- 172.21.15.96:0/2166712649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243014bbf0 con 0x7f24300b3640 2024-06-02T23:59:11.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.694+0000 7f243594f640 1 -- 172.21.15.96:0/2166712649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243014c1b0 con 0x7f24300b3640 2024-06-02T23:59:11.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.694+0000 7f243594f640 1 -- 172.21.15.96:0/2166712649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2430073da0 con 0x7f24300b3640 2024-06-02T23:59:11.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.695+0000 7f2417fff640 1 -- 172.21.15.96:0/2166712649 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f2424048070 con 0x7f24300b3640 2024-06-02T23:59:11.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.695+0000 7f2417fff640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f241c06be30 0x7f241c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:11.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.695+0000 7f242effd640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f241c06be30 0x7f241c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:11.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.695+0000 7f2417fff640 1 -- 172.21.15.96:0/2166712649 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7f24240ab820 con 0x7f24300b3640 2024-06-02T23:59:11.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.696+0000 7f242effd640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f241c06be30 0x7f241c06e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2428000c00 tx=0x7f2428009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:11.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.700+0000 7f2417fff640 1 -- 172.21.15.96:0/2166712649 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f2430073da0 con 0x7f24300b3640 2024-06-02T23:59:11.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.911+0000 7f243594f640 1 -- 172.21.15.96:0/2166712649 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2430068af0 con 0x7f24300b3640 2024-06-02T23:59:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.912+0000 7f2417fff640 1 -- 172.21.15.96:0/2166712649 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f242407a0d0 con 0x7f24300b3640 2024-06-02T23:59:11.912 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T23:59:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.913+0000 7f243594f640 1 -- 172.21.15.96:0/2166712649 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f241c06be30 msgr2=0x7f241c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.913+0000 7f243594f640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f241c06be30 0x7f241c06e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2428000c00 tx=0x7f2428009040 comp rx=0 tx=0).stop 2024-06-02T23:59:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.913+0000 7f243594f640 1 -- 172.21.15.96:0/2166712649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24300b3640 msgr2=0x7f24300b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.913+0000 7f243594f640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24300b3640 0x7f24300b3ac0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f242402b500 tx=0x7f242402d070 comp rx=0 tx=0).stop 2024-06-02T23:59:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.914+0000 7f243594f640 1 -- 172.21.15.96:0/2166712649 shutdown_connections 2024-06-02T23:59:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.914+0000 7f243594f640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f241c06be30 0x7f241c06e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.914+0000 7f243594f640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f243015a3c0 0x7f243015a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.914+0000 7f243594f640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24300b3640 0x7f24300b3ac0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.914+0000 7f243594f640 1 --2- 172.21.15.96:0/2166712649 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2418004800 0x7f2430157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.914+0000 7f243594f640 1 -- 172.21.15.96:0/2166712649 >> 172.21.15.96:0/2166712649 conn(0x7f24300d1d90 msgr2=0x7f24300b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.914+0000 7f243594f640 1 -- 172.21.15.96:0/2166712649 shutdown_connections 2024-06-02T23:59:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:11.914+0000 7f243594f640 1 -- 172.21.15.96:0/2166712649 wait complete. 2024-06-02T23:59:11.924 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T23:59:11.925 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T23:59:11.925 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-06-02T23:59:11.925 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T23:59:11.925 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-02T23:59:11.925 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T23:59:11.925 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T23:59:11.925 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T23:59:11.925 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T23:59:11.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:59:11.925 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-06-02T23:59:11.941 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T23:59:11.941 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T23:59:11.941 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T23:59:11.942 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42008sec preferred_lft 42008sec 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether d2:8f:fd:4a:d7:e3 brd ff:ff:ff:ff:ff:ff 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::fc2d:2aff:fe99:fd88/64 scope link 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether da:61:41:8f:5f:36 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::d861:41ff:fe8f:5f36/64 scope link 2024-06-02T23:59:11.943 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:59:11.944 INFO:teuthology.orchestra.run.smithi096.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-06-02T23:59:11.944 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether d2:8f:fd:4a:d7:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:59:11.944 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::d08f:fdff:fe4a:d7e3/64 scope link 2024-06-02T23:59:11.944 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-06-02T23:59:11.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:59:11.944 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T23:59:12.005 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-06-02T23:59:12.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:59:12.007 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-06-02T23:59:12.063 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-06-02T23:59:12.063 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T23:59:12.063 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T23:59:12.063 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T23:59:12.063 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T23:59:12.063 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-02T23:59:12.064 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-06-02T23:59:12.064 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T23:59:12.064 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T23:59:12.064 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T23:59:12.064 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-06-02T23:59:12.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-02T23:59:12.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:59:12.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:59:12.189 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-06-02T23:59:12.205 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-02T23:59:12.205 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-02T23:59:12.205 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-02T23:59:12.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:59:12.205 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2024-06-02T23:59:12.269 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-06-02T23:59:12.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:59:12.270 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-02T23:59:12.325 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-02T23:59:12.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T23:59:12.325 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-02T23:59:12.381 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-06-02T23:59:12.446 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:59:12.502 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-06-02T23:59:12.502 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-06-02T23:59:12.502 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-06-02T23:59:12.502 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-06-02T23:59:12.502 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-06-02T23:59:12.502 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-06-02T23:59:12.503 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:59:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:59:12.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:59:12.505 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-06-02T23:59:12.558 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-02T23:59:12.558 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-06-02T23:59:12.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2024-06-02T23:59:12.624 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2024-06-02T23:59:12.681 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2024-06-02T23:59:12.681 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2024-06-02T23:59:12.681 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2024-06-02T23:59:12.681 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2024-06-02T23:59:12.681 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2024-06-02T23:59:12.682 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2024-06-02T23:59:12.683 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:59:12.684 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-02T23:59:12.684 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:59:12.684 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-02T23:59:12.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:59:12.684 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2024-06-02T23:59:12.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:2024-06-02T23:59:12.681+0000 7f1554c86480 -1 init, newargv = 0x55e65a6101b0 newargc=15 2024-06-02T23:59:12.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[59434]: starting ceph client 2024-06-02T23:59:12.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[59434]: starting fuse 2024-06-02T23:59:12.701 INFO:teuthology.orchestra.run.smithi096.stdout:40 2024-06-02T23:59:12.701 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-06-02T23:59:12.701 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2024-06-02T23:59:12.701 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2024-06-02T23:59:12.701 DEBUG:teuthology.orchestra.run.smithi096:> import re 2024-06-02T23:59:12.701 DEBUG:teuthology.orchestra.run.smithi096:> import os 2024-06-02T23:59:12.701 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2024-06-02T23:59:12.701 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:59:12.701 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-02T23:59:12.702 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2024-06-02T23:59:12.703 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2024-06-02T23:59:12.703 DEBUG:teuthology.orchestra.run.smithi096:> return f 2024-06-02T23:59:12.703 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-02T23:59:12.703 DEBUG:teuthology.orchestra.run.smithi096:> 2024-06-02T23:59:12.703 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.0")) 2024-06-02T23:59:12.703 DEBUG:teuthology.orchestra.run.smithi096:> ' 2024-06-02T23:59:12.818 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.0.59434.asok 2024-06-02T23:59:12.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-02T23:59:12.828 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.59434.asok 2024-06-02T23:59:12.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:59:12.828 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.59434.asok status 2024-06-02T23:59:12.961 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-02T23:59:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2024-06-02T23:59:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-02T23:59:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-02T23:59:12.961 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "0", 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "59434", 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 5919, 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2024-06-02T23:59:12.962 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5919 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2105190732 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2105190732 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.5919 192.168.0.1:0/2105190732", 2024-06-02T23:59:12.963 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.1:0/2105190732", 2024-06-02T23:59:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2024-06-02T23:59:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 25, 2024-06-02T23:59:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 70, 2024-06-02T23:59:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2024-06-02T23:59:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2024-06-02T23:59:12.964 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2024-06-02T23:59:12.964 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-02T23:59:12.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:59:12.970 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2024-06-02T23:59:12.970 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.0 2024-06-02T23:59:12.985 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2024-06-02T23:59:12.986 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-06-02T23:59:12.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T23:59:12.986 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-02T23:59:13.051 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-06-02T23:59:13.190 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.190+0000 7fc1fc309640 1 Processor -- start 2024-06-02T23:59:13.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.190+0000 7fc1fc309640 1 -- start start 2024-06-02T23:59:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.191+0000 7fc1fc309640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc1f406ed20 0x7fc1f40ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.191+0000 7fc1fc309640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc1f40cab60 0x7fc1f4072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.191+0000 7fc1fc309640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f4155950 con 0x7fc1f4155570 2024-06-02T23:59:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.191+0000 7fc1fc309640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fc1f40cb2e0 con 0x7fc1f40cab60 2024-06-02T23:59:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.191+0000 7fc1fc309640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc1f40cb5c0 con 0x7fc1f406ed20 2024-06-02T23:59:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.191+0000 7fc1fa8a6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc1f40cab60 0x7fc1f4072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.191+0000 7fc1fa8a6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc1f40cab60 0x7fc1f4072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42390/0 (socket says 172.21.15.96:42390) 2024-06-02T23:59:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.191+0000 7fc1fa8a6640 1 -- 172.21.15.96:0/400449028 learned_addr learned my addr 172.21.15.96:0/400449028 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.191+0000 7fc1f98a4640 1 --2- 172.21.15.96:0/400449028 >> v2:172.21.15.162:3300/0 conn(0x7fc1f406ed20 0x7fc1f40ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:13.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.192+0000 7fc1fa8a6640 1 -- 172.21.15.96:0/400449028 >> v2:172.21.15.162:3300/0 conn(0x7fc1f406ed20 msgr2=0x7fc1f40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T23:59:13.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.192+0000 7fc1fa8a6640 1 --2- 172.21.15.96:0/400449028 >> v2:172.21.15.162:3300/0 conn(0x7fc1f406ed20 0x7fc1f40ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:13.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.192+0000 7fc1fa8a6640 1 -- 172.21.15.96:0/400449028 >> v1:172.21.15.162:6789/0 conn(0x7fc1f4155570 legacy=0x7fc1f406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:13.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.192+0000 7fc1fa8a6640 1 -- 172.21.15.96:0/400449028 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f40cb8a0 con 0x7fc1f40cab60 2024-06-02T23:59:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.192+0000 7fc1fa8a6640 1 --2- 172.21.15.96:0/400449028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cab60 0x7fc1f4072020 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4070b60 tx=0x7fc1ec02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ac458c576355f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1f90a3640 1 -- 172.21.15.96:0/400449028 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec036070 con 0x7fc1f40cab60 2024-06-02T23:59:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1f90a3640 1 -- 172.21.15.96:0/400449028 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ec031600 con 0x7fc1f40cab60 2024-06-02T23:59:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1f90a3640 1 -- 172.21.15.96:0/400449028 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0319d0 con 0x7fc1f40cab60 2024-06-02T23:59:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1fc309640 1 -- 172.21.15.96:0/400449028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cab60 msgr2=0x7fc1f4072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1fc309640 1 --2- 172.21.15.96:0/400449028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cab60 0x7fc1f4072020 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4070b60 tx=0x7fc1ec02a730 comp rx=0 tx=0).stop 2024-06-02T23:59:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1fc309640 1 -- 172.21.15.96:0/400449028 shutdown_connections 2024-06-02T23:59:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1fc309640 1 --2- 172.21.15.96:0/400449028 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f40cab60 0x7fc1f4072020 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:13.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1fc309640 1 --2- 172.21.15.96:0/400449028 >> v2:172.21.15.162:3300/0 conn(0x7fc1f406ed20 0x7fc1f40ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:13.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1fc309640 1 -- 172.21.15.96:0/400449028 >> 172.21.15.96:0/400449028 conn(0x7fc1f40cfc30 msgr2=0x7fc1f40d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T23:59:13.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1fc309640 1 -- 172.21.15.96:0/400449028 shutdown_connections 2024-06-02T23:59:13.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.193+0000 7fc1fc309640 1 -- 172.21.15.96:0/400449028 wait complete. 2024-06-02T23:59:13.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.194+0000 7fc1fc309640 1 Processor -- start 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.194+0000 7fc1fc309640 1 -- start start 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1fc309640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f406ed20 0x7fc1f40c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1fc309640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f40cab60 0x7fc1f4148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1fc309640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f4155570 0x7fc1f414ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1fc309640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f40caf70 con 0x7fc1f406ed20 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1fc309640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f40717d0 con 0x7fc1f40cab60 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1fc309640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f4072560 con 0x7fc1f4155570 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1fa0a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f406ed20 0x7fc1f40c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1fa0a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f406ed20 0x7fc1f40c49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42396/0 (socket says 172.21.15.96:42396) 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1fa0a5640 1 -- 172.21.15.96:0/624909047 learned_addr learned my addr 172.21.15.96:0/624909047 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1f98a4640 1 --2- 172.21.15.96:0/624909047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f40cab60 0x7fc1f4148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.195+0000 7fc1fa8a6640 1 --2- 172.21.15.96:0/624909047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f4155570 0x7fc1f414ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1fa0a5640 1 -- 172.21.15.96:0/624909047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f4155570 msgr2=0x7fc1f414ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:13.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1fa0a5640 1 --2- 172.21.15.96:0/624909047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1f4155570 0x7fc1f414ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1fa0a5640 1 -- 172.21.15.96:0/624909047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f40cab60 msgr2=0x7fc1f4148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T23:59:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1fa0a5640 1 --2- 172.21.15.96:0/624909047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1f40cab60 0x7fc1f4148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T23:59:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1fa0a5640 1 -- 172.21.15.96:0/624909047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f40c5d30 con 0x7fc1f406ed20 2024-06-02T23:59:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1fa0a5640 1 --2- 172.21.15.96:0/624909047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1f406ed20 0x7fc1f40c49d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000c3f0 tx=0x7fc1f000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1eaffd640 1 -- 172.21.15.96:0/624909047 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00052d0 con 0x7fc1f406ed20 2024-06-02T23:59:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1eaffd640 1 -- 172.21.15.96:0/624909047 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f0005490 con 0x7fc1f406ed20 2024-06-02T23:59:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1eaffd640 1 -- 172.21.15.96:0/624909047 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0007260 con 0x7fc1f406ed20 2024-06-02T23:59:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1fc309640 1 -- 172.21.15.96:0/624909047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f40c50b0 con 0x7fc1f406ed20 2024-06-02T23:59:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.196+0000 7fc1fc309640 1 -- 172.21.15.96:0/624909047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f40c5670 con 0x7fc1f406ed20 2024-06-02T23:59:13.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.197+0000 7fc1fc309640 1 -- 172.21.15.96:0/624909047 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f40683e0 con 0x7fc1f406ed20 2024-06-02T23:59:13.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.197+0000 7fc1eaffd640 1 -- 172.21.15.96:0/624909047 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fc1f0007400 con 0x7fc1f406ed20 2024-06-02T23:59:13.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.198+0000 7fc1eaffd640 1 --2- 172.21.15.96:0/624909047 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc1d806be30 0x7fc1d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T23:59:13.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.198+0000 7fc1eaffd640 1 -- 172.21.15.96:0/624909047 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6101+0+0 (secure 0 0 0) 0x7fc1f008a450 con 0x7fc1f406ed20 2024-06-02T23:59:13.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.198+0000 7fc1f98a4640 1 --2- 172.21.15.96:0/624909047 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc1d806be30 0x7fc1d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T23:59:13.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.198+0000 7fc1f98a4640 1 --2- 172.21.15.96:0/624909047 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc1d806be30 0x7fc1d806e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4149320 tx=0x7fc1e4008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T23:59:13.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.202+0000 7fc1eaffd640 1 -- 172.21.15.96:0/624909047 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc1f40c5d30 con 0x7fc1f406ed20 2024-06-02T23:59:13.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-02T23:59:13.397+0000 7fc1fc309640 1 -- 172.21.15.96:0/624909047 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fc1f406cc90 con 0x7fc1d806be30 2024-06-02T23:59:29.383 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:59:29.387 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:59:59.559 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-02T23:59:59.562 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-03T00:00:29.607 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-03T00:00:29.611 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-03T00:00:59.938 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-03T00:00:59.941 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-03T00:01:13.121 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-06-03T00:01:13.123 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ERROR 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner: 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner:====================================================================== 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner:ERROR: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/test_snap_schedules.py", line 103, in setUp 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner: self._create_or_reuse_test_volume() 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/test_snap_schedules.py", line 79, in _create_or_reuse_test_volume 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner: result = json.loads(self._fs_cmd("volume", "ls")) 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/test_snap_schedules.py", line 63, in _fs_cmd 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-06-03T00:01:13.124 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: r.wait() 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi096 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls' 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner:Ran 2 tests in 852.021s 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner: 2024-06-03T00:01:13.125 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner:====================================================================== 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner:ERROR: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/test_snap_schedules.py", line 103, in setUp 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: self._create_or_reuse_test_volume() 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/test_snap_schedules.py", line 79, in _create_or_reuse_test_volume 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: result = json.loads(self._fs_cmd("volume", "ls")) 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs/test_snap_schedules.py", line 63, in _fs_cmd 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-06-03T00:01:13.126 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/remote.py", line 523, in run 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 455, in run 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner: r.wait() 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 161, in wait 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi096 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls' 2024-06-03T00:01:13.127 INFO:tasks.cephfs_test_runner: 2024-06-03T00:01:13.127 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-06-03T00:01:13.336 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=df5940f83f2d42c2b6013cb878d4387a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_861a8dcf7aa816a26e13f039336f7ed0a9aec0fa/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_dfcc4b3c2c55532c4c04fa47551c9df1dffdf746/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-06-03T00:01:13.337 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-06-03T00:01:13.349 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-06-03T00:01:13.361 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-06-03T00:01:13.361 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-03T00:01:13.361 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-03T00:01:13.387 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-03T00:01:13.387 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-03T00:01:13.446 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-03T00:01:13.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.596+0000 7f07d9990640 1 Processor -- start 2024-06-03T00:01:13.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.596+0000 7f07d9990640 1 -- start start 2024-06-03T00:01:13.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d9990640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f07d4164f10 0x7f07d4167300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d9990640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07d4071f20 con 0x7f07d415f5e0 2024-06-03T00:01:13.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d9990640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07d406f210 con 0x7f07d406ea70 2024-06-03T00:01:13.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d9990640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f07d406ef30 con 0x7f07d4164f10 2024-06-03T00:01:13.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d2ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f07d415f5e0 0x7f07d4071100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40934/0 (socket says 172.21.15.96:40934) 2024-06-03T00:01:13.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d2ffd640 1 -- 172.21.15.96:0/975350527 learned_addr learned my addr 172.21.15.96:0/975350527 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-03T00:01:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d37fe640 1 --2- 172.21.15.96:0/975350527 >> v2:172.21.15.162:3300/0 conn(0x7f07d4164f10 0x7f07d4167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289137342 0 0) 0x7f07d4071f20 con 0x7f07d415f5e0 2024-06-03T00:01:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07c0003520 con 0x7f07d415f5e0 2024-06-03T00:01:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1034899812 0 0) 0x7f07c0003520 con 0x7f07d415f5e0 2024-06-03T00:01:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 >> v2:172.21.15.162:3300/0 conn(0x7f07d4164f10 msgr2=0x7f07d4167300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d27fc640 1 --2- 172.21.15.96:0/975350527 >> v2:172.21.15.162:3300/0 conn(0x7f07d4164f10 0x7f07d4167300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 >> v1:172.21.15.162:6789/0 conn(0x7f07d406ea70 legacy=0x7f07d4071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d40ca320 con 0x7f07d415f5e0 2024-06-03T00:01:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.597+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f07c4001670 con 0x7f07d415f5e0 2024-06-03T00:01:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 >> v1:172.21.15.96:6789/0 conn(0x7f07d415f5e0 legacy=0x7f07d4071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d27fc640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07c00039b0 0x7f07c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d27fc640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07c0004800 0x7f07c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d27fc640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c00051c0 0x7f07c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f07d406ef30 con 0x7f07c00039b0 2024-06-03T00:01:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07c000c060 con 0x7f07c0004800 2024-06-03T00:01:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f07c000c260 con 0x7f07c00051c0 2024-06-03T00:01:13.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d2ffd640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07c00039b0 0x7f07c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07cbfff640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07c0004800 0x7f07c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d37fe640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c00051c0 0x7f07c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d2ffd640 1 -- 172.21.15.96:0/975350527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c00051c0 msgr2=0x7f07c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:13.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d2ffd640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c00051c0 0x7f07c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d2ffd640 1 -- 172.21.15.96:0/975350527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07c0004800 msgr2=0x7f07c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:13.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d2ffd640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07c0004800 0x7f07c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d37fe640 1 -- 172.21.15.96:0/975350527 reap_dead start 2024-06-03T00:01:13.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.598+0000 7f07d2ffd640 1 -- 172.21.15.96:0/975350527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c0003520 con 0x7f07c00039b0 2024-06-03T00:01:13.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d2ffd640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07c00039b0 0x7f07c0003dd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f07c400c240 tx=0x7f07c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d169cc8bafa87a server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:13.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4007d10 con 0x7f07c00039b0 2024-06-03T00:01:13.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c4005ad0 con 0x7f07c00039b0 2024-06-03T00:01:13.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d27fc640 1 -- 172.21.15.96:0/975350527 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4007070 con 0x7f07c00039b0 2024-06-03T00:01:13.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d9990640 1 -- 172.21.15.96:0/975350527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07c00039b0 msgr2=0x7f07c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d9990640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07c00039b0 0x7f07c0003dd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f07c400c240 tx=0x7f07c0005830 comp rx=0 tx=0).stop 2024-06-03T00:01:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d9990640 1 -- 172.21.15.96:0/975350527 shutdown_connections 2024-06-03T00:01:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d9990640 1 --2- 172.21.15.96:0/975350527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07c00039b0 0x7f07c0003dd0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d9990640 1 -- 172.21.15.96:0/975350527 >> 172.21.15.96:0/975350527 conn(0x7f07d40cfc30 msgr2=0x7f07d40d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d9990640 1 -- 172.21.15.96:0/975350527 shutdown_connections 2024-06-03T00:01:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.599+0000 7f07d9990640 1 -- 172.21.15.96:0/975350527 wait complete. 2024-06-03T00:01:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.601+0000 7f07d9990640 1 Processor -- start 2024-06-03T00:01:13.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.601+0000 7f07d9990640 1 -- start start 2024-06-03T00:01:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.601+0000 7f07d9990640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c00039b0 0x7f07d414bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.601+0000 7f07d9990640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07d4154100 0x7f07d40c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.601+0000 7f07d9990640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d40c9310 0x7f07d4154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.601+0000 7f07d9990640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f07d4073030 con 0x7f07d40c9310 2024-06-03T00:01:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.601+0000 7f07d9990640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07d40ca8e0 con 0x7f07d4154100 2024-06-03T00:01:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.601+0000 7f07d9990640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f07d40731b0 con 0x7f07c00039b0 2024-06-03T00:01:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d40c9310 0x7f07d4154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d40c9310 0x7f07d4154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51274/0 (socket says 172.21.15.96:51274) 2024-06-03T00:01:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d37fe640 1 -- 172.21.15.96:0/3068547653 learned_addr learned my addr 172.21.15.96:0/3068547653 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d2ffd640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c00039b0 0x7f07d414bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07cbfff640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07d4154100 0x7f07d40c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d37fe640 1 -- 172.21.15.96:0/3068547653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c00039b0 msgr2=0x7f07d414bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d37fe640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c00039b0 0x7f07d414bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d37fe640 1 -- 172.21.15.96:0/3068547653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07d4154100 msgr2=0x7f07d40c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d37fe640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07d4154100 0x7f07d40c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d37fe640 1 -- 172.21.15.96:0/3068547653 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d40c9990 con 0x7f07d40c9310 2024-06-03T00:01:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d37fe640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d40c9310 0x7f07d4154b00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f07cc011b40 tx=0x7f07cc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d0ff9640 1 -- 172.21.15.96:0/3068547653 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc00fd10 con 0x7f07d40c9310 2024-06-03T00:01:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d0ff9640 1 -- 172.21.15.96:0/3068547653 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07cc015430 con 0x7f07d40c9310 2024-06-03T00:01:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d0ff9640 1 -- 172.21.15.96:0/3068547653 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc015820 con 0x7f07d40c9310 2024-06-03T00:01:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d9990640 1 -- 172.21.15.96:0/3068547653 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d4153620 con 0x7f07d40c9310 2024-06-03T00:01:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.602+0000 7f07d9990640 1 -- 172.21.15.96:0/3068547653 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d415ea10 con 0x7f07d40c9310 2024-06-03T00:01:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.603+0000 7f07d9990640 1 -- 172.21.15.96:0/3068547653 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d40683e0 con 0x7f07d40c9310 2024-06-03T00:01:13.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.604+0000 7f07d0ff9640 1 -- 172.21.15.96:0/3068547653 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f07cc0159c0 con 0x7f07d40c9310 2024-06-03T00:01:13.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.604+0000 7f07d0ff9640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f07b406be30 0x7f07b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.604+0000 7f07d0ff9640 1 -- 172.21.15.96:0/3068547653 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f07cc08bc30 con 0x7f07d40c9310 2024-06-03T00:01:13.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.604+0000 7f07d2ffd640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f07b406be30 0x7f07b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.605+0000 7f07d2ffd640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f07b406be30 0x7f07b406e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07c4032000 tx=0x7f07c402d000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:13.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.609+0000 7f07d0ff9640 1 -- 172.21.15.96:0/3068547653 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f07cc019030 con 0x7f07d40c9310 2024-06-03T00:01:13.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.794+0000 7f07d9990640 1 -- 172.21.15.96:0/3068547653 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07d40c6ac0 con 0x7f07d40c9310 2024-06-03T00:01:13.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.794+0000 7f07d0ff9640 1 -- 172.21.15.96:0/3068547653 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) ==== 80+0+0 (secure 0 0 0) 0x7f07cc010040 con 0x7f07d40c9310 2024-06-03T00:01:13.794 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-03T00:01:13.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 -- 172.21.15.96:0/3068547653 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f07b406be30 msgr2=0x7f07b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f07b406be30 0x7f07b406e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07c4032000 tx=0x7f07c402d000 comp rx=0 tx=0).stop 2024-06-03T00:01:13.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 -- 172.21.15.96:0/3068547653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d40c9310 msgr2=0x7f07d4154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d40c9310 0x7f07d4154b00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f07cc011b40 tx=0x7f07cc00f1b0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 -- 172.21.15.96:0/3068547653 shutdown_connections 2024-06-03T00:01:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f07b406be30 0x7f07b406e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07d40c9310 0x7f07d4154b00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07d4154100 0x7f07d40c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 --2- 172.21.15.96:0/3068547653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07c00039b0 0x7f07d414bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 -- 172.21.15.96:0/3068547653 >> 172.21.15.96:0/3068547653 conn(0x7f07d40cfc30 msgr2=0x7f07d40b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:13.797 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 -- 172.21.15.96:0/3068547653 shutdown_connections 2024-06-03T00:01:13.798 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.796+0000 7f07d9990640 1 -- 172.21.15.96:0/3068547653 wait complete. 2024-06-03T00:01:13.807 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-03T00:01:13.807 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-03T00:01:13.823 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-03T00:01:13.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.963+0000 7fa473645640 1 Processor -- start 2024-06-03T00:01:13.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.964+0000 7fa473645640 1 -- start start 2024-06-03T00:01:13.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.964+0000 7fa473645640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa46c161900 0x7fa46c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.964+0000 7fa473645640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa46c0b5510 0x7fa46c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.964+0000 7fa473645640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46c0d4a90 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.964+0000 7fa473645640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fa46c0cf5c0 con 0x7fa46c0b5510 2024-06-03T00:01:13.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.964+0000 7fa473645640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa46c0caf70 con 0x7fa46c161900 2024-06-03T00:01:13.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.965+0000 7fa470be0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa46c0b5510 0x7fa46c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.965+0000 7fa471be2640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa46c0b4fa0 0x7fa46c0d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40938/0 (socket says 172.21.15.96:40938) 2024-06-03T00:01:13.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.965+0000 7fa471be2640 1 -- 172.21.15.96:0/2085330400 learned_addr learned my addr 172.21.15.96:0/2085330400 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-03T00:01:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.965+0000 7fa470be0640 1 -- 172.21.15.96:0/2085330400 >> v2:172.21.15.162:3300/0 conn(0x7fa46c161900 msgr2=0x7fa46c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.965+0000 7fa470be0640 1 --2- 172.21.15.96:0/2085330400 >> v2:172.21.15.162:3300/0 conn(0x7fa46c161900 0x7fa46c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.965+0000 7fa470be0640 1 -- 172.21.15.96:0/2085330400 >> v1:172.21.15.96:6789/0 conn(0x7fa46c0b4fa0 legacy=0x7fa46c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.965+0000 7fa470be0640 1 -- 172.21.15.96:0/2085330400 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c0d4d70 con 0x7fa46c0b5510 2024-06-03T00:01:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.965+0000 7fa45ffff640 1 -- 172.21.15.96:0/2085330400 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317012147 0 0) 0x7fa46c0d4a90 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa470be0640 1 --2- 172.21.15.96:0/2085330400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b5510 0x7fa46c0d0f50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0d1740 tx=0x7fa46802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e020890def8d3e6f server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:13.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa45ffff640 1 -- 172.21.15.96:0/2085330400 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468037070 con 0x7fa46c0b5510 2024-06-03T00:01:13.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa45ffff640 1 -- 172.21.15.96:0/2085330400 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa468032440 con 0x7fa46c0b5510 2024-06-03T00:01:13.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa45ffff640 1 -- 172.21.15.96:0/2085330400 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46802ae60 con 0x7fa46c0b5510 2024-06-03T00:01:13.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa473645640 1 -- 172.21.15.96:0/2085330400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b5510 msgr2=0x7fa46c0d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa473645640 1 --2- 172.21.15.96:0/2085330400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b5510 0x7fa46c0d0f50 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0d1740 tx=0x7fa46802a110 comp rx=0 tx=0).stop 2024-06-03T00:01:13.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa473645640 1 -- 172.21.15.96:0/2085330400 shutdown_connections 2024-06-03T00:01:13.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa473645640 1 --2- 172.21.15.96:0/2085330400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b5510 0x7fa46c0d0f50 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa473645640 1 --2- 172.21.15.96:0/2085330400 >> v2:172.21.15.162:3300/0 conn(0x7fa46c161900 0x7fa46c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa473645640 1 -- 172.21.15.96:0/2085330400 >> 172.21.15.96:0/2085330400 conn(0x7fa46c09d3b0 msgr2=0x7fa46c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:13.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa473645640 1 -- 172.21.15.96:0/2085330400 shutdown_connections 2024-06-03T00:01:13.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.966+0000 7fa473645640 1 -- 172.21.15.96:0/2085330400 wait complete. 2024-06-03T00:01:13.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa473645640 1 Processor -- start 2024-06-03T00:01:13.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa473645640 1 -- start start 2024-06-03T00:01:13.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa473645640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b4fa0 0x7fa46c0b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa473645640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46c0b5510 0x7fa46c0b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa473645640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c161900 0x7fa46c155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa473645640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0d4780 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa473645640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0cfae0 con 0x7fa46c161900 2024-06-03T00:01:13.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa473645640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c161ce0 con 0x7fa46c0b5510 2024-06-03T00:01:13.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa4713e1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b4fa0 0x7fa46c0b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa4713e1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b4fa0 0x7fa46c0b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51296/0 (socket says 172.21.15.96:51296) 2024-06-03T00:01:13.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.968+0000 7fa4713e1640 1 -- 172.21.15.96:0/1784365774 learned_addr learned my addr 172.21.15.96:0/1784365774 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:13.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa471be2640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c161900 0x7fa46c155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa4713e1640 1 -- 172.21.15.96:0/1784365774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46c0b5510 msgr2=0x7fa46c0b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa4713e1640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46c0b5510 0x7fa46c0b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa4713e1640 1 -- 172.21.15.96:0/1784365774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c161900 msgr2=0x7fa46c155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:13.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa4713e1640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c161900 0x7fa46c155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:13.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa4713e1640 1 -- 172.21.15.96:0/1784365774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c156020 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa471be2640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c161900 0x7fa46c155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:13.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa4713e1640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b4fa0 0x7fa46c0b8da0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa46000b440 tx=0x7fa46000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:13.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa45dffb640 1 -- 172.21.15.96:0/1784365774 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa460015020 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa45dffb640 1 -- 172.21.15.96:0/1784365774 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa460011890 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa473645640 1 -- 172.21.15.96:0/1784365774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c156300 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa45dffb640 1 -- 172.21.15.96:0/1784365774 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa460011c80 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.969+0000 7fa473645640 1 -- 172.21.15.96:0/1784365774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c1568c0 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.970+0000 7fa473645640 1 -- 172.21.15.96:0/1784365774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c0683e0 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.971+0000 7fa45dffb640 1 -- 172.21.15.96:0/1784365774 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fa460018020 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.971+0000 7fa45dffb640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fa45006be30 0x7fa45006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:13.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.971+0000 7fa45dffb640 1 -- 172.21.15.96:0/1784365774 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7fa46008b1c0 con 0x7fa46c0b4fa0 2024-06-03T00:01:13.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.971+0000 7fa470be0640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fa45006be30 0x7fa45006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:13.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.972+0000 7fa470be0640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fa45006be30 0x7fa45006e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa468034000 tx=0x7fa46802c000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:13.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:13.975+0000 7fa45dffb640 1 -- 172.21.15.96:0/1784365774 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fa46001f020 con 0x7fa46c0b4fa0 2024-06-03T00:01:14.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.159+0000 7fa473645640 1 -- 172.21.15.96:0/1784365774 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa46c0d05e0 con 0x7fa46c0b4fa0 2024-06-03T00:01:14.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.159+0000 7fa45dffb640 1 -- 172.21.15.96:0/1784365774 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) ==== 80+0+0 (secure 0 0 0) 0x7fa46000d040 con 0x7fa46c0b4fa0 2024-06-03T00:01:14.160 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2024-06-03T00:01:14.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.161+0000 7fa473645640 1 -- 172.21.15.96:0/1784365774 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fa45006be30 msgr2=0x7fa45006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.161+0000 7fa473645640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fa45006be30 0x7fa45006e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa468034000 tx=0x7fa46802c000 comp rx=0 tx=0).stop 2024-06-03T00:01:14.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.161+0000 7fa473645640 1 -- 172.21.15.96:0/1784365774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b4fa0 msgr2=0x7fa46c0b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:14.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.161+0000 7fa473645640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b4fa0 0x7fa46c0b8da0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa46000b440 tx=0x7fa46000b900 comp rx=0 tx=0).stop 2024-06-03T00:01:14.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.161+0000 7fa473645640 1 -- 172.21.15.96:0/1784365774 shutdown_connections 2024-06-03T00:01:14.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.161+0000 7fa473645640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fa45006be30 0x7fa45006e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.161+0000 7fa473645640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa46c161900 0x7fa46c155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.161+0000 7fa473645640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46c0b5510 0x7fa46c0b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.161+0000 7fa473645640 1 --2- 172.21.15.96:0/1784365774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa46c0b4fa0 0x7fa46c0b8da0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:14.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.162+0000 7fa473645640 1 -- 172.21.15.96:0/1784365774 >> 172.21.15.96:0/1784365774 conn(0x7fa46c09d3b0 msgr2=0x7fa46c160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:14.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.162+0000 7fa473645640 1 -- 172.21.15.96:0/1784365774 shutdown_connections 2024-06-03T00:01:14.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:14.162+0000 7fa473645640 1 -- 172.21.15.96:0/1784365774 wait complete. 2024-06-03T00:01:14.172 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2024-06-03T00:01:14.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:01:14.173 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-06-03T00:01:14.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[59434]: fuse finished with error 0 and tester_r 0 2024-06-03T00:01:14.199 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:14.238 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-06-03T00:01:14.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:01:14.238 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-03T00:01:14.294 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-06-03T00:01:14.294 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-03T00:01:14.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17530 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248812k,nr_inodes=812203,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497632k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-06-03T00:01:14.350 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-03T00:01:14.350 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-03T00:01:14.372 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056333,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16850 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-03T00:01:14.372 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-03T00:01:14.372 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-03T00:01:14.432 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056333,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16850 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248816k,nr_inodes=812204,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497636k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-06-03T00:01:14.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:01:14.432 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-06-03T00:01:14.490 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-06-03T00:01:14.491 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-06-03T00:01:14.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:01:14.491 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-06-03T00:01:14.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:01:14.562 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-06-03T00:01:14.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:01:14.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-06-03T00:01:14.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:01:14.726 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-06-03T00:01:14.743 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-06-03T00:01:14.743 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-03T00:01:14.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:01:14.744 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-06-03T00:01:14.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:01:14.809 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-03T00:01:14.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-03T00:01:14.877 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-06-03T00:01:14.967 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-06-03T00:01:14.978 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-06-03T00:01:14.978 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-03T00:01:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.079+0000 7f1ead1ee640 1 Processor -- start 2024-06-03T00:01:15.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.079+0000 7f1ead1ee640 1 -- start start 2024-06-03T00:01:15.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.079+0000 7f1ead1ee640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1ea8155570 0x7f1ea806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.079+0000 7f1ead1ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 0x7f1ea8072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.079+0000 7f1ead1ee640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ea8155950 con 0x7f1ea806eb50 2024-06-03T00:01:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.079+0000 7f1ead1ee640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1ea80cb2e0 con 0x7f1ea8155570 2024-06-03T00:01:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.079+0000 7f1ead1ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea80cb5c0 con 0x7f1ea80cad30 2024-06-03T00:01:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.080+0000 7f1ea759e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 0x7f1ea8072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.080+0000 7f1ea759e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 0x7f1ea8072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:48032/0 (socket says 172.21.15.96:48032) 2024-06-03T00:01:15.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.080+0000 7f1ea6d9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1ea8155570 0x7f1ea806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.080+0000 7f1ea759e640 1 -- 172.21.15.96:0/2323197126 learned_addr learned my addr 172.21.15.96:0/2323197126 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:15.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.081+0000 7f1ea6d9d640 1 -- 172.21.15.96:0/2323197126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 msgr2=0x7f1ea8072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:15.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.081+0000 7f1ea6d9d640 1 --2- 172.21.15.96:0/2323197126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 0x7f1ea8072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.081+0000 7f1ea6d9d640 1 -- 172.21.15.96:0/2323197126 >> v1:172.21.15.162:6789/0 conn(0x7f1ea806eb50 legacy=0x7f1ea80ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.081+0000 7f1ea6d9d640 1 -- 172.21.15.96:0/2323197126 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea80cb8a0 con 0x7f1ea8155570 2024-06-03T00:01:15.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.081+0000 7f1ea5d9b640 1 -- 172.21.15.96:0/2323197126 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211435363 0 0) 0x7f1ea8155950 con 0x7f1ea806eb50 2024-06-03T00:01:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.081+0000 7f1ea6d9d640 1 --2- 172.21.15.96:0/2323197126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ea8155570 0x7f1ea806e610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1e980097a0 tx=0x7f1e9802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce3e787395f1935 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.081+0000 7f1ea5d9b640 1 -- 172.21.15.96:0/2323197126 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98037070 con 0x7f1ea8155570 2024-06-03T00:01:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.082+0000 7f1ea5d9b640 1 -- 172.21.15.96:0/2323197126 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e98032440 con 0x7f1ea8155570 2024-06-03T00:01:15.086 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.082+0000 7f1ea5d9b640 1 -- 172.21.15.96:0/2323197126 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98032810 con 0x7f1ea8155570 2024-06-03T00:01:15.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.082+0000 7f1ead1ee640 1 -- 172.21.15.96:0/2323197126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ea8155570 msgr2=0x7f1ea806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.082+0000 7f1ead1ee640 1 --2- 172.21.15.96:0/2323197126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ea8155570 0x7f1ea806e610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1e980097a0 tx=0x7f1e9802a180 comp rx=0 tx=0).stop 2024-06-03T00:01:15.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.082+0000 7f1ead1ee640 1 -- 172.21.15.96:0/2323197126 shutdown_connections 2024-06-03T00:01:15.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.082+0000 7f1ead1ee640 1 --2- 172.21.15.96:0/2323197126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 0x7f1ea8072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.082+0000 7f1ead1ee640 1 --2- 172.21.15.96:0/2323197126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ea8155570 0x7f1ea806e610 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.087 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.082+0000 7f1ead1ee640 1 -- 172.21.15.96:0/2323197126 >> 172.21.15.96:0/2323197126 conn(0x7f1ea80cfc30 msgr2=0x7f1ea80d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.082+0000 7f1ead1ee640 1 -- 172.21.15.96:0/2323197126 shutdown_connections 2024-06-03T00:01:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.082+0000 7f1ead1ee640 1 -- 172.21.15.96:0/2323197126 wait complete. 2024-06-03T00:01:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ead1ee640 1 Processor -- start 2024-06-03T00:01:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ead1ee640 1 -- start start 2024-06-03T00:01:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ead1ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ea806eb50 0x7f1ea815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ead1ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 0x7f1ea8153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ead1ee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea8155570 0x7f1ea81574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.088 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ead1ee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea8072560 con 0x7f1ea8155570 2024-06-03T00:01:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ead1ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea80717d0 con 0x7f1ea806eb50 2024-06-03T00:01:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ead1ee640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea80726e0 con 0x7f1ea80cad30 2024-06-03T00:01:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ea759e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea8155570 0x7f1ea81574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ea759e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea8155570 0x7f1ea81574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51312/0 (socket says 172.21.15.96:51312) 2024-06-03T00:01:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ea759e640 1 -- 172.21.15.96:0/4128476327 learned_addr learned my addr 172.21.15.96:0/4128476327 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.084+0000 7f1ea6d9d640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ea806eb50 0x7f1ea815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1ea659c640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 0x7f1ea8153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.089 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1ea759e640 1 -- 172.21.15.96:0/4128476327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 msgr2=0x7f1ea8153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1ea759e640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 0x7f1ea8153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1ea759e640 1 -- 172.21.15.96:0/4128476327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ea806eb50 msgr2=0x7f1ea815e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1ea759e640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ea806eb50 0x7f1ea815e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1ea759e640 1 -- 172.21.15.96:0/4128476327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea8156730 con 0x7f1ea8155570 2024-06-03T00:01:15.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1ea759e640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea8155570 0x7f1ea81574b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0010f30 tx=0x7f1ea000e550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:15.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1e8f7fe640 1 -- 172.21.15.96:0/4128476327 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000b310 con 0x7f1ea8155570 2024-06-03T00:01:15.090 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1e8f7fe640 1 -- 172.21.15.96:0/4128476327 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea0003990 con 0x7f1ea8155570 2024-06-03T00:01:15.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1ead1ee640 1 -- 172.21.15.96:0/4128476327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea81569d0 con 0x7f1ea8155570 2024-06-03T00:01:15.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1e8f7fe640 1 -- 172.21.15.96:0/4128476327 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0003d60 con 0x7f1ea8155570 2024-06-03T00:01:15.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.085+0000 7f1ead1ee640 1 -- 172.21.15.96:0/4128476327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea815e720 con 0x7f1ea8155570 2024-06-03T00:01:15.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.086+0000 7f1ead1ee640 1 -- 172.21.15.96:0/4128476327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea80683e0 con 0x7f1ea8155570 2024-06-03T00:01:15.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.087+0000 7f1e8f7fe640 1 -- 172.21.15.96:0/4128476327 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f1ea0005d10 con 0x7f1ea8155570 2024-06-03T00:01:15.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.087+0000 7f1e8f7fe640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e9406be30 0x7f1e9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.087+0000 7f1e8f7fe640 1 -- 172.21.15.96:0/4128476327 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f1ea008d600 con 0x7f1ea8155570 2024-06-03T00:01:15.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.087+0000 7f1ea6d9d640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e9406be30 0x7f1e9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.088+0000 7f1ea6d9d640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e9406be30 0x7f1e9406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e98034000 tx=0x7f1e9802e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:15.092 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.091+0000 7f1e8f7fe640 1 -- 172.21.15.96:0/4128476327 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1ea0024020 con 0x7f1ea8155570 2024-06-03T00:01:15.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.263+0000 7f1ead1ee640 1 -- 172.21.15.96:0/4128476327 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ea806cc90 con 0x7f1e9406be30 2024-06-03T00:01:15.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.269+0000 7f1e8f7fe640 1 -- 172.21.15.96:0/4128476327 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7f1ea806cc90 con 0x7f1e9406be30 2024-06-03T00:01:15.272 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-03T00:01:15.273 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-03T00:01:15.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 -- 172.21.15.96:0/4128476327 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e9406be30 msgr2=0x7f1e9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e9406be30 0x7f1e9406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e98034000 tx=0x7f1e9802e000 comp rx=0 tx=0).stop 2024-06-03T00:01:15.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 -- 172.21.15.96:0/4128476327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea8155570 msgr2=0x7f1ea81574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea8155570 0x7f1ea81574b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0010f30 tx=0x7f1ea000e550 comp rx=0 tx=0).stop 2024-06-03T00:01:15.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 -- 172.21.15.96:0/4128476327 shutdown_connections 2024-06-03T00:01:15.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e9406be30 0x7f1e9406e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1ea8155570 0x7f1ea81574b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea80cad30 0x7f1ea8153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 --2- 172.21.15.96:0/4128476327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ea806eb50 0x7f1ea815e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 -- 172.21.15.96:0/4128476327 >> 172.21.15.96:0/4128476327 conn(0x7f1ea80cfc30 msgr2=0x7f1ea80af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:15.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 -- 172.21.15.96:0/4128476327 shutdown_connections 2024-06-03T00:01:15.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.272+0000 7f1ead1ee640 1 -- 172.21.15.96:0/4128476327 wait complete. 2024-06-03T00:01:15.283 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-06-03T00:01:14.526808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594033,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":247,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319900,"kb_used_data":7976,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754654820,"statfs":{"total":773094113280,"available":772766535680,"internally_reserved":0,"allocated":8167424,"data_stored":4657234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002968"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229064+0000","last_change":"2024-06-02T23:59:01.586938+0000","last_active":"2024-06-03T00:00:46.229064+0000","last_peered":"2024-06-03T00:00:46.229064+0000","last_clean":"2024-06-03T00:00:46.229064+0000","last_became_active":"2024-06-02T23:59:01.586669+0000","last_became_peered":"2024-06-02T23:59:01.586669+0000","last_unstale":"2024-06-03T00:00:46.229064+0000","last_undegraded":"2024-06-03T00:00:46.229064+0000","last_fullsized":"2024-06-03T00:00:46.229064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:32:12.883830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781379+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-03T00:00:45.781379+0000","last_peered":"2024-06-03T00:00:45.781379+0000","last_clean":"2024-06-03T00:00:45.781379+0000","last_became_active":"2024-06-02T23:59:01.582687+0000","last_became_peered":"2024-06-02T23:59:01.582687+0000","last_unstale":"2024-06-03T00:00:45.781379+0000","last_undegraded":"2024-06-03T00:00:45.781379+0000","last_fullsized":"2024-06-03T00:00:45.781379+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230121+0000","last_change":"2024-06-02T23:59:01.586233+0000","last_active":"2024-06-03T00:00:46.230121+0000","last_peered":"2024-06-03T00:00:46.230121+0000","last_clean":"2024-06-03T00:00:46.230121+0000","last_became_active":"2024-06-02T23:59:01.586006+0000","last_became_peered":"2024-06-02T23:59:01.586006+0000","last_unstale":"2024-06-03T00:00:46.230121+0000","last_undegraded":"2024-06-03T00:00:46.230121+0000","last_fullsized":"2024-06-03T00:00:46.230121+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780728+0000","last_change":"2024-06-02T23:59:01.587310+0000","last_active":"2024-06-03T00:00:45.780728+0000","last_peered":"2024-06-03T00:00:45.780728+0000","last_clean":"2024-06-03T00:00:45.780728+0000","last_became_active":"2024-06-02T23:59:01.586761+0000","last_became_peered":"2024-06-02T23:59:01.586761+0000","last_unstale":"2024-06-03T00:00:45.780728+0000","last_undegraded":"2024-06-03T00:00:45.780728+0000","last_fullsized":"2024-06-03T00:00:45.780728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776333+0000","last_change":"2024-06-02T23:59:01.583800+0000","last_active":"2024-06-03T00:00:45.776333+0000","last_peered":"2024-06-03T00:00:45.776333+0000","last_clean":"2024-06-03T00:00:45.776333+0000","last_became_active":"2024-06-02T23:59:01.581028+0000","last_became_peered":"2024-06-02T23:59:01.581028+0000","last_unstale":"2024-06-03T00:00:45.776333+0000","last_undegraded":"2024-06-03T00:00:45.776333+0000","last_fullsized":"2024-06-03T00:00:45.776333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:25:47.061955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228969+0000","last_change":"2024-06-02T23:59:01.587296+0000","last_active":"2024-06-03T00:00:46.228969+0000","last_peered":"2024-06-03T00:00:46.228969+0000","last_clean":"2024-06-03T00:00:46.228969+0000","last_became_active":"2024-06-02T23:59:01.586996+0000","last_became_peered":"2024-06-02T23:59:01.586996+0000","last_unstale":"2024-06-03T00:00:46.228969+0000","last_undegraded":"2024-06-03T00:00:46.228969+0000","last_fullsized":"2024-06-03T00:00:46.228969+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:56:54.953142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229778+0000","last_change":"2024-06-02T23:59:01.586195+0000","last_active":"2024-06-03T00:00:46.229778+0000","last_peered":"2024-06-03T00:00:46.229778+0000","last_clean":"2024-06-03T00:00:46.229778+0000","last_became_active":"2024-06-02T23:59:01.583488+0000","last_became_peered":"2024-06-02T23:59:01.583488+0000","last_unstale":"2024-06-03T00:00:46.229778+0000","last_undegraded":"2024-06-03T00:00:46.229778+0000","last_fullsized":"2024-06-03T00:00:46.229778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:42:09.116457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773168+0000","last_change":"2024-06-02T23:59:01.588746+0000","last_active":"2024-06-03T00:00:45.773168+0000","last_peered":"2024-06-03T00:00:45.773168+0000","last_clean":"2024-06-03T00:00:45.773168+0000","last_became_active":"2024-06-02T23:59:01.588310+0000","last_became_peered":"2024-06-02T23:59:01.588310+0000","last_unstale":"2024-06-03T00:00:45.773168+0000","last_undegraded":"2024-06-03T00:00:45.773168+0000","last_fullsized":"2024-06-03T00:00:45.773168+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:56:25.974137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773512+0000","last_change":"2024-06-02T23:59:01.592959+0000","last_active":"2024-06-03T00:00:45.773512+0000","last_peered":"2024-06-03T00:00:45.773512+0000","last_clean":"2024-06-03T00:00:45.773512+0000","last_became_active":"2024-06-02T23:59:01.592704+0000","last_became_peered":"2024-06-02T23:59:01.592704+0000","last_unstale":"2024-06-03T00:00:45.773512+0000","last_undegraded":"2024-06-03T00:00:45.773512+0000","last_fullsized":"2024-06-03T00:00:45.773512+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:57:55.310878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228621+0000","last_change":"2024-06-02T23:59:01.589283+0000","last_active":"2024-06-03T00:00:46.228621+0000","last_peered":"2024-06-03T00:00:46.228621+0000","last_clean":"2024-06-03T00:00:46.228621+0000","last_became_active":"2024-06-02T23:59:01.588961+0000","last_became_peered":"2024-06-02T23:59:01.588961+0000","last_unstale":"2024-06-03T00:00:46.228621+0000","last_undegraded":"2024-06-03T00:00:46.228621+0000","last_fullsized":"2024-06-03T00:00:46.228621+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:09:42.099307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229227+0000","last_change":"2024-06-02T23:59:01.583139+0000","last_active":"2024-06-03T00:00:46.229227+0000","last_peered":"2024-06-03T00:00:46.229227+0000","last_clean":"2024-06-03T00:00:46.229227+0000","last_became_active":"2024-06-02T23:59:01.582876+0000","last_became_peered":"2024-06-02T23:59:01.582876+0000","last_unstale":"2024-06-03T00:00:46.229227+0000","last_undegraded":"2024-06-03T00:00:46.229227+0000","last_fullsized":"2024-06-03T00:00:46.229227+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.666135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773306+0000","last_change":"2024-06-02T23:59:01.589336+0000","last_active":"2024-06-03T00:00:45.773306+0000","last_peered":"2024-06-03T00:00:45.773306+0000","last_clean":"2024-06-03T00:00:45.773306+0000","last_became_active":"2024-06-02T23:59:01.589067+0000","last_became_peered":"2024-06-02T23:59:01.589067+0000","last_unstale":"2024-06-03T00:00:45.773306+0000","last_undegraded":"2024-06-03T00:00:45.773306+0000","last_fullsized":"2024-06-03T00:00:45.773306+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:49:36.524901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228658+0000","last_change":"2024-06-02T23:59:01.591325+0000","last_active":"2024-06-03T00:00:46.228658+0000","last_peered":"2024-06-03T00:00:46.228658+0000","last_clean":"2024-06-03T00:00:46.228658+0000","last_became_active":"2024-06-02T23:59:01.590545+0000","last_became_peered":"2024-06-02T23:59:01.590545+0000","last_unstale":"2024-06-03T00:00:46.228658+0000","last_undegraded":"2024-06-03T00:00:46.228658+0000","last_fullsized":"2024-06-03T00:00:46.228658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:17.184163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229891+0000","last_change":"2024-06-02T23:59:01.583413+0000","last_active":"2024-06-03T00:00:46.229891+0000","last_peered":"2024-06-03T00:00:46.229891+0000","last_clean":"2024-06-03T00:00:46.229891+0000","last_became_active":"2024-06-02T23:59:01.582568+0000","last_became_peered":"2024-06-02T23:59:01.582568+0000","last_unstale":"2024-06-03T00:00:46.229891+0000","last_undegraded":"2024-06-03T00:00:46.229891+0000","last_fullsized":"2024-06-03T00:00:46.229891+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:45.895866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780842+0000","last_change":"2024-06-02T23:59:01.591575+0000","last_active":"2024-06-03T00:00:45.780842+0000","last_peered":"2024-06-03T00:00:45.780842+0000","last_clean":"2024-06-03T00:00:45.780842+0000","last_became_active":"2024-06-02T23:59:01.591265+0000","last_became_peered":"2024-06-02T23:59:01.591265+0000","last_unstale":"2024-06-03T00:00:45.780842+0000","last_undegraded":"2024-06-03T00:00:45.780842+0000","last_fullsized":"2024-06-03T00:00:45.780842+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228641+0000","last_change":"2024-06-02T23:59:01.590700+0000","last_active":"2024-06-03T00:00:46.228641+0000","last_peered":"2024-06-03T00:00:46.228641+0000","last_clean":"2024-06-03T00:00:46.228641+0000","last_became_active":"2024-06-02T23:59:01.590445+0000","last_became_peered":"2024-06-02T23:59:01.590445+0000","last_unstale":"2024-06-03T00:00:46.228641+0000","last_undegraded":"2024-06-03T00:00:46.228641+0000","last_fullsized":"2024-06-03T00:00:46.228641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:31.933956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230494+0000","last_change":"2024-06-02T23:59:01.587034+0000","last_active":"2024-06-03T00:00:46.230494+0000","last_peered":"2024-06-03T00:00:46.230494+0000","last_clean":"2024-06-03T00:00:46.230494+0000","last_became_active":"2024-06-02T23:59:01.586784+0000","last_became_peered":"2024-06-02T23:59:01.586784+0000","last_unstale":"2024-06-03T00:00:46.230494+0000","last_undegraded":"2024-06-03T00:00:46.230494+0000","last_fullsized":"2024-06-03T00:00:46.230494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:10.502903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781431+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-03T00:00:45.781431+0000","last_peered":"2024-06-03T00:00:45.781431+0000","last_clean":"2024-06-03T00:00:45.781431+0000","last_became_active":"2024-06-02T23:59:01.582680+0000","last_became_peered":"2024-06-02T23:59:01.582680+0000","last_unstale":"2024-06-03T00:00:45.781431+0000","last_undegraded":"2024-06-03T00:00:45.781431+0000","last_fullsized":"2024-06-03T00:00:45.781431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230068+0000","last_change":"2024-06-02T23:59:01.582684+0000","last_active":"2024-06-03T00:00:46.230068+0000","last_peered":"2024-06-03T00:00:46.230068+0000","last_clean":"2024-06-03T00:00:46.230068+0000","last_became_active":"2024-06-02T23:59:01.582422+0000","last_became_peered":"2024-06-02T23:59:01.582422+0000","last_unstale":"2024-06-03T00:00:46.230068+0000","last_undegraded":"2024-06-03T00:00:46.230068+0000","last_fullsized":"2024-06-03T00:00:46.230068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:06.674997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080965+0000","last_change":"2024-06-02T23:59:01.591052+0000","last_active":"2024-06-03T00:00:46.080965+0000","last_peered":"2024-06-03T00:00:46.080965+0000","last_clean":"2024-06-03T00:00:46.080965+0000","last_became_active":"2024-06-02T23:59:01.590601+0000","last_became_peered":"2024-06-02T23:59:01.590601+0000","last_unstale":"2024-06-03T00:00:46.080965+0000","last_undegraded":"2024-06-03T00:00:46.080965+0000","last_fullsized":"2024-06-03T00:00:46.080965+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:29:55.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080646+0000","last_change":"2024-06-02T23:59:01.593871+0000","last_active":"2024-06-03T00:00:46.080646+0000","last_peered":"2024-06-03T00:00:46.080646+0000","last_clean":"2024-06-03T00:00:46.080646+0000","last_became_active":"2024-06-02T23:59:01.593596+0000","last_became_peered":"2024-06-02T23:59:01.593596+0000","last_unstale":"2024-06-03T00:00:46.080646+0000","last_undegraded":"2024-06-03T00:00:46.080646+0000","last_fullsized":"2024-06-03T00:00:46.080646+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:35:33.955552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773123+0000","last_change":"2024-06-02T23:59:01.587899+0000","last_active":"2024-06-03T00:00:45.773123+0000","last_peered":"2024-06-03T00:00:45.773123+0000","last_clean":"2024-06-03T00:00:45.773123+0000","last_became_active":"2024-06-02T23:59:01.587641+0000","last_became_peered":"2024-06-02T23:59:01.587641+0000","last_unstale":"2024-06-03T00:00:45.773123+0000","last_undegraded":"2024-06-03T00:00:45.773123+0000","last_fullsized":"2024-06-03T00:00:45.773123+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:24:09.334139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228797+0000","last_change":"2024-06-02T23:59:01.584645+0000","last_active":"2024-06-03T00:00:46.228797+0000","last_peered":"2024-06-03T00:00:46.228797+0000","last_clean":"2024-06-03T00:00:46.228797+0000","last_became_active":"2024-06-02T23:59:01.584358+0000","last_became_peered":"2024-06-02T23:59:01.584358+0000","last_unstale":"2024-06-03T00:00:46.228797+0000","last_undegraded":"2024-06-03T00:00:46.228797+0000","last_fullsized":"2024-06-03T00:00:46.228797+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:31:25.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229486+0000","last_change":"2024-06-02T23:59:01.583175+0000","last_active":"2024-06-03T00:00:46.229486+0000","last_peered":"2024-06-03T00:00:46.229486+0000","last_clean":"2024-06-03T00:00:46.229486+0000","last_became_active":"2024-06-02T23:59:01.582904+0000","last_became_peered":"2024-06-02T23:59:01.582904+0000","last_unstale":"2024-06-03T00:00:46.229486+0000","last_undegraded":"2024-06-03T00:00:46.229486+0000","last_fullsized":"2024-06-03T00:00:46.229486+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:56:06.478241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229396+0000","last_change":"2024-06-02T23:59:01.591616+0000","last_active":"2024-06-03T00:00:46.229396+0000","last_peered":"2024-06-03T00:00:46.229396+0000","last_clean":"2024-06-03T00:00:46.229396+0000","last_became_active":"2024-06-02T23:59:01.589760+0000","last_became_peered":"2024-06-02T23:59:01.589760+0000","last_unstale":"2024-06-03T00:00:46.229396+0000","last_undegraded":"2024-06-03T00:00:46.229396+0000","last_fullsized":"2024-06-03T00:00:46.229396+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:29.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773359+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-03T00:00:45.773359+0000","last_peered":"2024-06-03T00:00:45.773359+0000","last_clean":"2024-06-03T00:00:45.773359+0000","last_became_active":"2024-06-02T23:59:01.585010+0000","last_became_peered":"2024-06-02T23:59:01.585010+0000","last_unstale":"2024-06-03T00:00:45.773359+0000","last_undegraded":"2024-06-03T00:00:45.773359+0000","last_fullsized":"2024-06-03T00:00:45.773359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:50:01.657005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229148+0000","last_change":"2024-06-02T23:59:01.593067+0000","last_active":"2024-06-03T00:00:46.229148+0000","last_peered":"2024-06-03T00:00:46.229148+0000","last_clean":"2024-06-03T00:00:46.229148+0000","last_became_active":"2024-06-02T23:59:01.592789+0000","last_became_peered":"2024-06-02T23:59:01.592789+0000","last_unstale":"2024-06-03T00:00:46.229148+0000","last_undegraded":"2024-06-03T00:00:46.229148+0000","last_fullsized":"2024-06-03T00:00:46.229148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:25:47.061955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080990+0000","last_change":"2024-06-02T23:59:01.591460+0000","last_active":"2024-06-03T00:00:46.080990+0000","last_peered":"2024-06-03T00:00:46.080990+0000","last_clean":"2024-06-03T00:00:46.080990+0000","last_became_active":"2024-06-02T23:59:01.590827+0000","last_became_peered":"2024-06-02T23:59:01.590827+0000","last_unstale":"2024-06-03T00:00:46.080990+0000","last_undegraded":"2024-06-03T00:00:46.080990+0000","last_fullsized":"2024-06-03T00:00:46.080990+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:27.044276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229879+0000","last_change":"2024-06-02T23:59:01.589715+0000","last_active":"2024-06-03T00:00:46.229879+0000","last_peered":"2024-06-03T00:00:46.229879+0000","last_clean":"2024-06-03T00:00:46.229879+0000","last_became_active":"2024-06-02T23:59:01.589456+0000","last_became_peered":"2024-06-02T23:59:01.589456+0000","last_unstale":"2024-06-03T00:00:46.229879+0000","last_undegraded":"2024-06-03T00:00:46.229879+0000","last_fullsized":"2024-06-03T00:00:46.229879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:36.510898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781075+0000","last_change":"2024-06-02T23:59:01.589048+0000","last_active":"2024-06-03T00:00:45.781075+0000","last_peered":"2024-06-03T00:00:45.781075+0000","last_clean":"2024-06-03T00:00:45.781075+0000","last_became_active":"2024-06-02T23:59:01.588773+0000","last_became_peered":"2024-06-02T23:59:01.588773+0000","last_unstale":"2024-06-03T00:00:45.781075+0000","last_undegraded":"2024-06-03T00:00:45.781075+0000","last_fullsized":"2024-06-03T00:00:45.781075+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229896+0000","last_change":"2024-06-02T23:59:01.586433+0000","last_active":"2024-06-03T00:00:46.229896+0000","last_peered":"2024-06-03T00:00:46.229896+0000","last_clean":"2024-06-03T00:00:46.229896+0000","last_became_active":"2024-06-02T23:59:01.585466+0000","last_became_peered":"2024-06-02T23:59:01.585466+0000","last_unstale":"2024-06-03T00:00:46.229896+0000","last_undegraded":"2024-06-03T00:00:46.229896+0000","last_fullsized":"2024-06-03T00:00:46.229896+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:24:38.083153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228206+0000","last_change":"2024-06-02T23:59:01.586007+0000","last_active":"2024-06-03T00:00:46.228206+0000","last_peered":"2024-06-03T00:00:46.228206+0000","last_clean":"2024-06-03T00:00:46.228206+0000","last_became_active":"2024-06-02T23:59:01.585721+0000","last_became_peered":"2024-06-02T23:59:01.585721+0000","last_unstale":"2024-06-03T00:00:46.228206+0000","last_undegraded":"2024-06-03T00:00:46.228206+0000","last_fullsized":"2024-06-03T00:00:46.228206+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:50:41.714294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780711+0000","last_change":"2024-06-02T23:59:01.582009+0000","last_active":"2024-06-03T00:00:45.780711+0000","last_peered":"2024-06-03T00:00:45.780711+0000","last_clean":"2024-06-03T00:00:45.780711+0000","last_became_active":"2024-06-02T23:59:01.581438+0000","last_became_peered":"2024-06-02T23:59:01.581438+0000","last_unstale":"2024-06-03T00:00:45.780711+0000","last_undegraded":"2024-06-03T00:00:45.780711+0000","last_fullsized":"2024-06-03T00:00:45.780711+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"69'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080898+0000","last_change":"2024-06-02T23:59:00.647990+0000","last_active":"2024-06-03T00:00:46.080898+0000","last_peered":"2024-06-03T00:00:46.080898+0000","last_clean":"2024-06-03T00:00:46.080898+0000","last_became_active":"2024-06-02T23:59:00.647031+0000","last_became_peered":"2024-06-02T23:59:00.647031+0000","last_unstale":"2024-06-03T00:00:46.080898+0000","last_undegraded":"2024-06-03T00:00:46.080898+0000","last_fullsized":"2024-06-03T00:00:46.080898+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:19:44.864617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228259+0000","last_change":"2024-06-02T23:59:01.587104+0000","last_active":"2024-06-03T00:00:46.228259+0000","last_peered":"2024-06-03T00:00:46.228259+0000","last_clean":"2024-06-03T00:00:46.228259+0000","last_became_active":"2024-06-02T23:59:01.586813+0000","last_became_peered":"2024-06-02T23:59:01.586813+0000","last_unstale":"2024-06-03T00:00:46.228259+0000","last_undegraded":"2024-06-03T00:00:46.228259+0000","last_fullsized":"2024-06-03T00:00:46.228259+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:10:37.679556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"69'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228813+0000","last_change":"2024-06-02T23:59:00.638860+0000","last_active":"2024-06-03T00:00:46.228813+0000","last_peered":"2024-06-03T00:00:46.228813+0000","last_clean":"2024-06-03T00:00:46.228813+0000","last_became_active":"2024-06-02T23:59:00.638579+0000","last_became_peered":"2024-06-02T23:59:00.638579+0000","last_unstale":"2024-06-03T00:00:46.228813+0000","last_undegraded":"2024-06-03T00:00:46.228813+0000","last_fullsized":"2024-06-03T00:00:46.228813+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:57:25.113202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080615+0000","last_change":"2024-06-02T23:59:01.593795+0000","last_active":"2024-06-03T00:00:46.080615+0000","last_peered":"2024-06-03T00:00:46.080615+0000","last_clean":"2024-06-03T00:00:46.080615+0000","last_became_active":"2024-06-02T23:59:01.593506+0000","last_became_peered":"2024-06-02T23:59:01.593506+0000","last_unstale":"2024-06-03T00:00:46.080615+0000","last_undegraded":"2024-06-03T00:00:46.080615+0000","last_fullsized":"2024-06-03T00:00:46.080615+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:51.301800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229152+0000","last_change":"2024-06-02T23:59:00.648871+0000","last_active":"2024-06-03T00:00:46.229152+0000","last_peered":"2024-06-03T00:00:46.229152+0000","last_clean":"2024-06-03T00:00:46.229152+0000","last_became_active":"2024-06-02T23:59:00.648667+0000","last_became_peered":"2024-06-02T23:59:00.648667+0000","last_unstale":"2024-06-03T00:00:46.229152+0000","last_undegraded":"2024-06-03T00:00:46.229152+0000","last_fullsized":"2024-06-03T00:00:46.229152+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:11:50.234565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773134+0000","last_change":"2024-06-02T23:59:01.585466+0000","last_active":"2024-06-03T00:00:45.773134+0000","last_peered":"2024-06-03T00:00:45.773134+0000","last_clean":"2024-06-03T00:00:45.773134+0000","last_became_active":"2024-06-02T23:59:01.585127+0000","last_became_peered":"2024-06-02T23:59:01.585127+0000","last_unstale":"2024-06-03T00:00:45.773134+0000","last_undegraded":"2024-06-03T00:00:45.773134+0000","last_fullsized":"2024-06-03T00:00:45.773134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:23:32.778002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228442+0000","last_change":"2024-06-02T23:59:00.642417+0000","last_active":"2024-06-03T00:00:46.228442+0000","last_peered":"2024-06-03T00:00:46.228442+0000","last_clean":"2024-06-03T00:00:46.228442+0000","last_became_active":"2024-06-02T23:59:00.642182+0000","last_became_peered":"2024-06-02T23:59:00.642182+0000","last_unstale":"2024-06-03T00:00:46.228442+0000","last_undegraded":"2024-06-03T00:00:46.228442+0000","last_fullsized":"2024-06-03T00:00:46.228442+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:48.372998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.082184+0000","last_change":"2024-06-03T00:00:46.082184+0000","last_active":"2024-06-03T00:00:46.082184+0000","last_peered":"2024-06-03T00:00:46.082184+0000","last_clean":"2024-06-03T00:00:46.082184+0000","last_became_active":"2024-06-03T00:00:46.081627+0000","last_became_peered":"2024-06-03T00:00:46.081627+0000","last_unstale":"2024-06-03T00:00:46.082184+0000","last_undegraded":"2024-06-03T00:00:46.082184+0000","last_fullsized":"2024-06-03T00:00:46.082184+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:40:22.021276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229869+0000","last_change":"2024-06-02T23:59:00.641231+0000","last_active":"2024-06-03T00:00:46.229869+0000","last_peered":"2024-06-03T00:00:46.229869+0000","last_clean":"2024-06-03T00:00:46.229869+0000","last_became_active":"2024-06-02T23:59:00.640963+0000","last_became_peered":"2024-06-02T23:59:00.640963+0000","last_unstale":"2024-06-03T00:00:46.229869+0000","last_undegraded":"2024-06-03T00:00:46.229869+0000","last_fullsized":"2024-06-03T00:00:46.229869+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.148246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781190+0000","last_change":"2024-06-02T23:59:01.591548+0000","last_active":"2024-06-03T00:00:45.781190+0000","last_peered":"2024-06-03T00:00:45.781190+0000","last_clean":"2024-06-03T00:00:45.781190+0000","last_became_active":"2024-06-02T23:59:01.591198+0000","last_became_peered":"2024-06-02T23:59:01.591198+0000","last_unstale":"2024-06-03T00:00:45.781190+0000","last_undegraded":"2024-06-03T00:00:45.781190+0000","last_fullsized":"2024-06-03T00:00:45.781190+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776211+0000","last_change":"2024-06-02T23:59:00.649120+0000","last_active":"2024-06-03T00:00:45.776211+0000","last_peered":"2024-06-03T00:00:45.776211+0000","last_clean":"2024-06-03T00:00:45.776211+0000","last_became_active":"2024-06-02T23:59:00.648839+0000","last_became_peered":"2024-06-02T23:59:00.648839+0000","last_unstale":"2024-06-03T00:00:45.776211+0000","last_undegraded":"2024-06-03T00:00:45.776211+0000","last_fullsized":"2024-06-03T00:00:45.776211+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:52:08.529881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773203+0000","last_change":"2024-06-02T23:59:01.585288+0000","last_active":"2024-06-03T00:00:45.773203+0000","last_peered":"2024-06-03T00:00:45.773203+0000","last_clean":"2024-06-03T00:00:45.773203+0000","last_became_active":"2024-06-02T23:59:01.584971+0000","last_became_peered":"2024-06-02T23:59:01.584971+0000","last_unstale":"2024-06-03T00:00:45.773203+0000","last_undegraded":"2024-06-03T00:00:45.773203+0000","last_fullsized":"2024-06-03T00:00:45.773203+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:54:54.767840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080841+0000","last_change":"2024-06-02T23:59:00.648200+0000","last_active":"2024-06-03T00:00:46.080841+0000","last_peered":"2024-06-03T00:00:46.080841+0000","last_clean":"2024-06-03T00:00:46.080841+0000","last_became_active":"2024-06-02T23:59:00.647175+0000","last_became_peered":"2024-06-02T23:59:00.647175+0000","last_unstale":"2024-06-03T00:00:46.080841+0000","last_undegraded":"2024-06-03T00:00:46.080841+0000","last_fullsized":"2024-06-03T00:00:46.080841+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:34:43.239731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.081972+0000","last_change":"2024-06-03T00:00:46.081972+0000","last_active":"2024-06-03T00:00:46.081972+0000","last_peered":"2024-06-03T00:00:46.081972+0000","last_clean":"2024-06-03T00:00:46.081972+0000","last_became_active":"2024-06-03T00:00:46.081552+0000","last_became_peered":"2024-06-03T00:00:46.081552+0000","last_unstale":"2024-06-03T00:00:46.081972+0000","last_undegraded":"2024-06-03T00:00:46.081972+0000","last_fullsized":"2024-06-03T00:00:46.081972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:37:10.667194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229593+0000","last_change":"2024-06-02T23:59:00.647400+0000","last_active":"2024-06-03T00:00:46.229593+0000","last_peered":"2024-06-03T00:00:46.229593+0000","last_clean":"2024-06-03T00:00:46.229593+0000","last_became_active":"2024-06-02T23:59:00.647210+0000","last_became_peered":"2024-06-02T23:59:00.647210+0000","last_unstale":"2024-06-03T00:00:46.229593+0000","last_undegraded":"2024-06-03T00:00:46.229593+0000","last_fullsized":"2024-06-03T00:00:46.229593+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:13.009966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776028+0000","last_change":"2024-06-02T23:59:01.587444+0000","last_active":"2024-06-03T00:00:45.776028+0000","last_peered":"2024-06-03T00:00:45.776028+0000","last_clean":"2024-06-03T00:00:45.776028+0000","last_became_active":"2024-06-02T23:59:01.587190+0000","last_became_peered":"2024-06-02T23:59:01.587190+0000","last_unstale":"2024-06-03T00:00:45.776028+0000","last_undegraded":"2024-06-03T00:00:45.776028+0000","last_fullsized":"2024-06-03T00:00:45.776028+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:56:54.953142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781643+0000","last_change":"2024-06-02T23:59:00.637111+0000","last_active":"2024-06-03T00:00:45.781643+0000","last_peered":"2024-06-03T00:00:45.781643+0000","last_clean":"2024-06-03T00:00:45.781643+0000","last_became_active":"2024-06-02T23:59:00.636815+0000","last_became_peered":"2024-06-02T23:59:00.636815+0000","last_unstale":"2024-06-03T00:00:45.781643+0000","last_undegraded":"2024-06-03T00:00:45.781643+0000","last_fullsized":"2024-06-03T00:00:45.781643+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:52:39.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228178+0000","last_change":"2024-06-02T23:59:01.585862+0000","last_active":"2024-06-03T00:00:46.228178+0000","last_peered":"2024-06-03T00:00:46.228178+0000","last_clean":"2024-06-03T00:00:46.228178+0000","last_became_active":"2024-06-02T23:59:01.585128+0000","last_became_peered":"2024-06-02T23:59:01.585128+0000","last_unstale":"2024-06-03T00:00:46.228178+0000","last_undegraded":"2024-06-03T00:00:46.228178+0000","last_fullsized":"2024-06-03T00:00:46.228178+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:28:18.588571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776556+0000","last_change":"2024-06-02T23:59:00.644991+0000","last_active":"2024-06-03T00:00:45.776556+0000","last_peered":"2024-06-03T00:00:45.776556+0000","last_clean":"2024-06-03T00:00:45.776556+0000","last_became_active":"2024-06-02T23:59:00.644759+0000","last_became_peered":"2024-06-02T23:59:00.644759+0000","last_unstale":"2024-06-03T00:00:45.776556+0000","last_undegraded":"2024-06-03T00:00:45.776556+0000","last_fullsized":"2024-06-03T00:00:45.776556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:26.313713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230012+0000","last_change":"2024-06-02T23:59:01.590250+0000","last_active":"2024-06-03T00:00:46.230012+0000","last_peered":"2024-06-03T00:00:46.230012+0000","last_clean":"2024-06-03T00:00:46.230012+0000","last_became_active":"2024-06-02T23:59:01.589942+0000","last_became_peered":"2024-06-02T23:59:01.589942+0000","last_unstale":"2024-06-03T00:00:46.230012+0000","last_undegraded":"2024-06-03T00:00:46.230012+0000","last_fullsized":"2024-06-03T00:00:46.230012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"69'3","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781520+0000","last_change":"2024-06-02T23:59:00.644405+0000","last_active":"2024-06-03T00:00:45.781520+0000","last_peered":"2024-06-03T00:00:45.781520+0000","last_clean":"2024-06-03T00:00:45.781520+0000","last_became_active":"2024-06-02T23:59:00.643978+0000","last_became_peered":"2024-06-02T23:59:00.643978+0000","last_unstale":"2024-06-03T00:00:45.781520+0000","last_undegraded":"2024-06-03T00:00:45.781520+0000","last_fullsized":"2024-06-03T00:00:45.781520+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:16:38.404329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776450+0000","last_change":"2024-06-02T23:59:01.574661+0000","last_active":"2024-06-03T00:00:45.776450+0000","last_peered":"2024-06-03T00:00:45.776450+0000","last_clean":"2024-06-03T00:00:45.776450+0000","last_became_active":"2024-06-02T23:59:01.574347+0000","last_became_peered":"2024-06-02T23:59:01.574347+0000","last_unstale":"2024-06-03T00:00:45.776450+0000","last_undegraded":"2024-06-03T00:00:45.776450+0000","last_fullsized":"2024-06-03T00:00:45.776450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:24.094731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"70'9","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774383+0000","last_change":"2024-06-02T23:59:00.638966+0000","last_active":"2024-06-03T00:00:45.774383+0000","last_peered":"2024-06-03T00:00:45.774383+0000","last_clean":"2024-06-03T00:00:45.774383+0000","last_became_active":"2024-06-02T23:59:00.638716+0000","last_became_peered":"2024-06-02T23:59:00.638716+0000","last_unstale":"2024-06-03T00:00:45.774383+0000","last_undegraded":"2024-06-03T00:00:45.774383+0000","last_fullsized":"2024-06-03T00:00:45.774383+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:28.207234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2867,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228283+0000","last_change":"2024-06-02T23:59:01.584960+0000","last_active":"2024-06-03T00:00:46.228283+0000","last_peered":"2024-06-03T00:00:46.228283+0000","last_clean":"2024-06-03T00:00:46.228283+0000","last_became_active":"2024-06-02T23:59:01.584575+0000","last_became_peered":"2024-06-02T23:59:01.584575+0000","last_unstale":"2024-06-03T00:00:46.228283+0000","last_undegraded":"2024-06-03T00:00:46.228283+0000","last_fullsized":"2024-06-03T00:00:46.228283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:00:08.310863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229953+0000","last_change":"2024-06-02T23:59:00.645893+0000","last_active":"2024-06-03T00:00:46.229953+0000","last_peered":"2024-06-03T00:00:46.229953+0000","last_clean":"2024-06-03T00:00:46.229953+0000","last_became_active":"2024-06-02T23:59:00.645639+0000","last_became_peered":"2024-06-02T23:59:00.645639+0000","last_unstale":"2024-06-03T00:00:46.229953+0000","last_undegraded":"2024-06-03T00:00:46.229953+0000","last_fullsized":"2024-06-03T00:00:46.229953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:01:07.347079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230197+0000","last_change":"2024-06-02T23:59:01.589530+0000","last_active":"2024-06-03T00:00:46.230197+0000","last_peered":"2024-06-03T00:00:46.230197+0000","last_clean":"2024-06-03T00:00:46.230197+0000","last_became_active":"2024-06-02T23:59:01.589024+0000","last_became_peered":"2024-06-02T23:59:01.589024+0000","last_unstale":"2024-06-03T00:00:46.230197+0000","last_undegraded":"2024-06-03T00:00:46.230197+0000","last_fullsized":"2024-06-03T00:00:46.230197+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080745+0000","last_change":"2024-06-02T23:59:00.647783+0000","last_active":"2024-06-03T00:00:46.080745+0000","last_peered":"2024-06-03T00:00:46.080745+0000","last_clean":"2024-06-03T00:00:46.080745+0000","last_became_active":"2024-06-02T23:59:00.647500+0000","last_became_peered":"2024-06-02T23:59:00.647500+0000","last_unstale":"2024-06-03T00:00:46.080745+0000","last_undegraded":"2024-06-03T00:00:46.080745+0000","last_fullsized":"2024-06-03T00:00:46.080745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:55:32.977530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773324+0000","last_change":"2024-06-02T23:59:01.582611+0000","last_active":"2024-06-03T00:00:45.773324+0000","last_peered":"2024-06-03T00:00:45.773324+0000","last_clean":"2024-06-03T00:00:45.773324+0000","last_became_active":"2024-06-02T23:59:01.582343+0000","last_became_peered":"2024-06-02T23:59:01.582343+0000","last_unstale":"2024-06-03T00:00:45.773324+0000","last_undegraded":"2024-06-03T00:00:45.773324+0000","last_fullsized":"2024-06-03T00:00:45.773324+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:34:05.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781000+0000","last_change":"2024-06-02T23:59:00.648669+0000","last_active":"2024-06-03T00:00:45.781000+0000","last_peered":"2024-06-03T00:00:45.781000+0000","last_clean":"2024-06-03T00:00:45.781000+0000","last_became_active":"2024-06-02T23:59:00.647777+0000","last_became_peered":"2024-06-02T23:59:00.647777+0000","last_unstale":"2024-06-03T00:00:45.781000+0000","last_undegraded":"2024-06-03T00:00:45.781000+0000","last_fullsized":"2024-06-03T00:00:45.781000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:05:23.931542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230460+0000","last_change":"2024-06-02T23:59:01.593580+0000","last_active":"2024-06-03T00:00:46.230460+0000","last_peered":"2024-06-03T00:00:46.230460+0000","last_clean":"2024-06-03T00:00:46.230460+0000","last_became_active":"2024-06-02T23:59:01.593303+0000","last_became_peered":"2024-06-02T23:59:01.593303+0000","last_unstale":"2024-06-03T00:00:46.230460+0000","last_undegraded":"2024-06-03T00:00:46.230460+0000","last_fullsized":"2024-06-03T00:00:46.230460+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"69'8","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773924+0000","last_change":"2024-06-02T23:59:00.645230+0000","last_active":"2024-06-03T00:00:45.773924+0000","last_peered":"2024-06-03T00:00:45.773924+0000","last_clean":"2024-06-03T00:00:45.773924+0000","last_became_active":"2024-06-02T23:59:00.644964+0000","last_became_peered":"2024-06-02T23:59:00.644964+0000","last_unstale":"2024-06-03T00:00:45.773924+0000","last_undegraded":"2024-06-03T00:00:45.773924+0000","last_fullsized":"2024-06-03T00:00:45.773924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:05.673357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774081+0000","last_change":"2024-06-02T23:59:01.582894+0000","last_active":"2024-06-03T00:00:45.774081+0000","last_peered":"2024-06-03T00:00:45.774081+0000","last_clean":"2024-06-03T00:00:45.774081+0000","last_became_active":"2024-06-02T23:59:01.581160+0000","last_became_peered":"2024-06-02T23:59:01.581160+0000","last_unstale":"2024-06-03T00:00:45.774081+0000","last_undegraded":"2024-06-03T00:00:45.774081+0000","last_fullsized":"2024-06-03T00:00:45.774081+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:52:00.630032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230539+0000","last_change":"2024-06-02T23:59:00.644263+0000","last_active":"2024-06-03T00:00:46.230539+0000","last_peered":"2024-06-03T00:00:46.230539+0000","last_clean":"2024-06-03T00:00:46.230539+0000","last_became_active":"2024-06-02T23:59:00.644014+0000","last_became_peered":"2024-06-02T23:59:00.644014+0000","last_unstale":"2024-06-03T00:00:46.230539+0000","last_undegraded":"2024-06-03T00:00:46.230539+0000","last_fullsized":"2024-06-03T00:00:46.230539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:40:21.019637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228857+0000","last_change":"2024-06-02T23:59:01.593089+0000","last_active":"2024-06-03T00:00:46.228857+0000","last_peered":"2024-06-03T00:00:46.228857+0000","last_clean":"2024-06-03T00:00:46.228857+0000","last_became_active":"2024-06-02T23:59:01.592800+0000","last_became_peered":"2024-06-02T23:59:01.592800+0000","last_unstale":"2024-06-03T00:00:46.228857+0000","last_undegraded":"2024-06-03T00:00:46.228857+0000","last_fullsized":"2024-06-03T00:00:46.228857+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:07.188102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229189+0000","last_change":"2024-06-02T23:59:00.636429+0000","last_active":"2024-06-03T00:00:46.229189+0000","last_peered":"2024-06-03T00:00:46.229189+0000","last_clean":"2024-06-03T00:00:46.229189+0000","last_became_active":"2024-06-02T23:59:00.636161+0000","last_became_peered":"2024-06-02T23:59:00.636161+0000","last_unstale":"2024-06-03T00:00:46.229189+0000","last_undegraded":"2024-06-03T00:00:46.229189+0000","last_fullsized":"2024-06-03T00:00:46.229189+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:45:33.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776154+0000","last_change":"2024-06-02T23:59:01.588676+0000","last_active":"2024-06-03T00:00:45.776154+0000","last_peered":"2024-06-03T00:00:45.776154+0000","last_clean":"2024-06-03T00:00:45.776154+0000","last_became_active":"2024-06-02T23:59:01.588372+0000","last_became_peered":"2024-06-02T23:59:01.588372+0000","last_unstale":"2024-06-03T00:00:45.776154+0000","last_undegraded":"2024-06-03T00:00:45.776154+0000","last_fullsized":"2024-06-03T00:00:45.776154+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:29:13.698815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080995+0000","last_change":"2024-06-02T23:59:00.646728+0000","last_active":"2024-06-03T00:00:46.080995+0000","last_peered":"2024-06-03T00:00:46.080995+0000","last_clean":"2024-06-03T00:00:46.080995+0000","last_became_active":"2024-06-02T23:59:00.646290+0000","last_became_peered":"2024-06-02T23:59:00.646290+0000","last_unstale":"2024-06-03T00:00:46.080995+0000","last_undegraded":"2024-06-03T00:00:46.080995+0000","last_fullsized":"2024-06-03T00:00:46.080995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:55.805472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228852+0000","last_change":"2024-06-02T23:59:01.590261+0000","last_active":"2024-06-03T00:00:46.228852+0000","last_peered":"2024-06-03T00:00:46.228852+0000","last_clean":"2024-06-03T00:00:46.228852+0000","last_became_active":"2024-06-02T23:59:01.590016+0000","last_became_peered":"2024-06-02T23:59:01.590016+0000","last_unstale":"2024-06-03T00:00:46.228852+0000","last_undegraded":"2024-06-03T00:00:46.228852+0000","last_fullsized":"2024-06-03T00:00:46.228852+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:24.094731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.081088+0000","last_change":"2024-06-02T23:59:00.647565+0000","last_active":"2024-06-03T00:00:46.081088+0000","last_peered":"2024-06-03T00:00:46.081088+0000","last_clean":"2024-06-03T00:00:46.081088+0000","last_became_active":"2024-06-02T23:59:00.647144+0000","last_became_peered":"2024-06-02T23:59:00.647144+0000","last_unstale":"2024-06-03T00:00:46.081088+0000","last_undegraded":"2024-06-03T00:00:46.081088+0000","last_fullsized":"2024-06-03T00:00:46.081088+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:14.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228395+0000","last_change":"2024-06-02T23:59:01.579062+0000","last_active":"2024-06-03T00:00:46.228395+0000","last_peered":"2024-06-03T00:00:46.228395+0000","last_clean":"2024-06-03T00:00:46.228395+0000","last_became_active":"2024-06-02T23:59:01.578711+0000","last_became_peered":"2024-06-02T23:59:01.578711+0000","last_unstale":"2024-06-03T00:00:46.228395+0000","last_undegraded":"2024-06-03T00:00:46.228395+0000","last_fullsized":"2024-06-03T00:00:46.228395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:10.046785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228789+0000","last_change":"2024-06-02T23:59:00.638071+0000","last_active":"2024-06-03T00:00:46.228789+0000","last_peered":"2024-06-03T00:00:46.228789+0000","last_clean":"2024-06-03T00:00:46.228789+0000","last_became_active":"2024-06-02T23:59:00.637806+0000","last_became_peered":"2024-06-02T23:59:00.637806+0000","last_unstale":"2024-06-03T00:00:46.228789+0000","last_undegraded":"2024-06-03T00:00:46.228789+0000","last_fullsized":"2024-06-03T00:00:46.228789+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:25.851075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.081002+0000","last_change":"2024-06-02T23:59:01.591902+0000","last_active":"2024-06-03T00:00:46.081002+0000","last_peered":"2024-06-03T00:00:46.081002+0000","last_clean":"2024-06-03T00:00:46.081002+0000","last_became_active":"2024-06-02T23:59:01.590949+0000","last_became_peered":"2024-06-02T23:59:01.590949+0000","last_unstale":"2024-06-03T00:00:46.081002+0000","last_undegraded":"2024-06-03T00:00:46.081002+0000","last_fullsized":"2024-06-03T00:00:46.081002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:11.888454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774057+0000","last_change":"2024-06-02T23:59:00.640128+0000","last_active":"2024-06-03T00:00:45.774057+0000","last_peered":"2024-06-03T00:00:45.774057+0000","last_clean":"2024-06-03T00:00:45.774057+0000","last_became_active":"2024-06-02T23:59:00.639852+0000","last_became_peered":"2024-06-02T23:59:00.639852+0000","last_unstale":"2024-06-03T00:00:45.774057+0000","last_undegraded":"2024-06-03T00:00:45.774057+0000","last_fullsized":"2024-06-03T00:00:45.774057+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:07.421496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230207+0000","last_change":"2024-06-02T23:59:01.588002+0000","last_active":"2024-06-03T00:00:46.230207+0000","last_peered":"2024-06-03T00:00:46.230207+0000","last_clean":"2024-06-03T00:00:46.230207+0000","last_became_active":"2024-06-02T23:59:01.587734+0000","last_became_peered":"2024-06-02T23:59:01.587734+0000","last_unstale":"2024-06-03T00:00:46.230207+0000","last_undegraded":"2024-06-03T00:00:46.230207+0000","last_fullsized":"2024-06-03T00:00:46.230207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230252+0000","last_change":"2024-06-02T23:59:00.643318+0000","last_active":"2024-06-03T00:00:46.230252+0000","last_peered":"2024-06-03T00:00:46.230252+0000","last_clean":"2024-06-03T00:00:46.230252+0000","last_became_active":"2024-06-02T23:59:00.643062+0000","last_became_peered":"2024-06-02T23:59:00.643062+0000","last_unstale":"2024-06-03T00:00:46.230252+0000","last_undegraded":"2024-06-03T00:00:46.230252+0000","last_fullsized":"2024-06-03T00:00:46.230252+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:25:50.830339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228661+0000","last_change":"2024-06-02T23:59:01.586699+0000","last_active":"2024-06-03T00:00:46.228661+0000","last_peered":"2024-06-03T00:00:46.228661+0000","last_clean":"2024-06-03T00:00:46.228661+0000","last_became_active":"2024-06-02T23:59:01.586401+0000","last_became_peered":"2024-06-02T23:59:01.586401+0000","last_unstale":"2024-06-03T00:00:46.228661+0000","last_undegraded":"2024-06-03T00:00:46.228661+0000","last_fullsized":"2024-06-03T00:00:46.228661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:12:10.532874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228564+0000","last_change":"2024-06-02T23:59:00.635754+0000","last_active":"2024-06-03T00:00:46.228564+0000","last_peered":"2024-06-03T00:00:46.228564+0000","last_clean":"2024-06-03T00:00:46.228564+0000","last_became_active":"2024-06-02T23:59:00.635444+0000","last_became_peered":"2024-06-02T23:59:00.635444+0000","last_unstale":"2024-06-03T00:00:46.228564+0000","last_undegraded":"2024-06-03T00:00:46.228564+0000","last_fullsized":"2024-06-03T00:00:46.228564+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:54:08.565345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228184+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-03T00:00:46.228184+0000","last_peered":"2024-06-03T00:00:46.228184+0000","last_clean":"2024-06-03T00:00:46.228184+0000","last_became_active":"2024-06-02T23:59:01.584978+0000","last_became_peered":"2024-06-02T23:59:01.584978+0000","last_unstale":"2024-06-03T00:00:46.228184+0000","last_undegraded":"2024-06-03T00:00:46.228184+0000","last_fullsized":"2024-06-03T00:00:46.228184+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:21:15.601996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"69'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080919+0000","last_change":"2024-06-02T23:59:00.647401+0000","last_active":"2024-06-03T00:00:46.080919+0000","last_peered":"2024-06-03T00:00:46.080919+0000","last_clean":"2024-06-03T00:00:46.080919+0000","last_became_active":"2024-06-02T23:59:00.647038+0000","last_became_peered":"2024-06-02T23:59:00.647038+0000","last_unstale":"2024-06-03T00:00:46.080919+0000","last_undegraded":"2024-06-03T00:00:46.080919+0000","last_fullsized":"2024-06-03T00:00:46.080919+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:49:28.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229013+0000","last_change":"2024-06-02T23:59:01.587184+0000","last_active":"2024-06-03T00:00:46.229013+0000","last_peered":"2024-06-03T00:00:46.229013+0000","last_clean":"2024-06-03T00:00:46.229013+0000","last_became_active":"2024-06-02T23:59:01.586774+0000","last_became_peered":"2024-06-02T23:59:01.586774+0000","last_unstale":"2024-06-03T00:00:46.229013+0000","last_undegraded":"2024-06-03T00:00:46.229013+0000","last_fullsized":"2024-06-03T00:00:46.229013+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:29:13.698815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781361+0000","last_change":"2024-06-02T23:59:00.641736+0000","last_active":"2024-06-03T00:00:45.781361+0000","last_peered":"2024-06-03T00:00:45.781361+0000","last_clean":"2024-06-03T00:00:45.781361+0000","last_became_active":"2024-06-02T23:59:00.640889+0000","last_became_peered":"2024-06-02T23:59:00.640889+0000","last_unstale":"2024-06-03T00:00:45.781361+0000","last_undegraded":"2024-06-03T00:00:45.781361+0000","last_fullsized":"2024-06-03T00:00:45.781361+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:35.892006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773123+0000","last_change":"2024-06-02T23:59:01.589758+0000","last_active":"2024-06-03T00:00:45.773123+0000","last_peered":"2024-06-03T00:00:45.773123+0000","last_clean":"2024-06-03T00:00:45.773123+0000","last_became_active":"2024-06-02T23:59:01.588438+0000","last_became_peered":"2024-06-02T23:59:01.588438+0000","last_unstale":"2024-06-03T00:00:45.773123+0000","last_undegraded":"2024-06-03T00:00:45.773123+0000","last_fullsized":"2024-06-03T00:00:45.773123+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:19.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230068+0000","last_change":"2024-06-02T23:59:00.644933+0000","last_active":"2024-06-03T00:00:46.230068+0000","last_peered":"2024-06-03T00:00:46.230068+0000","last_clean":"2024-06-03T00:00:46.230068+0000","last_became_active":"2024-06-02T23:59:00.644680+0000","last_became_peered":"2024-06-02T23:59:00.644680+0000","last_unstale":"2024-06-03T00:00:46.230068+0000","last_undegraded":"2024-06-03T00:00:46.230068+0000","last_fullsized":"2024-06-03T00:00:46.230068+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:10:07.936871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228552+0000","last_change":"2024-06-02T23:59:01.589967+0000","last_active":"2024-06-03T00:00:46.228552+0000","last_peered":"2024-06-03T00:00:46.228552+0000","last_clean":"2024-06-03T00:00:46.228552+0000","last_became_active":"2024-06-02T23:59:01.589146+0000","last_became_peered":"2024-06-02T23:59:01.589146+0000","last_unstale":"2024-06-03T00:00:46.228552+0000","last_undegraded":"2024-06-03T00:00:46.228552+0000","last_fullsized":"2024-06-03T00:00:46.228552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774303+0000","last_change":"2024-06-02T23:59:00.642493+0000","last_active":"2024-06-03T00:00:45.774303+0000","last_peered":"2024-06-03T00:00:45.774303+0000","last_clean":"2024-06-03T00:00:45.774303+0000","last_became_active":"2024-06-02T23:59:00.642225+0000","last_became_peered":"2024-06-02T23:59:00.642225+0000","last_unstale":"2024-06-03T00:00:45.774303+0000","last_undegraded":"2024-06-03T00:00:45.774303+0000","last_fullsized":"2024-06-03T00:00:45.774303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:09.501263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228293+0000","last_change":"2024-06-02T23:59:01.584170+0000","last_active":"2024-06-03T00:00:46.228293+0000","last_peered":"2024-06-03T00:00:46.228293+0000","last_clean":"2024-06-03T00:00:46.228293+0000","last_became_active":"2024-06-02T23:59:01.583901+0000","last_became_peered":"2024-06-02T23:59:01.583901+0000","last_unstale":"2024-06-03T00:00:46.228293+0000","last_undegraded":"2024-06-03T00:00:46.228293+0000","last_fullsized":"2024-06-03T00:00:46.228293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:22:32.595470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774175+0000","last_change":"2024-06-02T23:59:00.644379+0000","last_active":"2024-06-03T00:00:45.774175+0000","last_peered":"2024-06-03T00:00:45.774175+0000","last_clean":"2024-06-03T00:00:45.774175+0000","last_became_active":"2024-06-02T23:59:00.644115+0000","last_became_peered":"2024-06-02T23:59:00.644115+0000","last_unstale":"2024-06-03T00:00:45.774175+0000","last_undegraded":"2024-06-03T00:00:45.774175+0000","last_fullsized":"2024-06-03T00:00:45.774175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:01.768574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230092+0000","last_change":"2024-06-02T23:59:01.587439+0000","last_active":"2024-06-03T00:00:46.230092+0000","last_peered":"2024-06-03T00:00:46.230092+0000","last_clean":"2024-06-03T00:00:46.230092+0000","last_became_active":"2024-06-02T23:59:01.587147+0000","last_became_peered":"2024-06-02T23:59:01.587147+0000","last_unstale":"2024-06-03T00:00:46.230092+0000","last_undegraded":"2024-06-03T00:00:46.230092+0000","last_fullsized":"2024-06-03T00:00:46.230092+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776166+0000","last_change":"2024-06-02T23:59:00.643747+0000","last_active":"2024-06-03T00:00:45.776166+0000","last_peered":"2024-06-03T00:00:45.776166+0000","last_clean":"2024-06-03T00:00:45.776166+0000","last_became_active":"2024-06-02T23:59:00.643445+0000","last_became_peered":"2024-06-02T23:59:00.643445+0000","last_unstale":"2024-06-03T00:00:45.776166+0000","last_undegraded":"2024-06-03T00:00:45.776166+0000","last_fullsized":"2024-06-03T00:00:45.776166+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:14:32.146732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773376+0000","last_change":"2024-06-02T23:59:01.583225+0000","last_active":"2024-06-03T00:00:45.773376+0000","last_peered":"2024-06-03T00:00:45.773376+0000","last_clean":"2024-06-03T00:00:45.773376+0000","last_became_active":"2024-06-02T23:59:01.582821+0000","last_became_peered":"2024-06-02T23:59:01.582821+0000","last_unstale":"2024-06-03T00:00:45.773376+0000","last_undegraded":"2024-06-03T00:00:45.773376+0000","last_fullsized":"2024-06-03T00:00:45.773376+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:39:34.474565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228394+0000","last_change":"2024-06-02T23:59:00.644323+0000","last_active":"2024-06-03T00:00:46.228394+0000","last_peered":"2024-06-03T00:00:46.228394+0000","last_clean":"2024-06-03T00:00:46.228394+0000","last_became_active":"2024-06-02T23:59:00.643711+0000","last_became_peered":"2024-06-02T23:59:00.643711+0000","last_unstale":"2024-06-03T00:00:46.228394+0000","last_undegraded":"2024-06-03T00:00:46.228394+0000","last_fullsized":"2024-06-03T00:00:46.228394+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:14.457408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080574+0000","last_change":"2024-06-02T23:59:01.587791+0000","last_active":"2024-06-03T00:00:46.080574+0000","last_peered":"2024-06-03T00:00:46.080574+0000","last_clean":"2024-06-03T00:00:46.080574+0000","last_became_active":"2024-06-02T23:59:01.587445+0000","last_became_peered":"2024-06-02T23:59:01.587445+0000","last_unstale":"2024-06-03T00:00:46.080574+0000","last_undegraded":"2024-06-03T00:00:46.080574+0000","last_fullsized":"2024-06-03T00:00:46.080574+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:11:51.236204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"70'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230357+0000","last_change":"2024-06-02T23:59:00.644532+0000","last_active":"2024-06-03T00:00:46.230357+0000","last_peered":"2024-06-03T00:00:46.230357+0000","last_clean":"2024-06-03T00:00:46.230357+0000","last_became_active":"2024-06-02T23:59:00.644293+0000","last_became_peered":"2024-06-02T23:59:00.644293+0000","last_unstale":"2024-06-03T00:00:46.230357+0000","last_undegraded":"2024-06-03T00:00:46.230357+0000","last_fullsized":"2024-06-03T00:00:46.230357+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:38.716399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":354,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780839+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-03T00:00:45.780839+0000","last_peered":"2024-06-03T00:00:45.780839+0000","last_clean":"2024-06-03T00:00:45.780839+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-03T00:00:45.780839+0000","last_undegraded":"2024-06-03T00:00:45.780839+0000","last_fullsized":"2024-06-03T00:00:45.780839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":3665,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54820,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317020,"statfs":{"total":96636764160,"available":96580628480,"internally_reserved":0,"allocated":1466368,"data_stored":1024138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":434298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50076,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321764,"statfs":{"total":96636764160,"available":96585486336,"internally_reserved":0,"allocated":864256,"data_stored":433646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":434228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":436535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54244,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317596,"statfs":{"total":96636764160,"available":96581218304,"internally_reserved":0,"allocated":876544,"data_stored":436513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":433806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1466368,"data_stored":1024070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:01:15.288 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-03T00:01:15.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.424+0000 7f4c6fd70640 1 Processor -- start 2024-06-03T00:01:15.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.425+0000 7f4c6fd70640 1 -- start start 2024-06-03T00:01:15.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.425+0000 7f4c6fd70640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c680d1120 0x7f4c680c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.425+0000 7f4c6fd70640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c680d4a90 con 0x7f4c680b5510 2024-06-03T00:01:15.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.425+0000 7f4c6fd70640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c680d4d70 con 0x7f4c68161900 2024-06-03T00:01:15.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.425+0000 7f4c6fd70640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4c680cf5c0 con 0x7f4c680d1120 2024-06-03T00:01:15.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.425+0000 7f4c6e30d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4c680b5510 0x7f4c680c8100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40944/0 (socket says 172.21.15.96:40944) 2024-06-03T00:01:15.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.425+0000 7f4c6e30d640 1 -- 172.21.15.96:0/351605727 learned_addr learned my addr 172.21.15.96:0/351605727 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-03T00:01:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489957069 0 0) 0x7f4c680d4a90 con 0x7f4c680b5510 2024-06-03T00:01:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c50003520 con 0x7f4c680b5510 2024-06-03T00:01:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6d30b640 1 --2- 172.21.15.96:0/351605727 >> v2:172.21.15.162:3300/0 conn(0x7f4c680d1120 0x7f4c680c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3385090090 0 0) 0x7f4c50003520 con 0x7f4c680b5510 2024-06-03T00:01:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 >> v2:172.21.15.162:3300/0 conn(0x7f4c680d1120 msgr2=0x7f4c680c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 --2- 172.21.15.96:0/351605727 >> v2:172.21.15.162:3300/0 conn(0x7f4c680d1120 0x7f4c680c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 >> v1:172.21.15.162:6789/0 conn(0x7f4c68161900 legacy=0x7f4c680d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c680cf800 con 0x7f4c680b5510 2024-06-03T00:01:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f4c600019f0 con 0x7f4c680b5510 2024-06-03T00:01:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 >> v1:172.21.15.96:6789/0 conn(0x7f4c680b5510 legacy=0x7f4c680c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c500039b0 0x7f4c50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c50004800 0x7f4c50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c500051c0 0x7f4c5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4c680cf5c0 con 0x7f4c500039b0 2024-06-03T00:01:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5000c160 con 0x7f4c500051c0 2024-06-03T00:01:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5000c360 con 0x7f4c50004800 2024-06-03T00:01:15.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6db0c640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c500039b0 0x7f4c50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6d30b640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c50004800 0x7f4c50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6e30d640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c500051c0 0x7f4c5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6db0c640 1 -- 172.21.15.96:0/351605727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c50004800 msgr2=0x7f4c50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6db0c640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c50004800 0x7f4c50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6db0c640 1 -- 172.21.15.96:0/351605727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c500051c0 msgr2=0x7f4c5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6db0c640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c500051c0 0x7f4c5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6db0c640 1 -- 172.21.15.96:0/351605727 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c50003520 con 0x7f4c500039b0 2024-06-03T00:01:15.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6d30b640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c50004800 0x7f4c50004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6e30d640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c500051c0 0x7f4c5000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.426+0000 7f4c6e30d640 1 -- 172.21.15.96:0/351605727 reap_dead start 2024-06-03T00:01:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.427+0000 7f4c6db0c640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c500039b0 0x7f4c50003dd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4c58001750 tx=0x7f4c50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2037c2f3f8f server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.427+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c58001370 con 0x7f4c500039b0 2024-06-03T00:01:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.427+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c580052d0 con 0x7f4c500039b0 2024-06-03T00:01:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.427+0000 7f4c6cb0a640 1 -- 172.21.15.96:0/351605727 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5802abc0 con 0x7f4c500039b0 2024-06-03T00:01:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.428+0000 7f4c6fd70640 1 -- 172.21.15.96:0/351605727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c500039b0 msgr2=0x7f4c50003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.428+0000 7f4c6fd70640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c500039b0 0x7f4c50003dd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4c58001750 tx=0x7f4c50005830 comp rx=0 tx=0).stop 2024-06-03T00:01:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.428+0000 7f4c6fd70640 1 -- 172.21.15.96:0/351605727 shutdown_connections 2024-06-03T00:01:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.428+0000 7f4c6fd70640 1 --2- 172.21.15.96:0/351605727 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c500039b0 0x7f4c50003dd0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.428+0000 7f4c6fd70640 1 -- 172.21.15.96:0/351605727 >> 172.21.15.96:0/351605727 conn(0x7f4c6809d3b0 msgr2=0x7f4c680d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.428+0000 7f4c6fd70640 1 -- 172.21.15.96:0/351605727 shutdown_connections 2024-06-03T00:01:15.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.428+0000 7f4c6fd70640 1 -- 172.21.15.96:0/351605727 wait complete. 2024-06-03T00:01:15.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.429+0000 7f4c6fd70640 1 Processor -- start 2024-06-03T00:01:15.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.429+0000 7f4c6fd70640 1 -- start start 2024-06-03T00:01:15.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6fd70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c500039b0 0x7f4c680cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6fd70640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c680b87b0 0x7f4c68155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6fd70640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c680b8c30 0x7f4c681f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6fd70640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4c680d4780 con 0x7f4c680b87b0 2024-06-03T00:01:15.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6fd70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c680caf70 con 0x7f4c500039b0 2024-06-03T00:01:15.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6fd70640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c68161ce0 con 0x7f4c680b8c30 2024-06-03T00:01:15.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6d30b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c680b87b0 0x7f4c68155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6d30b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c680b87b0 0x7f4c68155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51328/0 (socket says 172.21.15.96:51328) 2024-06-03T00:01:15.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6d30b640 1 -- 172.21.15.96:0/3892496025 learned_addr learned my addr 172.21.15.96:0/3892496025 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:15.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6db0c640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c500039b0 0x7f4c680cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6e30d640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c680b8c30 0x7f4c681f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6d30b640 1 -- 172.21.15.96:0/3892496025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c680b8c30 msgr2=0x7f4c681f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6d30b640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c680b8c30 0x7f4c681f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6d30b640 1 -- 172.21.15.96:0/3892496025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c500039b0 msgr2=0x7f4c680cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6d30b640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c500039b0 0x7f4c680cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6d30b640 1 -- 172.21.15.96:0/3892496025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c680ce070 con 0x7f4c680b87b0 2024-06-03T00:01:15.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6e30d640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c680b8c30 0x7f4c681f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:15.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.430+0000 7f4c6d30b640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c680b87b0 0x7f4c68155210 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0114e0 tx=0x7f4c5c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:15.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.431+0000 7f4c667fc640 1 -- 172.21.15.96:0/3892496025 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c015870 con 0x7f4c680b87b0 2024-06-03T00:01:15.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.431+0000 7f4c667fc640 1 -- 172.21.15.96:0/3892496025 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5c015a10 con 0x7f4c680b87b0 2024-06-03T00:01:15.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.431+0000 7f4c6fd70640 1 -- 172.21.15.96:0/3892496025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c680cca90 con 0x7f4c680b87b0 2024-06-03T00:01:15.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.431+0000 7f4c667fc640 1 -- 172.21.15.96:0/3892496025 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c015e00 con 0x7f4c680b87b0 2024-06-03T00:01:15.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.431+0000 7f4c6fd70640 1 -- 172.21.15.96:0/3892496025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c680cd050 con 0x7f4c680b87b0 2024-06-03T00:01:15.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.432+0000 7f4c6fd70640 1 -- 172.21.15.96:0/3892496025 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c680b9f00 con 0x7f4c680b87b0 2024-06-03T00:01:15.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.432+0000 7f4c667fc640 1 -- 172.21.15.96:0/3892496025 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f4c5c01d400 con 0x7f4c680b87b0 2024-06-03T00:01:15.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.432+0000 7f4c667fc640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c5406be60 0x7f4c5406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.433+0000 7f4c667fc640 1 -- 172.21.15.96:0/3892496025 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f4c5c08b730 con 0x7f4c680b87b0 2024-06-03T00:01:15.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.433+0000 7f4c6db0c640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c5406be60 0x7f4c5406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.433+0000 7f4c6db0c640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c5406be60 0x7f4c5406e320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c58032000 tx=0x7f4c5802e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:15.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.437+0000 7f4c667fc640 1 -- 172.21.15.96:0/3892496025 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4c680b9f00 con 0x7f4c680b87b0 2024-06-03T00:01:15.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.608+0000 7f4c6fd70640 1 -- 172.21.15.96:0/3892496025 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c680683e0 con 0x7f4c5406be60 2024-06-03T00:01:15.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.614+0000 7f4c667fc640 1 -- 172.21.15.96:0/3892496025 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7f4c5807f7d0 con 0x7f4c5406be60 2024-06-03T00:01:15.619 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-03T00:01:15.621 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-03T00:01:15.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 -- 172.21.15.96:0/3892496025 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c5406be60 msgr2=0x7f4c5406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c5406be60 0x7f4c5406e320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c58032000 tx=0x7f4c5802e000 comp rx=0 tx=0).stop 2024-06-03T00:01:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 -- 172.21.15.96:0/3892496025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c680b87b0 msgr2=0x7f4c68155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c680b87b0 0x7f4c68155210 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0114e0 tx=0x7f4c5c0119a0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 -- 172.21.15.96:0/3892496025 shutdown_connections 2024-06-03T00:01:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4c5406be60 0x7f4c5406e320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c680b8c30 0x7f4c681f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4c680b87b0 0x7f4c68155210 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 --2- 172.21.15.96:0/3892496025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c500039b0 0x7f4c680cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 -- 172.21.15.96:0/3892496025 >> 172.21.15.96:0/3892496025 conn(0x7f4c6809d3b0 msgr2=0x7f4c6815fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:15.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 -- 172.21.15.96:0/3892496025 shutdown_connections 2024-06-03T00:01:15.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.617+0000 7f4c6fd70640 1 -- 172.21.15.96:0/3892496025 wait complete. 2024-06-03T00:01:15.628 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-06-03T00:01:14.526808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594033,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":247,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319900,"kb_used_data":7976,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754654820,"statfs":{"total":773094113280,"available":772766535680,"internally_reserved":0,"allocated":8167424,"data_stored":4657234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002968"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229064+0000","last_change":"2024-06-02T23:59:01.586938+0000","last_active":"2024-06-03T00:00:46.229064+0000","last_peered":"2024-06-03T00:00:46.229064+0000","last_clean":"2024-06-03T00:00:46.229064+0000","last_became_active":"2024-06-02T23:59:01.586669+0000","last_became_peered":"2024-06-02T23:59:01.586669+0000","last_unstale":"2024-06-03T00:00:46.229064+0000","last_undegraded":"2024-06-03T00:00:46.229064+0000","last_fullsized":"2024-06-03T00:00:46.229064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:32:12.883830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781379+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-03T00:00:45.781379+0000","last_peered":"2024-06-03T00:00:45.781379+0000","last_clean":"2024-06-03T00:00:45.781379+0000","last_became_active":"2024-06-02T23:59:01.582687+0000","last_became_peered":"2024-06-02T23:59:01.582687+0000","last_unstale":"2024-06-03T00:00:45.781379+0000","last_undegraded":"2024-06-03T00:00:45.781379+0000","last_fullsized":"2024-06-03T00:00:45.781379+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230121+0000","last_change":"2024-06-02T23:59:01.586233+0000","last_active":"2024-06-03T00:00:46.230121+0000","last_peered":"2024-06-03T00:00:46.230121+0000","last_clean":"2024-06-03T00:00:46.230121+0000","last_became_active":"2024-06-02T23:59:01.586006+0000","last_became_peered":"2024-06-02T23:59:01.586006+0000","last_unstale":"2024-06-03T00:00:46.230121+0000","last_undegraded":"2024-06-03T00:00:46.230121+0000","last_fullsized":"2024-06-03T00:00:46.230121+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780728+0000","last_change":"2024-06-02T23:59:01.587310+0000","last_active":"2024-06-03T00:00:45.780728+0000","last_peered":"2024-06-03T00:00:45.780728+0000","last_clean":"2024-06-03T00:00:45.780728+0000","last_became_active":"2024-06-02T23:59:01.586761+0000","last_became_peered":"2024-06-02T23:59:01.586761+0000","last_unstale":"2024-06-03T00:00:45.780728+0000","last_undegraded":"2024-06-03T00:00:45.780728+0000","last_fullsized":"2024-06-03T00:00:45.780728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776333+0000","last_change":"2024-06-02T23:59:01.583800+0000","last_active":"2024-06-03T00:00:45.776333+0000","last_peered":"2024-06-03T00:00:45.776333+0000","last_clean":"2024-06-03T00:00:45.776333+0000","last_became_active":"2024-06-02T23:59:01.581028+0000","last_became_peered":"2024-06-02T23:59:01.581028+0000","last_unstale":"2024-06-03T00:00:45.776333+0000","last_undegraded":"2024-06-03T00:00:45.776333+0000","last_fullsized":"2024-06-03T00:00:45.776333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:25:47.061955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228969+0000","last_change":"2024-06-02T23:59:01.587296+0000","last_active":"2024-06-03T00:00:46.228969+0000","last_peered":"2024-06-03T00:00:46.228969+0000","last_clean":"2024-06-03T00:00:46.228969+0000","last_became_active":"2024-06-02T23:59:01.586996+0000","last_became_peered":"2024-06-02T23:59:01.586996+0000","last_unstale":"2024-06-03T00:00:46.228969+0000","last_undegraded":"2024-06-03T00:00:46.228969+0000","last_fullsized":"2024-06-03T00:00:46.228969+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:56:54.953142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229778+0000","last_change":"2024-06-02T23:59:01.586195+0000","last_active":"2024-06-03T00:00:46.229778+0000","last_peered":"2024-06-03T00:00:46.229778+0000","last_clean":"2024-06-03T00:00:46.229778+0000","last_became_active":"2024-06-02T23:59:01.583488+0000","last_became_peered":"2024-06-02T23:59:01.583488+0000","last_unstale":"2024-06-03T00:00:46.229778+0000","last_undegraded":"2024-06-03T00:00:46.229778+0000","last_fullsized":"2024-06-03T00:00:46.229778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:42:09.116457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773168+0000","last_change":"2024-06-02T23:59:01.588746+0000","last_active":"2024-06-03T00:00:45.773168+0000","last_peered":"2024-06-03T00:00:45.773168+0000","last_clean":"2024-06-03T00:00:45.773168+0000","last_became_active":"2024-06-02T23:59:01.588310+0000","last_became_peered":"2024-06-02T23:59:01.588310+0000","last_unstale":"2024-06-03T00:00:45.773168+0000","last_undegraded":"2024-06-03T00:00:45.773168+0000","last_fullsized":"2024-06-03T00:00:45.773168+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:56:25.974137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773512+0000","last_change":"2024-06-02T23:59:01.592959+0000","last_active":"2024-06-03T00:00:45.773512+0000","last_peered":"2024-06-03T00:00:45.773512+0000","last_clean":"2024-06-03T00:00:45.773512+0000","last_became_active":"2024-06-02T23:59:01.592704+0000","last_became_peered":"2024-06-02T23:59:01.592704+0000","last_unstale":"2024-06-03T00:00:45.773512+0000","last_undegraded":"2024-06-03T00:00:45.773512+0000","last_fullsized":"2024-06-03T00:00:45.773512+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:57:55.310878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228621+0000","last_change":"2024-06-02T23:59:01.589283+0000","last_active":"2024-06-03T00:00:46.228621+0000","last_peered":"2024-06-03T00:00:46.228621+0000","last_clean":"2024-06-03T00:00:46.228621+0000","last_became_active":"2024-06-02T23:59:01.588961+0000","last_became_peered":"2024-06-02T23:59:01.588961+0000","last_unstale":"2024-06-03T00:00:46.228621+0000","last_undegraded":"2024-06-03T00:00:46.228621+0000","last_fullsized":"2024-06-03T00:00:46.228621+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:09:42.099307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229227+0000","last_change":"2024-06-02T23:59:01.583139+0000","last_active":"2024-06-03T00:00:46.229227+0000","last_peered":"2024-06-03T00:00:46.229227+0000","last_clean":"2024-06-03T00:00:46.229227+0000","last_became_active":"2024-06-02T23:59:01.582876+0000","last_became_peered":"2024-06-02T23:59:01.582876+0000","last_unstale":"2024-06-03T00:00:46.229227+0000","last_undegraded":"2024-06-03T00:00:46.229227+0000","last_fullsized":"2024-06-03T00:00:46.229227+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.666135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773306+0000","last_change":"2024-06-02T23:59:01.589336+0000","last_active":"2024-06-03T00:00:45.773306+0000","last_peered":"2024-06-03T00:00:45.773306+0000","last_clean":"2024-06-03T00:00:45.773306+0000","last_became_active":"2024-06-02T23:59:01.589067+0000","last_became_peered":"2024-06-02T23:59:01.589067+0000","last_unstale":"2024-06-03T00:00:45.773306+0000","last_undegraded":"2024-06-03T00:00:45.773306+0000","last_fullsized":"2024-06-03T00:00:45.773306+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:49:36.524901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228658+0000","last_change":"2024-06-02T23:59:01.591325+0000","last_active":"2024-06-03T00:00:46.228658+0000","last_peered":"2024-06-03T00:00:46.228658+0000","last_clean":"2024-06-03T00:00:46.228658+0000","last_became_active":"2024-06-02T23:59:01.590545+0000","last_became_peered":"2024-06-02T23:59:01.590545+0000","last_unstale":"2024-06-03T00:00:46.228658+0000","last_undegraded":"2024-06-03T00:00:46.228658+0000","last_fullsized":"2024-06-03T00:00:46.228658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:17.184163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229891+0000","last_change":"2024-06-02T23:59:01.583413+0000","last_active":"2024-06-03T00:00:46.229891+0000","last_peered":"2024-06-03T00:00:46.229891+0000","last_clean":"2024-06-03T00:00:46.229891+0000","last_became_active":"2024-06-02T23:59:01.582568+0000","last_became_peered":"2024-06-02T23:59:01.582568+0000","last_unstale":"2024-06-03T00:00:46.229891+0000","last_undegraded":"2024-06-03T00:00:46.229891+0000","last_fullsized":"2024-06-03T00:00:46.229891+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:45.895866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780842+0000","last_change":"2024-06-02T23:59:01.591575+0000","last_active":"2024-06-03T00:00:45.780842+0000","last_peered":"2024-06-03T00:00:45.780842+0000","last_clean":"2024-06-03T00:00:45.780842+0000","last_became_active":"2024-06-02T23:59:01.591265+0000","last_became_peered":"2024-06-02T23:59:01.591265+0000","last_unstale":"2024-06-03T00:00:45.780842+0000","last_undegraded":"2024-06-03T00:00:45.780842+0000","last_fullsized":"2024-06-03T00:00:45.780842+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228641+0000","last_change":"2024-06-02T23:59:01.590700+0000","last_active":"2024-06-03T00:00:46.228641+0000","last_peered":"2024-06-03T00:00:46.228641+0000","last_clean":"2024-06-03T00:00:46.228641+0000","last_became_active":"2024-06-02T23:59:01.590445+0000","last_became_peered":"2024-06-02T23:59:01.590445+0000","last_unstale":"2024-06-03T00:00:46.228641+0000","last_undegraded":"2024-06-03T00:00:46.228641+0000","last_fullsized":"2024-06-03T00:00:46.228641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:31.933956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230494+0000","last_change":"2024-06-02T23:59:01.587034+0000","last_active":"2024-06-03T00:00:46.230494+0000","last_peered":"2024-06-03T00:00:46.230494+0000","last_clean":"2024-06-03T00:00:46.230494+0000","last_became_active":"2024-06-02T23:59:01.586784+0000","last_became_peered":"2024-06-02T23:59:01.586784+0000","last_unstale":"2024-06-03T00:00:46.230494+0000","last_undegraded":"2024-06-03T00:00:46.230494+0000","last_fullsized":"2024-06-03T00:00:46.230494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:10.502903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781431+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-03T00:00:45.781431+0000","last_peered":"2024-06-03T00:00:45.781431+0000","last_clean":"2024-06-03T00:00:45.781431+0000","last_became_active":"2024-06-02T23:59:01.582680+0000","last_became_peered":"2024-06-02T23:59:01.582680+0000","last_unstale":"2024-06-03T00:00:45.781431+0000","last_undegraded":"2024-06-03T00:00:45.781431+0000","last_fullsized":"2024-06-03T00:00:45.781431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230068+0000","last_change":"2024-06-02T23:59:01.582684+0000","last_active":"2024-06-03T00:00:46.230068+0000","last_peered":"2024-06-03T00:00:46.230068+0000","last_clean":"2024-06-03T00:00:46.230068+0000","last_became_active":"2024-06-02T23:59:01.582422+0000","last_became_peered":"2024-06-02T23:59:01.582422+0000","last_unstale":"2024-06-03T00:00:46.230068+0000","last_undegraded":"2024-06-03T00:00:46.230068+0000","last_fullsized":"2024-06-03T00:00:46.230068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:06.674997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080965+0000","last_change":"2024-06-02T23:59:01.591052+0000","last_active":"2024-06-03T00:00:46.080965+0000","last_peered":"2024-06-03T00:00:46.080965+0000","last_clean":"2024-06-03T00:00:46.080965+0000","last_became_active":"2024-06-02T23:59:01.590601+0000","last_became_peered":"2024-06-02T23:59:01.590601+0000","last_unstale":"2024-06-03T00:00:46.080965+0000","last_undegraded":"2024-06-03T00:00:46.080965+0000","last_fullsized":"2024-06-03T00:00:46.080965+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:29:55.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080646+0000","last_change":"2024-06-02T23:59:01.593871+0000","last_active":"2024-06-03T00:00:46.080646+0000","last_peered":"2024-06-03T00:00:46.080646+0000","last_clean":"2024-06-03T00:00:46.080646+0000","last_became_active":"2024-06-02T23:59:01.593596+0000","last_became_peered":"2024-06-02T23:59:01.593596+0000","last_unstale":"2024-06-03T00:00:46.080646+0000","last_undegraded":"2024-06-03T00:00:46.080646+0000","last_fullsized":"2024-06-03T00:00:46.080646+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:35:33.955552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773123+0000","last_change":"2024-06-02T23:59:01.587899+0000","last_active":"2024-06-03T00:00:45.773123+0000","last_peered":"2024-06-03T00:00:45.773123+0000","last_clean":"2024-06-03T00:00:45.773123+0000","last_became_active":"2024-06-02T23:59:01.587641+0000","last_became_peered":"2024-06-02T23:59:01.587641+0000","last_unstale":"2024-06-03T00:00:45.773123+0000","last_undegraded":"2024-06-03T00:00:45.773123+0000","last_fullsized":"2024-06-03T00:00:45.773123+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:24:09.334139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228797+0000","last_change":"2024-06-02T23:59:01.584645+0000","last_active":"2024-06-03T00:00:46.228797+0000","last_peered":"2024-06-03T00:00:46.228797+0000","last_clean":"2024-06-03T00:00:46.228797+0000","last_became_active":"2024-06-02T23:59:01.584358+0000","last_became_peered":"2024-06-02T23:59:01.584358+0000","last_unstale":"2024-06-03T00:00:46.228797+0000","last_undegraded":"2024-06-03T00:00:46.228797+0000","last_fullsized":"2024-06-03T00:00:46.228797+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:31:25.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229486+0000","last_change":"2024-06-02T23:59:01.583175+0000","last_active":"2024-06-03T00:00:46.229486+0000","last_peered":"2024-06-03T00:00:46.229486+0000","last_clean":"2024-06-03T00:00:46.229486+0000","last_became_active":"2024-06-02T23:59:01.582904+0000","last_became_peered":"2024-06-02T23:59:01.582904+0000","last_unstale":"2024-06-03T00:00:46.229486+0000","last_undegraded":"2024-06-03T00:00:46.229486+0000","last_fullsized":"2024-06-03T00:00:46.229486+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:56:06.478241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229396+0000","last_change":"2024-06-02T23:59:01.591616+0000","last_active":"2024-06-03T00:00:46.229396+0000","last_peered":"2024-06-03T00:00:46.229396+0000","last_clean":"2024-06-03T00:00:46.229396+0000","last_became_active":"2024-06-02T23:59:01.589760+0000","last_became_peered":"2024-06-02T23:59:01.589760+0000","last_unstale":"2024-06-03T00:00:46.229396+0000","last_undegraded":"2024-06-03T00:00:46.229396+0000","last_fullsized":"2024-06-03T00:00:46.229396+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:29.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773359+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-03T00:00:45.773359+0000","last_peered":"2024-06-03T00:00:45.773359+0000","last_clean":"2024-06-03T00:00:45.773359+0000","last_became_active":"2024-06-02T23:59:01.585010+0000","last_became_peered":"2024-06-02T23:59:01.585010+0000","last_unstale":"2024-06-03T00:00:45.773359+0000","last_undegraded":"2024-06-03T00:00:45.773359+0000","last_fullsized":"2024-06-03T00:00:45.773359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:50:01.657005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229148+0000","last_change":"2024-06-02T23:59:01.593067+0000","last_active":"2024-06-03T00:00:46.229148+0000","last_peered":"2024-06-03T00:00:46.229148+0000","last_clean":"2024-06-03T00:00:46.229148+0000","last_became_active":"2024-06-02T23:59:01.592789+0000","last_became_peered":"2024-06-02T23:59:01.592789+0000","last_unstale":"2024-06-03T00:00:46.229148+0000","last_undegraded":"2024-06-03T00:00:46.229148+0000","last_fullsized":"2024-06-03T00:00:46.229148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:25:47.061955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080990+0000","last_change":"2024-06-02T23:59:01.591460+0000","last_active":"2024-06-03T00:00:46.080990+0000","last_peered":"2024-06-03T00:00:46.080990+0000","last_clean":"2024-06-03T00:00:46.080990+0000","last_became_active":"2024-06-02T23:59:01.590827+0000","last_became_peered":"2024-06-02T23:59:01.590827+0000","last_unstale":"2024-06-03T00:00:46.080990+0000","last_undegraded":"2024-06-03T00:00:46.080990+0000","last_fullsized":"2024-06-03T00:00:46.080990+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:27.044276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229879+0000","last_change":"2024-06-02T23:59:01.589715+0000","last_active":"2024-06-03T00:00:46.229879+0000","last_peered":"2024-06-03T00:00:46.229879+0000","last_clean":"2024-06-03T00:00:46.229879+0000","last_became_active":"2024-06-02T23:59:01.589456+0000","last_became_peered":"2024-06-02T23:59:01.589456+0000","last_unstale":"2024-06-03T00:00:46.229879+0000","last_undegraded":"2024-06-03T00:00:46.229879+0000","last_fullsized":"2024-06-03T00:00:46.229879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:36.510898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781075+0000","last_change":"2024-06-02T23:59:01.589048+0000","last_active":"2024-06-03T00:00:45.781075+0000","last_peered":"2024-06-03T00:00:45.781075+0000","last_clean":"2024-06-03T00:00:45.781075+0000","last_became_active":"2024-06-02T23:59:01.588773+0000","last_became_peered":"2024-06-02T23:59:01.588773+0000","last_unstale":"2024-06-03T00:00:45.781075+0000","last_undegraded":"2024-06-03T00:00:45.781075+0000","last_fullsized":"2024-06-03T00:00:45.781075+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229896+0000","last_change":"2024-06-02T23:59:01.586433+0000","last_active":"2024-06-03T00:00:46.229896+0000","last_peered":"2024-06-03T00:00:46.229896+0000","last_clean":"2024-06-03T00:00:46.229896+0000","last_became_active":"2024-06-02T23:59:01.585466+0000","last_became_peered":"2024-06-02T23:59:01.585466+0000","last_unstale":"2024-06-03T00:00:46.229896+0000","last_undegraded":"2024-06-03T00:00:46.229896+0000","last_fullsized":"2024-06-03T00:00:46.229896+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:24:38.083153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228206+0000","last_change":"2024-06-02T23:59:01.586007+0000","last_active":"2024-06-03T00:00:46.228206+0000","last_peered":"2024-06-03T00:00:46.228206+0000","last_clean":"2024-06-03T00:00:46.228206+0000","last_became_active":"2024-06-02T23:59:01.585721+0000","last_became_peered":"2024-06-02T23:59:01.585721+0000","last_unstale":"2024-06-03T00:00:46.228206+0000","last_undegraded":"2024-06-03T00:00:46.228206+0000","last_fullsized":"2024-06-03T00:00:46.228206+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:50:41.714294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780711+0000","last_change":"2024-06-02T23:59:01.582009+0000","last_active":"2024-06-03T00:00:45.780711+0000","last_peered":"2024-06-03T00:00:45.780711+0000","last_clean":"2024-06-03T00:00:45.780711+0000","last_became_active":"2024-06-02T23:59:01.581438+0000","last_became_peered":"2024-06-02T23:59:01.581438+0000","last_unstale":"2024-06-03T00:00:45.780711+0000","last_undegraded":"2024-06-03T00:00:45.780711+0000","last_fullsized":"2024-06-03T00:00:45.780711+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"69'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080898+0000","last_change":"2024-06-02T23:59:00.647990+0000","last_active":"2024-06-03T00:00:46.080898+0000","last_peered":"2024-06-03T00:00:46.080898+0000","last_clean":"2024-06-03T00:00:46.080898+0000","last_became_active":"2024-06-02T23:59:00.647031+0000","last_became_peered":"2024-06-02T23:59:00.647031+0000","last_unstale":"2024-06-03T00:00:46.080898+0000","last_undegraded":"2024-06-03T00:00:46.080898+0000","last_fullsized":"2024-06-03T00:00:46.080898+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:19:44.864617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228259+0000","last_change":"2024-06-02T23:59:01.587104+0000","last_active":"2024-06-03T00:00:46.228259+0000","last_peered":"2024-06-03T00:00:46.228259+0000","last_clean":"2024-06-03T00:00:46.228259+0000","last_became_active":"2024-06-02T23:59:01.586813+0000","last_became_peered":"2024-06-02T23:59:01.586813+0000","last_unstale":"2024-06-03T00:00:46.228259+0000","last_undegraded":"2024-06-03T00:00:46.228259+0000","last_fullsized":"2024-06-03T00:00:46.228259+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:10:37.679556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"69'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228813+0000","last_change":"2024-06-02T23:59:00.638860+0000","last_active":"2024-06-03T00:00:46.228813+0000","last_peered":"2024-06-03T00:00:46.228813+0000","last_clean":"2024-06-03T00:00:46.228813+0000","last_became_active":"2024-06-02T23:59:00.638579+0000","last_became_peered":"2024-06-02T23:59:00.638579+0000","last_unstale":"2024-06-03T00:00:46.228813+0000","last_undegraded":"2024-06-03T00:00:46.228813+0000","last_fullsized":"2024-06-03T00:00:46.228813+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:57:25.113202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080615+0000","last_change":"2024-06-02T23:59:01.593795+0000","last_active":"2024-06-03T00:00:46.080615+0000","last_peered":"2024-06-03T00:00:46.080615+0000","last_clean":"2024-06-03T00:00:46.080615+0000","last_became_active":"2024-06-02T23:59:01.593506+0000","last_became_peered":"2024-06-02T23:59:01.593506+0000","last_unstale":"2024-06-03T00:00:46.080615+0000","last_undegraded":"2024-06-03T00:00:46.080615+0000","last_fullsized":"2024-06-03T00:00:46.080615+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:51.301800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229152+0000","last_change":"2024-06-02T23:59:00.648871+0000","last_active":"2024-06-03T00:00:46.229152+0000","last_peered":"2024-06-03T00:00:46.229152+0000","last_clean":"2024-06-03T00:00:46.229152+0000","last_became_active":"2024-06-02T23:59:00.648667+0000","last_became_peered":"2024-06-02T23:59:00.648667+0000","last_unstale":"2024-06-03T00:00:46.229152+0000","last_undegraded":"2024-06-03T00:00:46.229152+0000","last_fullsized":"2024-06-03T00:00:46.229152+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:11:50.234565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773134+0000","last_change":"2024-06-02T23:59:01.585466+0000","last_active":"2024-06-03T00:00:45.773134+0000","last_peered":"2024-06-03T00:00:45.773134+0000","last_clean":"2024-06-03T00:00:45.773134+0000","last_became_active":"2024-06-02T23:59:01.585127+0000","last_became_peered":"2024-06-02T23:59:01.585127+0000","last_unstale":"2024-06-03T00:00:45.773134+0000","last_undegraded":"2024-06-03T00:00:45.773134+0000","last_fullsized":"2024-06-03T00:00:45.773134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:23:32.778002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228442+0000","last_change":"2024-06-02T23:59:00.642417+0000","last_active":"2024-06-03T00:00:46.228442+0000","last_peered":"2024-06-03T00:00:46.228442+0000","last_clean":"2024-06-03T00:00:46.228442+0000","last_became_active":"2024-06-02T23:59:00.642182+0000","last_became_peered":"2024-06-02T23:59:00.642182+0000","last_unstale":"2024-06-03T00:00:46.228442+0000","last_undegraded":"2024-06-03T00:00:46.228442+0000","last_fullsized":"2024-06-03T00:00:46.228442+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:48.372998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.082184+0000","last_change":"2024-06-03T00:00:46.082184+0000","last_active":"2024-06-03T00:00:46.082184+0000","last_peered":"2024-06-03T00:00:46.082184+0000","last_clean":"2024-06-03T00:00:46.082184+0000","last_became_active":"2024-06-03T00:00:46.081627+0000","last_became_peered":"2024-06-03T00:00:46.081627+0000","last_unstale":"2024-06-03T00:00:46.082184+0000","last_undegraded":"2024-06-03T00:00:46.082184+0000","last_fullsized":"2024-06-03T00:00:46.082184+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:40:22.021276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229869+0000","last_change":"2024-06-02T23:59:00.641231+0000","last_active":"2024-06-03T00:00:46.229869+0000","last_peered":"2024-06-03T00:00:46.229869+0000","last_clean":"2024-06-03T00:00:46.229869+0000","last_became_active":"2024-06-02T23:59:00.640963+0000","last_became_peered":"2024-06-02T23:59:00.640963+0000","last_unstale":"2024-06-03T00:00:46.229869+0000","last_undegraded":"2024-06-03T00:00:46.229869+0000","last_fullsized":"2024-06-03T00:00:46.229869+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.148246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781190+0000","last_change":"2024-06-02T23:59:01.591548+0000","last_active":"2024-06-03T00:00:45.781190+0000","last_peered":"2024-06-03T00:00:45.781190+0000","last_clean":"2024-06-03T00:00:45.781190+0000","last_became_active":"2024-06-02T23:59:01.591198+0000","last_became_peered":"2024-06-02T23:59:01.591198+0000","last_unstale":"2024-06-03T00:00:45.781190+0000","last_undegraded":"2024-06-03T00:00:45.781190+0000","last_fullsized":"2024-06-03T00:00:45.781190+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776211+0000","last_change":"2024-06-02T23:59:00.649120+0000","last_active":"2024-06-03T00:00:45.776211+0000","last_peered":"2024-06-03T00:00:45.776211+0000","last_clean":"2024-06-03T00:00:45.776211+0000","last_became_active":"2024-06-02T23:59:00.648839+0000","last_became_peered":"2024-06-02T23:59:00.648839+0000","last_unstale":"2024-06-03T00:00:45.776211+0000","last_undegraded":"2024-06-03T00:00:45.776211+0000","last_fullsized":"2024-06-03T00:00:45.776211+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:52:08.529881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773203+0000","last_change":"2024-06-02T23:59:01.585288+0000","last_active":"2024-06-03T00:00:45.773203+0000","last_peered":"2024-06-03T00:00:45.773203+0000","last_clean":"2024-06-03T00:00:45.773203+0000","last_became_active":"2024-06-02T23:59:01.584971+0000","last_became_peered":"2024-06-02T23:59:01.584971+0000","last_unstale":"2024-06-03T00:00:45.773203+0000","last_undegraded":"2024-06-03T00:00:45.773203+0000","last_fullsized":"2024-06-03T00:00:45.773203+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:54:54.767840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080841+0000","last_change":"2024-06-02T23:59:00.648200+0000","last_active":"2024-06-03T00:00:46.080841+0000","last_peered":"2024-06-03T00:00:46.080841+0000","last_clean":"2024-06-03T00:00:46.080841+0000","last_became_active":"2024-06-02T23:59:00.647175+0000","last_became_peered":"2024-06-02T23:59:00.647175+0000","last_unstale":"2024-06-03T00:00:46.080841+0000","last_undegraded":"2024-06-03T00:00:46.080841+0000","last_fullsized":"2024-06-03T00:00:46.080841+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:34:43.239731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.081972+0000","last_change":"2024-06-03T00:00:46.081972+0000","last_active":"2024-06-03T00:00:46.081972+0000","last_peered":"2024-06-03T00:00:46.081972+0000","last_clean":"2024-06-03T00:00:46.081972+0000","last_became_active":"2024-06-03T00:00:46.081552+0000","last_became_peered":"2024-06-03T00:00:46.081552+0000","last_unstale":"2024-06-03T00:00:46.081972+0000","last_undegraded":"2024-06-03T00:00:46.081972+0000","last_fullsized":"2024-06-03T00:00:46.081972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:37:10.667194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229593+0000","last_change":"2024-06-02T23:59:00.647400+0000","last_active":"2024-06-03T00:00:46.229593+0000","last_peered":"2024-06-03T00:00:46.229593+0000","last_clean":"2024-06-03T00:00:46.229593+0000","last_became_active":"2024-06-02T23:59:00.647210+0000","last_became_peered":"2024-06-02T23:59:00.647210+0000","last_unstale":"2024-06-03T00:00:46.229593+0000","last_undegraded":"2024-06-03T00:00:46.229593+0000","last_fullsized":"2024-06-03T00:00:46.229593+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:13.009966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776028+0000","last_change":"2024-06-02T23:59:01.587444+0000","last_active":"2024-06-03T00:00:45.776028+0000","last_peered":"2024-06-03T00:00:45.776028+0000","last_clean":"2024-06-03T00:00:45.776028+0000","last_became_active":"2024-06-02T23:59:01.587190+0000","last_became_peered":"2024-06-02T23:59:01.587190+0000","last_unstale":"2024-06-03T00:00:45.776028+0000","last_undegraded":"2024-06-03T00:00:45.776028+0000","last_fullsized":"2024-06-03T00:00:45.776028+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:56:54.953142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781643+0000","last_change":"2024-06-02T23:59:00.637111+0000","last_active":"2024-06-03T00:00:45.781643+0000","last_peered":"2024-06-03T00:00:45.781643+0000","last_clean":"2024-06-03T00:00:45.781643+0000","last_became_active":"2024-06-02T23:59:00.636815+0000","last_became_peered":"2024-06-02T23:59:00.636815+0000","last_unstale":"2024-06-03T00:00:45.781643+0000","last_undegraded":"2024-06-03T00:00:45.781643+0000","last_fullsized":"2024-06-03T00:00:45.781643+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:52:39.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228178+0000","last_change":"2024-06-02T23:59:01.585862+0000","last_active":"2024-06-03T00:00:46.228178+0000","last_peered":"2024-06-03T00:00:46.228178+0000","last_clean":"2024-06-03T00:00:46.228178+0000","last_became_active":"2024-06-02T23:59:01.585128+0000","last_became_peered":"2024-06-02T23:59:01.585128+0000","last_unstale":"2024-06-03T00:00:46.228178+0000","last_undegraded":"2024-06-03T00:00:46.228178+0000","last_fullsized":"2024-06-03T00:00:46.228178+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:28:18.588571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776556+0000","last_change":"2024-06-02T23:59:00.644991+0000","last_active":"2024-06-03T00:00:45.776556+0000","last_peered":"2024-06-03T00:00:45.776556+0000","last_clean":"2024-06-03T00:00:45.776556+0000","last_became_active":"2024-06-02T23:59:00.644759+0000","last_became_peered":"2024-06-02T23:59:00.644759+0000","last_unstale":"2024-06-03T00:00:45.776556+0000","last_undegraded":"2024-06-03T00:00:45.776556+0000","last_fullsized":"2024-06-03T00:00:45.776556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:26.313713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230012+0000","last_change":"2024-06-02T23:59:01.590250+0000","last_active":"2024-06-03T00:00:46.230012+0000","last_peered":"2024-06-03T00:00:46.230012+0000","last_clean":"2024-06-03T00:00:46.230012+0000","last_became_active":"2024-06-02T23:59:01.589942+0000","last_became_peered":"2024-06-02T23:59:01.589942+0000","last_unstale":"2024-06-03T00:00:46.230012+0000","last_undegraded":"2024-06-03T00:00:46.230012+0000","last_fullsized":"2024-06-03T00:00:46.230012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"69'3","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781520+0000","last_change":"2024-06-02T23:59:00.644405+0000","last_active":"2024-06-03T00:00:45.781520+0000","last_peered":"2024-06-03T00:00:45.781520+0000","last_clean":"2024-06-03T00:00:45.781520+0000","last_became_active":"2024-06-02T23:59:00.643978+0000","last_became_peered":"2024-06-02T23:59:00.643978+0000","last_unstale":"2024-06-03T00:00:45.781520+0000","last_undegraded":"2024-06-03T00:00:45.781520+0000","last_fullsized":"2024-06-03T00:00:45.781520+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:16:38.404329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776450+0000","last_change":"2024-06-02T23:59:01.574661+0000","last_active":"2024-06-03T00:00:45.776450+0000","last_peered":"2024-06-03T00:00:45.776450+0000","last_clean":"2024-06-03T00:00:45.776450+0000","last_became_active":"2024-06-02T23:59:01.574347+0000","last_became_peered":"2024-06-02T23:59:01.574347+0000","last_unstale":"2024-06-03T00:00:45.776450+0000","last_undegraded":"2024-06-03T00:00:45.776450+0000","last_fullsized":"2024-06-03T00:00:45.776450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:24.094731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"70'9","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774383+0000","last_change":"2024-06-02T23:59:00.638966+0000","last_active":"2024-06-03T00:00:45.774383+0000","last_peered":"2024-06-03T00:00:45.774383+0000","last_clean":"2024-06-03T00:00:45.774383+0000","last_became_active":"2024-06-02T23:59:00.638716+0000","last_became_peered":"2024-06-02T23:59:00.638716+0000","last_unstale":"2024-06-03T00:00:45.774383+0000","last_undegraded":"2024-06-03T00:00:45.774383+0000","last_fullsized":"2024-06-03T00:00:45.774383+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:28.207234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2867,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228283+0000","last_change":"2024-06-02T23:59:01.584960+0000","last_active":"2024-06-03T00:00:46.228283+0000","last_peered":"2024-06-03T00:00:46.228283+0000","last_clean":"2024-06-03T00:00:46.228283+0000","last_became_active":"2024-06-02T23:59:01.584575+0000","last_became_peered":"2024-06-02T23:59:01.584575+0000","last_unstale":"2024-06-03T00:00:46.228283+0000","last_undegraded":"2024-06-03T00:00:46.228283+0000","last_fullsized":"2024-06-03T00:00:46.228283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:00:08.310863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229953+0000","last_change":"2024-06-02T23:59:00.645893+0000","last_active":"2024-06-03T00:00:46.229953+0000","last_peered":"2024-06-03T00:00:46.229953+0000","last_clean":"2024-06-03T00:00:46.229953+0000","last_became_active":"2024-06-02T23:59:00.645639+0000","last_became_peered":"2024-06-02T23:59:00.645639+0000","last_unstale":"2024-06-03T00:00:46.229953+0000","last_undegraded":"2024-06-03T00:00:46.229953+0000","last_fullsized":"2024-06-03T00:00:46.229953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:01:07.347079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230197+0000","last_change":"2024-06-02T23:59:01.589530+0000","last_active":"2024-06-03T00:00:46.230197+0000","last_peered":"2024-06-03T00:00:46.230197+0000","last_clean":"2024-06-03T00:00:46.230197+0000","last_became_active":"2024-06-02T23:59:01.589024+0000","last_became_peered":"2024-06-02T23:59:01.589024+0000","last_unstale":"2024-06-03T00:00:46.230197+0000","last_undegraded":"2024-06-03T00:00:46.230197+0000","last_fullsized":"2024-06-03T00:00:46.230197+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080745+0000","last_change":"2024-06-02T23:59:00.647783+0000","last_active":"2024-06-03T00:00:46.080745+0000","last_peered":"2024-06-03T00:00:46.080745+0000","last_clean":"2024-06-03T00:00:46.080745+0000","last_became_active":"2024-06-02T23:59:00.647500+0000","last_became_peered":"2024-06-02T23:59:00.647500+0000","last_unstale":"2024-06-03T00:00:46.080745+0000","last_undegraded":"2024-06-03T00:00:46.080745+0000","last_fullsized":"2024-06-03T00:00:46.080745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:55:32.977530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773324+0000","last_change":"2024-06-02T23:59:01.582611+0000","last_active":"2024-06-03T00:00:45.773324+0000","last_peered":"2024-06-03T00:00:45.773324+0000","last_clean":"2024-06-03T00:00:45.773324+0000","last_became_active":"2024-06-02T23:59:01.582343+0000","last_became_peered":"2024-06-02T23:59:01.582343+0000","last_unstale":"2024-06-03T00:00:45.773324+0000","last_undegraded":"2024-06-03T00:00:45.773324+0000","last_fullsized":"2024-06-03T00:00:45.773324+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:34:05.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781000+0000","last_change":"2024-06-02T23:59:00.648669+0000","last_active":"2024-06-03T00:00:45.781000+0000","last_peered":"2024-06-03T00:00:45.781000+0000","last_clean":"2024-06-03T00:00:45.781000+0000","last_became_active":"2024-06-02T23:59:00.647777+0000","last_became_peered":"2024-06-02T23:59:00.647777+0000","last_unstale":"2024-06-03T00:00:45.781000+0000","last_undegraded":"2024-06-03T00:00:45.781000+0000","last_fullsized":"2024-06-03T00:00:45.781000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:05:23.931542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230460+0000","last_change":"2024-06-02T23:59:01.593580+0000","last_active":"2024-06-03T00:00:46.230460+0000","last_peered":"2024-06-03T00:00:46.230460+0000","last_clean":"2024-06-03T00:00:46.230460+0000","last_became_active":"2024-06-02T23:59:01.593303+0000","last_became_peered":"2024-06-02T23:59:01.593303+0000","last_unstale":"2024-06-03T00:00:46.230460+0000","last_undegraded":"2024-06-03T00:00:46.230460+0000","last_fullsized":"2024-06-03T00:00:46.230460+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"69'8","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773924+0000","last_change":"2024-06-02T23:59:00.645230+0000","last_active":"2024-06-03T00:00:45.773924+0000","last_peered":"2024-06-03T00:00:45.773924+0000","last_clean":"2024-06-03T00:00:45.773924+0000","last_became_active":"2024-06-02T23:59:00.644964+0000","last_became_peered":"2024-06-02T23:59:00.644964+0000","last_unstale":"2024-06-03T00:00:45.773924+0000","last_undegraded":"2024-06-03T00:00:45.773924+0000","last_fullsized":"2024-06-03T00:00:45.773924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:05.673357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774081+0000","last_change":"2024-06-02T23:59:01.582894+0000","last_active":"2024-06-03T00:00:45.774081+0000","last_peered":"2024-06-03T00:00:45.774081+0000","last_clean":"2024-06-03T00:00:45.774081+0000","last_became_active":"2024-06-02T23:59:01.581160+0000","last_became_peered":"2024-06-02T23:59:01.581160+0000","last_unstale":"2024-06-03T00:00:45.774081+0000","last_undegraded":"2024-06-03T00:00:45.774081+0000","last_fullsized":"2024-06-03T00:00:45.774081+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:52:00.630032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230539+0000","last_change":"2024-06-02T23:59:00.644263+0000","last_active":"2024-06-03T00:00:46.230539+0000","last_peered":"2024-06-03T00:00:46.230539+0000","last_clean":"2024-06-03T00:00:46.230539+0000","last_became_active":"2024-06-02T23:59:00.644014+0000","last_became_peered":"2024-06-02T23:59:00.644014+0000","last_unstale":"2024-06-03T00:00:46.230539+0000","last_undegraded":"2024-06-03T00:00:46.230539+0000","last_fullsized":"2024-06-03T00:00:46.230539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:40:21.019637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228857+0000","last_change":"2024-06-02T23:59:01.593089+0000","last_active":"2024-06-03T00:00:46.228857+0000","last_peered":"2024-06-03T00:00:46.228857+0000","last_clean":"2024-06-03T00:00:46.228857+0000","last_became_active":"2024-06-02T23:59:01.592800+0000","last_became_peered":"2024-06-02T23:59:01.592800+0000","last_unstale":"2024-06-03T00:00:46.228857+0000","last_undegraded":"2024-06-03T00:00:46.228857+0000","last_fullsized":"2024-06-03T00:00:46.228857+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:07.188102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229189+0000","last_change":"2024-06-02T23:59:00.636429+0000","last_active":"2024-06-03T00:00:46.229189+0000","last_peered":"2024-06-03T00:00:46.229189+0000","last_clean":"2024-06-03T00:00:46.229189+0000","last_became_active":"2024-06-02T23:59:00.636161+0000","last_became_peered":"2024-06-02T23:59:00.636161+0000","last_unstale":"2024-06-03T00:00:46.229189+0000","last_undegraded":"2024-06-03T00:00:46.229189+0000","last_fullsized":"2024-06-03T00:00:46.229189+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:45:33.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776154+0000","last_change":"2024-06-02T23:59:01.588676+0000","last_active":"2024-06-03T00:00:45.776154+0000","last_peered":"2024-06-03T00:00:45.776154+0000","last_clean":"2024-06-03T00:00:45.776154+0000","last_became_active":"2024-06-02T23:59:01.588372+0000","last_became_peered":"2024-06-02T23:59:01.588372+0000","last_unstale":"2024-06-03T00:00:45.776154+0000","last_undegraded":"2024-06-03T00:00:45.776154+0000","last_fullsized":"2024-06-03T00:00:45.776154+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:29:13.698815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080995+0000","last_change":"2024-06-02T23:59:00.646728+0000","last_active":"2024-06-03T00:00:46.080995+0000","last_peered":"2024-06-03T00:00:46.080995+0000","last_clean":"2024-06-03T00:00:46.080995+0000","last_became_active":"2024-06-02T23:59:00.646290+0000","last_became_peered":"2024-06-02T23:59:00.646290+0000","last_unstale":"2024-06-03T00:00:46.080995+0000","last_undegraded":"2024-06-03T00:00:46.080995+0000","last_fullsized":"2024-06-03T00:00:46.080995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:55.805472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228852+0000","last_change":"2024-06-02T23:59:01.590261+0000","last_active":"2024-06-03T00:00:46.228852+0000","last_peered":"2024-06-03T00:00:46.228852+0000","last_clean":"2024-06-03T00:00:46.228852+0000","last_became_active":"2024-06-02T23:59:01.590016+0000","last_became_peered":"2024-06-02T23:59:01.590016+0000","last_unstale":"2024-06-03T00:00:46.228852+0000","last_undegraded":"2024-06-03T00:00:46.228852+0000","last_fullsized":"2024-06-03T00:00:46.228852+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:24.094731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.081088+0000","last_change":"2024-06-02T23:59:00.647565+0000","last_active":"2024-06-03T00:00:46.081088+0000","last_peered":"2024-06-03T00:00:46.081088+0000","last_clean":"2024-06-03T00:00:46.081088+0000","last_became_active":"2024-06-02T23:59:00.647144+0000","last_became_peered":"2024-06-02T23:59:00.647144+0000","last_unstale":"2024-06-03T00:00:46.081088+0000","last_undegraded":"2024-06-03T00:00:46.081088+0000","last_fullsized":"2024-06-03T00:00:46.081088+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:14.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228395+0000","last_change":"2024-06-02T23:59:01.579062+0000","last_active":"2024-06-03T00:00:46.228395+0000","last_peered":"2024-06-03T00:00:46.228395+0000","last_clean":"2024-06-03T00:00:46.228395+0000","last_became_active":"2024-06-02T23:59:01.578711+0000","last_became_peered":"2024-06-02T23:59:01.578711+0000","last_unstale":"2024-06-03T00:00:46.228395+0000","last_undegraded":"2024-06-03T00:00:46.228395+0000","last_fullsized":"2024-06-03T00:00:46.228395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:10.046785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228789+0000","last_change":"2024-06-02T23:59:00.638071+0000","last_active":"2024-06-03T00:00:46.228789+0000","last_peered":"2024-06-03T00:00:46.228789+0000","last_clean":"2024-06-03T00:00:46.228789+0000","last_became_active":"2024-06-02T23:59:00.637806+0000","last_became_peered":"2024-06-02T23:59:00.637806+0000","last_unstale":"2024-06-03T00:00:46.228789+0000","last_undegraded":"2024-06-03T00:00:46.228789+0000","last_fullsized":"2024-06-03T00:00:46.228789+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:25.851075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.081002+0000","last_change":"2024-06-02T23:59:01.591902+0000","last_active":"2024-06-03T00:00:46.081002+0000","last_peered":"2024-06-03T00:00:46.081002+0000","last_clean":"2024-06-03T00:00:46.081002+0000","last_became_active":"2024-06-02T23:59:01.590949+0000","last_became_peered":"2024-06-02T23:59:01.590949+0000","last_unstale":"2024-06-03T00:00:46.081002+0000","last_undegraded":"2024-06-03T00:00:46.081002+0000","last_fullsized":"2024-06-03T00:00:46.081002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:11.888454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774057+0000","last_change":"2024-06-02T23:59:00.640128+0000","last_active":"2024-06-03T00:00:45.774057+0000","last_peered":"2024-06-03T00:00:45.774057+0000","last_clean":"2024-06-03T00:00:45.774057+0000","last_became_active":"2024-06-02T23:59:00.639852+0000","last_became_peered":"2024-06-02T23:59:00.639852+0000","last_unstale":"2024-06-03T00:00:45.774057+0000","last_undegraded":"2024-06-03T00:00:45.774057+0000","last_fullsized":"2024-06-03T00:00:45.774057+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:07.421496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230207+0000","last_change":"2024-06-02T23:59:01.588002+0000","last_active":"2024-06-03T00:00:46.230207+0000","last_peered":"2024-06-03T00:00:46.230207+0000","last_clean":"2024-06-03T00:00:46.230207+0000","last_became_active":"2024-06-02T23:59:01.587734+0000","last_became_peered":"2024-06-02T23:59:01.587734+0000","last_unstale":"2024-06-03T00:00:46.230207+0000","last_undegraded":"2024-06-03T00:00:46.230207+0000","last_fullsized":"2024-06-03T00:00:46.230207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230252+0000","last_change":"2024-06-02T23:59:00.643318+0000","last_active":"2024-06-03T00:00:46.230252+0000","last_peered":"2024-06-03T00:00:46.230252+0000","last_clean":"2024-06-03T00:00:46.230252+0000","last_became_active":"2024-06-02T23:59:00.643062+0000","last_became_peered":"2024-06-02T23:59:00.643062+0000","last_unstale":"2024-06-03T00:00:46.230252+0000","last_undegraded":"2024-06-03T00:00:46.230252+0000","last_fullsized":"2024-06-03T00:00:46.230252+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:25:50.830339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228661+0000","last_change":"2024-06-02T23:59:01.586699+0000","last_active":"2024-06-03T00:00:46.228661+0000","last_peered":"2024-06-03T00:00:46.228661+0000","last_clean":"2024-06-03T00:00:46.228661+0000","last_became_active":"2024-06-02T23:59:01.586401+0000","last_became_peered":"2024-06-02T23:59:01.586401+0000","last_unstale":"2024-06-03T00:00:46.228661+0000","last_undegraded":"2024-06-03T00:00:46.228661+0000","last_fullsized":"2024-06-03T00:00:46.228661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:12:10.532874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228564+0000","last_change":"2024-06-02T23:59:00.635754+0000","last_active":"2024-06-03T00:00:46.228564+0000","last_peered":"2024-06-03T00:00:46.228564+0000","last_clean":"2024-06-03T00:00:46.228564+0000","last_became_active":"2024-06-02T23:59:00.635444+0000","last_became_peered":"2024-06-02T23:59:00.635444+0000","last_unstale":"2024-06-03T00:00:46.228564+0000","last_undegraded":"2024-06-03T00:00:46.228564+0000","last_fullsized":"2024-06-03T00:00:46.228564+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:54:08.565345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228184+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-03T00:00:46.228184+0000","last_peered":"2024-06-03T00:00:46.228184+0000","last_clean":"2024-06-03T00:00:46.228184+0000","last_became_active":"2024-06-02T23:59:01.584978+0000","last_became_peered":"2024-06-02T23:59:01.584978+0000","last_unstale":"2024-06-03T00:00:46.228184+0000","last_undegraded":"2024-06-03T00:00:46.228184+0000","last_fullsized":"2024-06-03T00:00:46.228184+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:21:15.601996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"69'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080919+0000","last_change":"2024-06-02T23:59:00.647401+0000","last_active":"2024-06-03T00:00:46.080919+0000","last_peered":"2024-06-03T00:00:46.080919+0000","last_clean":"2024-06-03T00:00:46.080919+0000","last_became_active":"2024-06-02T23:59:00.647038+0000","last_became_peered":"2024-06-02T23:59:00.647038+0000","last_unstale":"2024-06-03T00:00:46.080919+0000","last_undegraded":"2024-06-03T00:00:46.080919+0000","last_fullsized":"2024-06-03T00:00:46.080919+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:49:28.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229013+0000","last_change":"2024-06-02T23:59:01.587184+0000","last_active":"2024-06-03T00:00:46.229013+0000","last_peered":"2024-06-03T00:00:46.229013+0000","last_clean":"2024-06-03T00:00:46.229013+0000","last_became_active":"2024-06-02T23:59:01.586774+0000","last_became_peered":"2024-06-02T23:59:01.586774+0000","last_unstale":"2024-06-03T00:00:46.229013+0000","last_undegraded":"2024-06-03T00:00:46.229013+0000","last_fullsized":"2024-06-03T00:00:46.229013+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:29:13.698815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781361+0000","last_change":"2024-06-02T23:59:00.641736+0000","last_active":"2024-06-03T00:00:45.781361+0000","last_peered":"2024-06-03T00:00:45.781361+0000","last_clean":"2024-06-03T00:00:45.781361+0000","last_became_active":"2024-06-02T23:59:00.640889+0000","last_became_peered":"2024-06-02T23:59:00.640889+0000","last_unstale":"2024-06-03T00:00:45.781361+0000","last_undegraded":"2024-06-03T00:00:45.781361+0000","last_fullsized":"2024-06-03T00:00:45.781361+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:35.892006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773123+0000","last_change":"2024-06-02T23:59:01.589758+0000","last_active":"2024-06-03T00:00:45.773123+0000","last_peered":"2024-06-03T00:00:45.773123+0000","last_clean":"2024-06-03T00:00:45.773123+0000","last_became_active":"2024-06-02T23:59:01.588438+0000","last_became_peered":"2024-06-02T23:59:01.588438+0000","last_unstale":"2024-06-03T00:00:45.773123+0000","last_undegraded":"2024-06-03T00:00:45.773123+0000","last_fullsized":"2024-06-03T00:00:45.773123+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:19.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230068+0000","last_change":"2024-06-02T23:59:00.644933+0000","last_active":"2024-06-03T00:00:46.230068+0000","last_peered":"2024-06-03T00:00:46.230068+0000","last_clean":"2024-06-03T00:00:46.230068+0000","last_became_active":"2024-06-02T23:59:00.644680+0000","last_became_peered":"2024-06-02T23:59:00.644680+0000","last_unstale":"2024-06-03T00:00:46.230068+0000","last_undegraded":"2024-06-03T00:00:46.230068+0000","last_fullsized":"2024-06-03T00:00:46.230068+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:10:07.936871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228552+0000","last_change":"2024-06-02T23:59:01.589967+0000","last_active":"2024-06-03T00:00:46.228552+0000","last_peered":"2024-06-03T00:00:46.228552+0000","last_clean":"2024-06-03T00:00:46.228552+0000","last_became_active":"2024-06-02T23:59:01.589146+0000","last_became_peered":"2024-06-02T23:59:01.589146+0000","last_unstale":"2024-06-03T00:00:46.228552+0000","last_undegraded":"2024-06-03T00:00:46.228552+0000","last_fullsized":"2024-06-03T00:00:46.228552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774303+0000","last_change":"2024-06-02T23:59:00.642493+0000","last_active":"2024-06-03T00:00:45.774303+0000","last_peered":"2024-06-03T00:00:45.774303+0000","last_clean":"2024-06-03T00:00:45.774303+0000","last_became_active":"2024-06-02T23:59:00.642225+0000","last_became_peered":"2024-06-02T23:59:00.642225+0000","last_unstale":"2024-06-03T00:00:45.774303+0000","last_undegraded":"2024-06-03T00:00:45.774303+0000","last_fullsized":"2024-06-03T00:00:45.774303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:09.501263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228293+0000","last_change":"2024-06-02T23:59:01.584170+0000","last_active":"2024-06-03T00:00:46.228293+0000","last_peered":"2024-06-03T00:00:46.228293+0000","last_clean":"2024-06-03T00:00:46.228293+0000","last_became_active":"2024-06-02T23:59:01.583901+0000","last_became_peered":"2024-06-02T23:59:01.583901+0000","last_unstale":"2024-06-03T00:00:46.228293+0000","last_undegraded":"2024-06-03T00:00:46.228293+0000","last_fullsized":"2024-06-03T00:00:46.228293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:22:32.595470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774175+0000","last_change":"2024-06-02T23:59:00.644379+0000","last_active":"2024-06-03T00:00:45.774175+0000","last_peered":"2024-06-03T00:00:45.774175+0000","last_clean":"2024-06-03T00:00:45.774175+0000","last_became_active":"2024-06-02T23:59:00.644115+0000","last_became_peered":"2024-06-02T23:59:00.644115+0000","last_unstale":"2024-06-03T00:00:45.774175+0000","last_undegraded":"2024-06-03T00:00:45.774175+0000","last_fullsized":"2024-06-03T00:00:45.774175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:01.768574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230092+0000","last_change":"2024-06-02T23:59:01.587439+0000","last_active":"2024-06-03T00:00:46.230092+0000","last_peered":"2024-06-03T00:00:46.230092+0000","last_clean":"2024-06-03T00:00:46.230092+0000","last_became_active":"2024-06-02T23:59:01.587147+0000","last_became_peered":"2024-06-02T23:59:01.587147+0000","last_unstale":"2024-06-03T00:00:46.230092+0000","last_undegraded":"2024-06-03T00:00:46.230092+0000","last_fullsized":"2024-06-03T00:00:46.230092+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776166+0000","last_change":"2024-06-02T23:59:00.643747+0000","last_active":"2024-06-03T00:00:45.776166+0000","last_peered":"2024-06-03T00:00:45.776166+0000","last_clean":"2024-06-03T00:00:45.776166+0000","last_became_active":"2024-06-02T23:59:00.643445+0000","last_became_peered":"2024-06-02T23:59:00.643445+0000","last_unstale":"2024-06-03T00:00:45.776166+0000","last_undegraded":"2024-06-03T00:00:45.776166+0000","last_fullsized":"2024-06-03T00:00:45.776166+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:14:32.146732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773376+0000","last_change":"2024-06-02T23:59:01.583225+0000","last_active":"2024-06-03T00:00:45.773376+0000","last_peered":"2024-06-03T00:00:45.773376+0000","last_clean":"2024-06-03T00:00:45.773376+0000","last_became_active":"2024-06-02T23:59:01.582821+0000","last_became_peered":"2024-06-02T23:59:01.582821+0000","last_unstale":"2024-06-03T00:00:45.773376+0000","last_undegraded":"2024-06-03T00:00:45.773376+0000","last_fullsized":"2024-06-03T00:00:45.773376+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:39:34.474565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228394+0000","last_change":"2024-06-02T23:59:00.644323+0000","last_active":"2024-06-03T00:00:46.228394+0000","last_peered":"2024-06-03T00:00:46.228394+0000","last_clean":"2024-06-03T00:00:46.228394+0000","last_became_active":"2024-06-02T23:59:00.643711+0000","last_became_peered":"2024-06-02T23:59:00.643711+0000","last_unstale":"2024-06-03T00:00:46.228394+0000","last_undegraded":"2024-06-03T00:00:46.228394+0000","last_fullsized":"2024-06-03T00:00:46.228394+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:14.457408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080574+0000","last_change":"2024-06-02T23:59:01.587791+0000","last_active":"2024-06-03T00:00:46.080574+0000","last_peered":"2024-06-03T00:00:46.080574+0000","last_clean":"2024-06-03T00:00:46.080574+0000","last_became_active":"2024-06-02T23:59:01.587445+0000","last_became_peered":"2024-06-02T23:59:01.587445+0000","last_unstale":"2024-06-03T00:00:46.080574+0000","last_undegraded":"2024-06-03T00:00:46.080574+0000","last_fullsized":"2024-06-03T00:00:46.080574+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:11:51.236204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"70'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230357+0000","last_change":"2024-06-02T23:59:00.644532+0000","last_active":"2024-06-03T00:00:46.230357+0000","last_peered":"2024-06-03T00:00:46.230357+0000","last_clean":"2024-06-03T00:00:46.230357+0000","last_became_active":"2024-06-02T23:59:00.644293+0000","last_became_peered":"2024-06-02T23:59:00.644293+0000","last_unstale":"2024-06-03T00:00:46.230357+0000","last_undegraded":"2024-06-03T00:00:46.230357+0000","last_fullsized":"2024-06-03T00:00:46.230357+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:38.716399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":354,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780839+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-03T00:00:45.780839+0000","last_peered":"2024-06-03T00:00:45.780839+0000","last_clean":"2024-06-03T00:00:45.780839+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-03T00:00:45.780839+0000","last_undegraded":"2024-06-03T00:00:45.780839+0000","last_fullsized":"2024-06-03T00:00:45.780839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":3665,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54820,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317020,"statfs":{"total":96636764160,"available":96580628480,"internally_reserved":0,"allocated":1466368,"data_stored":1024138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":434298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50076,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321764,"statfs":{"total":96636764160,"available":96585486336,"internally_reserved":0,"allocated":864256,"data_stored":433646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":434228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":436535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54244,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317596,"statfs":{"total":96636764160,"available":96581218304,"internally_reserved":0,"allocated":876544,"data_stored":436513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":433806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1466368,"data_stored":1024070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:01:15.632 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-06-03T00:01:15.632 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-03T00:01:15.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.768+0000 7f1e50984640 1 Processor -- start 2024-06-03T00:01:15.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.768+0000 7f1e50984640 1 -- start start 2024-06-03T00:01:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e50984640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e4c06ed20 0x7f1e4c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e50984640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e4c0cab60 0x7f1e4c072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e50984640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4c155950 con 0x7f1e4c155570 2024-06-03T00:01:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e50984640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1e4c0cb2e0 con 0x7f1e4c0cab60 2024-06-03T00:01:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e50984640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c0cb5c0 con 0x7f1e4c06ed20 2024-06-03T00:01:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e4ad9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e4c0cab60 0x7f1e4c072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e4ad9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e4c0cab60 0x7f1e4c072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:44094/0 (socket says 172.21.15.96:44094) 2024-06-03T00:01:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e4ad9d640 1 -- 172.21.15.96:0/2606433670 learned_addr learned my addr 172.21.15.96:0/2606433670 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e4a59c640 1 --1- 172.21.15.96:0/2606433670 >> v1:172.21.15.162:6789/0 conn(0x7f1e4c155570 0x7f1e4c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:37202/0 (socket says 172.21.15.96:37202) 2024-06-03T00:01:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e49d9b640 1 --2- 172.21.15.96:0/2606433670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e4c06ed20 0x7f1e4c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e4ad9d640 1 -- 172.21.15.96:0/2606433670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e4c06ed20 msgr2=0x7f1e4c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e4ad9d640 1 --2- 172.21.15.96:0/2606433670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e4c06ed20 0x7f1e4c0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e4ad9d640 1 -- 172.21.15.96:0/2606433670 >> v1:172.21.15.162:6789/0 conn(0x7f1e4c155570 legacy=0x7f1e4c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.769+0000 7f1e4ad9d640 1 -- 172.21.15.96:0/2606433670 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c0cb8a0 con 0x7f1e4c0cab60 2024-06-03T00:01:15.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.770+0000 7f1e4ad9d640 1 --2- 172.21.15.96:0/2606433670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e4c0cab60 0x7f1e4c072020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009e50 tx=0x7f1e4402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e1ad19e6d061a71 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:15.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.770+0000 7f1e4959a640 1 -- 172.21.15.96:0/2606433670 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44036070 con 0x7f1e4c0cab60 2024-06-03T00:01:15.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.770+0000 7f1e4959a640 1 -- 172.21.15.96:0/2606433670 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e44031600 con 0x7f1e4c0cab60 2024-06-03T00:01:15.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.770+0000 7f1e4959a640 1 -- 172.21.15.96:0/2606433670 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440319d0 con 0x7f1e4c0cab60 2024-06-03T00:01:15.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.771+0000 7f1e50984640 1 -- 172.21.15.96:0/2606433670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e4c0cab60 msgr2=0x7f1e4c072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.771+0000 7f1e50984640 1 --2- 172.21.15.96:0/2606433670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e4c0cab60 0x7f1e4c072020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009e50 tx=0x7f1e4402a710 comp rx=0 tx=0).stop 2024-06-03T00:01:15.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.771+0000 7f1e50984640 1 -- 172.21.15.96:0/2606433670 shutdown_connections 2024-06-03T00:01:15.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.771+0000 7f1e50984640 1 --2- 172.21.15.96:0/2606433670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e4c06ed20 0x7f1e4c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.771+0000 7f1e50984640 1 --2- 172.21.15.96:0/2606433670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e4c0cab60 0x7f1e4c072020 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.771+0000 7f1e50984640 1 -- 172.21.15.96:0/2606433670 >> 172.21.15.96:0/2606433670 conn(0x7f1e4c0cfc30 msgr2=0x7f1e4c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:15.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.771+0000 7f1e50984640 1 -- 172.21.15.96:0/2606433670 shutdown_connections 2024-06-03T00:01:15.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.771+0000 7f1e50984640 1 -- 172.21.15.96:0/2606433670 wait complete. 2024-06-03T00:01:15.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.772+0000 7f1e50984640 1 Processor -- start 2024-06-03T00:01:15.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.772+0000 7f1e50984640 1 -- start start 2024-06-03T00:01:15.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e50984640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e4c06ed20 0x7f1e4c150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e50984640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e4c0cab60 0x7f1e4c1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e50984640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e4c155570 0x7f1e4c1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e50984640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0717d0 con 0x7f1e4c06ed20 2024-06-03T00:01:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e50984640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c0cafd0 con 0x7f1e4c0cab60 2024-06-03T00:01:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e50984640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1e4c072560 con 0x7f1e4c155570 2024-06-03T00:01:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e4a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e4c06ed20 0x7f1e4c150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e4a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e4c06ed20 0x7f1e4c150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51342/0 (socket says 172.21.15.96:51342) 2024-06-03T00:01:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e4a59c640 1 -- 172.21.15.96:0/3578251242 learned_addr learned my addr 172.21.15.96:0/3578251242 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e49d9b640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e4c0cab60 0x7f1e4c1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.777 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e4ad9d640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e4c155570 0x7f1e4c1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e4a59c640 1 -- 172.21.15.96:0/3578251242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e4c155570 msgr2=0x7f1e4c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e4a59c640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e4c155570 0x7f1e4c1596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e4a59c640 1 -- 172.21.15.96:0/3578251242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e4c0cab60 msgr2=0x7f1e4c1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e4a59c640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e4c0cab60 0x7f1e4c1586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.773+0000 7f1e4a59c640 1 -- 172.21.15.96:0/3578251242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c1f5a80 con 0x7f1e4c06ed20 2024-06-03T00:01:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.774+0000 7f1e4a59c640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e4c06ed20 0x7f1e4c150160 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c3c0 tx=0x7f1e3c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.774+0000 7f1e42ffd640 1 -- 172.21.15.96:0/3578251242 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0074e0 con 0x7f1e4c06ed20 2024-06-03T00:01:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.774+0000 7f1e42ffd640 1 -- 172.21.15.96:0/3578251242 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e3c007680 con 0x7f1e4c06ed20 2024-06-03T00:01:15.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.774+0000 7f1e42ffd640 1 -- 172.21.15.96:0/3578251242 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c004a00 con 0x7f1e4c06ed20 2024-06-03T00:01:15.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.774+0000 7f1e50984640 1 -- 172.21.15.96:0/3578251242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c1f5d60 con 0x7f1e4c06ed20 2024-06-03T00:01:15.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.774+0000 7f1e50984640 1 -- 172.21.15.96:0/3578251242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c1f6320 con 0x7f1e4c06ed20 2024-06-03T00:01:15.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.775+0000 7f1e50984640 1 -- 172.21.15.96:0/3578251242 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4c0cf4b0 con 0x7f1e4c06ed20 2024-06-03T00:01:15.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.775+0000 7f1e42ffd640 1 -- 172.21.15.96:0/3578251242 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f1e3c01a020 con 0x7f1e4c06ed20 2024-06-03T00:01:15.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.776+0000 7f1e42ffd640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e2c06be60 0x7f1e2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:15.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.776+0000 7f1e42ffd640 1 -- 172.21.15.96:0/3578251242 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f1e3c08a720 con 0x7f1e4c06ed20 2024-06-03T00:01:15.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.776+0000 7f1e49d9b640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e2c06be60 0x7f1e2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:15.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.776+0000 7f1e49d9b640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e2c06be60 0x7f1e2c06e320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c1581d0 tx=0x7f1e34008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:15.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.780+0000 7f1e42ffd640 1 -- 172.21.15.96:0/3578251242 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f1e4c0cf4b0 con 0x7f1e4c06ed20 2024-06-03T00:01:15.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.950+0000 7f1e50984640 1 -- 172.21.15.96:0/3578251242 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e4c0683e0 con 0x7f1e2c06be60 2024-06-03T00:01:15.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.956+0000 7f1e42ffd640 1 -- 172.21.15.96:0/3578251242 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7f1e4c0683e0 con 0x7f1e2c06be60 2024-06-03T00:01:15.958 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-03T00:01:15.959 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-03T00:01:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 -- 172.21.15.96:0/3578251242 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e2c06be60 msgr2=0x7f1e2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e2c06be60 0x7f1e2c06e320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c1581d0 tx=0x7f1e34008040 comp rx=0 tx=0).stop 2024-06-03T00:01:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 -- 172.21.15.96:0/3578251242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e4c06ed20 msgr2=0x7f1e4c150160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e4c06ed20 0x7f1e4c150160 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00c3c0 tx=0x7f1e3c00c880 comp rx=0 tx=0).stop 2024-06-03T00:01:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 -- 172.21.15.96:0/3578251242 shutdown_connections 2024-06-03T00:01:15.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f1e2c06be60 0x7f1e2c06e320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e4c155570 0x7f1e4c1596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e4c0cab60 0x7f1e4c1586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 --2- 172.21.15.96:0/3578251242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e4c06ed20 0x7f1e4c150160 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 -- 172.21.15.96:0/3578251242 >> 172.21.15.96:0/3578251242 conn(0x7f1e4c0cfc30 msgr2=0x7f1e4c0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 -- 172.21.15.96:0/3578251242 shutdown_connections 2024-06-03T00:01:15.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:15.959+0000 7f1e50984640 1 -- 172.21.15.96:0/3578251242 wait complete. 2024-06-03T00:01:15.970 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-06-03T00:01:14.526808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594033,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":247,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319900,"kb_used_data":7976,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754654820,"statfs":{"total":773094113280,"available":772766535680,"internally_reserved":0,"allocated":8167424,"data_stored":4657234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002968"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229064+0000","last_change":"2024-06-02T23:59:01.586938+0000","last_active":"2024-06-03T00:00:46.229064+0000","last_peered":"2024-06-03T00:00:46.229064+0000","last_clean":"2024-06-03T00:00:46.229064+0000","last_became_active":"2024-06-02T23:59:01.586669+0000","last_became_peered":"2024-06-02T23:59:01.586669+0000","last_unstale":"2024-06-03T00:00:46.229064+0000","last_undegraded":"2024-06-03T00:00:46.229064+0000","last_fullsized":"2024-06-03T00:00:46.229064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:32:12.883830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781379+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-03T00:00:45.781379+0000","last_peered":"2024-06-03T00:00:45.781379+0000","last_clean":"2024-06-03T00:00:45.781379+0000","last_became_active":"2024-06-02T23:59:01.582687+0000","last_became_peered":"2024-06-02T23:59:01.582687+0000","last_unstale":"2024-06-03T00:00:45.781379+0000","last_undegraded":"2024-06-03T00:00:45.781379+0000","last_fullsized":"2024-06-03T00:00:45.781379+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230121+0000","last_change":"2024-06-02T23:59:01.586233+0000","last_active":"2024-06-03T00:00:46.230121+0000","last_peered":"2024-06-03T00:00:46.230121+0000","last_clean":"2024-06-03T00:00:46.230121+0000","last_became_active":"2024-06-02T23:59:01.586006+0000","last_became_peered":"2024-06-02T23:59:01.586006+0000","last_unstale":"2024-06-03T00:00:46.230121+0000","last_undegraded":"2024-06-03T00:00:46.230121+0000","last_fullsized":"2024-06-03T00:00:46.230121+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780728+0000","last_change":"2024-06-02T23:59:01.587310+0000","last_active":"2024-06-03T00:00:45.780728+0000","last_peered":"2024-06-03T00:00:45.780728+0000","last_clean":"2024-06-03T00:00:45.780728+0000","last_became_active":"2024-06-02T23:59:01.586761+0000","last_became_peered":"2024-06-02T23:59:01.586761+0000","last_unstale":"2024-06-03T00:00:45.780728+0000","last_undegraded":"2024-06-03T00:00:45.780728+0000","last_fullsized":"2024-06-03T00:00:45.780728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776333+0000","last_change":"2024-06-02T23:59:01.583800+0000","last_active":"2024-06-03T00:00:45.776333+0000","last_peered":"2024-06-03T00:00:45.776333+0000","last_clean":"2024-06-03T00:00:45.776333+0000","last_became_active":"2024-06-02T23:59:01.581028+0000","last_became_peered":"2024-06-02T23:59:01.581028+0000","last_unstale":"2024-06-03T00:00:45.776333+0000","last_undegraded":"2024-06-03T00:00:45.776333+0000","last_fullsized":"2024-06-03T00:00:45.776333+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:25:47.061955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228969+0000","last_change":"2024-06-02T23:59:01.587296+0000","last_active":"2024-06-03T00:00:46.228969+0000","last_peered":"2024-06-03T00:00:46.228969+0000","last_clean":"2024-06-03T00:00:46.228969+0000","last_became_active":"2024-06-02T23:59:01.586996+0000","last_became_peered":"2024-06-02T23:59:01.586996+0000","last_unstale":"2024-06-03T00:00:46.228969+0000","last_undegraded":"2024-06-03T00:00:46.228969+0000","last_fullsized":"2024-06-03T00:00:46.228969+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:56:54.953142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229778+0000","last_change":"2024-06-02T23:59:01.586195+0000","last_active":"2024-06-03T00:00:46.229778+0000","last_peered":"2024-06-03T00:00:46.229778+0000","last_clean":"2024-06-03T00:00:46.229778+0000","last_became_active":"2024-06-02T23:59:01.583488+0000","last_became_peered":"2024-06-02T23:59:01.583488+0000","last_unstale":"2024-06-03T00:00:46.229778+0000","last_undegraded":"2024-06-03T00:00:46.229778+0000","last_fullsized":"2024-06-03T00:00:46.229778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:42:09.116457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773168+0000","last_change":"2024-06-02T23:59:01.588746+0000","last_active":"2024-06-03T00:00:45.773168+0000","last_peered":"2024-06-03T00:00:45.773168+0000","last_clean":"2024-06-03T00:00:45.773168+0000","last_became_active":"2024-06-02T23:59:01.588310+0000","last_became_peered":"2024-06-02T23:59:01.588310+0000","last_unstale":"2024-06-03T00:00:45.773168+0000","last_undegraded":"2024-06-03T00:00:45.773168+0000","last_fullsized":"2024-06-03T00:00:45.773168+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:56:25.974137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773512+0000","last_change":"2024-06-02T23:59:01.592959+0000","last_active":"2024-06-03T00:00:45.773512+0000","last_peered":"2024-06-03T00:00:45.773512+0000","last_clean":"2024-06-03T00:00:45.773512+0000","last_became_active":"2024-06-02T23:59:01.592704+0000","last_became_peered":"2024-06-02T23:59:01.592704+0000","last_unstale":"2024-06-03T00:00:45.773512+0000","last_undegraded":"2024-06-03T00:00:45.773512+0000","last_fullsized":"2024-06-03T00:00:45.773512+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:57:55.310878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228621+0000","last_change":"2024-06-02T23:59:01.589283+0000","last_active":"2024-06-03T00:00:46.228621+0000","last_peered":"2024-06-03T00:00:46.228621+0000","last_clean":"2024-06-03T00:00:46.228621+0000","last_became_active":"2024-06-02T23:59:01.588961+0000","last_became_peered":"2024-06-02T23:59:01.588961+0000","last_unstale":"2024-06-03T00:00:46.228621+0000","last_undegraded":"2024-06-03T00:00:46.228621+0000","last_fullsized":"2024-06-03T00:00:46.228621+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:09:42.099307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229227+0000","last_change":"2024-06-02T23:59:01.583139+0000","last_active":"2024-06-03T00:00:46.229227+0000","last_peered":"2024-06-03T00:00:46.229227+0000","last_clean":"2024-06-03T00:00:46.229227+0000","last_became_active":"2024-06-02T23:59:01.582876+0000","last_became_peered":"2024-06-02T23:59:01.582876+0000","last_unstale":"2024-06-03T00:00:46.229227+0000","last_undegraded":"2024-06-03T00:00:46.229227+0000","last_fullsized":"2024-06-03T00:00:46.229227+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:35:19.666135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773306+0000","last_change":"2024-06-02T23:59:01.589336+0000","last_active":"2024-06-03T00:00:45.773306+0000","last_peered":"2024-06-03T00:00:45.773306+0000","last_clean":"2024-06-03T00:00:45.773306+0000","last_became_active":"2024-06-02T23:59:01.589067+0000","last_became_peered":"2024-06-02T23:59:01.589067+0000","last_unstale":"2024-06-03T00:00:45.773306+0000","last_undegraded":"2024-06-03T00:00:45.773306+0000","last_fullsized":"2024-06-03T00:00:45.773306+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:49:36.524901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228658+0000","last_change":"2024-06-02T23:59:01.591325+0000","last_active":"2024-06-03T00:00:46.228658+0000","last_peered":"2024-06-03T00:00:46.228658+0000","last_clean":"2024-06-03T00:00:46.228658+0000","last_became_active":"2024-06-02T23:59:01.590545+0000","last_became_peered":"2024-06-02T23:59:01.590545+0000","last_unstale":"2024-06-03T00:00:46.228658+0000","last_undegraded":"2024-06-03T00:00:46.228658+0000","last_fullsized":"2024-06-03T00:00:46.228658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:29:17.184163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229891+0000","last_change":"2024-06-02T23:59:01.583413+0000","last_active":"2024-06-03T00:00:46.229891+0000","last_peered":"2024-06-03T00:00:46.229891+0000","last_clean":"2024-06-03T00:00:46.229891+0000","last_became_active":"2024-06-02T23:59:01.582568+0000","last_became_peered":"2024-06-02T23:59:01.582568+0000","last_unstale":"2024-06-03T00:00:46.229891+0000","last_undegraded":"2024-06-03T00:00:46.229891+0000","last_fullsized":"2024-06-03T00:00:46.229891+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:45.895866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780842+0000","last_change":"2024-06-02T23:59:01.591575+0000","last_active":"2024-06-03T00:00:45.780842+0000","last_peered":"2024-06-03T00:00:45.780842+0000","last_clean":"2024-06-03T00:00:45.780842+0000","last_became_active":"2024-06-02T23:59:01.591265+0000","last_became_peered":"2024-06-02T23:59:01.591265+0000","last_unstale":"2024-06-03T00:00:45.780842+0000","last_undegraded":"2024-06-03T00:00:45.780842+0000","last_fullsized":"2024-06-03T00:00:45.780842+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228641+0000","last_change":"2024-06-02T23:59:01.590700+0000","last_active":"2024-06-03T00:00:46.228641+0000","last_peered":"2024-06-03T00:00:46.228641+0000","last_clean":"2024-06-03T00:00:46.228641+0000","last_became_active":"2024-06-02T23:59:01.590445+0000","last_became_peered":"2024-06-02T23:59:01.590445+0000","last_unstale":"2024-06-03T00:00:46.228641+0000","last_undegraded":"2024-06-03T00:00:46.228641+0000","last_fullsized":"2024-06-03T00:00:46.228641+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:08:31.933956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230494+0000","last_change":"2024-06-02T23:59:01.587034+0000","last_active":"2024-06-03T00:00:46.230494+0000","last_peered":"2024-06-03T00:00:46.230494+0000","last_clean":"2024-06-03T00:00:46.230494+0000","last_became_active":"2024-06-02T23:59:01.586784+0000","last_became_peered":"2024-06-02T23:59:01.586784+0000","last_unstale":"2024-06-03T00:00:46.230494+0000","last_undegraded":"2024-06-03T00:00:46.230494+0000","last_fullsized":"2024-06-03T00:00:46.230494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:10.502903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781431+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-03T00:00:45.781431+0000","last_peered":"2024-06-03T00:00:45.781431+0000","last_clean":"2024-06-03T00:00:45.781431+0000","last_became_active":"2024-06-02T23:59:01.582680+0000","last_became_peered":"2024-06-02T23:59:01.582680+0000","last_unstale":"2024-06-03T00:00:45.781431+0000","last_undegraded":"2024-06-03T00:00:45.781431+0000","last_fullsized":"2024-06-03T00:00:45.781431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230068+0000","last_change":"2024-06-02T23:59:01.582684+0000","last_active":"2024-06-03T00:00:46.230068+0000","last_peered":"2024-06-03T00:00:46.230068+0000","last_clean":"2024-06-03T00:00:46.230068+0000","last_became_active":"2024-06-02T23:59:01.582422+0000","last_became_peered":"2024-06-02T23:59:01.582422+0000","last_unstale":"2024-06-03T00:00:46.230068+0000","last_undegraded":"2024-06-03T00:00:46.230068+0000","last_fullsized":"2024-06-03T00:00:46.230068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:06.674997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080965+0000","last_change":"2024-06-02T23:59:01.591052+0000","last_active":"2024-06-03T00:00:46.080965+0000","last_peered":"2024-06-03T00:00:46.080965+0000","last_clean":"2024-06-03T00:00:46.080965+0000","last_became_active":"2024-06-02T23:59:01.590601+0000","last_became_peered":"2024-06-02T23:59:01.590601+0000","last_unstale":"2024-06-03T00:00:46.080965+0000","last_undegraded":"2024-06-03T00:00:46.080965+0000","last_fullsized":"2024-06-03T00:00:46.080965+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:29:55.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080646+0000","last_change":"2024-06-02T23:59:01.593871+0000","last_active":"2024-06-03T00:00:46.080646+0000","last_peered":"2024-06-03T00:00:46.080646+0000","last_clean":"2024-06-03T00:00:46.080646+0000","last_became_active":"2024-06-02T23:59:01.593596+0000","last_became_peered":"2024-06-02T23:59:01.593596+0000","last_unstale":"2024-06-03T00:00:46.080646+0000","last_undegraded":"2024-06-03T00:00:46.080646+0000","last_fullsized":"2024-06-03T00:00:46.080646+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:35:33.955552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773123+0000","last_change":"2024-06-02T23:59:01.587899+0000","last_active":"2024-06-03T00:00:45.773123+0000","last_peered":"2024-06-03T00:00:45.773123+0000","last_clean":"2024-06-03T00:00:45.773123+0000","last_became_active":"2024-06-02T23:59:01.587641+0000","last_became_peered":"2024-06-02T23:59:01.587641+0000","last_unstale":"2024-06-03T00:00:45.773123+0000","last_undegraded":"2024-06-03T00:00:45.773123+0000","last_fullsized":"2024-06-03T00:00:45.773123+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:24:09.334139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228797+0000","last_change":"2024-06-02T23:59:01.584645+0000","last_active":"2024-06-03T00:00:46.228797+0000","last_peered":"2024-06-03T00:00:46.228797+0000","last_clean":"2024-06-03T00:00:46.228797+0000","last_became_active":"2024-06-02T23:59:01.584358+0000","last_became_peered":"2024-06-02T23:59:01.584358+0000","last_unstale":"2024-06-03T00:00:46.228797+0000","last_undegraded":"2024-06-03T00:00:46.228797+0000","last_fullsized":"2024-06-03T00:00:46.228797+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:31:25.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229486+0000","last_change":"2024-06-02T23:59:01.583175+0000","last_active":"2024-06-03T00:00:46.229486+0000","last_peered":"2024-06-03T00:00:46.229486+0000","last_clean":"2024-06-03T00:00:46.229486+0000","last_became_active":"2024-06-02T23:59:01.582904+0000","last_became_peered":"2024-06-02T23:59:01.582904+0000","last_unstale":"2024-06-03T00:00:46.229486+0000","last_undegraded":"2024-06-03T00:00:46.229486+0000","last_fullsized":"2024-06-03T00:00:46.229486+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:56:06.478241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229396+0000","last_change":"2024-06-02T23:59:01.591616+0000","last_active":"2024-06-03T00:00:46.229396+0000","last_peered":"2024-06-03T00:00:46.229396+0000","last_clean":"2024-06-03T00:00:46.229396+0000","last_became_active":"2024-06-02T23:59:01.589760+0000","last_became_peered":"2024-06-02T23:59:01.589760+0000","last_unstale":"2024-06-03T00:00:46.229396+0000","last_undegraded":"2024-06-03T00:00:46.229396+0000","last_fullsized":"2024-06-03T00:00:46.229396+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:02:29.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773359+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-03T00:00:45.773359+0000","last_peered":"2024-06-03T00:00:45.773359+0000","last_clean":"2024-06-03T00:00:45.773359+0000","last_became_active":"2024-06-02T23:59:01.585010+0000","last_became_peered":"2024-06-02T23:59:01.585010+0000","last_unstale":"2024-06-03T00:00:45.773359+0000","last_undegraded":"2024-06-03T00:00:45.773359+0000","last_fullsized":"2024-06-03T00:00:45.773359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:50:01.657005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229148+0000","last_change":"2024-06-02T23:59:01.593067+0000","last_active":"2024-06-03T00:00:46.229148+0000","last_peered":"2024-06-03T00:00:46.229148+0000","last_clean":"2024-06-03T00:00:46.229148+0000","last_became_active":"2024-06-02T23:59:01.592789+0000","last_became_peered":"2024-06-02T23:59:01.592789+0000","last_unstale":"2024-06-03T00:00:46.229148+0000","last_undegraded":"2024-06-03T00:00:46.229148+0000","last_fullsized":"2024-06-03T00:00:46.229148+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:25:47.061955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080990+0000","last_change":"2024-06-02T23:59:01.591460+0000","last_active":"2024-06-03T00:00:46.080990+0000","last_peered":"2024-06-03T00:00:46.080990+0000","last_clean":"2024-06-03T00:00:46.080990+0000","last_became_active":"2024-06-02T23:59:01.590827+0000","last_became_peered":"2024-06-02T23:59:01.590827+0000","last_unstale":"2024-06-03T00:00:46.080990+0000","last_undegraded":"2024-06-03T00:00:46.080990+0000","last_fullsized":"2024-06-03T00:00:46.080990+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:04:27.044276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229879+0000","last_change":"2024-06-02T23:59:01.589715+0000","last_active":"2024-06-03T00:00:46.229879+0000","last_peered":"2024-06-03T00:00:46.229879+0000","last_clean":"2024-06-03T00:00:46.229879+0000","last_became_active":"2024-06-02T23:59:01.589456+0000","last_became_peered":"2024-06-02T23:59:01.589456+0000","last_unstale":"2024-06-03T00:00:46.229879+0000","last_undegraded":"2024-06-03T00:00:46.229879+0000","last_fullsized":"2024-06-03T00:00:46.229879+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:56:36.510898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781075+0000","last_change":"2024-06-02T23:59:01.589048+0000","last_active":"2024-06-03T00:00:45.781075+0000","last_peered":"2024-06-03T00:00:45.781075+0000","last_clean":"2024-06-03T00:00:45.781075+0000","last_became_active":"2024-06-02T23:59:01.588773+0000","last_became_peered":"2024-06-02T23:59:01.588773+0000","last_unstale":"2024-06-03T00:00:45.781075+0000","last_undegraded":"2024-06-03T00:00:45.781075+0000","last_fullsized":"2024-06-03T00:00:45.781075+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229896+0000","last_change":"2024-06-02T23:59:01.586433+0000","last_active":"2024-06-03T00:00:46.229896+0000","last_peered":"2024-06-03T00:00:46.229896+0000","last_clean":"2024-06-03T00:00:46.229896+0000","last_became_active":"2024-06-02T23:59:01.585466+0000","last_became_peered":"2024-06-02T23:59:01.585466+0000","last_unstale":"2024-06-03T00:00:46.229896+0000","last_undegraded":"2024-06-03T00:00:46.229896+0000","last_fullsized":"2024-06-03T00:00:46.229896+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:24:38.083153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228206+0000","last_change":"2024-06-02T23:59:01.586007+0000","last_active":"2024-06-03T00:00:46.228206+0000","last_peered":"2024-06-03T00:00:46.228206+0000","last_clean":"2024-06-03T00:00:46.228206+0000","last_became_active":"2024-06-02T23:59:01.585721+0000","last_became_peered":"2024-06-02T23:59:01.585721+0000","last_unstale":"2024-06-03T00:00:46.228206+0000","last_undegraded":"2024-06-03T00:00:46.228206+0000","last_fullsized":"2024-06-03T00:00:46.228206+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:50:41.714294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780711+0000","last_change":"2024-06-02T23:59:01.582009+0000","last_active":"2024-06-03T00:00:45.780711+0000","last_peered":"2024-06-03T00:00:45.780711+0000","last_clean":"2024-06-03T00:00:45.780711+0000","last_became_active":"2024-06-02T23:59:01.581438+0000","last_became_peered":"2024-06-02T23:59:01.581438+0000","last_unstale":"2024-06-03T00:00:45.780711+0000","last_undegraded":"2024-06-03T00:00:45.780711+0000","last_fullsized":"2024-06-03T00:00:45.780711+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"69'4","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080898+0000","last_change":"2024-06-02T23:59:00.647990+0000","last_active":"2024-06-03T00:00:46.080898+0000","last_peered":"2024-06-03T00:00:46.080898+0000","last_clean":"2024-06-03T00:00:46.080898+0000","last_became_active":"2024-06-02T23:59:00.647031+0000","last_became_peered":"2024-06-02T23:59:00.647031+0000","last_unstale":"2024-06-03T00:00:46.080898+0000","last_undegraded":"2024-06-03T00:00:46.080898+0000","last_fullsized":"2024-06-03T00:00:46.080898+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:19:44.864617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228259+0000","last_change":"2024-06-02T23:59:01.587104+0000","last_active":"2024-06-03T00:00:46.228259+0000","last_peered":"2024-06-03T00:00:46.228259+0000","last_clean":"2024-06-03T00:00:46.228259+0000","last_became_active":"2024-06-02T23:59:01.586813+0000","last_became_peered":"2024-06-02T23:59:01.586813+0000","last_unstale":"2024-06-03T00:00:46.228259+0000","last_undegraded":"2024-06-03T00:00:46.228259+0000","last_fullsized":"2024-06-03T00:00:46.228259+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:10:37.679556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"69'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228813+0000","last_change":"2024-06-02T23:59:00.638860+0000","last_active":"2024-06-03T00:00:46.228813+0000","last_peered":"2024-06-03T00:00:46.228813+0000","last_clean":"2024-06-03T00:00:46.228813+0000","last_became_active":"2024-06-02T23:59:00.638579+0000","last_became_peered":"2024-06-02T23:59:00.638579+0000","last_unstale":"2024-06-03T00:00:46.228813+0000","last_undegraded":"2024-06-03T00:00:46.228813+0000","last_fullsized":"2024-06-03T00:00:46.228813+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:57:25.113202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080615+0000","last_change":"2024-06-02T23:59:01.593795+0000","last_active":"2024-06-03T00:00:46.080615+0000","last_peered":"2024-06-03T00:00:46.080615+0000","last_clean":"2024-06-03T00:00:46.080615+0000","last_became_active":"2024-06-02T23:59:01.593506+0000","last_became_peered":"2024-06-02T23:59:01.593506+0000","last_unstale":"2024-06-03T00:00:46.080615+0000","last_undegraded":"2024-06-03T00:00:46.080615+0000","last_fullsized":"2024-06-03T00:00:46.080615+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:51.301800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229152+0000","last_change":"2024-06-02T23:59:00.648871+0000","last_active":"2024-06-03T00:00:46.229152+0000","last_peered":"2024-06-03T00:00:46.229152+0000","last_clean":"2024-06-03T00:00:46.229152+0000","last_became_active":"2024-06-02T23:59:00.648667+0000","last_became_peered":"2024-06-02T23:59:00.648667+0000","last_unstale":"2024-06-03T00:00:46.229152+0000","last_undegraded":"2024-06-03T00:00:46.229152+0000","last_fullsized":"2024-06-03T00:00:46.229152+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:11:50.234565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773134+0000","last_change":"2024-06-02T23:59:01.585466+0000","last_active":"2024-06-03T00:00:45.773134+0000","last_peered":"2024-06-03T00:00:45.773134+0000","last_clean":"2024-06-03T00:00:45.773134+0000","last_became_active":"2024-06-02T23:59:01.585127+0000","last_became_peered":"2024-06-02T23:59:01.585127+0000","last_unstale":"2024-06-03T00:00:45.773134+0000","last_undegraded":"2024-06-03T00:00:45.773134+0000","last_fullsized":"2024-06-03T00:00:45.773134+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:23:32.778002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228442+0000","last_change":"2024-06-02T23:59:00.642417+0000","last_active":"2024-06-03T00:00:46.228442+0000","last_peered":"2024-06-03T00:00:46.228442+0000","last_clean":"2024-06-03T00:00:46.228442+0000","last_became_active":"2024-06-02T23:59:00.642182+0000","last_became_peered":"2024-06-02T23:59:00.642182+0000","last_unstale":"2024-06-03T00:00:46.228442+0000","last_undegraded":"2024-06-03T00:00:46.228442+0000","last_fullsized":"2024-06-03T00:00:46.228442+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:48.372998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.082184+0000","last_change":"2024-06-03T00:00:46.082184+0000","last_active":"2024-06-03T00:00:46.082184+0000","last_peered":"2024-06-03T00:00:46.082184+0000","last_clean":"2024-06-03T00:00:46.082184+0000","last_became_active":"2024-06-03T00:00:46.081627+0000","last_became_peered":"2024-06-03T00:00:46.081627+0000","last_unstale":"2024-06-03T00:00:46.082184+0000","last_undegraded":"2024-06-03T00:00:46.082184+0000","last_fullsized":"2024-06-03T00:00:46.082184+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:40:22.021276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229869+0000","last_change":"2024-06-02T23:59:00.641231+0000","last_active":"2024-06-03T00:00:46.229869+0000","last_peered":"2024-06-03T00:00:46.229869+0000","last_clean":"2024-06-03T00:00:46.229869+0000","last_became_active":"2024-06-02T23:59:00.640963+0000","last_became_peered":"2024-06-02T23:59:00.640963+0000","last_unstale":"2024-06-03T00:00:46.229869+0000","last_undegraded":"2024-06-03T00:00:46.229869+0000","last_fullsized":"2024-06-03T00:00:46.229869+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:35:22.148246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781190+0000","last_change":"2024-06-02T23:59:01.591548+0000","last_active":"2024-06-03T00:00:45.781190+0000","last_peered":"2024-06-03T00:00:45.781190+0000","last_clean":"2024-06-03T00:00:45.781190+0000","last_became_active":"2024-06-02T23:59:01.591198+0000","last_became_peered":"2024-06-02T23:59:01.591198+0000","last_unstale":"2024-06-03T00:00:45.781190+0000","last_undegraded":"2024-06-03T00:00:45.781190+0000","last_fullsized":"2024-06-03T00:00:45.781190+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776211+0000","last_change":"2024-06-02T23:59:00.649120+0000","last_active":"2024-06-03T00:00:45.776211+0000","last_peered":"2024-06-03T00:00:45.776211+0000","last_clean":"2024-06-03T00:00:45.776211+0000","last_became_active":"2024-06-02T23:59:00.648839+0000","last_became_peered":"2024-06-02T23:59:00.648839+0000","last_unstale":"2024-06-03T00:00:45.776211+0000","last_undegraded":"2024-06-03T00:00:45.776211+0000","last_fullsized":"2024-06-03T00:00:45.776211+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:52:08.529881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773203+0000","last_change":"2024-06-02T23:59:01.585288+0000","last_active":"2024-06-03T00:00:45.773203+0000","last_peered":"2024-06-03T00:00:45.773203+0000","last_clean":"2024-06-03T00:00:45.773203+0000","last_became_active":"2024-06-02T23:59:01.584971+0000","last_became_peered":"2024-06-02T23:59:01.584971+0000","last_unstale":"2024-06-03T00:00:45.773203+0000","last_undegraded":"2024-06-03T00:00:45.773203+0000","last_fullsized":"2024-06-03T00:00:45.773203+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:54:54.767840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080841+0000","last_change":"2024-06-02T23:59:00.648200+0000","last_active":"2024-06-03T00:00:46.080841+0000","last_peered":"2024-06-03T00:00:46.080841+0000","last_clean":"2024-06-03T00:00:46.080841+0000","last_became_active":"2024-06-02T23:59:00.647175+0000","last_became_peered":"2024-06-02T23:59:00.647175+0000","last_unstale":"2024-06-03T00:00:46.080841+0000","last_undegraded":"2024-06-03T00:00:46.080841+0000","last_fullsized":"2024-06-03T00:00:46.080841+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:34:43.239731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.081972+0000","last_change":"2024-06-03T00:00:46.081972+0000","last_active":"2024-06-03T00:00:46.081972+0000","last_peered":"2024-06-03T00:00:46.081972+0000","last_clean":"2024-06-03T00:00:46.081972+0000","last_became_active":"2024-06-03T00:00:46.081552+0000","last_became_peered":"2024-06-03T00:00:46.081552+0000","last_unstale":"2024-06-03T00:00:46.081972+0000","last_undegraded":"2024-06-03T00:00:46.081972+0000","last_fullsized":"2024-06-03T00:00:46.081972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:37:10.667194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229593+0000","last_change":"2024-06-02T23:59:00.647400+0000","last_active":"2024-06-03T00:00:46.229593+0000","last_peered":"2024-06-03T00:00:46.229593+0000","last_clean":"2024-06-03T00:00:46.229593+0000","last_became_active":"2024-06-02T23:59:00.647210+0000","last_became_peered":"2024-06-02T23:59:00.647210+0000","last_unstale":"2024-06-03T00:00:46.229593+0000","last_undegraded":"2024-06-03T00:00:46.229593+0000","last_fullsized":"2024-06-03T00:00:46.229593+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:13.009966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776028+0000","last_change":"2024-06-02T23:59:01.587444+0000","last_active":"2024-06-03T00:00:45.776028+0000","last_peered":"2024-06-03T00:00:45.776028+0000","last_clean":"2024-06-03T00:00:45.776028+0000","last_became_active":"2024-06-02T23:59:01.587190+0000","last_became_peered":"2024-06-02T23:59:01.587190+0000","last_unstale":"2024-06-03T00:00:45.776028+0000","last_undegraded":"2024-06-03T00:00:45.776028+0000","last_fullsized":"2024-06-03T00:00:45.776028+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:56:54.953142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781643+0000","last_change":"2024-06-02T23:59:00.637111+0000","last_active":"2024-06-03T00:00:45.781643+0000","last_peered":"2024-06-03T00:00:45.781643+0000","last_clean":"2024-06-03T00:00:45.781643+0000","last_became_active":"2024-06-02T23:59:00.636815+0000","last_became_peered":"2024-06-02T23:59:00.636815+0000","last_unstale":"2024-06-03T00:00:45.781643+0000","last_undegraded":"2024-06-03T00:00:45.781643+0000","last_fullsized":"2024-06-03T00:00:45.781643+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:52:39.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228178+0000","last_change":"2024-06-02T23:59:01.585862+0000","last_active":"2024-06-03T00:00:46.228178+0000","last_peered":"2024-06-03T00:00:46.228178+0000","last_clean":"2024-06-03T00:00:46.228178+0000","last_became_active":"2024-06-02T23:59:01.585128+0000","last_became_peered":"2024-06-02T23:59:01.585128+0000","last_unstale":"2024-06-03T00:00:46.228178+0000","last_undegraded":"2024-06-03T00:00:46.228178+0000","last_fullsized":"2024-06-03T00:00:46.228178+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:28:18.588571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776556+0000","last_change":"2024-06-02T23:59:00.644991+0000","last_active":"2024-06-03T00:00:45.776556+0000","last_peered":"2024-06-03T00:00:45.776556+0000","last_clean":"2024-06-03T00:00:45.776556+0000","last_became_active":"2024-06-02T23:59:00.644759+0000","last_became_peered":"2024-06-02T23:59:00.644759+0000","last_unstale":"2024-06-03T00:00:45.776556+0000","last_undegraded":"2024-06-03T00:00:45.776556+0000","last_fullsized":"2024-06-03T00:00:45.776556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:29:26.313713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230012+0000","last_change":"2024-06-02T23:59:01.590250+0000","last_active":"2024-06-03T00:00:46.230012+0000","last_peered":"2024-06-03T00:00:46.230012+0000","last_clean":"2024-06-03T00:00:46.230012+0000","last_became_active":"2024-06-02T23:59:01.589942+0000","last_became_peered":"2024-06-02T23:59:01.589942+0000","last_unstale":"2024-06-03T00:00:46.230012+0000","last_undegraded":"2024-06-03T00:00:46.230012+0000","last_fullsized":"2024-06-03T00:00:46.230012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"69'3","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781520+0000","last_change":"2024-06-02T23:59:00.644405+0000","last_active":"2024-06-03T00:00:45.781520+0000","last_peered":"2024-06-03T00:00:45.781520+0000","last_clean":"2024-06-03T00:00:45.781520+0000","last_became_active":"2024-06-02T23:59:00.643978+0000","last_became_peered":"2024-06-02T23:59:00.643978+0000","last_unstale":"2024-06-03T00:00:45.781520+0000","last_undegraded":"2024-06-03T00:00:45.781520+0000","last_fullsized":"2024-06-03T00:00:45.781520+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:16:38.404329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776450+0000","last_change":"2024-06-02T23:59:01.574661+0000","last_active":"2024-06-03T00:00:45.776450+0000","last_peered":"2024-06-03T00:00:45.776450+0000","last_clean":"2024-06-03T00:00:45.776450+0000","last_became_active":"2024-06-02T23:59:01.574347+0000","last_became_peered":"2024-06-02T23:59:01.574347+0000","last_unstale":"2024-06-03T00:00:45.776450+0000","last_undegraded":"2024-06-03T00:00:45.776450+0000","last_fullsized":"2024-06-03T00:00:45.776450+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:24.094731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"70'9","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774383+0000","last_change":"2024-06-02T23:59:00.638966+0000","last_active":"2024-06-03T00:00:45.774383+0000","last_peered":"2024-06-03T00:00:45.774383+0000","last_clean":"2024-06-03T00:00:45.774383+0000","last_became_active":"2024-06-02T23:59:00.638716+0000","last_became_peered":"2024-06-02T23:59:00.638716+0000","last_unstale":"2024-06-03T00:00:45.774383+0000","last_undegraded":"2024-06-03T00:00:45.774383+0000","last_fullsized":"2024-06-03T00:00:45.774383+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:28.207234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2867,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228283+0000","last_change":"2024-06-02T23:59:01.584960+0000","last_active":"2024-06-03T00:00:46.228283+0000","last_peered":"2024-06-03T00:00:46.228283+0000","last_clean":"2024-06-03T00:00:46.228283+0000","last_became_active":"2024-06-02T23:59:01.584575+0000","last_became_peered":"2024-06-02T23:59:01.584575+0000","last_unstale":"2024-06-03T00:00:46.228283+0000","last_undegraded":"2024-06-03T00:00:46.228283+0000","last_fullsized":"2024-06-03T00:00:46.228283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:00:08.310863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229953+0000","last_change":"2024-06-02T23:59:00.645893+0000","last_active":"2024-06-03T00:00:46.229953+0000","last_peered":"2024-06-03T00:00:46.229953+0000","last_clean":"2024-06-03T00:00:46.229953+0000","last_became_active":"2024-06-02T23:59:00.645639+0000","last_became_peered":"2024-06-02T23:59:00.645639+0000","last_unstale":"2024-06-03T00:00:46.229953+0000","last_undegraded":"2024-06-03T00:00:46.229953+0000","last_fullsized":"2024-06-03T00:00:46.229953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:01:07.347079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230197+0000","last_change":"2024-06-02T23:59:01.589530+0000","last_active":"2024-06-03T00:00:46.230197+0000","last_peered":"2024-06-03T00:00:46.230197+0000","last_clean":"2024-06-03T00:00:46.230197+0000","last_became_active":"2024-06-02T23:59:01.589024+0000","last_became_peered":"2024-06-02T23:59:01.589024+0000","last_unstale":"2024-06-03T00:00:46.230197+0000","last_undegraded":"2024-06-03T00:00:46.230197+0000","last_fullsized":"2024-06-03T00:00:46.230197+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080745+0000","last_change":"2024-06-02T23:59:00.647783+0000","last_active":"2024-06-03T00:00:46.080745+0000","last_peered":"2024-06-03T00:00:46.080745+0000","last_clean":"2024-06-03T00:00:46.080745+0000","last_became_active":"2024-06-02T23:59:00.647500+0000","last_became_peered":"2024-06-02T23:59:00.647500+0000","last_unstale":"2024-06-03T00:00:46.080745+0000","last_undegraded":"2024-06-03T00:00:46.080745+0000","last_fullsized":"2024-06-03T00:00:46.080745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:55:32.977530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773324+0000","last_change":"2024-06-02T23:59:01.582611+0000","last_active":"2024-06-03T00:00:45.773324+0000","last_peered":"2024-06-03T00:00:45.773324+0000","last_clean":"2024-06-03T00:00:45.773324+0000","last_became_active":"2024-06-02T23:59:01.582343+0000","last_became_peered":"2024-06-02T23:59:01.582343+0000","last_unstale":"2024-06-03T00:00:45.773324+0000","last_undegraded":"2024-06-03T00:00:45.773324+0000","last_fullsized":"2024-06-03T00:00:45.773324+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:34:05.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781000+0000","last_change":"2024-06-02T23:59:00.648669+0000","last_active":"2024-06-03T00:00:45.781000+0000","last_peered":"2024-06-03T00:00:45.781000+0000","last_clean":"2024-06-03T00:00:45.781000+0000","last_became_active":"2024-06-02T23:59:00.647777+0000","last_became_peered":"2024-06-02T23:59:00.647777+0000","last_unstale":"2024-06-03T00:00:45.781000+0000","last_undegraded":"2024-06-03T00:00:45.781000+0000","last_fullsized":"2024-06-03T00:00:45.781000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:05:23.931542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230460+0000","last_change":"2024-06-02T23:59:01.593580+0000","last_active":"2024-06-03T00:00:46.230460+0000","last_peered":"2024-06-03T00:00:46.230460+0000","last_clean":"2024-06-03T00:00:46.230460+0000","last_became_active":"2024-06-02T23:59:01.593303+0000","last_became_peered":"2024-06-02T23:59:01.593303+0000","last_unstale":"2024-06-03T00:00:46.230460+0000","last_undegraded":"2024-06-03T00:00:46.230460+0000","last_fullsized":"2024-06-03T00:00:46.230460+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"69'8","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773924+0000","last_change":"2024-06-02T23:59:00.645230+0000","last_active":"2024-06-03T00:00:45.773924+0000","last_peered":"2024-06-03T00:00:45.773924+0000","last_clean":"2024-06-03T00:00:45.773924+0000","last_became_active":"2024-06-02T23:59:00.644964+0000","last_became_peered":"2024-06-02T23:59:00.644964+0000","last_unstale":"2024-06-03T00:00:45.773924+0000","last_undegraded":"2024-06-03T00:00:45.773924+0000","last_fullsized":"2024-06-03T00:00:45.773924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:17:05.673357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774081+0000","last_change":"2024-06-02T23:59:01.582894+0000","last_active":"2024-06-03T00:00:45.774081+0000","last_peered":"2024-06-03T00:00:45.774081+0000","last_clean":"2024-06-03T00:00:45.774081+0000","last_became_active":"2024-06-02T23:59:01.581160+0000","last_became_peered":"2024-06-02T23:59:01.581160+0000","last_unstale":"2024-06-03T00:00:45.774081+0000","last_undegraded":"2024-06-03T00:00:45.774081+0000","last_fullsized":"2024-06-03T00:00:45.774081+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:52:00.630032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230539+0000","last_change":"2024-06-02T23:59:00.644263+0000","last_active":"2024-06-03T00:00:46.230539+0000","last_peered":"2024-06-03T00:00:46.230539+0000","last_clean":"2024-06-03T00:00:46.230539+0000","last_became_active":"2024-06-02T23:59:00.644014+0000","last_became_peered":"2024-06-02T23:59:00.644014+0000","last_unstale":"2024-06-03T00:00:46.230539+0000","last_undegraded":"2024-06-03T00:00:46.230539+0000","last_fullsized":"2024-06-03T00:00:46.230539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:40:21.019637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228857+0000","last_change":"2024-06-02T23:59:01.593089+0000","last_active":"2024-06-03T00:00:46.228857+0000","last_peered":"2024-06-03T00:00:46.228857+0000","last_clean":"2024-06-03T00:00:46.228857+0000","last_became_active":"2024-06-02T23:59:01.592800+0000","last_became_peered":"2024-06-02T23:59:01.592800+0000","last_unstale":"2024-06-03T00:00:46.228857+0000","last_undegraded":"2024-06-03T00:00:46.228857+0000","last_fullsized":"2024-06-03T00:00:46.228857+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:42:07.188102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229189+0000","last_change":"2024-06-02T23:59:00.636429+0000","last_active":"2024-06-03T00:00:46.229189+0000","last_peered":"2024-06-03T00:00:46.229189+0000","last_clean":"2024-06-03T00:00:46.229189+0000","last_became_active":"2024-06-02T23:59:00.636161+0000","last_became_peered":"2024-06-02T23:59:00.636161+0000","last_unstale":"2024-06-03T00:00:46.229189+0000","last_undegraded":"2024-06-03T00:00:46.229189+0000","last_fullsized":"2024-06-03T00:00:46.229189+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:45:33.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776154+0000","last_change":"2024-06-02T23:59:01.588676+0000","last_active":"2024-06-03T00:00:45.776154+0000","last_peered":"2024-06-03T00:00:45.776154+0000","last_clean":"2024-06-03T00:00:45.776154+0000","last_became_active":"2024-06-02T23:59:01.588372+0000","last_became_peered":"2024-06-02T23:59:01.588372+0000","last_unstale":"2024-06-03T00:00:45.776154+0000","last_undegraded":"2024-06-03T00:00:45.776154+0000","last_fullsized":"2024-06-03T00:00:45.776154+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:29:13.698815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"69'1","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080995+0000","last_change":"2024-06-02T23:59:00.646728+0000","last_active":"2024-06-03T00:00:46.080995+0000","last_peered":"2024-06-03T00:00:46.080995+0000","last_clean":"2024-06-03T00:00:46.080995+0000","last_became_active":"2024-06-02T23:59:00.646290+0000","last_became_peered":"2024-06-02T23:59:00.646290+0000","last_unstale":"2024-06-03T00:00:46.080995+0000","last_undegraded":"2024-06-03T00:00:46.080995+0000","last_fullsized":"2024-06-03T00:00:46.080995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:51:55.805472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228852+0000","last_change":"2024-06-02T23:59:01.590261+0000","last_active":"2024-06-03T00:00:46.228852+0000","last_peered":"2024-06-03T00:00:46.228852+0000","last_clean":"2024-06-03T00:00:46.228852+0000","last_became_active":"2024-06-02T23:59:01.590016+0000","last_became_peered":"2024-06-02T23:59:01.590016+0000","last_unstale":"2024-06-03T00:00:46.228852+0000","last_undegraded":"2024-06-03T00:00:46.228852+0000","last_fullsized":"2024-06-03T00:00:46.228852+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:47:24.094731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.081088+0000","last_change":"2024-06-02T23:59:00.647565+0000","last_active":"2024-06-03T00:00:46.081088+0000","last_peered":"2024-06-03T00:00:46.081088+0000","last_clean":"2024-06-03T00:00:46.081088+0000","last_became_active":"2024-06-02T23:59:00.647144+0000","last_became_peered":"2024-06-02T23:59:00.647144+0000","last_unstale":"2024-06-03T00:00:46.081088+0000","last_undegraded":"2024-06-03T00:00:46.081088+0000","last_fullsized":"2024-06-03T00:00:46.081088+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:50:14.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228395+0000","last_change":"2024-06-02T23:59:01.579062+0000","last_active":"2024-06-03T00:00:46.228395+0000","last_peered":"2024-06-03T00:00:46.228395+0000","last_clean":"2024-06-03T00:00:46.228395+0000","last_became_active":"2024-06-02T23:59:01.578711+0000","last_became_peered":"2024-06-02T23:59:01.578711+0000","last_unstale":"2024-06-03T00:00:46.228395+0000","last_undegraded":"2024-06-03T00:00:46.228395+0000","last_fullsized":"2024-06-03T00:00:46.228395+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:10.046785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"69'2","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228789+0000","last_change":"2024-06-02T23:59:00.638071+0000","last_active":"2024-06-03T00:00:46.228789+0000","last_peered":"2024-06-03T00:00:46.228789+0000","last_clean":"2024-06-03T00:00:46.228789+0000","last_became_active":"2024-06-02T23:59:00.637806+0000","last_became_peered":"2024-06-02T23:59:00.637806+0000","last_unstale":"2024-06-03T00:00:46.228789+0000","last_undegraded":"2024-06-03T00:00:46.228789+0000","last_fullsized":"2024-06-03T00:00:46.228789+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:23:25.851075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.081002+0000","last_change":"2024-06-02T23:59:01.591902+0000","last_active":"2024-06-03T00:00:46.081002+0000","last_peered":"2024-06-03T00:00:46.081002+0000","last_clean":"2024-06-03T00:00:46.081002+0000","last_became_active":"2024-06-02T23:59:01.590949+0000","last_became_peered":"2024-06-02T23:59:01.590949+0000","last_unstale":"2024-06-03T00:00:46.081002+0000","last_undegraded":"2024-06-03T00:00:46.081002+0000","last_fullsized":"2024-06-03T00:00:46.081002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:13:11.888454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774057+0000","last_change":"2024-06-02T23:59:00.640128+0000","last_active":"2024-06-03T00:00:45.774057+0000","last_peered":"2024-06-03T00:00:45.774057+0000","last_clean":"2024-06-03T00:00:45.774057+0000","last_became_active":"2024-06-02T23:59:00.639852+0000","last_became_peered":"2024-06-02T23:59:00.639852+0000","last_unstale":"2024-06-03T00:00:45.774057+0000","last_undegraded":"2024-06-03T00:00:45.774057+0000","last_fullsized":"2024-06-03T00:00:45.774057+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:07.421496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230207+0000","last_change":"2024-06-02T23:59:01.588002+0000","last_active":"2024-06-03T00:00:46.230207+0000","last_peered":"2024-06-03T00:00:46.230207+0000","last_clean":"2024-06-03T00:00:46.230207+0000","last_became_active":"2024-06-02T23:59:01.587734+0000","last_became_peered":"2024-06-02T23:59:01.587734+0000","last_unstale":"2024-06-03T00:00:46.230207+0000","last_undegraded":"2024-06-03T00:00:46.230207+0000","last_fullsized":"2024-06-03T00:00:46.230207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230252+0000","last_change":"2024-06-02T23:59:00.643318+0000","last_active":"2024-06-03T00:00:46.230252+0000","last_peered":"2024-06-03T00:00:46.230252+0000","last_clean":"2024-06-03T00:00:46.230252+0000","last_became_active":"2024-06-02T23:59:00.643062+0000","last_became_peered":"2024-06-02T23:59:00.643062+0000","last_unstale":"2024-06-03T00:00:46.230252+0000","last_undegraded":"2024-06-03T00:00:46.230252+0000","last_fullsized":"2024-06-03T00:00:46.230252+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:25:50.830339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228661+0000","last_change":"2024-06-02T23:59:01.586699+0000","last_active":"2024-06-03T00:00:46.228661+0000","last_peered":"2024-06-03T00:00:46.228661+0000","last_clean":"2024-06-03T00:00:46.228661+0000","last_became_active":"2024-06-02T23:59:01.586401+0000","last_became_peered":"2024-06-02T23:59:01.586401+0000","last_unstale":"2024-06-03T00:00:46.228661+0000","last_undegraded":"2024-06-03T00:00:46.228661+0000","last_fullsized":"2024-06-03T00:00:46.228661+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:12:10.532874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228564+0000","last_change":"2024-06-02T23:59:00.635754+0000","last_active":"2024-06-03T00:00:46.228564+0000","last_peered":"2024-06-03T00:00:46.228564+0000","last_clean":"2024-06-03T00:00:46.228564+0000","last_became_active":"2024-06-02T23:59:00.635444+0000","last_became_peered":"2024-06-02T23:59:00.635444+0000","last_unstale":"2024-06-03T00:00:46.228564+0000","last_undegraded":"2024-06-03T00:00:46.228564+0000","last_fullsized":"2024-06-03T00:00:46.228564+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:54:08.565345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228184+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-03T00:00:46.228184+0000","last_peered":"2024-06-03T00:00:46.228184+0000","last_clean":"2024-06-03T00:00:46.228184+0000","last_became_active":"2024-06-02T23:59:01.584978+0000","last_became_peered":"2024-06-02T23:59:01.584978+0000","last_unstale":"2024-06-03T00:00:46.228184+0000","last_undegraded":"2024-06-03T00:00:46.228184+0000","last_fullsized":"2024-06-03T00:00:46.228184+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:21:15.601996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"69'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080919+0000","last_change":"2024-06-02T23:59:00.647401+0000","last_active":"2024-06-03T00:00:46.080919+0000","last_peered":"2024-06-03T00:00:46.080919+0000","last_clean":"2024-06-03T00:00:46.080919+0000","last_became_active":"2024-06-02T23:59:00.647038+0000","last_became_peered":"2024-06-02T23:59:00.647038+0000","last_unstale":"2024-06-03T00:00:46.080919+0000","last_undegraded":"2024-06-03T00:00:46.080919+0000","last_fullsized":"2024-06-03T00:00:46.080919+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:49:28.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229013+0000","last_change":"2024-06-02T23:59:01.587184+0000","last_active":"2024-06-03T00:00:46.229013+0000","last_peered":"2024-06-03T00:00:46.229013+0000","last_clean":"2024-06-03T00:00:46.229013+0000","last_became_active":"2024-06-02T23:59:01.586774+0000","last_became_peered":"2024-06-02T23:59:01.586774+0000","last_unstale":"2024-06-03T00:00:46.229013+0000","last_undegraded":"2024-06-03T00:00:46.229013+0000","last_fullsized":"2024-06-03T00:00:46.229013+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:29:13.698815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781361+0000","last_change":"2024-06-02T23:59:00.641736+0000","last_active":"2024-06-03T00:00:45.781361+0000","last_peered":"2024-06-03T00:00:45.781361+0000","last_clean":"2024-06-03T00:00:45.781361+0000","last_became_active":"2024-06-02T23:59:00.640889+0000","last_became_peered":"2024-06-02T23:59:00.640889+0000","last_unstale":"2024-06-03T00:00:45.781361+0000","last_undegraded":"2024-06-03T00:00:45.781361+0000","last_fullsized":"2024-06-03T00:00:45.781361+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:35.892006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773123+0000","last_change":"2024-06-02T23:59:01.589758+0000","last_active":"2024-06-03T00:00:45.773123+0000","last_peered":"2024-06-03T00:00:45.773123+0000","last_clean":"2024-06-03T00:00:45.773123+0000","last_became_active":"2024-06-02T23:59:01.588438+0000","last_became_peered":"2024-06-02T23:59:01.588438+0000","last_unstale":"2024-06-03T00:00:45.773123+0000","last_undegraded":"2024-06-03T00:00:45.773123+0000","last_fullsized":"2024-06-03T00:00:45.773123+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:43:19.754402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230068+0000","last_change":"2024-06-02T23:59:00.644933+0000","last_active":"2024-06-03T00:00:46.230068+0000","last_peered":"2024-06-03T00:00:46.230068+0000","last_clean":"2024-06-03T00:00:46.230068+0000","last_became_active":"2024-06-02T23:59:00.644680+0000","last_became_peered":"2024-06-02T23:59:00.644680+0000","last_unstale":"2024-06-03T00:00:46.230068+0000","last_undegraded":"2024-06-03T00:00:46.230068+0000","last_fullsized":"2024-06-03T00:00:46.230068+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:10:07.936871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228552+0000","last_change":"2024-06-02T23:59:01.589967+0000","last_active":"2024-06-03T00:00:46.228552+0000","last_peered":"2024-06-03T00:00:46.228552+0000","last_clean":"2024-06-03T00:00:46.228552+0000","last_became_active":"2024-06-02T23:59:01.589146+0000","last_became_peered":"2024-06-02T23:59:01.589146+0000","last_unstale":"2024-06-03T00:00:46.228552+0000","last_undegraded":"2024-06-03T00:00:46.228552+0000","last_fullsized":"2024-06-03T00:00:46.228552+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774303+0000","last_change":"2024-06-02T23:59:00.642493+0000","last_active":"2024-06-03T00:00:45.774303+0000","last_peered":"2024-06-03T00:00:45.774303+0000","last_clean":"2024-06-03T00:00:45.774303+0000","last_became_active":"2024-06-02T23:59:00.642225+0000","last_became_peered":"2024-06-02T23:59:00.642225+0000","last_unstale":"2024-06-03T00:00:45.774303+0000","last_undegraded":"2024-06-03T00:00:45.774303+0000","last_fullsized":"2024-06-03T00:00:45.774303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:00:09.501263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228293+0000","last_change":"2024-06-02T23:59:01.584170+0000","last_active":"2024-06-03T00:00:46.228293+0000","last_peered":"2024-06-03T00:00:46.228293+0000","last_clean":"2024-06-03T00:00:46.228293+0000","last_became_active":"2024-06-02T23:59:01.583901+0000","last_became_peered":"2024-06-02T23:59:01.583901+0000","last_unstale":"2024-06-03T00:00:46.228293+0000","last_undegraded":"2024-06-03T00:00:46.228293+0000","last_fullsized":"2024-06-03T00:00:46.228293+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:22:32.595470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.774175+0000","last_change":"2024-06-02T23:59:00.644379+0000","last_active":"2024-06-03T00:00:45.774175+0000","last_peered":"2024-06-03T00:00:45.774175+0000","last_clean":"2024-06-03T00:00:45.774175+0000","last_became_active":"2024-06-02T23:59:00.644115+0000","last_became_peered":"2024-06-02T23:59:00.644115+0000","last_unstale":"2024-06-03T00:00:45.774175+0000","last_undegraded":"2024-06-03T00:00:45.774175+0000","last_fullsized":"2024-06-03T00:00:45.774175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:01.768574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230092+0000","last_change":"2024-06-02T23:59:01.587439+0000","last_active":"2024-06-03T00:00:46.230092+0000","last_peered":"2024-06-03T00:00:46.230092+0000","last_clean":"2024-06-03T00:00:46.230092+0000","last_became_active":"2024-06-02T23:59:01.587147+0000","last_became_peered":"2024-06-02T23:59:01.587147+0000","last_unstale":"2024-06-03T00:00:46.230092+0000","last_undegraded":"2024-06-03T00:00:46.230092+0000","last_fullsized":"2024-06-03T00:00:46.230092+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776166+0000","last_change":"2024-06-02T23:59:00.643747+0000","last_active":"2024-06-03T00:00:45.776166+0000","last_peered":"2024-06-03T00:00:45.776166+0000","last_clean":"2024-06-03T00:00:45.776166+0000","last_became_active":"2024-06-02T23:59:00.643445+0000","last_became_peered":"2024-06-02T23:59:00.643445+0000","last_unstale":"2024-06-03T00:00:45.776166+0000","last_undegraded":"2024-06-03T00:00:45.776166+0000","last_fullsized":"2024-06-03T00:00:45.776166+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:14:32.146732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773376+0000","last_change":"2024-06-02T23:59:01.583225+0000","last_active":"2024-06-03T00:00:45.773376+0000","last_peered":"2024-06-03T00:00:45.773376+0000","last_clean":"2024-06-03T00:00:45.773376+0000","last_became_active":"2024-06-02T23:59:01.582821+0000","last_became_peered":"2024-06-02T23:59:01.582821+0000","last_unstale":"2024-06-03T00:00:45.773376+0000","last_undegraded":"2024-06-03T00:00:45.773376+0000","last_fullsized":"2024-06-03T00:00:45.773376+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:39:34.474565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228394+0000","last_change":"2024-06-02T23:59:00.644323+0000","last_active":"2024-06-03T00:00:46.228394+0000","last_peered":"2024-06-03T00:00:46.228394+0000","last_clean":"2024-06-03T00:00:46.228394+0000","last_became_active":"2024-06-02T23:59:00.643711+0000","last_became_peered":"2024-06-02T23:59:00.643711+0000","last_unstale":"2024-06-03T00:00:46.228394+0000","last_undegraded":"2024-06-03T00:00:46.228394+0000","last_fullsized":"2024-06-03T00:00:46.228394+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:14.457408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080574+0000","last_change":"2024-06-02T23:59:01.587791+0000","last_active":"2024-06-03T00:00:46.080574+0000","last_peered":"2024-06-03T00:00:46.080574+0000","last_clean":"2024-06-03T00:00:46.080574+0000","last_became_active":"2024-06-02T23:59:01.587445+0000","last_became_peered":"2024-06-02T23:59:01.587445+0000","last_unstale":"2024-06-03T00:00:46.080574+0000","last_undegraded":"2024-06-03T00:00:46.080574+0000","last_fullsized":"2024-06-03T00:00:46.080574+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:11:51.236204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"70'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230357+0000","last_change":"2024-06-02T23:59:00.644532+0000","last_active":"2024-06-03T00:00:46.230357+0000","last_peered":"2024-06-03T00:00:46.230357+0000","last_clean":"2024-06-03T00:00:46.230357+0000","last_became_active":"2024-06-02T23:59:00.644293+0000","last_became_peered":"2024-06-02T23:59:00.644293+0000","last_unstale":"2024-06-03T00:00:46.230357+0000","last_undegraded":"2024-06-03T00:00:46.230357+0000","last_fullsized":"2024-06-03T00:00:46.230357+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:05:38.716399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":354,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780839+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-03T00:00:45.780839+0000","last_peered":"2024-06-03T00:00:45.780839+0000","last_clean":"2024-06-03T00:00:45.780839+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-03T00:00:45.780839+0000","last_undegraded":"2024-06-03T00:00:45.780839+0000","last_fullsized":"2024-06-03T00:00:45.780839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":3665,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54820,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317020,"statfs":{"total":96636764160,"available":96580628480,"internally_reserved":0,"allocated":1466368,"data_stored":1024138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":434298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50076,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321764,"statfs":{"total":96636764160,"available":96585486336,"internally_reserved":0,"allocated":864256,"data_stored":433646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":434228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":436535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54244,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317596,"statfs":{"total":96636764160,"available":96581218304,"internally_reserved":0,"allocated":876544,"data_stored":436513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":433806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1466368,"data_stored":1024070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:01:15.973 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-03T00:01:16.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.111+0000 7fc9582e7640 1 Processor -- start 2024-06-03T00:01:16.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.111+0000 7fc9582e7640 1 -- start start 2024-06-03T00:01:16.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.112+0000 7fc9582e7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc950161900 0x7fc9500d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:16.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.112+0000 7fc9582e7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9500b4fa0 0x7fc9500d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:16.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.112+0000 7fc9582e7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9500d4a90 con 0x7fc9500b5510 2024-06-03T00:01:16.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.112+0000 7fc9582e7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc9500cf5c0 con 0x7fc9500b4fa0 2024-06-03T00:01:16.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.112+0000 7fc9582e7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc9500caf70 con 0x7fc950161900 2024-06-03T00:01:16.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc956083640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc950161900 0x7fc9500d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:16.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc956884640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9500b4fa0 0x7fc9500d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:16.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc956884640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9500b4fa0 0x7fc9500d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:44104/0 (socket says 172.21.15.96:44104) 2024-06-03T00:01:16.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc956083640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc950161900 0x7fc9500d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:48084/0 (socket says 172.21.15.96:48084) 2024-06-03T00:01:16.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc956884640 1 -- 172.21.15.96:0/2696477045 learned_addr learned my addr 172.21.15.96:0/2696477045 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:16.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc955882640 1 --1- 172.21.15.96:0/2696477045 >> v1:172.21.15.162:6789/0 conn(0x7fc9500b5510 0x7fc9500d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.96:37218/0 (socket says 172.21.15.96:37218) 2024-06-03T00:01:16.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc956083640 1 -- 172.21.15.96:0/2696477045 >> v2:172.21.15.162:3300/0 conn(0x7fc9500b4fa0 msgr2=0x7fc9500d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:16.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc956083640 1 --2- 172.21.15.96:0/2696477045 >> v2:172.21.15.162:3300/0 conn(0x7fc9500b4fa0 0x7fc9500d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc956083640 1 -- 172.21.15.96:0/2696477045 >> v1:172.21.15.162:6789/0 conn(0x7fc9500b5510 legacy=0x7fc9500d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:16.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc956083640 1 -- 172.21.15.96:0/2696477045 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9500d4d70 con 0x7fc950161900 2024-06-03T00:01:16.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.113+0000 7fc956884640 1 --2- 172.21.15.96:0/2696477045 >> v2:172.21.15.162:3300/0 conn(0x7fc9500b4fa0 0x7fc9500d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:16.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.114+0000 7fc956083640 1 --2- 172.21.15.96:0/2696477045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc950161900 0x7fc9500d0a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc9480097a0 tx=0x7fc94802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a354628964dc036 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:16.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.114+0000 7fc955081640 1 -- 172.21.15.96:0/2696477045 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948037070 con 0x7fc950161900 2024-06-03T00:01:16.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.114+0000 7fc955081640 1 -- 172.21.15.96:0/2696477045 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94802ae50 con 0x7fc950161900 2024-06-03T00:01:16.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.114+0000 7fc955081640 1 -- 172.21.15.96:0/2696477045 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948032660 con 0x7fc950161900 2024-06-03T00:01:16.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.115+0000 7fc9582e7640 1 -- 172.21.15.96:0/2696477045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc950161900 msgr2=0x7fc9500d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:16.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.115+0000 7fc9582e7640 1 --2- 172.21.15.96:0/2696477045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc950161900 0x7fc9500d0a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc9480097a0 tx=0x7fc94802a100 comp rx=0 tx=0).stop 2024-06-03T00:01:16.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.115+0000 7fc9582e7640 1 -- 172.21.15.96:0/2696477045 shutdown_connections 2024-06-03T00:01:16.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.115+0000 7fc9582e7640 1 --2- 172.21.15.96:0/2696477045 >> v2:172.21.15.162:3300/0 conn(0x7fc9500b4fa0 0x7fc9500d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.115+0000 7fc9582e7640 1 --2- 172.21.15.96:0/2696477045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc950161900 0x7fc9500d0a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.115+0000 7fc9582e7640 1 -- 172.21.15.96:0/2696477045 >> 172.21.15.96:0/2696477045 conn(0x7fc95009d3b0 msgr2=0x7fc9500d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:16.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.115+0000 7fc9582e7640 1 -- 172.21.15.96:0/2696477045 shutdown_connections 2024-06-03T00:01:16.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.115+0000 7fc9582e7640 1 -- 172.21.15.96:0/2696477045 wait complete. 2024-06-03T00:01:16.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.116+0000 7fc9582e7640 1 Processor -- start 2024-06-03T00:01:16.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.116+0000 7fc9582e7640 1 -- start start 2024-06-03T00:01:16.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc9582e7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500b4fa0 0x7fc9500ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:16.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc9582e7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9500b5510 0x7fc9500c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:16.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc9582e7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc950161900 0x7fc950157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:16.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc9582e7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fc9500d4780 con 0x7fc9500b4fa0 2024-06-03T00:01:16.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc9582e7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9500cfae0 con 0x7fc950161900 2024-06-03T00:01:16.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc9582e7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc950161ce0 con 0x7fc9500b5510 2024-06-03T00:01:16.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc956083640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500b4fa0 0x7fc9500ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:16.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc956083640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500b4fa0 0x7fc9500ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51354/0 (socket says 172.21.15.96:51354) 2024-06-03T00:01:16.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc956083640 1 -- 172.21.15.96:0/2468618133 learned_addr learned my addr 172.21.15.96:0/2468618133 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:16.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc955882640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9500b5510 0x7fc9500c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:16.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc956884640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc950161900 0x7fc950157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:16.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc956083640 1 -- 172.21.15.96:0/2468618133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9500b5510 msgr2=0x7fc9500c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc956083640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9500b5510 0x7fc9500c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc956083640 1 -- 172.21.15.96:0/2468618133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc950161900 msgr2=0x7fc950157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc956083640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc950161900 0x7fc950157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc956083640 1 -- 172.21.15.96:0/2468618133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9500cd080 con 0x7fc9500b4fa0 2024-06-03T00:01:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc956083640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500b4fa0 0x7fc9500ce120 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc948000c00 tx=0x7fc9480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc94effd640 1 -- 172.21.15.96:0/2468618133 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948041070 con 0x7fc9500b4fa0 2024-06-03T00:01:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.117+0000 7fc94effd640 1 -- 172.21.15.96:0/2468618133 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94803c460 con 0x7fc9500b4fa0 2024-06-03T00:01:16.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.118+0000 7fc94effd640 1 -- 172.21.15.96:0/2468618133 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948037040 con 0x7fc9500b4fa0 2024-06-03T00:01:16.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.118+0000 7fc9582e7640 1 -- 172.21.15.96:0/2468618133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9500cd360 con 0x7fc9500b4fa0 2024-06-03T00:01:16.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.118+0000 7fc9582e7640 1 -- 172.21.15.96:0/2468618133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9500cd920 con 0x7fc9500b4fa0 2024-06-03T00:01:16.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.119+0000 7fc9582e7640 1 -- 172.21.15.96:0/2468618133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9500ca1a0 con 0x7fc9500b4fa0 2024-06-03T00:01:16.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.119+0000 7fc94effd640 1 -- 172.21.15.96:0/2468618133 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fc948044070 con 0x7fc9500b4fa0 2024-06-03T00:01:16.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.120+0000 7fc94effd640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc93c06be30 0x7fc93c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:16.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.120+0000 7fc955882640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc93c06be30 0x7fc93c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:16.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.120+0000 7fc94effd640 1 -- 172.21.15.96:0/2468618133 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7fc9480ab9f0 con 0x7fc9500b4fa0 2024-06-03T00:01:16.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.120+0000 7fc955882640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc93c06be30 0x7fc93c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc9500cce50 tx=0x7fc9440016d0 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:16.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.124+0000 7fc94effd640 1 -- 172.21.15.96:0/2468618133 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7fc948079cb0 con 0x7fc9500b4fa0 2024-06-03T00:01:16.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.302+0000 7fc9582e7640 1 -- 172.21.15.96:0/2468618133 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9500683e0 con 0x7fc9500b4fa0 2024-06-03T00:01:16.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.303+0000 7fc94effd640 1 -- 172.21.15.96:0/2468618133 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+17038 (secure 0 0 0) 0x7fc94807dfb0 con 0x7fc9500b4fa0 2024-06-03T00:01:16.303 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-03T00:01:16.304 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":72,"fsid":"83723afd-2657-4b93-818a-1e4b19cab42f","created":"2024-06-02T23:46:01.893103+0000","modified":"2024-06-03T00:00:45.769673+0000","last_up_change":"2024-06-02T23:46:13.045497+0000","last_in_change":"2024-06-02T23:46:04.087153+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T23:46:14.025119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-06-02T23:58:59.564247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-06-02T23:58:59.946495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"676c9ee9-2d5a-4ed5-a74d-4c174799d433","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6817","nonce":2024861809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6819","nonce":2024861809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6823","nonce":2024861809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":2024861809},{"type":"v1","addr":"172.21.15.96:6821","nonce":2024861809}]},"public_addr":"172.21.15.96:6817/2024861809","cluster_addr":"172.21.15.96:6819/2024861809","heartbeat_back_addr":"172.21.15.96:6823/2024861809","heartbeat_front_addr":"172.21.15.96:6821/2024861809","state":["exists","up"]},{"osd":1,"uuid":"33afefe9-4fbc-464c-882e-eb7678d89a1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6809","nonce":3077632507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6811","nonce":3077632507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6815","nonce":3077632507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3077632507},{"type":"v1","addr":"172.21.15.96:6813","nonce":3077632507}]},"public_addr":"172.21.15.96:6809/3077632507","cluster_addr":"172.21.15.96:6811/3077632507","heartbeat_back_addr":"172.21.15.96:6815/3077632507","heartbeat_front_addr":"172.21.15.96:6813/3077632507","state":["exists","up"]},{"osd":2,"uuid":"c0708c1a-bcbe-4e0b-86ac-582bd12b0999","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6825","nonce":2465470784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6827","nonce":2465470784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6831","nonce":2465470784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2465470784},{"type":"v1","addr":"172.21.15.96:6829","nonce":2465470784}]},"public_addr":"172.21.15.96:6825/2465470784","cluster_addr":"172.21.15.96:6827/2465470784","heartbeat_back_addr":"172.21.15.96:6831/2465470784","heartbeat_front_addr":"172.21.15.96:6829/2465470784","state":["exists","up"]},{"osd":3,"uuid":"3ccf5232-d50c-40f1-985c-cd5b36e1dffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6801","nonce":1530888449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6803","nonce":1530888449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6807","nonce":1530888449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1530888449},{"type":"v1","addr":"172.21.15.96:6805","nonce":1530888449}]},"public_addr":"172.21.15.96:6801/1530888449","cluster_addr":"172.21.15.96:6803/1530888449","heartbeat_back_addr":"172.21.15.96:6807/1530888449","heartbeat_front_addr":"172.21.15.96:6805/1530888449","state":["exists","up"]},{"osd":4,"uuid":"0e9f0793-389a-4bae-b84a-147786827665","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6817","nonce":3130662630}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6819","nonce":3130662630}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6824","nonce":3130662630}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":3130662630},{"type":"v1","addr":"172.21.15.162:6821","nonce":3130662630}]},"public_addr":"172.21.15.162:6817/3130662630","cluster_addr":"172.21.15.162:6819/3130662630","heartbeat_back_addr":"172.21.15.162:6824/3130662630","heartbeat_front_addr":"172.21.15.162:6821/3130662630","state":["exists","up"]},{"osd":5,"uuid":"f0c4a207-fec0-4a99-b751-4d5dcb3fddd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6809","nonce":2259495148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6811","nonce":2259495148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6815","nonce":2259495148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2259495148},{"type":"v1","addr":"172.21.15.162:6813","nonce":2259495148}]},"public_addr":"172.21.15.162:6809/2259495148","cluster_addr":"172.21.15.162:6811/2259495148","heartbeat_back_addr":"172.21.15.162:6815/2259495148","heartbeat_front_addr":"172.21.15.162:6813/2259495148","state":["exists","up"]},{"osd":6,"uuid":"6c2b64d7-c956-43cf-8723-92ae977adffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6801","nonce":1800327622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6803","nonce":1800327622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6808","nonce":1800327622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1800327622},{"type":"v1","addr":"172.21.15.162:6805","nonce":1800327622}]},"public_addr":"172.21.15.162:6801/1800327622","cluster_addr":"172.21.15.162:6803/1800327622","heartbeat_back_addr":"172.21.15.162:6808/1800327622","heartbeat_front_addr":"172.21.15.162:6805/1800327622","state":["exists","up"]},{"osd":7,"uuid":"4b4aae57-776c-4afa-a0f8-04e41a4fabb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6825","nonce":334757134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6827","nonce":334757134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6831","nonce":334757134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":334757134},{"type":"v1","addr":"172.21.15.162:6829","nonce":334757134}]},"public_addr":"172.21.15.162:6825/334757134","cluster_addr":"172.21.15.162:6827/334757134","heartbeat_back_addr":"172.21.15.162:6831/334757134","heartbeat_front_addr":"172.21.15.162:6829/334757134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.217570+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.183485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.224882+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.299190+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.355389+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.348028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.292379+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T23:46:09.340109+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-03T00:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.305+0000 7fc9582e7640 1 -- 172.21.15.96:0/2468618133 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc93c06be30 msgr2=0x7fc93c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.305+0000 7fc9582e7640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc93c06be30 0x7fc93c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc9500cce50 tx=0x7fc9440016d0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.305+0000 7fc9582e7640 1 -- 172.21.15.96:0/2468618133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500b4fa0 msgr2=0x7fc9500ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.305+0000 7fc9582e7640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500b4fa0 0x7fc9500ce120 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc948000c00 tx=0x7fc9480046c0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.305+0000 7fc9582e7640 1 -- 172.21.15.96:0/2468618133 shutdown_connections 2024-06-03T00:01:16.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.305+0000 7fc9582e7640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fc93c06be30 0x7fc93c06e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.305+0000 7fc9582e7640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc950161900 0x7fc950157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.305+0000 7fc9582e7640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9500b5510 0x7fc9500c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.305+0000 7fc9582e7640 1 --2- 172.21.15.96:0/2468618133 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9500b4fa0 0x7fc9500ce120 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:16.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.306+0000 7fc9582e7640 1 -- 172.21.15.96:0/2468618133 >> 172.21.15.96:0/2468618133 conn(0x7fc95009d3b0 msgr2=0x7fc9500b9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:16.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.306+0000 7fc9582e7640 1 -- 172.21.15.96:0/2468618133 shutdown_connections 2024-06-03T00:01:16.307 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:16.306+0000 7fc9582e7640 1 -- 172.21.15.96:0/2468618133 wait complete. 2024-06-03T00:01:17.318 INFO:tasks.ceph:Scrubbing osd.0 2024-06-03T00:01:17.318 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-06-03T00:01:17.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.424+0000 7facc027d640 1 Processor -- start 2024-06-03T00:01:17.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.424+0000 7facc027d640 1 -- start start 2024-06-03T00:01:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facc027d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7facb8071240 0x7facb806d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facc027d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7facb80cbeb0 0x7facb80cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facc027d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb8145770 con 0x7facb8145390 2024-06-03T00:01:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facc027d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7facb80ca3c0 con 0x7facb80cbeb0 2024-06-03T00:01:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facc027d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7facb80ca660 con 0x7facb8071240 2024-06-03T00:01:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facbe81a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7facb80cbeb0 0x7facb80cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facbe81a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7facb80cbeb0 0x7facb80cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51356/0 (socket says 172.21.15.96:51356) 2024-06-03T00:01:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facbe81a640 1 -- 172.21.15.96:0/3178296623 learned_addr learned my addr 172.21.15.96:0/3178296623 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facbd818640 1 --2- 172.21.15.96:0/3178296623 >> v2:172.21.15.162:3300/0 conn(0x7facb8071240 0x7facb806d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facbe81a640 1 -- 172.21.15.96:0/3178296623 >> v2:172.21.15.162:3300/0 conn(0x7facb8071240 msgr2=0x7facb806d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facbe81a640 1 --2- 172.21.15.96:0/3178296623 >> v2:172.21.15.162:3300/0 conn(0x7facb8071240 0x7facb806d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facbe81a640 1 -- 172.21.15.96:0/3178296623 >> v1:172.21.15.162:6789/0 conn(0x7facb8145390 legacy=0x7facb806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facbe81a640 1 -- 172.21.15.96:0/3178296623 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb80ca940 con 0x7facb80cbeb0 2024-06-03T00:01:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.425+0000 7facbd818640 1 --2- 172.21.15.96:0/3178296623 >> v2:172.21.15.162:3300/0 conn(0x7facb8071240 0x7facb806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:17.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.426+0000 7facbe81a640 1 --2- 172.21.15.96:0/3178296623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7facb80cbeb0 0x7facb80cc300 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7facb80b2970 tx=0x7facb002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fc7d7dcf3581b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.426+0000 7facbd017640 1 -- 172.21.15.96:0/3178296623 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0036070 con 0x7facb80cbeb0 2024-06-03T00:01:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.426+0000 7facbd017640 1 -- 172.21.15.96:0/3178296623 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb0031600 con 0x7facb80cbeb0 2024-06-03T00:01:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.426+0000 7facbd017640 1 -- 172.21.15.96:0/3178296623 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb00319d0 con 0x7facb80cbeb0 2024-06-03T00:01:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.427+0000 7facc027d640 1 -- 172.21.15.96:0/3178296623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7facb80cbeb0 msgr2=0x7facb80cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.427+0000 7facc027d640 1 --2- 172.21.15.96:0/3178296623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7facb80cbeb0 0x7facb80cc300 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7facb80b2970 tx=0x7facb002a6f0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.427+0000 7facc027d640 1 -- 172.21.15.96:0/3178296623 shutdown_connections 2024-06-03T00:01:17.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.427+0000 7facc027d640 1 --2- 172.21.15.96:0/3178296623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7facb80cbeb0 0x7facb80cc300 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.427+0000 7facc027d640 1 --2- 172.21.15.96:0/3178296623 >> v2:172.21.15.162:3300/0 conn(0x7facb8071240 0x7facb806d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.427+0000 7facc027d640 1 -- 172.21.15.96:0/3178296623 >> 172.21.15.96:0/3178296623 conn(0x7facb80b1a40 msgr2=0x7facb80b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.427+0000 7facc027d640 1 -- 172.21.15.96:0/3178296623 shutdown_connections 2024-06-03T00:01:17.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.427+0000 7facc027d640 1 -- 172.21.15.96:0/3178296623 wait complete. 2024-06-03T00:01:17.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.428+0000 7facc027d640 1 Processor -- start 2024-06-03T00:01:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.428+0000 7facc027d640 1 -- start start 2024-06-03T00:01:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facc027d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facb8071240 0x7facb8135670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facc027d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7facb80cbeb0 0x7facb80b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facc027d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb8145390 0x7facb809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facc027d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7facb80cb1e0 con 0x7facb80cbeb0 2024-06-03T00:01:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facc027d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7facb80caf00 con 0x7facb8145390 2024-06-03T00:01:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facc027d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7facb806dbe0 con 0x7facb8071240 2024-06-03T00:01:17.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbd818640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7facb80cbeb0 0x7facb80b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbd818640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7facb80cbeb0 0x7facb80b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51368/0 (socket says 172.21.15.96:51368) 2024-06-03T00:01:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbd818640 1 -- 172.21.15.96:0/1962445679 learned_addr learned my addr 172.21.15.96:0/1962445679 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbe019640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facb8071240 0x7facb8135670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbe81a640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb8145390 0x7facb809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbd818640 1 -- 172.21.15.96:0/1962445679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facb8071240 msgr2=0x7facb8135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbd818640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7facb8071240 0x7facb8135670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbd818640 1 -- 172.21.15.96:0/1962445679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb8145390 msgr2=0x7facb809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbd818640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7facb8145390 0x7facb809aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbd818640 1 -- 172.21.15.96:0/1962445679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb8135dc0 con 0x7facb80cbeb0 2024-06-03T00:01:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facbd818640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7facb80cbeb0 0x7facb80b4940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7faca800c820 tx=0x7faca800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facaeffd640 1 -- 172.21.15.96:0/1962445679 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8015070 con 0x7facb80cbeb0 2024-06-03T00:01:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facaeffd640 1 -- 172.21.15.96:0/1962445679 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca8007a30 con 0x7facb80cbeb0 2024-06-03T00:01:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facaeffd640 1 -- 172.21.15.96:0/1962445679 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8007e00 con 0x7facb80cbeb0 2024-06-03T00:01:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb81360a0 con 0x7facb80cbeb0 2024-06-03T00:01:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.429+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb815c890 con 0x7facb80cbeb0 2024-06-03T00:01:17.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.430+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7facb81365c0 con 0x7facb80cbeb0 2024-06-03T00:01:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.431+0000 7facaeffd640 1 -- 172.21.15.96:0/1962445679 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7faca8018070 con 0x7facb80cbeb0 2024-06-03T00:01:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.431+0000 7facaeffd640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fac9c06be30 0x7fac9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.431+0000 7facaeffd640 1 -- 172.21.15.96:0/1962445679 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7faca808b010 con 0x7facb80cbeb0 2024-06-03T00:01:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.431+0000 7facbe019640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fac9c06be30 0x7fac9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.431+0000 7facaeffd640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] conn(0x7fac9c074760 0x7fac9c076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.431+0000 7facaeffd640 1 -- 172.21.15.96:0/1962445679 --> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faca8006810 con 0x7fac9c074760 2024-06-03T00:01:17.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.431+0000 7facaeffd640 1 -- 172.21.15.96:0/1962445679 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7faca8092050 con 0x7facb80cbeb0 2024-06-03T00:01:17.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.432+0000 7facbe81a640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] conn(0x7fac9c074760 0x7fac9c076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.432+0000 7facbe019640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fac9c06be30 0x7fac9c06e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facb4006fd0 tx=0x7facb4008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.432+0000 7facbe81a640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] conn(0x7fac9c074760 0x7fac9c076be0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.432+0000 7facaeffd640 1 -- 172.21.15.96:0/1962445679 <== osd.0 v2:172.21.15.96:6816/2024861809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faca8006810 con 0x7fac9c074760 2024-06-03T00:01:17.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.445+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 --> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7facb80683e0 con 0x7fac9c074760 2024-06-03T00:01:17.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facaeffd640 1 -- 172.21.15.96:0/1962445679 <== osd.0 v2:172.21.15.96:6816/2024861809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7facb80683e0 con 0x7fac9c074760 2024-06-03T00:01:17.447 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-03T00:01:17.447 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-03T00:01:17.447 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-03T00:01:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] conn(0x7fac9c074760 msgr2=0x7fac9c076be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facc027d640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:6816/2024861809,v1:172.21.15.96:6817/2024861809] conn(0x7fac9c074760 0x7fac9c076be0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fac9c06be30 msgr2=0x7fac9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facc027d640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fac9c06be30 0x7fac9c06e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facb4006fd0 tx=0x7facb4008040 comp rx=0 tx=0).stop 2024-06-03T00:01:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7facb80cbeb0 msgr2=0x7facb80b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facc027d640 1 --2- 172.21.15.96:0/1962445679 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7facb80cbeb0 0x7facb80b4940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7faca800c820 tx=0x7faca800cc20 comp rx=0 tx=0).stop 2024-06-03T00:01:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facbe81a640 1 -- 172.21.15.96:0/1962445679 reap_dead start 2024-06-03T00:01:17.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 shutdown_connections 2024-06-03T00:01:17.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 >> 172.21.15.96:0/1962445679 conn(0x7facb80b1a40 msgr2=0x7facb80b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 shutdown_connections 2024-06-03T00:01:17.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.446+0000 7facc027d640 1 -- 172.21.15.96:0/1962445679 wait complete. 2024-06-03T00:01:17.456 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-06-03T00:01:17.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.557+0000 7f01a4510640 1 Processor -- start 2024-06-03T00:01:17.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.557+0000 7f01a4510640 1 -- start start 2024-06-03T00:01:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a4510640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f019c155570 0x7f019c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a4510640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c06eb50 0x7f019c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a4510640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f019c0cab60 0x7f019c15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a4510640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f019c06efb0 con 0x7f019c155570 2024-06-03T00:01:17.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a4510640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f019c155950 con 0x7f019c0cab60 2024-06-03T00:01:17.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a4510640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f019c0cb2e0 con 0x7f019c06eb50 2024-06-03T00:01:17.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a22ac640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f019c155570 0x7f019c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a22ac640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f019c155570 0x7f019c06e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51372/0 (socket says 172.21.15.96:51372) 2024-06-03T00:01:17.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a22ac640 1 -- 172.21.15.96:0/1170644172 learned_addr learned my addr 172.21.15.96:0/1170644172 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:17.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a1aab640 1 --2- 172.21.15.96:0/1170644172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c06eb50 0x7f019c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a2aad640 1 --2- 172.21.15.96:0/1170644172 >> v2:172.21.15.162:3300/0 conn(0x7f019c0cab60 0x7f019c15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a22ac640 1 -- 172.21.15.96:0/1170644172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c06eb50 msgr2=0x7f019c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a22ac640 1 --2- 172.21.15.96:0/1170644172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c06eb50 0x7f019c0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a22ac640 1 -- 172.21.15.96:0/1170644172 >> v2:172.21.15.162:3300/0 conn(0x7f019c0cab60 msgr2=0x7f019c15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a22ac640 1 --2- 172.21.15.96:0/1170644172 >> v2:172.21.15.162:3300/0 conn(0x7f019c0cab60 0x7f019c15eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a22ac640 1 -- 172.21.15.96:0/1170644172 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c0cb5c0 con 0x7f019c155570 2024-06-03T00:01:17.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.558+0000 7f01a2aad640 1 --2- 172.21.15.96:0/1170644172 >> v2:172.21.15.162:3300/0 conn(0x7f019c0cab60 0x7f019c15eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:17.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.559+0000 7f01a22ac640 1 --2- 172.21.15.96:0/1170644172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 0x7f019c06e610 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f019c0af6e0 tx=0x7f019802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04169a82bfce8ab server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.559+0000 7f01a12aa640 1 -- 172.21.15.96:0/1170644172 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198037070 con 0x7f019c155570 2024-06-03T00:01:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.559+0000 7f01a12aa640 1 -- 172.21.15.96:0/1170644172 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0198032440 con 0x7f019c155570 2024-06-03T00:01:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.559+0000 7f01a12aa640 1 -- 172.21.15.96:0/1170644172 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198032810 con 0x7f019c155570 2024-06-03T00:01:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.559+0000 7f01a4510640 1 -- 172.21.15.96:0/1170644172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 msgr2=0x7f019c06e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.559+0000 7f01a4510640 1 --2- 172.21.15.96:0/1170644172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 0x7f019c06e610 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f019c0af6e0 tx=0x7f019802a1e0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.560+0000 7f01a4510640 1 -- 172.21.15.96:0/1170644172 shutdown_connections 2024-06-03T00:01:17.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.560+0000 7f01a4510640 1 --2- 172.21.15.96:0/1170644172 >> v2:172.21.15.162:3300/0 conn(0x7f019c0cab60 0x7f019c15eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.560+0000 7f01a4510640 1 --2- 172.21.15.96:0/1170644172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c06eb50 0x7f019c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.560+0000 7f01a4510640 1 --2- 172.21.15.96:0/1170644172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 0x7f019c06e610 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.560+0000 7f01a4510640 1 -- 172.21.15.96:0/1170644172 >> 172.21.15.96:0/1170644172 conn(0x7f019c0cfc30 msgr2=0x7f019c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.560+0000 7f01a4510640 1 -- 172.21.15.96:0/1170644172 shutdown_connections 2024-06-03T00:01:17.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.560+0000 7f01a4510640 1 -- 172.21.15.96:0/1170644172 wait complete. 2024-06-03T00:01:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.561+0000 7f01a4510640 1 Processor -- start 2024-06-03T00:01:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.561+0000 7f01a4510640 1 -- start start 2024-06-03T00:01:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a4510640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c06eb50 0x7f019c14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a4510640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c0cab60 0x7f019c156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a4510640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 0x7f019c156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a4510640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f019c0caff0 con 0x7f019c155570 2024-06-03T00:01:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a4510640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f019c071b00 con 0x7f019c0cab60 2024-06-03T00:01:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a4510640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f019c0717d0 con 0x7f019c06eb50 2024-06-03T00:01:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a2aad640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 0x7f019c156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a2aad640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 0x7f019c156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51376/0 (socket says 172.21.15.96:51376) 2024-06-03T00:01:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a2aad640 1 -- 172.21.15.96:0/2585022002 learned_addr learned my addr 172.21.15.96:0/2585022002 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a1aab640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c0cab60 0x7f019c156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a22ac640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c06eb50 0x7f019c14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a2aad640 1 -- 172.21.15.96:0/2585022002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c06eb50 msgr2=0x7f019c14e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a2aad640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c06eb50 0x7f019c14e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a2aad640 1 -- 172.21.15.96:0/2585022002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c0cab60 msgr2=0x7f019c156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a2aad640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c0cab60 0x7f019c156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a2aad640 1 -- 172.21.15.96:0/2585022002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019c0c8e30 con 0x7f019c155570 2024-06-03T00:01:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a2aad640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 0x7f019c156b50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0194007f20 tx=0x7f019400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f0192ffd640 1 -- 172.21.15.96:0/2585022002 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019401a070 con 0x7f019c155570 2024-06-03T00:01:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f0192ffd640 1 -- 172.21.15.96:0/2585022002 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0194003b90 con 0x7f019c155570 2024-06-03T00:01:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f0192ffd640 1 -- 172.21.15.96:0/2585022002 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194004030 con 0x7f019c155570 2024-06-03T00:01:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a4510640 1 -- 172.21.15.96:0/2585022002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019c0c9110 con 0x7f019c155570 2024-06-03T00:01:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.562+0000 7f01a4510640 1 -- 172.21.15.96:0/2585022002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019c0c96d0 con 0x7f019c155570 2024-06-03T00:01:17.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.563+0000 7f01a4510640 1 -- 172.21.15.96:0/2585022002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f019c0683e0 con 0x7f019c155570 2024-06-03T00:01:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.564+0000 7f0192ffd640 1 -- 172.21.15.96:0/2585022002 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f019401d070 con 0x7f019c155570 2024-06-03T00:01:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.565+0000 7f0192ffd640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f018006be30 0x7f018006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.565+0000 7f01a22ac640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f018006be30 0x7f018006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.565+0000 7f0192ffd640 1 -- 172.21.15.96:0/2585022002 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f019408b270 con 0x7f019c155570 2024-06-03T00:01:17.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.565+0000 7f01a22ac640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f018006be30 0x7f018006e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0198034000 tx=0x7f019802e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.569+0000 7f0192ffd640 1 -- 172.21.15.96:0/2585022002 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0194010070 con 0x7f019c155570 2024-06-03T00:01:17.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.743+0000 7f01a4510640 1 -- 172.21.15.96:0/2585022002 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f019c06cc90 con 0x7f018006be30 2024-06-03T00:01:17.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.744+0000 7f0192ffd640 1 -- 172.21.15.96:0/2585022002 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f019c06cc90 con 0x7f018006be30 2024-06-03T00:01:17.744 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 0 to deep-scrub 2024-06-03T00:01:17.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 -- 172.21.15.96:0/2585022002 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f018006be30 msgr2=0x7f018006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f018006be30 0x7f018006e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0198034000 tx=0x7f019802e000 comp rx=0 tx=0).stop 2024-06-03T00:01:17.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 -- 172.21.15.96:0/2585022002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 msgr2=0x7f019c156b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 0x7f019c156b50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0194007f20 tx=0x7f019400d560 comp rx=0 tx=0).stop 2024-06-03T00:01:17.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 -- 172.21.15.96:0/2585022002 shutdown_connections 2024-06-03T00:01:17.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f018006be30 0x7f018006e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f019c155570 0x7f019c156b50 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019c0cab60 0x7f019c156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 --2- 172.21.15.96:0/2585022002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f019c06eb50 0x7f019c14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 -- 172.21.15.96:0/2585022002 >> 172.21.15.96:0/2585022002 conn(0x7f019c0cfc30 msgr2=0x7f019c0b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 -- 172.21.15.96:0/2585022002 shutdown_connections 2024-06-03T00:01:17.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.746+0000 7f01a4510640 1 -- 172.21.15.96:0/2585022002 wait complete. 2024-06-03T00:01:17.756 INFO:tasks.ceph:Scrubbing osd.1 2024-06-03T00:01:17.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-06-03T00:01:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.861+0000 7fcbcc5c1640 1 Processor -- start 2024-06-03T00:01:17.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.861+0000 7fcbcc5c1640 1 -- start start 2024-06-03T00:01:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcc5c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbc4145390 0x7fcbc406cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcc5c1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcbc40cbeb0 0x7fcbc40cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcc5c1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc4145770 con 0x7fcbc4071240 2024-06-03T00:01:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcc5c1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fcbc40ca3c0 con 0x7fcbc40cbeb0 2024-06-03T00:01:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcc5c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc40ca660 con 0x7fcbc4145390 2024-06-03T00:01:17.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcab5e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcbc40cbeb0 0x7fcbc40cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcab5e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcbc40cbeb0 0x7fcbc40cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51390/0 (socket says 172.21.15.96:51390) 2024-06-03T00:01:17.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcab5e640 1 -- 172.21.15.96:0/3669192507 learned_addr learned my addr 172.21.15.96:0/3669192507 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:17.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbca35d640 1 --2- 172.21.15.96:0/3669192507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbc4145390 0x7fcbc406cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcab5e640 1 -- 172.21.15.96:0/3669192507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbc4145390 msgr2=0x7fcbc406cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcab5e640 1 --2- 172.21.15.96:0/3669192507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbc4145390 0x7fcbc406cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcab5e640 1 -- 172.21.15.96:0/3669192507 >> v1:172.21.15.162:6789/0 conn(0x7fcbc4071240 legacy=0x7fcbc406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbcab5e640 1 -- 172.21.15.96:0/3669192507 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc40ca940 con 0x7fcbc40cbeb0 2024-06-03T00:01:17.864 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.862+0000 7fcbca35d640 1 --2- 172.21.15.96:0/3669192507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbc4145390 0x7fcbc406cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:17.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.863+0000 7fcbcab5e640 1 --2- 172.21.15.96:0/3669192507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc40cbeb0 0x7fcbc40cc340 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009e50 tx=0x7fcbbc02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd1453dc8f033fe server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.863+0000 7fcbc935b640 1 -- 172.21.15.96:0/3669192507 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc036070 con 0x7fcbc40cbeb0 2024-06-03T00:01:17.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.863+0000 7fcbc935b640 1 -- 172.21.15.96:0/3669192507 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbbc031600 con 0x7fcbc40cbeb0 2024-06-03T00:01:17.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.863+0000 7fcbc935b640 1 -- 172.21.15.96:0/3669192507 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc0319d0 con 0x7fcbc40cbeb0 2024-06-03T00:01:17.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.864+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/3669192507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc40cbeb0 msgr2=0x7fcbc40cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.864+0000 7fcbcc5c1640 1 --2- 172.21.15.96:0/3669192507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc40cbeb0 0x7fcbc40cc340 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009e50 tx=0x7fcbbc02a6c0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.864+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/3669192507 shutdown_connections 2024-06-03T00:01:17.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.864+0000 7fcbcc5c1640 1 --2- 172.21.15.96:0/3669192507 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc40cbeb0 0x7fcbc40cc340 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.864+0000 7fcbcc5c1640 1 --2- 172.21.15.96:0/3669192507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbc4145390 0x7fcbc406cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.864+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/3669192507 >> 172.21.15.96:0/3669192507 conn(0x7fcbc40b1a40 msgr2=0x7fcbc40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.864+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/3669192507 shutdown_connections 2024-06-03T00:01:17.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.864+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/3669192507 wait complete. 2024-06-03T00:01:17.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.865+0000 7fcbcc5c1640 1 Processor -- start 2024-06-03T00:01:17.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.865+0000 7fcbcc5c1640 1 -- start start 2024-06-03T00:01:17.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbcc5c1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc4071240 0x7fcbc415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbcc5c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbc40cbeb0 0x7fcbc4143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbcc5c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbc4145390 0x7fcbc4141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbcc5c1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc40cb1e0 con 0x7fcbc4071240 2024-06-03T00:01:17.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbcc5c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc40caf00 con 0x7fcbc4145390 2024-06-03T00:01:17.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbcc5c1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc406dbe0 con 0x7fcbc40cbeb0 2024-06-03T00:01:17.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbca35d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc4071240 0x7fcbc415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbca35d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc4071240 0x7fcbc415bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51396/0 (socket says 172.21.15.96:51396) 2024-06-03T00:01:17.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbca35d640 1 -- 172.21.15.96:0/906854217 learned_addr learned my addr 172.21.15.96:0/906854217 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:17.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbc9b5c640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbc40cbeb0 0x7fcbc4143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbcab5e640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbc4145390 0x7fcbc4141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbca35d640 1 -- 172.21.15.96:0/906854217 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbc40cbeb0 msgr2=0x7fcbc4143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbca35d640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbc40cbeb0 0x7fcbc4143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbca35d640 1 -- 172.21.15.96:0/906854217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbc4145390 msgr2=0x7fcbc4141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbca35d640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbc4145390 0x7fcbc4141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbca35d640 1 -- 172.21.15.96:0/906854217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc415f290 con 0x7fcbc4071240 2024-06-03T00:01:17.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbca35d640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc4071240 0x7fcbc415bac0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c7f0 tx=0x7fcbc000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbbaffd640 1 -- 172.21.15.96:0/906854217 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0015070 con 0x7fcbc4071240 2024-06-03T00:01:17.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbbaffd640 1 -- 172.21.15.96:0/906854217 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc0007a30 con 0x7fcbc4071240 2024-06-03T00:01:17.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc4142970 con 0x7fcbc4071240 2024-06-03T00:01:17.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbbaffd640 1 -- 172.21.15.96:0/906854217 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0007e00 con 0x7fcbc4071240 2024-06-03T00:01:17.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.866+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc4142f30 con 0x7fcbc4071240 2024-06-03T00:01:17.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.867+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcbc40683e0 con 0x7fcbc4071240 2024-06-03T00:01:17.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.868+0000 7fcbbaffd640 1 -- 172.21.15.96:0/906854217 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fcbc0018070 con 0x7fcbc4071240 2024-06-03T00:01:17.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.868+0000 7fcbbaffd640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcba806be30 0x7fcba806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.868+0000 7fcbbaffd640 1 -- 172.21.15.96:0/906854217 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7fcbc008af10 con 0x7fcbc4071240 2024-06-03T00:01:17.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.868+0000 7fcbc9b5c640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcba806be30 0x7fcba806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.868+0000 7fcbbaffd640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] conn(0x7fcba8074760 0x7fcba8076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.868+0000 7fcbbaffd640 1 -- 172.21.15.96:0/906854217 --> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbc001ce50 con 0x7fcba8074760 2024-06-03T00:01:17.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.868+0000 7fcbbaffd640 1 -- 172.21.15.96:0/906854217 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fcbc008d610 con 0x7fcbc4071240 2024-06-03T00:01:17.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.868+0000 7fcbcab5e640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] conn(0x7fcba8074760 0x7fcba8076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.869+0000 7fcbc9b5c640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcba806be30 0x7fcba806e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4006fd0 tx=0x7fcbb4008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.869+0000 7fcbcab5e640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] conn(0x7fcba8074760 0x7fcba8076be0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.869+0000 7fcbbaffd640 1 -- 172.21.15.96:0/906854217 <== osd.1 v2:172.21.15.96:6808/3077632507 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcbc001ce50 con 0x7fcba8074760 2024-06-03T00:01:17.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.882+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 --> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcbc406e4d0 con 0x7fcba8074760 2024-06-03T00:01:17.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.882+0000 7fcbbaffd640 1 -- 172.21.15.96:0/906854217 <== osd.1 v2:172.21.15.96:6808/3077632507 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcbc406e4d0 con 0x7fcba8074760 2024-06-03T00:01:17.883 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-03T00:01:17.883 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-03T00:01:17.883 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-03T00:01:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] conn(0x7fcba8074760 msgr2=0x7fcba8076be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcc5c1640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:6808/3077632507,v1:172.21.15.96:6809/3077632507] conn(0x7fcba8074760 0x7fcba8076be0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcba806be30 msgr2=0x7fcba806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcc5c1640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fcba806be30 0x7fcba806e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4006fd0 tx=0x7fcbb4008040 comp rx=0 tx=0).stop 2024-06-03T00:01:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc4071240 msgr2=0x7fcbc415bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcc5c1640 1 --2- 172.21.15.96:0/906854217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc4071240 0x7fcbc415bac0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c7f0 tx=0x7fcbc000cbf0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcab5e640 1 -- 172.21.15.96:0/906854217 reap_dead start 2024-06-03T00:01:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 shutdown_connections 2024-06-03T00:01:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 >> 172.21.15.96:0/906854217 conn(0x7fcbc40b1a40 msgr2=0x7fcbc40b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 shutdown_connections 2024-06-03T00:01:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.883+0000 7fcbcc5c1640 1 -- 172.21.15.96:0/906854217 wait complete. 2024-06-03T00:01:17.894 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-06-03T00:01:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.994+0000 7f4daa82a640 1 Processor -- start 2024-06-03T00:01:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.994+0000 7f4daa82a640 1 -- start start 2024-06-03T00:01:17.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4daa82a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4da406ed20 0x7f4da40ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4daa82a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4da40cab60 0x7f4da4072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:17.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4daa82a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4da4155950 con 0x7f4da4155570 2024-06-03T00:01:17.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4daa82a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f4da40cb2e0 con 0x7f4da40cab60 2024-06-03T00:01:17.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4daa82a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4da40cb5c0 con 0x7f4da406ed20 2024-06-03T00:01:17.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4da8dc7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4da40cab60 0x7f4da4072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4da8dc7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4da40cab60 0x7f4da4072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51406/0 (socket says 172.21.15.96:51406) 2024-06-03T00:01:17.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4da8dc7640 1 -- 172.21.15.96:0/1293176667 learned_addr learned my addr 172.21.15.96:0/1293176667 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:17.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4da37fe640 1 --2- 172.21.15.96:0/1293176667 >> v2:172.21.15.162:3300/0 conn(0x7f4da406ed20 0x7f4da40ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:17.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4da8dc7640 1 -- 172.21.15.96:0/1293176667 >> v2:172.21.15.162:3300/0 conn(0x7f4da406ed20 msgr2=0x7f4da40ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4da8dc7640 1 --2- 172.21.15.96:0/1293176667 >> v2:172.21.15.162:3300/0 conn(0x7f4da406ed20 0x7f4da40ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4da8dc7640 1 -- 172.21.15.96:0/1293176667 >> v1:172.21.15.162:6789/0 conn(0x7f4da4155570 legacy=0x7f4da406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:17.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.995+0000 7f4da8dc7640 1 -- 172.21.15.96:0/1293176667 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da40cb8a0 con 0x7f4da40cab60 2024-06-03T00:01:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.996+0000 7f4da8dc7640 1 --2- 172.21.15.96:0/1293176667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40cab60 0x7f4da4072020 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4da4070b60 tx=0x7f4d9c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5f0f640e5d09d2 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.996+0000 7f4da2ffd640 1 -- 172.21.15.96:0/1293176667 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c036070 con 0x7f4da40cab60 2024-06-03T00:01:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.996+0000 7f4da2ffd640 1 -- 172.21.15.96:0/1293176667 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9c031600 con 0x7f4da40cab60 2024-06-03T00:01:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.996+0000 7f4da2ffd640 1 -- 172.21.15.96:0/1293176667 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0319d0 con 0x7f4da40cab60 2024-06-03T00:01:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.997+0000 7f4daa82a640 1 -- 172.21.15.96:0/1293176667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40cab60 msgr2=0x7f4da4072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.997+0000 7f4daa82a640 1 --2- 172.21.15.96:0/1293176667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40cab60 0x7f4da4072020 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4da4070b60 tx=0x7f4d9c02a6f0 comp rx=0 tx=0).stop 2024-06-03T00:01:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.997+0000 7f4daa82a640 1 -- 172.21.15.96:0/1293176667 shutdown_connections 2024-06-03T00:01:17.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.997+0000 7f4daa82a640 1 --2- 172.21.15.96:0/1293176667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40cab60 0x7f4da4072020 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.997+0000 7f4daa82a640 1 --2- 172.21.15.96:0/1293176667 >> v2:172.21.15.162:3300/0 conn(0x7f4da406ed20 0x7f4da40ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.997+0000 7f4daa82a640 1 -- 172.21.15.96:0/1293176667 >> 172.21.15.96:0/1293176667 conn(0x7f4da40cfc30 msgr2=0x7f4da40d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.997+0000 7f4daa82a640 1 -- 172.21.15.96:0/1293176667 shutdown_connections 2024-06-03T00:01:18.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.997+0000 7f4daa82a640 1 -- 172.21.15.96:0/1293176667 wait complete. 2024-06-03T00:01:18.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.998+0000 7f4daa82a640 1 Processor -- start 2024-06-03T00:01:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.998+0000 7f4daa82a640 1 -- start start 2024-06-03T00:01:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4daa82a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da406ed20 0x7f4da4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4daa82a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4da40cab60 0x7f4da4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4daa82a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da4155570 0x7f4da41560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4daa82a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f4da40caf70 con 0x7f4da406ed20 2024-06-03T00:01:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4daa82a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4da40717d0 con 0x7f4da40cab60 2024-06-03T00:01:18.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4daa82a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4da4072560 con 0x7f4da4155570 2024-06-03T00:01:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da406ed20 0x7f4da4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da406ed20 0x7f4da4157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51410/0 (socket says 172.21.15.96:51410) 2024-06-03T00:01:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da3fff640 1 -- 172.21.15.96:0/4090366597 learned_addr learned my addr 172.21.15.96:0/4090366597 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da8dc7640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da4155570 0x7f4da41560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da37fe640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4da40cab60 0x7f4da4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da3fff640 1 -- 172.21.15.96:0/4090366597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da4155570 msgr2=0x7f4da41560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da3fff640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da4155570 0x7f4da41560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da3fff640 1 -- 172.21.15.96:0/4090366597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4da40cab60 msgr2=0x7f4da4155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da3fff640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4da40cab60 0x7f4da4155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da3fff640 1 -- 172.21.15.96:0/4090366597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da414c820 con 0x7f4da406ed20 2024-06-03T00:01:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da37fe640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4da40cab60 0x7f4da4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da3fff640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da406ed20 0x7f4da4157a70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400b420 tx=0x7f4d9400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da0ff9640 1 -- 172.21.15.96:0/4090366597 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94011830 con 0x7f4da406ed20 2024-06-03T00:01:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da0ff9640 1 -- 172.21.15.96:0/4090366597 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d94016070 con 0x7f4da406ed20 2024-06-03T00:01:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4daa82a640 1 -- 172.21.15.96:0/4090366597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da414ca90 con 0x7f4da406ed20 2024-06-03T00:01:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:17.999+0000 7f4da0ff9640 1 -- 172.21.15.96:0/4090366597 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94011c10 con 0x7f4da406ed20 2024-06-03T00:01:18.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.000+0000 7f4daa82a640 1 -- 172.21.15.96:0/4090366597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da41586b0 con 0x7f4da406ed20 2024-06-03T00:01:18.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.001+0000 7f4daa82a640 1 -- 172.21.15.96:0/4090366597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da40ca420 con 0x7f4da406ed20 2024-06-03T00:01:18.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.001+0000 7f4da0ff9640 1 -- 172.21.15.96:0/4090366597 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f4d9401b460 con 0x7f4da406ed20 2024-06-03T00:01:18.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.001+0000 7f4da0ff9640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4d9006be60 0x7f4d9006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.002+0000 7f4da37fe640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4d9006be60 0x7f4d9006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.002+0000 7f4da0ff9640 1 -- 172.21.15.96:0/4090366597 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f4d9408a960 con 0x7f4da406ed20 2024-06-03T00:01:18.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.002+0000 7f4da37fe640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4d9006be60 0x7f4d9006e320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4da4071df0 tx=0x7f4d98008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.006+0000 7f4da0ff9640 1 -- 172.21.15.96:0/4090366597 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f4da40ca420 con 0x7f4da406ed20 2024-06-03T00:01:18.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.183+0000 7f4daa82a640 1 -- 172.21.15.96:0/4090366597 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4da40731b0 con 0x7f4d9006be60 2024-06-03T00:01:18.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.183+0000 7f4da0ff9640 1 -- 172.21.15.96:0/4090366597 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4da40731b0 con 0x7f4d9006be60 2024-06-03T00:01:18.183 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 1 to deep-scrub 2024-06-03T00:01:18.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.185+0000 7f4daa82a640 1 -- 172.21.15.96:0/4090366597 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4d9006be60 msgr2=0x7f4d9006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.185+0000 7f4daa82a640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4d9006be60 0x7f4d9006e320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4da4071df0 tx=0x7f4d98008040 comp rx=0 tx=0).stop 2024-06-03T00:01:18.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.185+0000 7f4daa82a640 1 -- 172.21.15.96:0/4090366597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da406ed20 msgr2=0x7f4da4157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.185+0000 7f4daa82a640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da406ed20 0x7f4da4157a70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400b420 tx=0x7f4d9400b8e0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.185+0000 7f4daa82a640 1 -- 172.21.15.96:0/4090366597 shutdown_connections 2024-06-03T00:01:18.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.185+0000 7f4daa82a640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f4d9006be60 0x7f4d9006e320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.185+0000 7f4daa82a640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4da4155570 0x7f4da41560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.185+0000 7f4daa82a640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4da40cab60 0x7f4da4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.185+0000 7f4daa82a640 1 --2- 172.21.15.96:0/4090366597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da406ed20 0x7f4da4157a70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.185+0000 7f4daa82a640 1 -- 172.21.15.96:0/4090366597 >> 172.21.15.96:0/4090366597 conn(0x7f4da40cfc30 msgr2=0x7f4da40cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:18.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.186+0000 7f4daa82a640 1 -- 172.21.15.96:0/4090366597 shutdown_connections 2024-06-03T00:01:18.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.186+0000 7f4daa82a640 1 -- 172.21.15.96:0/4090366597 wait complete. 2024-06-03T00:01:18.196 INFO:tasks.ceph:Scrubbing osd.2 2024-06-03T00:01:18.197 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-06-03T00:01:18.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.301+0000 7ff4aabb0640 1 Processor -- start 2024-06-03T00:01:18.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.301+0000 7ff4aabb0640 1 -- start start 2024-06-03T00:01:18.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.302+0000 7ff4aabb0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff4a415e470 0x7ff4a40cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.302+0000 7ff4aabb0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4a40cc480 0x7ff4a406e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.302+0000 7ff4aabb0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a40af400 con 0x7ff4a4071850 2024-06-03T00:01:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.302+0000 7ff4aabb0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a415e850 con 0x7ff4a415e470 2024-06-03T00:01:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.302+0000 7ff4aabb0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a40cc990 con 0x7ff4a40cc480 2024-06-03T00:01:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.302+0000 7ff4a894c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff4a415e470 0x7ff4a40cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.302+0000 7ff4a914d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff4a4071850 0x7ff4a415eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40956/0 (socket says 172.21.15.96:40956) 2024-06-03T00:01:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.302+0000 7ff4a914d640 1 -- 172.21.15.96:0/2387129304 learned_addr learned my addr 172.21.15.96:0/2387129304 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-03T00:01:18.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.303+0000 7ff4a3fff640 1 --2- 172.21.15.96:0/2387129304 >> v2:172.21.15.162:3300/0 conn(0x7ff4a40cc480 0x7ff4a406e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.303+0000 7ff4a894c640 1 -- 172.21.15.96:0/2387129304 >> v2:172.21.15.162:3300/0 conn(0x7ff4a40cc480 msgr2=0x7ff4a406e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.303+0000 7ff4a894c640 1 --2- 172.21.15.96:0/2387129304 >> v2:172.21.15.162:3300/0 conn(0x7ff4a40cc480 0x7ff4a406e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.303+0000 7ff4a894c640 1 -- 172.21.15.96:0/2387129304 >> v1:172.21.15.96:6789/0 conn(0x7ff4a4071850 legacy=0x7ff4a415eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.303+0000 7ff4a37fe640 1 -- 172.21.15.96:0/2387129304 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3199946189 0 0) 0x7ff49c001110 con 0x7ff4a4071850 2024-06-03T00:01:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.303+0000 7ff4a894c640 1 -- 172.21.15.96:0/2387129304 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a40ccc70 con 0x7ff4a415e470 2024-06-03T00:01:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.303+0000 7ff4a894c640 1 --2- 172.21.15.96:0/2387129304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4a415e470 0x7ff4a40cb370 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4071340 tx=0x7ff49402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a41c101dcc785d1 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4a37fe640 1 -- 172.21.15.96:0/2387129304 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494007740 con 0x7ff4a415e470 2024-06-03T00:01:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4a37fe640 1 -- 172.21.15.96:0/2387129304 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4940078e0 con 0x7ff4a415e470 2024-06-03T00:01:18.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4a37fe640 1 -- 172.21.15.96:0/2387129304 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494007cb0 con 0x7ff4a415e470 2024-06-03T00:01:18.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4aabb0640 1 -- 172.21.15.96:0/2387129304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4a415e470 msgr2=0x7ff4a40cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4aabb0640 1 --2- 172.21.15.96:0/2387129304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4a415e470 0x7ff4a40cb370 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4071340 tx=0x7ff49402a680 comp rx=0 tx=0).stop 2024-06-03T00:01:18.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4aabb0640 1 -- 172.21.15.96:0/2387129304 shutdown_connections 2024-06-03T00:01:18.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4aabb0640 1 --2- 172.21.15.96:0/2387129304 >> v2:172.21.15.162:3300/0 conn(0x7ff4a40cc480 0x7ff4a406e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4aabb0640 1 --2- 172.21.15.96:0/2387129304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4a415e470 0x7ff4a40cb370 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4aabb0640 1 -- 172.21.15.96:0/2387129304 >> 172.21.15.96:0/2387129304 conn(0x7ff4a40b1a40 msgr2=0x7ff4a40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:18.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4aabb0640 1 -- 172.21.15.96:0/2387129304 shutdown_connections 2024-06-03T00:01:18.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.304+0000 7ff4aabb0640 1 -- 172.21.15.96:0/2387129304 wait complete. 2024-06-03T00:01:18.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.305+0000 7ff4aabb0640 1 Processor -- start 2024-06-03T00:01:18.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.305+0000 7ff4aabb0640 1 -- start start 2024-06-03T00:01:18.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.306+0000 7ff4aabb0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4a4071850 0x7ff4a4157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.306+0000 7ff4aabb0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4a40cc480 0x7ff4a4150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.306+0000 7ff4aabb0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4a415e470 0x7ff4a409bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.306+0000 7ff4aabb0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a40cd510 con 0x7ff4a4071850 2024-06-03T00:01:18.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.306+0000 7ff4aabb0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a40cd230 con 0x7ff4a415e470 2024-06-03T00:01:18.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.306+0000 7ff4aabb0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a40cb8b0 con 0x7ff4a40cc480 2024-06-03T00:01:18.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.306+0000 7ff4a894c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4a4071850 0x7ff4a4157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.306+0000 7ff4a894c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4a4071850 0x7ff4a4157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51424/0 (socket says 172.21.15.96:51424) 2024-06-03T00:01:18.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.306+0000 7ff4a894c640 1 -- 172.21.15.96:0/626315569 learned_addr learned my addr 172.21.15.96:0/626315569 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:18.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4a894c640 1 -- 172.21.15.96:0/626315569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4a40cc480 msgr2=0x7ff4a4150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4a894c640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4a40cc480 0x7ff4a4150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4a894c640 1 -- 172.21.15.96:0/626315569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4a415e470 msgr2=0x7ff4a409bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4a894c640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4a415e470 0x7ff4a409bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4a894c640 1 -- 172.21.15.96:0/626315569 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a41511f0 con 0x7ff4a4071850 2024-06-03T00:01:18.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4a894c640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4a4071850 0x7ff4a4157510 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff494009e80 tx=0x7ff494004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4a17fa640 1 -- 172.21.15.96:0/626315569 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49403f070 con 0x7ff4a4071850 2024-06-03T00:01:18.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4a17fa640 1 -- 172.21.15.96:0/626315569 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff494031c40 con 0x7ff4a4071850 2024-06-03T00:01:18.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a409b470 con 0x7ff4a4071850 2024-06-03T00:01:18.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4a17fa640 1 -- 172.21.15.96:0/626315569 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494043410 con 0x7ff4a4071850 2024-06-03T00:01:18.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.307+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a41536c0 con 0x7ff4a4071850 2024-06-03T00:01:18.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.308+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4a40683e0 con 0x7ff4a4071850 2024-06-03T00:01:18.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.308+0000 7ff4a17fa640 1 -- 172.21.15.96:0/626315569 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7ff4940435b0 con 0x7ff4a4071850 2024-06-03T00:01:18.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.309+0000 7ff4a17fa640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7ff49006be30 0x7ff49006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.309+0000 7ff4a17fa640 1 -- 172.21.15.96:0/626315569 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7ff4940ac4f0 con 0x7ff4a4071850 2024-06-03T00:01:18.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.309+0000 7ff4a3fff640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7ff49006be30 0x7ff49006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.309+0000 7ff4a17fa640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] conn(0x7ff490074760 0x7ff490076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.309+0000 7ff4a17fa640 1 -- 172.21.15.96:0/626315569 --> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff49403de50 con 0x7ff490074760 2024-06-03T00:01:18.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.309+0000 7ff4a17fa640 1 -- 172.21.15.96:0/626315569 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7ff4940b3050 con 0x7ff4a4071850 2024-06-03T00:01:18.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.309+0000 7ff4a914d640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] conn(0x7ff490074760 0x7ff490076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.309+0000 7ff4a3fff640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7ff49006be30 0x7ff49006e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40ca6a0 tx=0x7ff498008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.309+0000 7ff4a914d640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] conn(0x7ff490074760 0x7ff490076be0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.310+0000 7ff4a17fa640 1 -- 172.21.15.96:0/626315569 <== osd.2 v2:172.21.15.96:6824/2465470784 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff49403de50 con 0x7ff490074760 2024-06-03T00:01:18.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 --> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff4a40cdf90 con 0x7ff490074760 2024-06-03T00:01:18.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4a17fa640 1 -- 172.21.15.96:0/626315569 <== osd.2 v2:172.21.15.96:6824/2465470784 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff4a40cdf90 con 0x7ff490074760 2024-06-03T00:01:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-03T00:01:18.324 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-03T00:01:18.324 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-03T00:01:18.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] conn(0x7ff490074760 msgr2=0x7ff490076be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:6824/2465470784,v1:172.21.15.96:6825/2465470784] conn(0x7ff490074760 0x7ff490076be0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7ff49006be30 msgr2=0x7ff49006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7ff49006be30 0x7ff49006e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40ca6a0 tx=0x7ff498008040 comp rx=0 tx=0).stop 2024-06-03T00:01:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4a4071850 msgr2=0x7ff4a4157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 --2- 172.21.15.96:0/626315569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4a4071850 0x7ff4a4157510 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff494009e80 tx=0x7ff494004a40 comp rx=0 tx=0).stop 2024-06-03T00:01:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4a914d640 1 -- 172.21.15.96:0/626315569 reap_dead start 2024-06-03T00:01:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 shutdown_connections 2024-06-03T00:01:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 >> 172.21.15.96:0/626315569 conn(0x7ff4a40b1a40 msgr2=0x7ff4a40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 shutdown_connections 2024-06-03T00:01:18.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.323+0000 7ff4aabb0640 1 -- 172.21.15.96:0/626315569 wait complete. 2024-06-03T00:01:18.334 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-06-03T00:01:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.435+0000 7f9022038640 1 Processor -- start 2024-06-03T00:01:18.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.435+0000 7f9022038640 1 -- start start 2024-06-03T00:01:18.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f9022038640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f901c0d1120 0x7f901c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f9022038640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f901c0d4a90 con 0x7f901c161900 2024-06-03T00:01:18.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f9022038640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f901c0d4d70 con 0x7f901c0b5510 2024-06-03T00:01:18.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f9022038640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f901c0cf5c0 con 0x7f901c0d1120 2024-06-03T00:01:18.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f901affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f901c0d1120 0x7f901c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f901b7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f901c161900 0x7f901c0d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40958/0 (socket says 172.21.15.96:40958) 2024-06-03T00:01:18.438 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f901affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f901c0d1120 0x7f901c0c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51430/0 (socket says 172.21.15.96:51430) 2024-06-03T00:01:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f901b7fe640 1 -- 172.21.15.96:0/3846388527 learned_addr learned my addr 172.21.15.96:0/3846388527 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-03T00:01:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f901affd640 1 -- 172.21.15.96:0/3846388527 >> v1:172.21.15.162:6789/0 conn(0x7f901c0b5510 legacy=0x7f901c0c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f901affd640 1 -- 172.21.15.96:0/3846388527 >> v1:172.21.15.96:6789/0 conn(0x7f901c161900 legacy=0x7f901c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f901affd640 1 -- 172.21.15.96:0/3846388527 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c0cf800 con 0x7f901c0d1120 2024-06-03T00:01:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.436+0000 7f901a7fc640 1 -- 172.21.15.96:0/3846388527 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147025249 0 0) 0x7f901c0d4a90 con 0x7f901c161900 2024-06-03T00:01:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f901affd640 1 --2- 172.21.15.96:0/3846388527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0d1120 0x7f901c0c7bc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f90100097a0 tx=0x7f901002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c34f89882aacf2 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f901a7fc640 1 -- 172.21.15.96:0/3846388527 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010037070 con 0x7f901c0d1120 2024-06-03T00:01:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f901a7fc640 1 -- 172.21.15.96:0/3846388527 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901002ae50 con 0x7f901c0d1120 2024-06-03T00:01:18.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f901a7fc640 1 -- 172.21.15.96:0/3846388527 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010032660 con 0x7f901c0d1120 2024-06-03T00:01:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f9022038640 1 -- 172.21.15.96:0/3846388527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0d1120 msgr2=0x7f901c0c7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f9022038640 1 --2- 172.21.15.96:0/3846388527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0d1120 0x7f901c0c7bc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f90100097a0 tx=0x7f901002a140 comp rx=0 tx=0).stop 2024-06-03T00:01:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f9022038640 1 -- 172.21.15.96:0/3846388527 shutdown_connections 2024-06-03T00:01:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f9022038640 1 --2- 172.21.15.96:0/3846388527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0d1120 0x7f901c0c7bc0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f9022038640 1 -- 172.21.15.96:0/3846388527 >> 172.21.15.96:0/3846388527 conn(0x7f901c09d3b0 msgr2=0x7f901c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f9022038640 1 -- 172.21.15.96:0/3846388527 shutdown_connections 2024-06-03T00:01:18.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.437+0000 7f9022038640 1 -- 172.21.15.96:0/3846388527 wait complete. 2024-06-03T00:01:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.439+0000 7f9022038640 1 Processor -- start 2024-06-03T00:01:18.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.439+0000 7f9022038640 1 -- start start 2024-06-03T00:01:18.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.439+0000 7f9022038640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0b5510 0x7f901c0cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.439+0000 7f9022038640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f901c0d1120 0x7f901c160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.439+0000 7f9022038640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f901c161900 0x7f901c157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f9022038640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f901c0d4780 con 0x7f901c0b5510 2024-06-03T00:01:18.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f9022038640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f901c0caf70 con 0x7f901c161900 2024-06-03T00:01:18.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f9022038640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f901c161ce0 con 0x7f901c0d1120 2024-06-03T00:01:18.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0b5510 0x7f901c0cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0b5510 0x7f901c0cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51442/0 (socket says 172.21.15.96:51442) 2024-06-03T00:01:18.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901b7fe640 1 -- 172.21.15.96:0/2595648395 learned_addr learned my addr 172.21.15.96:0/2595648395 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:18.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901affd640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f901c0d1120 0x7f901c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901bfff640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f901c161900 0x7f901c157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901b7fe640 1 -- 172.21.15.96:0/2595648395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f901c0d1120 msgr2=0x7f901c160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901b7fe640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f901c0d1120 0x7f901c160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901b7fe640 1 -- 172.21.15.96:0/2595648395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f901c161900 msgr2=0x7f901c157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901b7fe640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f901c161900 0x7f901c157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901b7fe640 1 -- 172.21.15.96:0/2595648395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c0ccc80 con 0x7f901c0b5510 2024-06-03T00:01:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f901b7fe640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0b5510 0x7f901c0cc740 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c430 tx=0x7f900c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f9003fff640 1 -- 172.21.15.96:0/2595648395 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c0074e0 con 0x7f901c0b5510 2024-06-03T00:01:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f9003fff640 1 -- 172.21.15.96:0/2595648395 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c0047e0 con 0x7f901c0b5510 2024-06-03T00:01:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f9022038640 1 -- 172.21.15.96:0/2595648395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901c1f4460 con 0x7f901c0b5510 2024-06-03T00:01:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f9003fff640 1 -- 172.21.15.96:0/2595648395 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c004bd0 con 0x7f901c0b5510 2024-06-03T00:01:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.440+0000 7f9022038640 1 -- 172.21.15.96:0/2595648395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901c1f4d00 con 0x7f901c0b5510 2024-06-03T00:01:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.441+0000 7f9022038640 1 -- 172.21.15.96:0/2595648395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901c1f4850 con 0x7f901c0b5510 2024-06-03T00:01:18.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.442+0000 7f9003fff640 1 -- 172.21.15.96:0/2595648395 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f900c011070 con 0x7f901c0b5510 2024-06-03T00:01:18.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.442+0000 7f9003fff640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f900806be30 0x7f900806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.442+0000 7f9003fff640 1 -- 172.21.15.96:0/2595648395 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f900c08abd0 con 0x7f901c0b5510 2024-06-03T00:01:18.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.442+0000 7f901affd640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f900806be30 0x7f900806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.443+0000 7f901affd640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f900806be30 0x7f900806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9010034000 tx=0x7f901002e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.446+0000 7f9003fff640 1 -- 172.21.15.96:0/2595648395 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f900c059450 con 0x7f901c0b5510 2024-06-03T00:01:18.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.622+0000 7f9022038640 1 -- 172.21.15.96:0/2595648395 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f901c0683e0 con 0x7f900806be30 2024-06-03T00:01:18.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.622+0000 7f9003fff640 1 -- 172.21.15.96:0/2595648395 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f901c0683e0 con 0x7f900806be30 2024-06-03T00:01:18.623 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 2 to deep-scrub 2024-06-03T00:01:18.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.624+0000 7f9022038640 1 -- 172.21.15.96:0/2595648395 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f900806be30 msgr2=0x7f900806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.624+0000 7f9022038640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f900806be30 0x7f900806e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9010034000 tx=0x7f901002e000 comp rx=0 tx=0).stop 2024-06-03T00:01:18.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.624+0000 7f9022038640 1 -- 172.21.15.96:0/2595648395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0b5510 msgr2=0x7f901c0cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.624+0000 7f9022038640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0b5510 0x7f901c0cc740 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c430 tx=0x7f900c00c8f0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.624+0000 7f9022038640 1 -- 172.21.15.96:0/2595648395 shutdown_connections 2024-06-03T00:01:18.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.624+0000 7f9022038640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f900806be30 0x7f900806e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.624+0000 7f9022038640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f901c161900 0x7f901c157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.624+0000 7f9022038640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f901c0d1120 0x7f901c160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.624+0000 7f9022038640 1 --2- 172.21.15.96:0/2595648395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f901c0b5510 0x7f901c0cc740 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.624+0000 7f9022038640 1 -- 172.21.15.96:0/2595648395 >> 172.21.15.96:0/2595648395 conn(0x7f901c09d3b0 msgr2=0x7f901c06c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:18.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.625+0000 7f9022038640 1 -- 172.21.15.96:0/2595648395 shutdown_connections 2024-06-03T00:01:18.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.625+0000 7f9022038640 1 -- 172.21.15.96:0/2595648395 wait complete. 2024-06-03T00:01:18.636 INFO:tasks.ceph:Scrubbing osd.3 2024-06-03T00:01:18.636 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-06-03T00:01:18.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.741+0000 7f2fb7142640 1 Processor -- start 2024-06-03T00:01:18.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.741+0000 7f2fb7142640 1 -- start start 2024-06-03T00:01:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.741+0000 7f2fb7142640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2fb00c9450 0x7f2fb015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.741+0000 7f2fb7142640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2fb00d10e0 0x7f2fb00d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.741+0000 7f2fb7142640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb00cfa70 con 0x7f2fb015e1d0 2024-06-03T00:01:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.741+0000 7f2fb7142640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb00d0030 con 0x7f2fb00d10e0 2024-06-03T00:01:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.741+0000 7f2fb7142640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb00cfd50 con 0x7f2fb00c9450 2024-06-03T00:01:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.742+0000 7f2fb56df640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2fb00d10e0 0x7f2fb00d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.742+0000 7f2fb56df640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2fb00d10e0 0x7f2fb00d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51458/0 (socket says 172.21.15.96:51458) 2024-06-03T00:01:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.742+0000 7f2fb56df640 1 -- 172.21.15.96:0/781655944 learned_addr learned my addr 172.21.15.96:0/781655944 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.742+0000 7f2fb4ede640 1 --1- 172.21.15.96:0/781655944 >> v1:172.21.15.96:6789/0 conn(0x7f2fb015e1d0 0x7f2fb00d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40970/0 (socket says 172.21.15.96:40970) 2024-06-03T00:01:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.742+0000 7f2faffff640 1 --2- 172.21.15.96:0/781655944 >> v2:172.21.15.162:3300/0 conn(0x7f2fb00c9450 0x7f2fb015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.742+0000 7f2fb56df640 1 -- 172.21.15.96:0/781655944 >> v2:172.21.15.162:3300/0 conn(0x7f2fb00c9450 msgr2=0x7f2fb015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.742+0000 7f2fb56df640 1 --2- 172.21.15.96:0/781655944 >> v2:172.21.15.162:3300/0 conn(0x7f2fb00c9450 0x7f2fb015e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.742+0000 7f2fb56df640 1 -- 172.21.15.96:0/781655944 >> v1:172.21.15.96:6789/0 conn(0x7f2fb015e1d0 legacy=0x7f2fb00d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.742+0000 7f2fb56df640 1 -- 172.21.15.96:0/781655944 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb00c7c40 con 0x7f2fb00d10e0 2024-06-03T00:01:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.742+0000 7f2faf7fe640 1 -- 172.21.15.96:0/781655944 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820074778 0 0) 0x7f2fb00cfa70 con 0x7f2fb015e1d0 2024-06-03T00:01:18.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2fb56df640 1 --2- 172.21.15.96:0/781655944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb00d10e0 0x7f2fb00d1da0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0161f50 tx=0x7f2fa802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f17b9c5e10e614 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2faf7fe640 1 -- 172.21.15.96:0/781655944 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8036070 con 0x7f2fb00d10e0 2024-06-03T00:01:18.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2faf7fe640 1 -- 172.21.15.96:0/781655944 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa8031600 con 0x7f2fb00d10e0 2024-06-03T00:01:18.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2faf7fe640 1 -- 172.21.15.96:0/781655944 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80319d0 con 0x7f2fb00d10e0 2024-06-03T00:01:18.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2fb7142640 1 -- 172.21.15.96:0/781655944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb00d10e0 msgr2=0x7f2fb00d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2fb7142640 1 --2- 172.21.15.96:0/781655944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb00d10e0 0x7f2fb00d1da0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0161f50 tx=0x7f2fa802a6a0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2fb7142640 1 -- 172.21.15.96:0/781655944 shutdown_connections 2024-06-03T00:01:18.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2fb7142640 1 --2- 172.21.15.96:0/781655944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb00d10e0 0x7f2fb00d1da0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2fb7142640 1 --2- 172.21.15.96:0/781655944 >> v2:172.21.15.162:3300/0 conn(0x7f2fb00c9450 0x7f2fb015e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2fb7142640 1 -- 172.21.15.96:0/781655944 >> 172.21.15.96:0/781655944 conn(0x7f2fb00d3fc0 msgr2=0x7f2fb00d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2fb7142640 1 -- 172.21.15.96:0/781655944 shutdown_connections 2024-06-03T00:01:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.743+0000 7f2fb7142640 1 -- 172.21.15.96:0/781655944 wait complete. 2024-06-03T00:01:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.744+0000 7f2fb7142640 1 Processor -- start 2024-06-03T00:01:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.745+0000 7f2fb7142640 1 -- start start 2024-06-03T00:01:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.745+0000 7f2fb7142640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb00c9450 0x7f2fb01534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.745+0000 7f2fb7142640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb00d10e0 0x7f2fb00a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.745+0000 7f2fb7142640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb015e1d0 0x7f2fb009e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.745+0000 7f2fb7142640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb00d16f0 con 0x7f2fb015e1d0 2024-06-03T00:01:18.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.745+0000 7f2fb7142640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb00d1570 con 0x7f2fb00c9450 2024-06-03T00:01:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.745+0000 7f2fb7142640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb00d22e0 con 0x7f2fb00d10e0 2024-06-03T00:01:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.745+0000 7f2fb56df640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb015e1d0 0x7f2fb009e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb56df640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb015e1d0 0x7f2fb009e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51460/0 (socket says 172.21.15.96:51460) 2024-06-03T00:01:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb56df640 1 -- 172.21.15.96:0/1492668263 learned_addr learned my addr 172.21.15.96:0/1492668263 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2faffff640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb00d10e0 0x7f2fb00a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb4ede640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb00c9450 0x7f2fb01534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb56df640 1 -- 172.21.15.96:0/1492668263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb00d10e0 msgr2=0x7f2fb00a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb56df640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb00d10e0 0x7f2fb00a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb56df640 1 -- 172.21.15.96:0/1492668263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb00c9450 msgr2=0x7f2fb01534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb56df640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb00c9450 0x7f2fb01534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb56df640 1 -- 172.21.15.96:0/1492668263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb015cb50 con 0x7f2fb015e1d0 2024-06-03T00:01:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb56df640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb015e1d0 0x7f2fb009e930 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2fa802ac90 tx=0x7f2fa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fad7fa640 1 -- 172.21.15.96:0/1492668263 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa803f020 con 0x7f2fb015e1d0 2024-06-03T00:01:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fad7fa640 1 -- 172.21.15.96:0/1492668263 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa8037040 con 0x7f2fb015e1d0 2024-06-03T00:01:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb009f4a0 con 0x7f2fb015e1d0 2024-06-03T00:01:18.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fad7fa640 1 -- 172.21.15.96:0/1492668263 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8036070 con 0x7f2fb015e1d0 2024-06-03T00:01:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.746+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb009fa60 con 0x7f2fb015e1d0 2024-06-03T00:01:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.747+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2fb00683e0 con 0x7f2fb015e1d0 2024-06-03T00:01:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.748+0000 7f2fad7fa640 1 -- 172.21.15.96:0/1492668263 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f2fa8042020 con 0x7f2fb015e1d0 2024-06-03T00:01:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.748+0000 7f2fad7fa640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.748+0000 7f2fad7fa640 1 -- 172.21.15.96:0/1492668263 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f2fa80ab3b0 con 0x7f2fb015e1d0 2024-06-03T00:01:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.748+0000 7f2fb4ede640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2f9406be30 0x7f2f9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.748+0000 7f2fad7fa640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] conn(0x7f2f94074750 0x7f2f94076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.748+0000 7f2fad7fa640 1 -- 172.21.15.96:0/1492668263 --> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f940772a0 con 0x7f2f94074750 2024-06-03T00:01:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.748+0000 7f2fad7fa640 1 -- 172.21.15.96:0/1492668263 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f2fa80b2050 con 0x7f2fb015e1d0 2024-06-03T00:01:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.748+0000 7f2faffff640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] conn(0x7f2f94074750 0x7f2f94076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.749+0000 7f2fb4ede640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2f9406be30 0x7f2f9406e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4007fd0 tx=0x7f2fa4007de0 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.749+0000 7f2faffff640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] conn(0x7f2f94074750 0x7f2f94076bd0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.749+0000 7f2fad7fa640 1 -- 172.21.15.96:0/1492668263 <== osd.3 v2:172.21.15.96:6800/1530888449 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f940772a0 con 0x7f2f94074750 2024-06-03T00:01:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.762+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 --> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2fb00ca600 con 0x7f2f94074750 2024-06-03T00:01:18.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fad7fa640 1 -- 172.21.15.96:0/1492668263 <== osd.3 v2:172.21.15.96:6800/1530888449 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2fb00ca600 con 0x7f2f94074750 2024-06-03T00:01:18.763 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-03T00:01:18.763 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-03T00:01:18.763 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-03T00:01:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] conn(0x7f2f94074750 msgr2=0x7f2f94076bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb7142640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:6800/1530888449,v1:172.21.15.96:6801/1530888449] conn(0x7f2f94074750 0x7f2f94076bd0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2f9406be30 msgr2=0x7f2f9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb7142640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f2f9406be30 0x7f2f9406e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4007fd0 tx=0x7f2fa4007de0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb015e1d0 msgr2=0x7f2fb009e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb7142640 1 --2- 172.21.15.96:0/1492668263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2fb015e1d0 0x7f2fb009e930 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2fa802ac90 tx=0x7f2fa8004a40 comp rx=0 tx=0).stop 2024-06-03T00:01:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb56df640 1 -- 172.21.15.96:0/1492668263 reap_dead start 2024-06-03T00:01:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 shutdown_connections 2024-06-03T00:01:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 >> 172.21.15.96:0/1492668263 conn(0x7f2fb00d3fc0 msgr2=0x7f2fb006be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 shutdown_connections 2024-06-03T00:01:18.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.763+0000 7f2fb7142640 1 -- 172.21.15.96:0/1492668263 wait complete. 2024-06-03T00:01:18.774 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-06-03T00:01:18.874 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.874+0000 7f18d4aa5640 1 Processor -- start 2024-06-03T00:01:18.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.874+0000 7f18d4aa5640 1 -- start start 2024-06-03T00:01:18.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18d4aa5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f18d0155570 0x7f18d006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18d4aa5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006eb50 0x7f18d00ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18d4aa5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d0155950 con 0x7f18d00cab60 2024-06-03T00:01:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18d4aa5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f18d006efb0 con 0x7f18d0155570 2024-06-03T00:01:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18d4aa5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f18d00cb2e0 con 0x7f18d006eb50 2024-06-03T00:01:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18ced9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f18d00cab60 0x7f18d015eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40986/0 (socket says 172.21.15.96:40986) 2024-06-03T00:01:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18ced9d640 1 -- 172.21.15.96:0/860771894 learned_addr learned my addr 172.21.15.96:0/860771894 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-03T00:01:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18c5d9b640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006eb50 0x7f18d00ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18ce59c640 1 --2- 172.21.15.96:0/860771894 >> v2:172.21.15.162:3300/0 conn(0x7f18d0155570 0x7f18d006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 749569710 0 0) 0x7f18d0155950 con 0x7f18d00cab60 2024-06-03T00:01:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.875+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18bc003520 con 0x7f18d00cab60 2024-06-03T00:01:18.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3274965953 0 0) 0x7f18bc003520 con 0x7f18d00cab60 2024-06-03T00:01:18.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006eb50 msgr2=0x7f18d00ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:18.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006eb50 0x7f18d00ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 >> v2:172.21.15.162:3300/0 conn(0x7f18d0155570 msgr2=0x7f18d006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:18.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 --2- 172.21.15.96:0/860771894 >> v2:172.21.15.162:3300/0 conn(0x7f18d0155570 0x7f18d006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d00cb5c0 con 0x7f18d00cab60 2024-06-03T00:01:18.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f18c80019f0 con 0x7f18d00cab60 2024-06-03T00:01:18.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18c5d9b640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006eb50 0x7f18d00ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 >> v1:172.21.15.96:6789/0 conn(0x7f18d00cab60 legacy=0x7f18d015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18bc0039b0 0x7f18bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18bc004800 0x7f18bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006eb50 0x7f18bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f18d00cb2e0 con 0x7f18bc0039b0 2024-06-03T00:01:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc00b9c0 con 0x7f18bc004800 2024-06-03T00:01:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f18bc00bb40 con 0x7f18d006eb50 2024-06-03T00:01:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18ce59c640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18bc0039b0 0x7f18bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18c5d9b640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18bc004800 0x7f18bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18ced9d640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006eb50 0x7f18bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18ce59c640 1 -- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006eb50 msgr2=0x7f18bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18ce59c640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006eb50 0x7f18bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18ce59c640 1 -- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18bc004800 msgr2=0x7f18bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18ce59c640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18bc004800 0x7f18bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18ce59c640 1 -- 172.21.15.96:0/860771894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18bc003520 con 0x7f18bc0039b0 2024-06-03T00:01:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.876+0000 7f18ced9d640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006eb50 0x7f18bc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.877+0000 7f18ce59c640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18bc0039b0 0x7f18bc003dd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009ac0 tx=0x7f18bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1208d2feba85cedd server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.877+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0036070 con 0x7f18bc0039b0 2024-06-03T00:01:18.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.877+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c0031400 con 0x7f18bc0039b0 2024-06-03T00:01:18.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.877+0000 7f18cdd9b640 1 -- 172.21.15.96:0/860771894 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c0009690 con 0x7f18bc0039b0 2024-06-03T00:01:18.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.877+0000 7f18d4aa5640 1 -- 172.21.15.96:0/860771894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18bc0039b0 msgr2=0x7f18bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.877+0000 7f18d4aa5640 1 --2- 172.21.15.96:0/860771894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18bc0039b0 0x7f18bc003dd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009ac0 tx=0x7f18bc005830 comp rx=0 tx=0).stop 2024-06-03T00:01:18.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.877+0000 7f18ced9d640 1 -- 172.21.15.96:0/860771894 reap_dead start 2024-06-03T00:01:18.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.877+0000 7f18d4aa5640 1 -- 172.21.15.96:0/860771894 shutdown_connections 2024-06-03T00:01:18.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.877+0000 7f18d4aa5640 1 -- 172.21.15.96:0/860771894 >> 172.21.15.96:0/860771894 conn(0x7f18d00cfc30 msgr2=0x7f18d00d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:18.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.878+0000 7f18d4aa5640 1 -- 172.21.15.96:0/860771894 shutdown_connections 2024-06-03T00:01:18.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.878+0000 7f18d4aa5640 1 -- 172.21.15.96:0/860771894 wait complete. 2024-06-03T00:01:18.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.879+0000 7f18d4aa5640 1 Processor -- start 2024-06-03T00:01:18.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.879+0000 7f18d4aa5640 1 -- start start 2024-06-03T00:01:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18d4aa5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18bc0039b0 0x7f18d01445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18d4aa5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d01eee70 0x7f18d01f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18d4aa5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006d500 0x7f18d006d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18d4aa5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f18d00caff0 con 0x7f18d01eee70 2024-06-03T00:01:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18d4aa5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f18d0071b00 con 0x7f18bc0039b0 2024-06-03T00:01:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18d4aa5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f18d00717d0 con 0x7f18d006d500 2024-06-03T00:01:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18c5d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d01eee70 0x7f18d01f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18c5d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d01eee70 0x7f18d01f1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51470/0 (socket says 172.21.15.96:51470) 2024-06-03T00:01:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18c5d9b640 1 -- 172.21.15.96:0/3321499357 learned_addr learned my addr 172.21.15.96:0/3321499357 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18ced9d640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006d500 0x7f18d006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18ce59c640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18bc0039b0 0x7f18d01445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18c5d9b640 1 -- 172.21.15.96:0/3321499357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006d500 msgr2=0x7f18d006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18c5d9b640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006d500 0x7f18d006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18c5d9b640 1 -- 172.21.15.96:0/3321499357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18bc0039b0 msgr2=0x7f18d01445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18c5d9b640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18bc0039b0 0x7f18d01445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18c5d9b640 1 -- 172.21.15.96:0/3321499357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d01f1e80 con 0x7f18d01eee70 2024-06-03T00:01:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18c5d9b640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d01eee70 0x7f18d01f1940 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f18b80119d0 tx=0x7f18b8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.880+0000 7f18c77fe640 1 -- 172.21.15.96:0/3321499357 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b800faf0 con 0x7f18d01eee70 2024-06-03T00:01:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.881+0000 7f18c77fe640 1 -- 172.21.15.96:0/3321499357 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b800fc90 con 0x7f18d01eee70 2024-06-03T00:01:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.881+0000 7f18d4aa5640 1 -- 172.21.15.96:0/3321499357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d00c5150 con 0x7f18d01eee70 2024-06-03T00:01:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.881+0000 7f18c77fe640 1 -- 172.21.15.96:0/3321499357 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8004030 con 0x7f18d01eee70 2024-06-03T00:01:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.881+0000 7f18d4aa5640 1 -- 172.21.15.96:0/3321499357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d01f2400 con 0x7f18d01eee70 2024-06-03T00:01:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.881+0000 7f18d4aa5640 1 -- 172.21.15.96:0/3321499357 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d00683e0 con 0x7f18d01eee70 2024-06-03T00:01:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.882+0000 7f18c77fe640 1 -- 172.21.15.96:0/3321499357 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f18b8012040 con 0x7f18d01eee70 2024-06-03T00:01:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.882+0000 7f18c77fe640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f18b006be60 0x7f18b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.882+0000 7f18c77fe640 1 -- 172.21.15.96:0/3321499357 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f18b808b2c0 con 0x7f18d01eee70 2024-06-03T00:01:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.882+0000 7f18ce59c640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f18b006be60 0x7f18b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.883+0000 7f18ce59c640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f18b006be60 0x7f18b006e320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18c0033000 tx=0x7f18c0008030 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:18.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:18.887+0000 7f18c77fe640 1 -- 172.21.15.96:0/3321499357 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f18b8019070 con 0x7f18d01eee70 2024-06-03T00:01:19.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.058+0000 7f18d4aa5640 1 -- 172.21.15.96:0/3321499357 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f18d006cc90 con 0x7f18b006be60 2024-06-03T00:01:19.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.058+0000 7f18c77fe640 1 -- 172.21.15.96:0/3321499357 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f18d006cc90 con 0x7f18b006be60 2024-06-03T00:01:19.059 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 3 to deep-scrub 2024-06-03T00:01:19.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 -- 172.21.15.96:0/3321499357 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f18b006be60 msgr2=0x7f18b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f18b006be60 0x7f18b006e320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18c0033000 tx=0x7f18c0008030 comp rx=0 tx=0).stop 2024-06-03T00:01:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 -- 172.21.15.96:0/3321499357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d01eee70 msgr2=0x7f18d01f1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d01eee70 0x7f18d01f1940 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f18b80119d0 tx=0x7f18b8011e90 comp rx=0 tx=0).stop 2024-06-03T00:01:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 -- 172.21.15.96:0/3321499357 shutdown_connections 2024-06-03T00:01:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f18b006be60 0x7f18b006e320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18d006d500 0x7f18d006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d01eee70 0x7f18d01f1940 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 --2- 172.21.15.96:0/3321499357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18bc0039b0 0x7f18d01445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 -- 172.21.15.96:0/3321499357 >> 172.21.15.96:0/3321499357 conn(0x7f18d00cfc30 msgr2=0x7f18d0159030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 -- 172.21.15.96:0/3321499357 shutdown_connections 2024-06-03T00:01:19.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.060+0000 7f18d4aa5640 1 -- 172.21.15.96:0/3321499357 wait complete. 2024-06-03T00:01:19.071 INFO:tasks.ceph:Scrubbing osd.4 2024-06-03T00:01:19.071 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-06-03T00:01:19.175 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.175+0000 7f351ab3b640 1 Processor -- start 2024-06-03T00:01:19.176 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.175+0000 7f351ab3b640 1 -- start start 2024-06-03T00:01:19.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f351ab3b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351415e470 0x7f35140cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f351ab3b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f351406e7b0 0x7f35140ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f351ab3b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35140af400 con 0x7f35140cc480 2024-06-03T00:01:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f351ab3b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f351415e850 con 0x7f351406e7b0 2024-06-03T00:01:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f351ab3b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f35140cc990 con 0x7f351415e470 2024-06-03T00:01:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f35190d8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f351406e7b0 0x7f35140ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f35190d8640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f351406e7b0 0x7f35140ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51484/0 (socket says 172.21.15.96:51484) 2024-06-03T00:01:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f35190d8640 1 -- 172.21.15.96:0/610660269 learned_addr learned my addr 172.21.15.96:0/610660269 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f35188d7640 1 --2- 172.21.15.96:0/610660269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351415e470 0x7f35140cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f35190d8640 1 -- 172.21.15.96:0/610660269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351415e470 msgr2=0x7f35140cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f35190d8640 1 --2- 172.21.15.96:0/610660269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351415e470 0x7f35140cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f35190d8640 1 -- 172.21.15.96:0/610660269 >> v1:172.21.15.96:6789/0 conn(0x7f35140cc480 legacy=0x7f351406e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.176+0000 7f35190d8640 1 -- 172.21.15.96:0/610660269 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35140ccc70 con 0x7f351406e7b0 2024-06-03T00:01:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.177+0000 7f35190d8640 1 --2- 172.21.15.96:0/610660269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351406e7b0 0x7f35140ce620 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f350c009e50 tx=0x7f350c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9393d73b4fe20c9f server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.177+0000 7f350b7fe640 1 -- 172.21.15.96:0/610660269 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c036070 con 0x7f351406e7b0 2024-06-03T00:01:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.177+0000 7f350b7fe640 1 -- 172.21.15.96:0/610660269 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350c031600 con 0x7f351406e7b0 2024-06-03T00:01:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.177+0000 7f350b7fe640 1 -- 172.21.15.96:0/610660269 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c0319d0 con 0x7f351406e7b0 2024-06-03T00:01:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.178+0000 7f351ab3b640 1 -- 172.21.15.96:0/610660269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351406e7b0 msgr2=0x7f35140ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.178+0000 7f351ab3b640 1 --2- 172.21.15.96:0/610660269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351406e7b0 0x7f35140ce620 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f350c009e50 tx=0x7f350c02a710 comp rx=0 tx=0).stop 2024-06-03T00:01:19.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.178+0000 7f351ab3b640 1 -- 172.21.15.96:0/610660269 shutdown_connections 2024-06-03T00:01:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.178+0000 7f351ab3b640 1 --2- 172.21.15.96:0/610660269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351406e7b0 0x7f35140ce620 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.178+0000 7f351ab3b640 1 --2- 172.21.15.96:0/610660269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351415e470 0x7f35140cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.178+0000 7f351ab3b640 1 -- 172.21.15.96:0/610660269 >> 172.21.15.96:0/610660269 conn(0x7f35140b1a40 msgr2=0x7f35140b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.178+0000 7f351ab3b640 1 -- 172.21.15.96:0/610660269 shutdown_connections 2024-06-03T00:01:19.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.178+0000 7f351ab3b640 1 -- 172.21.15.96:0/610660269 wait complete. 2024-06-03T00:01:19.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.179+0000 7f351ab3b640 1 Processor -- start 2024-06-03T00:01:19.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.179+0000 7f351ab3b640 1 -- start start 2024-06-03T00:01:19.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f351ab3b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351406e7b0 0x7f351409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f351ab3b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35140cc480 0x7f35140ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f351ab3b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351415e470 0x7f35141569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f351ab3b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f35140cd510 con 0x7f351406e7b0 2024-06-03T00:01:19.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f351ab3b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f35140cd230 con 0x7f35140cc480 2024-06-03T00:01:19.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f351ab3b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f35140cb8b0 con 0x7f351415e470 2024-06-03T00:01:19.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f35188d7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351406e7b0 0x7f351409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f35188d7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351406e7b0 0x7f351409aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51500/0 (socket says 172.21.15.96:51500) 2024-06-03T00:01:19.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f35188d7640 1 -- 172.21.15.96:0/3765392331 learned_addr learned my addr 172.21.15.96:0/3765392331 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:19.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f35188d7640 1 -- 172.21.15.96:0/3765392331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351415e470 msgr2=0x7f35141569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f35188d7640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f351415e470 0x7f35141569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f35188d7640 1 -- 172.21.15.96:0/3765392331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35140cc480 msgr2=0x7f35140ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f35188d7640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35140cc480 0x7f35140ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f35188d7640 1 -- 172.21.15.96:0/3765392331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35140b1770 con 0x7f351406e7b0 2024-06-03T00:01:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f35188d7640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351406e7b0 0x7f351409aa60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f351000c820 tx=0x7f351000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.180+0000 7f35097fa640 1 -- 172.21.15.96:0/3765392331 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3510015070 con 0x7f351406e7b0 2024-06-03T00:01:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.181+0000 7f35097fa640 1 -- 172.21.15.96:0/3765392331 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3510004020 con 0x7f351406e7b0 2024-06-03T00:01:19.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.181+0000 7f35097fa640 1 -- 172.21.15.96:0/3765392331 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35100043f0 con 0x7f351406e7b0 2024-06-03T00:01:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.181+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351409b0f0 con 0x7f351406e7b0 2024-06-03T00:01:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.181+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f351409b6b0 con 0x7f351406e7b0 2024-06-03T00:01:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.181+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f35140cbc80 con 0x7f351406e7b0 2024-06-03T00:01:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.182+0000 7f35097fa640 1 -- 172.21.15.96:0/3765392331 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f3510007830 con 0x7f351406e7b0 2024-06-03T00:01:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.182+0000 7f35097fa640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f350006be30 0x7f350006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.182+0000 7f35097fa640 1 -- 172.21.15.96:0/3765392331 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f351008ad50 con 0x7f351406e7b0 2024-06-03T00:01:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.182+0000 7f350bfff640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f350006be30 0x7f350006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.183+0000 7f35097fa640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] conn(0x7f3500074760 0x7f3500076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.183+0000 7f35097fa640 1 -- 172.21.15.96:0/3765392331 --> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f351001be50 con 0x7f3500074760 2024-06-03T00:01:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.183+0000 7f35097fa640 1 -- 172.21.15.96:0/3765392331 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f351008d450 con 0x7f351406e7b0 2024-06-03T00:01:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.183+0000 7f35190d8640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] conn(0x7f3500074760 0x7f3500076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.183+0000 7f350bfff640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f350006be30 0x7f350006e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f35140af070 tx=0x7f3504007950 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.183+0000 7f35190d8640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] conn(0x7f3500074760 0x7f3500076be0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.184+0000 7f35097fa640 1 -- 172.21.15.96:0/3765392331 <== osd.4 v2:172.21.15.162:6816/3130662630 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f351001be50 con 0x7f3500074760 2024-06-03T00:01:19.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.197+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 --> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f35140683e0 con 0x7f3500074760 2024-06-03T00:01:19.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.197+0000 7f35097fa640 1 -- 172.21.15.96:0/3765392331 <== osd.4 v2:172.21.15.162:6816/3130662630 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f35140683e0 con 0x7f3500074760 2024-06-03T00:01:19.198 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-03T00:01:19.198 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-03T00:01:19.198 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-03T00:01:19.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 >> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] conn(0x7f3500074760 msgr2=0x7f3500076be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f351ab3b640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.162:6816/3130662630,v1:172.21.15.162:6817/3130662630] conn(0x7f3500074760 0x7f3500076be0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f350006be30 msgr2=0x7f350006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f351ab3b640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f350006be30 0x7f350006e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f35140af070 tx=0x7f3504007950 comp rx=0 tx=0).stop 2024-06-03T00:01:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351406e7b0 msgr2=0x7f351409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f351ab3b640 1 --2- 172.21.15.96:0/3765392331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f351406e7b0 0x7f351409aa60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f351000c820 tx=0x7f351000cce0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f35190d8640 1 -- 172.21.15.96:0/3765392331 reap_dead start 2024-06-03T00:01:19.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 shutdown_connections 2024-06-03T00:01:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 >> 172.21.15.96:0/3765392331 conn(0x7f35140b1a40 msgr2=0x7f35140b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 shutdown_connections 2024-06-03T00:01:19.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.198+0000 7f351ab3b640 1 -- 172.21.15.96:0/3765392331 wait complete. 2024-06-03T00:01:19.209 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-06-03T00:01:19.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.309+0000 7f5d7089e640 1 Processor -- start 2024-06-03T00:01:19.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.310+0000 7f5d7089e640 1 -- start start 2024-06-03T00:01:19.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.310+0000 7f5d7089e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d6c161900 0x7f5d6c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.310+0000 7f5d7089e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 0x7f5d6c0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.310+0000 7f5d7089e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d6c0d4a90 con 0x7f5d6c0b4fa0 2024-06-03T00:01:19.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.310+0000 7f5d7089e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5d6c0cf5c0 con 0x7f5d6c161900 2024-06-03T00:01:19.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.310+0000 7f5d7089e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6c0caf70 con 0x7f5d6c0b5510 2024-06-03T00:01:19.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.311+0000 7f5d6a59c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d6c161900 0x7f5d6c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.311+0000 7f5d69d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 0x7f5d6c0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.311+0000 7f5d6a59c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d6c161900 0x7f5d6c0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.96:44276/0 (socket says 172.21.15.96:44276) 2024-06-03T00:01:19.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.311+0000 7f5d6a59c640 1 -- 172.21.15.96:0/1572568781 learned_addr learned my addr 172.21.15.96:0/1572568781 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:19.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.311+0000 7f5d69d9b640 1 -- 172.21.15.96:0/1572568781 >> v2:172.21.15.162:3300/0 conn(0x7f5d6c161900 msgr2=0x7f5d6c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.311+0000 7f5d69d9b640 1 --2- 172.21.15.96:0/1572568781 >> v2:172.21.15.162:3300/0 conn(0x7f5d6c161900 0x7f5d6c0d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.311+0000 7f5d69d9b640 1 -- 172.21.15.96:0/1572568781 >> v1:172.21.15.162:6789/0 conn(0x7f5d6c0b4fa0 legacy=0x7f5d6c0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.311+0000 7f5d69d9b640 1 -- 172.21.15.96:0/1572568781 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6c0d4d70 con 0x7f5d6c0b5510 2024-06-03T00:01:19.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.311+0000 7f5d6a59c640 1 --2- 172.21.15.96:0/1572568781 >> v2:172.21.15.162:3300/0 conn(0x7f5d6c161900 0x7f5d6c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-03T00:01:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.312+0000 7f5d69d9b640 1 --2- 172.21.15.96:0/1572568781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 0x7f5d6c0d0f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0097a0 tx=0x7f5d5c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abf409301540f572 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.312+0000 7f5d6959a640 1 -- 172.21.15.96:0/1572568781 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c037070 con 0x7f5d6c0b5510 2024-06-03T00:01:19.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.312+0000 7f5d6959a640 1 -- 172.21.15.96:0/1572568781 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d5c02ae50 con 0x7f5d6c0b5510 2024-06-03T00:01:19.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.312+0000 7f5d6959a640 1 -- 172.21.15.96:0/1572568781 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c032660 con 0x7f5d6c0b5510 2024-06-03T00:01:19.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.313+0000 7f5d7089e640 1 -- 172.21.15.96:0/1572568781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 msgr2=0x7f5d6c0d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.313+0000 7f5d7089e640 1 --2- 172.21.15.96:0/1572568781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 0x7f5d6c0d0f50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0097a0 tx=0x7f5d5c02a100 comp rx=0 tx=0).stop 2024-06-03T00:01:19.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.313+0000 7f5d7089e640 1 -- 172.21.15.96:0/1572568781 shutdown_connections 2024-06-03T00:01:19.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.313+0000 7f5d7089e640 1 --2- 172.21.15.96:0/1572568781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 0x7f5d6c0d0f50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.318 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.313+0000 7f5d7089e640 1 --2- 172.21.15.96:0/1572568781 >> v2:172.21.15.162:3300/0 conn(0x7f5d6c161900 0x7f5d6c0d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.313+0000 7f5d7089e640 1 -- 172.21.15.96:0/1572568781 >> 172.21.15.96:0/1572568781 conn(0x7f5d6c09d3b0 msgr2=0x7f5d6c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.313+0000 7f5d7089e640 1 -- 172.21.15.96:0/1572568781 shutdown_connections 2024-06-03T00:01:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.313+0000 7f5d7089e640 1 -- 172.21.15.96:0/1572568781 wait complete. 2024-06-03T00:01:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.314+0000 7f5d7089e640 1 Processor -- start 2024-06-03T00:01:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.314+0000 7f5d7089e640 1 -- start start 2024-06-03T00:01:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d7089e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d6c0b4fa0 0x7f5d6c14a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d7089e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 0x7f5d6c0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d7089e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6c161900 0x7f5d6c0b7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d7089e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c0d4780 con 0x7f5d6c161900 2024-06-03T00:01:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d7089e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6c0cfae0 con 0x7f5d6c0b4fa0 2024-06-03T00:01:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d7089e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6c161ce0 con 0x7f5d6c0b5510 2024-06-03T00:01:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d6ad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6c161900 0x7f5d6c0b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d6ad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6c161900 0x7f5d6c0b7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51502/0 (socket says 172.21.15.96:51502) 2024-06-03T00:01:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d6ad9d640 1 -- 172.21.15.96:0/326671766 learned_addr learned my addr 172.21.15.96:0/326671766 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d69d9b640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 0x7f5d6c0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d6a59c640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d6c0b4fa0 0x7f5d6c14a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d6ad9d640 1 -- 172.21.15.96:0/326671766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 msgr2=0x7f5d6c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.315+0000 7f5d6ad9d640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 0x7f5d6c0cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.316+0000 7f5d6ad9d640 1 -- 172.21.15.96:0/326671766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d6c0b4fa0 msgr2=0x7f5d6c14a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.316+0000 7f5d6ad9d640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d6c0b4fa0 0x7f5d6c14a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.316+0000 7f5d6ad9d640 1 -- 172.21.15.96:0/326671766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6c156ea0 con 0x7f5d6c161900 2024-06-03T00:01:19.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.316+0000 7f5d69d9b640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 0x7f5d6c0cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:19.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.316+0000 7f5d6ad9d640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6c161900 0x7f5d6c0b7740 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400c7a0 tx=0x7f5d6400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.316+0000 7f5d62ffd640 1 -- 172.21.15.96:0/326671766 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64003b70 con 0x7f5d6c161900 2024-06-03T00:01:19.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.316+0000 7f5d62ffd640 1 -- 172.21.15.96:0/326671766 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d64003d30 con 0x7f5d6c161900 2024-06-03T00:01:19.321 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.316+0000 7f5d7089e640 1 -- 172.21.15.96:0/326671766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d6c157180 con 0x7f5d6c161900 2024-06-03T00:01:19.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.316+0000 7f5d62ffd640 1 -- 172.21.15.96:0/326671766 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400aa90 con 0x7f5d6c161900 2024-06-03T00:01:19.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.316+0000 7f5d7089e640 1 -- 172.21.15.96:0/326671766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d6c147710 con 0x7f5d6c161900 2024-06-03T00:01:19.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.317+0000 7f5d7089e640 1 -- 172.21.15.96:0/326671766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d6c1479a0 con 0x7f5d6c161900 2024-06-03T00:01:19.322 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.317+0000 7f5d62ffd640 1 -- 172.21.15.96:0/326671766 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f5d6400ac30 con 0x7f5d6c161900 2024-06-03T00:01:19.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.318+0000 7f5d62ffd640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.318+0000 7f5d62ffd640 1 -- 172.21.15.96:0/326671766 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f5d6408ae90 con 0x7f5d6c161900 2024-06-03T00:01:19.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.318+0000 7f5d6a59c640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.318+0000 7f5d6a59c640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009ac0 tx=0x7f5d54008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.323 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.322+0000 7f5d62ffd640 1 -- 172.21.15.96:0/326671766 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5d64059710 con 0x7f5d6c161900 2024-06-03T00:01:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.495+0000 7f5d7089e640 1 -- 172.21.15.96:0/326671766 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5d6c0683e0 con 0x7f5d4c06be30 2024-06-03T00:01:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.495+0000 7f5d62ffd640 1 -- 172.21.15.96:0/326671766 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5d6c0683e0 con 0x7f5d4c06be30 2024-06-03T00:01:19.496 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 4 to deep-scrub 2024-06-03T00:01:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 -- 172.21.15.96:0/326671766 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5d4c06be30 msgr2=0x7f5d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009ac0 tx=0x7f5d54008040 comp rx=0 tx=0).stop 2024-06-03T00:01:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 -- 172.21.15.96:0/326671766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6c161900 msgr2=0x7f5d6c0b7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6c161900 0x7f5d6c0b7740 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400c7a0 tx=0x7f5d6400cc60 comp rx=0 tx=0).stop 2024-06-03T00:01:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 -- 172.21.15.96:0/326671766 shutdown_connections 2024-06-03T00:01:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5d4c06be30 0x7f5d4c06e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5d6c161900 0x7f5d6c0b7740 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d6c0b5510 0x7f5d6c0cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 --2- 172.21.15.96:0/326671766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d6c0b4fa0 0x7f5d6c14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 -- 172.21.15.96:0/326671766 >> 172.21.15.96:0/326671766 conn(0x7f5d6c09d3b0 msgr2=0x7f5d6c06cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 -- 172.21.15.96:0/326671766 shutdown_connections 2024-06-03T00:01:19.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.497+0000 7f5d7089e640 1 -- 172.21.15.96:0/326671766 wait complete. 2024-06-03T00:01:19.509 INFO:tasks.ceph:Scrubbing osd.5 2024-06-03T00:01:19.509 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-06-03T00:01:19.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.613+0000 7f517e8bd640 1 Processor -- start 2024-06-03T00:01:19.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.613+0000 7f517e8bd640 1 -- start start 2024-06-03T00:01:19.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.613+0000 7f517e8bd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51780d2db0 0x7f517815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.613+0000 7f517e8bd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51780d17f0 con 0x7f51780c9450 2024-06-03T00:01:19.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.613+0000 7f517e8bd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51780cfa70 con 0x7f517815e1d0 2024-06-03T00:01:19.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.613+0000 7f517e8bd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f51780d0030 con 0x7f51780d2db0 2024-06-03T00:01:19.616 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f516ffff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f51780c9450 0x7f51780d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:40998/0 (socket says 172.21.15.96:40998) 2024-06-03T00:01:19.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f516ffff640 1 -- 172.21.15.96:0/3406354711 learned_addr learned my addr 172.21.15.96:0/3406354711 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-03T00:01:19.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f517ce5a640 1 --2- 172.21.15.96:0/3406354711 >> v2:172.21.15.162:3300/0 conn(0x7f51780d2db0 0x7f517815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691927268 0 0) 0x7f51780d17f0 con 0x7f51780c9450 2024-06-03T00:01:19.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5164003520 con 0x7f51780c9450 2024-06-03T00:01:19.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3278772374 0 0) 0x7f5164003520 con 0x7f51780c9450 2024-06-03T00:01:19.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 >> v2:172.21.15.162:3300/0 conn(0x7f51780d2db0 msgr2=0x7f517815e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 --2- 172.21.15.96:0/3406354711 >> v2:172.21.15.162:3300/0 conn(0x7f51780d2db0 0x7f517815e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 >> v1:172.21.15.162:6789/0 conn(0x7f517815e1d0 legacy=0x7f51780d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.617 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51780cfd50 con 0x7f51780c9450 2024-06-03T00:01:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f5160001670 con 0x7f51780c9450 2024-06-03T00:01:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 >> v1:172.21.15.96:6789/0 conn(0x7f51780c9450 legacy=0x7f51780d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51640039b0 0x7f5164003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5164004800 0x7f5164004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51640051c0 0x7f516400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f51780d0030 con 0x7f51640039b0 2024-06-03T00:01:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f516400c160 con 0x7f5164004800 2024-06-03T00:01:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f516400c360 con 0x7f51640051c0 2024-06-03T00:01:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f5177fff640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51640039b0 0x7f5164003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f516ffff640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5164004800 0x7f5164004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.614+0000 7f517ce5a640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51640051c0 0x7f516400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.615+0000 7f5177fff640 1 -- 172.21.15.96:0/3406354711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51640051c0 msgr2=0x7f516400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.615+0000 7f5177fff640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51640051c0 0x7f516400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.615+0000 7f5177fff640 1 -- 172.21.15.96:0/3406354711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5164004800 msgr2=0x7f5164004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.615+0000 7f5177fff640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5164004800 0x7f5164004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.615+0000 7f5177fff640 1 -- 172.21.15.96:0/3406354711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5164003520 con 0x7f51640039b0 2024-06-03T00:01:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.615+0000 7f517ce5a640 1 -- 172.21.15.96:0/3406354711 reap_dead start 2024-06-03T00:01:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.615+0000 7f5177fff640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51640039b0 0x7f5164003dd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5168001750 tx=0x7f5164005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b63177e5fab4648 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.615+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168001370 con 0x7f51640039b0 2024-06-03T00:01:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.615+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51680052d0 con 0x7f51640039b0 2024-06-03T00:01:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.615+0000 7f51777fe640 1 -- 172.21.15.96:0/3406354711 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516802abe0 con 0x7f51640039b0 2024-06-03T00:01:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.616+0000 7f517e8bd640 1 -- 172.21.15.96:0/3406354711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51640039b0 msgr2=0x7f5164003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.616+0000 7f517e8bd640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51640039b0 0x7f5164003dd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5168001750 tx=0x7f5164005830 comp rx=0 tx=0).stop 2024-06-03T00:01:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.616+0000 7f517e8bd640 1 -- 172.21.15.96:0/3406354711 shutdown_connections 2024-06-03T00:01:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.616+0000 7f517e8bd640 1 --2- 172.21.15.96:0/3406354711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51640039b0 0x7f5164003dd0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.616+0000 7f517e8bd640 1 -- 172.21.15.96:0/3406354711 >> 172.21.15.96:0/3406354711 conn(0x7f51780d3fc0 msgr2=0x7f51780d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.616+0000 7f517e8bd640 1 -- 172.21.15.96:0/3406354711 shutdown_connections 2024-06-03T00:01:19.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.616+0000 7f517e8bd640 1 -- 172.21.15.96:0/3406354711 wait complete. 2024-06-03T00:01:19.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.617+0000 7f517e8bd640 1 Processor -- start 2024-06-03T00:01:19.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.617+0000 7f517e8bd640 1 -- start start 2024-06-03T00:01:19.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f517e8bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51640039b0 0x7f517815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f517e8bd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51780a0a40 0x7f51780a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f517e8bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51780b8bd0 0x7f51780b9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f517e8bd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f517815e5b0 con 0x7f51780a0a40 2024-06-03T00:01:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f517e8bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51780cf720 con 0x7f51780b8bd0 2024-06-03T00:01:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f517e8bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f517815e730 con 0x7f51640039b0 2024-06-03T00:01:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f516ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51780a0a40 0x7f51780a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f516ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51780a0a40 0x7f51780a0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51520/0 (socket says 172.21.15.96:51520) 2024-06-03T00:01:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f516ffff640 1 -- 172.21.15.96:0/2871722048 learned_addr learned my addr 172.21.15.96:0/2871722048 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f5177fff640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51640039b0 0x7f517815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f517ce5a640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51780b8bd0 0x7f51780b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f516ffff640 1 -- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51640039b0 msgr2=0x7f517815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f516ffff640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51640039b0 0x7f517815c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f516ffff640 1 -- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51780b8bd0 msgr2=0x7f51780b9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f516ffff640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51780b8bd0 0x7f51780b9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f516ffff640 1 -- 172.21.15.96:0/2871722048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517809e080 con 0x7f51780a0a40 2024-06-03T00:01:19.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.618+0000 7f516ffff640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51780a0a40 0x7f51780a0ec0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5160004ec0 tx=0x7f5160007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.619+0000 7f51757fa640 1 -- 172.21.15.96:0/2871722048 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516000f730 con 0x7f51780a0a40 2024-06-03T00:01:19.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.619+0000 7f51757fa640 1 -- 172.21.15.96:0/2871722048 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5160018070 con 0x7f51780a0a40 2024-06-03T00:01:19.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.619+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517809e360 con 0x7f51780a0a40 2024-06-03T00:01:19.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.619+0000 7f51757fa640 1 -- 172.21.15.96:0/2871722048 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516000fb50 con 0x7f51780a0a40 2024-06-03T00:01:19.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.619+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f517809e920 con 0x7f51780a0a40 2024-06-03T00:01:19.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.620+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51780683e0 con 0x7f51780a0a40 2024-06-03T00:01:19.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.620+0000 7f51757fa640 1 -- 172.21.15.96:0/2871722048 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f516000fcf0 con 0x7f51780a0a40 2024-06-03T00:01:19.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.620+0000 7f51757fa640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f515806be30 0x7f515806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.620+0000 7f51757fa640 1 -- 172.21.15.96:0/2871722048 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f516008ae90 con 0x7f51780a0a40 2024-06-03T00:01:19.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.621+0000 7f5177fff640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f515806be30 0x7f515806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.621+0000 7f51757fa640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] conn(0x7f5158074750 0x7f5158076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.621+0000 7f51757fa640 1 -- 172.21.15.96:0/2871722048 --> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51580772a0 con 0x7f5158074750 2024-06-03T00:01:19.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.621+0000 7f51757fa640 1 -- 172.21.15.96:0/2871722048 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f516008d590 con 0x7f51780a0a40 2024-06-03T00:01:19.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.621+0000 7f5177fff640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f515806be30 0x7f515806e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5168032000 tx=0x7f516802e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.621+0000 7f517ce5a640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] conn(0x7f5158074750 0x7f5158076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.621+0000 7f517ce5a640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] conn(0x7f5158074750 0x7f5158076bd0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.622+0000 7f51757fa640 1 -- 172.21.15.96:0/2871722048 <== osd.5 v2:172.21.15.162:6807/2259495148 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f51580772a0 con 0x7f5158074750 2024-06-03T00:01:19.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.635+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 --> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f517809dca0 con 0x7f5158074750 2024-06-03T00:01:19.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f51757fa640 1 -- 172.21.15.96:0/2871722048 <== osd.5 v2:172.21.15.162:6807/2259495148 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f517809dca0 con 0x7f5158074750 2024-06-03T00:01:19.636 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-03T00:01:19.636 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-03T00:01:19.637 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-03T00:01:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] conn(0x7f5158074750 msgr2=0x7f5158076bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517e8bd640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.162:6807/2259495148,v1:172.21.15.162:6809/2259495148] conn(0x7f5158074750 0x7f5158076bd0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f515806be30 msgr2=0x7f515806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517e8bd640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f515806be30 0x7f515806e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5168032000 tx=0x7f516802e000 comp rx=0 tx=0).stop 2024-06-03T00:01:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51780a0a40 msgr2=0x7f51780a0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517e8bd640 1 --2- 172.21.15.96:0/2871722048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f51780a0a40 0x7f51780a0ec0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5160004ec0 tx=0x7f5160007430 comp rx=0 tx=0).stop 2024-06-03T00:01:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517ce5a640 1 -- 172.21.15.96:0/2871722048 reap_dead start 2024-06-03T00:01:19.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 shutdown_connections 2024-06-03T00:01:19.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 >> 172.21.15.96:0/2871722048 conn(0x7f51780d3fc0 msgr2=0x7f517806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 shutdown_connections 2024-06-03T00:01:19.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.636+0000 7f517e8bd640 1 -- 172.21.15.96:0/2871722048 wait complete. 2024-06-03T00:01:19.647 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-06-03T00:01:19.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.747+0000 7f7ff698b640 1 Processor -- start 2024-06-03T00:01:19.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.747+0000 7f7ff698b640 1 -- start start 2024-06-03T00:01:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff698b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7ff0161900 0x7f7ff00d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff698b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7ff00b4fa0 0x7f7ff00d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff698b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff00d4a90 con 0x7f7ff00b5510 2024-06-03T00:01:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff698b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff00cf5c0 con 0x7f7ff00b4fa0 2024-06-03T00:01:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff698b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff00caf70 con 0x7f7ff0161900 2024-06-03T00:01:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff4f28640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7ff00b4fa0 0x7f7ff00d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff4f28640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7ff00b4fa0 0x7f7ff00d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51530/0 (socket says 172.21.15.96:51530) 2024-06-03T00:01:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff4f28640 1 -- 172.21.15.96:0/2915028410 learned_addr learned my addr 172.21.15.96:0/2915028410 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7feffff640 1 --2- 172.21.15.96:0/2915028410 >> v2:172.21.15.162:3300/0 conn(0x7f7ff0161900 0x7f7ff00d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff4f28640 1 -- 172.21.15.96:0/2915028410 >> v2:172.21.15.162:3300/0 conn(0x7f7ff0161900 msgr2=0x7f7ff00d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff4f28640 1 --2- 172.21.15.96:0/2915028410 >> v2:172.21.15.162:3300/0 conn(0x7f7ff0161900 0x7f7ff00d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff4f28640 1 -- 172.21.15.96:0/2915028410 >> v1:172.21.15.162:6789/0 conn(0x7f7ff00b5510 legacy=0x7f7ff00d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.748+0000 7f7ff4f28640 1 -- 172.21.15.96:0/2915028410 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff00d4d70 con 0x7f7ff00b4fa0 2024-06-03T00:01:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.749+0000 7f7ff4f28640 1 --2- 172.21.15.96:0/2915028410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b4fa0 0x7f7ff00d0f50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00d1740 tx=0x7f7fe802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a923c91e34484b3 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.749+0000 7f7fef7fe640 1 -- 172.21.15.96:0/2915028410 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8036070 con 0x7f7ff00b4fa0 2024-06-03T00:01:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.749+0000 7f7fef7fe640 1 -- 172.21.15.96:0/2915028410 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe8031600 con 0x7f7ff00b4fa0 2024-06-03T00:01:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.749+0000 7f7fef7fe640 1 -- 172.21.15.96:0/2915028410 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80319d0 con 0x7f7ff00b4fa0 2024-06-03T00:01:19.753 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.749+0000 7f7ff698b640 1 -- 172.21.15.96:0/2915028410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b4fa0 msgr2=0x7f7ff00d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.749+0000 7f7ff698b640 1 --2- 172.21.15.96:0/2915028410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b4fa0 0x7f7ff00d0f50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00d1740 tx=0x7f7fe802a6a0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.750+0000 7f7ff698b640 1 -- 172.21.15.96:0/2915028410 shutdown_connections 2024-06-03T00:01:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.750+0000 7f7ff698b640 1 --2- 172.21.15.96:0/2915028410 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b4fa0 0x7f7ff00d0f50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.750+0000 7f7ff698b640 1 --2- 172.21.15.96:0/2915028410 >> v2:172.21.15.162:3300/0 conn(0x7f7ff0161900 0x7f7ff00d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.750+0000 7f7ff698b640 1 -- 172.21.15.96:0/2915028410 >> 172.21.15.96:0/2915028410 conn(0x7f7ff009d3b0 msgr2=0x7f7ff00d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.750+0000 7f7ff698b640 1 -- 172.21.15.96:0/2915028410 shutdown_connections 2024-06-03T00:01:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.750+0000 7f7ff698b640 1 -- 172.21.15.96:0/2915028410 wait complete. 2024-06-03T00:01:19.754 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.751+0000 7f7ff698b640 1 Processor -- start 2024-06-03T00:01:19.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.751+0000 7f7ff698b640 1 -- start start 2024-06-03T00:01:19.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.751+0000 7f7ff698b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ff00b4fa0 0x7f7ff0159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.751+0000 7f7ff698b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b5510 0x7f7ff00b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.751+0000 7f7ff698b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ff0161900 0x7f7ff014c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.751+0000 7f7ff698b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff00d4780 con 0x7f7ff00b5510 2024-06-03T00:01:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.751+0000 7f7ff698b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff00cfae0 con 0x7f7ff0161900 2024-06-03T00:01:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.751+0000 7f7ff698b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff0161ce0 con 0x7f7ff00b4fa0 2024-06-03T00:01:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fe7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b5510 0x7f7ff00b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fe7fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b5510 0x7f7ff00b97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51532/0 (socket says 172.21.15.96:51532) 2024-06-03T00:01:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fe7fff640 1 -- 172.21.15.96:0/3032447678 learned_addr learned my addr 172.21.15.96:0/3032447678 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7feffff640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ff00b4fa0 0x7f7ff0159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7ff4f28640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ff0161900 0x7f7ff014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fe7fff640 1 -- 172.21.15.96:0/3032447678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ff00b4fa0 msgr2=0x7f7ff0159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fe7fff640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ff00b4fa0 0x7f7ff0159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fe7fff640 1 -- 172.21.15.96:0/3032447678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ff0161900 msgr2=0x7f7ff014c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fe7fff640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ff0161900 0x7f7ff014c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fe7fff640 1 -- 172.21.15.96:0/3032447678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff00b6de0 con 0x7f7ff00b5510 2024-06-03T00:01:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fe7fff640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b5510 0x7f7ff00b97f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800c400 tx=0x7f7fd800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fed7fa640 1 -- 172.21.15.96:0/3032447678 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd80052d0 con 0x7f7ff00b5510 2024-06-03T00:01:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fed7fa640 1 -- 172.21.15.96:0/3032447678 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd8005490 con 0x7f7ff00b5510 2024-06-03T00:01:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7ff698b640 1 -- 172.21.15.96:0/3032447678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff00b70c0 con 0x7f7ff00b5510 2024-06-03T00:01:19.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7fed7fa640 1 -- 172.21.15.96:0/3032447678 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8007260 con 0x7f7ff00b5510 2024-06-03T00:01:19.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.752+0000 7f7ff698b640 1 -- 172.21.15.96:0/3032447678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff00b9d30 con 0x7f7ff00b5510 2024-06-03T00:01:19.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.753+0000 7f7ff698b640 1 -- 172.21.15.96:0/3032447678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff00683e0 con 0x7f7ff00b5510 2024-06-03T00:01:19.758 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.754+0000 7f7fed7fa640 1 -- 172.21.15.96:0/3032447678 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f7fd8007400 con 0x7f7ff00b5510 2024-06-03T00:01:19.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.754+0000 7f7fed7fa640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7fd006be30 0x7f7fd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:19.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.754+0000 7f7feffff640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7fd006be30 0x7f7fd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:19.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.754+0000 7f7fed7fa640 1 -- 172.21.15.96:0/3032447678 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f7fd808a4b0 con 0x7f7ff00b5510 2024-06-03T00:01:19.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.754+0000 7f7feffff640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7fd006be30 0x7f7fd006e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00079a0 tx=0x7f7fe0008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:19.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.758+0000 7f7fed7fa640 1 -- 172.21.15.96:0/3032447678 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f7fd8058650 con 0x7f7ff00b5510 2024-06-03T00:01:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.933+0000 7f7ff698b640 1 -- 172.21.15.96:0/3032447678 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f7ff00d05e0 con 0x7f7fd006be30 2024-06-03T00:01:19.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.933+0000 7f7fed7fa640 1 -- 172.21.15.96:0/3032447678 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7ff00d05e0 con 0x7f7fd006be30 2024-06-03T00:01:19.934 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 5 to deep-scrub 2024-06-03T00:01:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 -- 172.21.15.96:0/3032447678 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7fd006be30 msgr2=0x7f7fd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7fd006be30 0x7f7fd006e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00079a0 tx=0x7f7fe0008040 comp rx=0 tx=0).stop 2024-06-03T00:01:19.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 -- 172.21.15.96:0/3032447678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b5510 msgr2=0x7f7ff00b97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b5510 0x7f7ff00b97f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800c400 tx=0x7f7fd800c8c0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 -- 172.21.15.96:0/3032447678 shutdown_connections 2024-06-03T00:01:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f7fd006be30 0x7f7fd006e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ff0161900 0x7f7ff014c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ff00b5510 0x7f7ff00b97f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 --2- 172.21.15.96:0/3032447678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ff00b4fa0 0x7f7ff0159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 -- 172.21.15.96:0/3032447678 >> 172.21.15.96:0/3032447678 conn(0x7f7ff009d3b0 msgr2=0x7f7ff00ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 -- 172.21.15.96:0/3032447678 shutdown_connections 2024-06-03T00:01:19.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:19.935+0000 7f7ff698b640 1 -- 172.21.15.96:0/3032447678 wait complete. 2024-06-03T00:01:19.946 INFO:tasks.ceph:Scrubbing osd.6 2024-06-03T00:01:19.946 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-06-03T00:01:20.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.049+0000 7ff778f34640 1 Processor -- start 2024-06-03T00:01:20.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.049+0000 7ff778f34640 1 -- start start 2024-06-03T00:01:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.050+0000 7ff778f34640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff7740d0a70 0x7ff7740ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.050+0000 7ff778f34640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 0x7ff7740cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.050+0000 7ff778f34640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7740d1010 con 0x7ff77415e510 2024-06-03T00:01:20.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.050+0000 7ff778f34640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff7740d12f0 con 0x7ff7740d0a70 2024-06-03T00:01:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.050+0000 7ff778f34640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7740cc480 con 0x7ff7740ccf60 2024-06-03T00:01:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.051+0000 7ff772d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 0x7ff7740cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.051+0000 7ff771d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff7740d0a70 0x7ff7740ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.051+0000 7ff772d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 0x7ff7740cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.96:48228/0 (socket says 172.21.15.96:48228) 2024-06-03T00:01:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.051+0000 7ff772d9d640 1 -- 172.21.15.96:0/1307606366 learned_addr learned my addr 172.21.15.96:0/1307606366 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.051+0000 7ff772d9d640 1 -- 172.21.15.96:0/1307606366 >> v2:172.21.15.162:3300/0 conn(0x7ff7740d0a70 msgr2=0x7ff7740ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.051+0000 7ff772d9d640 1 --2- 172.21.15.96:0/1307606366 >> v2:172.21.15.162:3300/0 conn(0x7ff7740d0a70 0x7ff7740ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.051+0000 7ff772d9d640 1 -- 172.21.15.96:0/1307606366 >> v1:172.21.15.162:6789/0 conn(0x7ff77415e510 legacy=0x7ff7740ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.051+0000 7ff772d9d640 1 -- 172.21.15.96:0/1307606366 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7740cc760 con 0x7ff7740ccf60 2024-06-03T00:01:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.052+0000 7ff772d9d640 1 --2- 172.21.15.96:0/1307606366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 0x7ff7740cd3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009870 tx=0x7ff76c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34d9396def2e9d4e server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.052+0000 7ff77159a640 1 -- 172.21.15.96:0/1307606366 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c037070 con 0x7ff7740ccf60 2024-06-03T00:01:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.052+0000 7ff77159a640 1 -- 172.21.15.96:0/1307606366 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76c032440 con 0x7ff7740ccf60 2024-06-03T00:01:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.052+0000 7ff77159a640 1 -- 172.21.15.96:0/1307606366 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c032810 con 0x7ff7740ccf60 2024-06-03T00:01:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.053+0000 7ff778f34640 1 -- 172.21.15.96:0/1307606366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 msgr2=0x7ff7740cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.053+0000 7ff778f34640 1 --2- 172.21.15.96:0/1307606366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 0x7ff7740cd3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009870 tx=0x7ff76c02a270 comp rx=0 tx=0).stop 2024-06-03T00:01:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.053+0000 7ff778f34640 1 -- 172.21.15.96:0/1307606366 shutdown_connections 2024-06-03T00:01:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.053+0000 7ff778f34640 1 --2- 172.21.15.96:0/1307606366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 0x7ff7740cd3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.053+0000 7ff778f34640 1 --2- 172.21.15.96:0/1307606366 >> v2:172.21.15.162:3300/0 conn(0x7ff7740d0a70 0x7ff7740ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.053+0000 7ff778f34640 1 -- 172.21.15.96:0/1307606366 >> 172.21.15.96:0/1307606366 conn(0x7ff7740d1d90 msgr2=0x7ff7740d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.053+0000 7ff778f34640 1 -- 172.21.15.96:0/1307606366 shutdown_connections 2024-06-03T00:01:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.053+0000 7ff778f34640 1 -- 172.21.15.96:0/1307606366 wait complete. 2024-06-03T00:01:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.054+0000 7ff778f34640 1 Processor -- start 2024-06-03T00:01:20.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.054+0000 7ff778f34640 1 -- start start 2024-06-03T00:01:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff778f34640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 0x7ff7741f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff778f34640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7740d0a70 0x7ff7740b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff778f34640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff77415e510 0x7ff7740cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff778f34640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7ff7740cf260 con 0x7ff7740d0a70 2024-06-03T00:01:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff778f34640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7740703f0 con 0x7ff77415e510 2024-06-03T00:01:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff778f34640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7740cf3e0 con 0x7ff7740ccf60 2024-06-03T00:01:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff771d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7740d0a70 0x7ff7740b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff771d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7740d0a70 0x7ff7740b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51534/0 (socket says 172.21.15.96:51534) 2024-06-03T00:01:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff771d9b640 1 -- 172.21.15.96:0/1519731088 learned_addr learned my addr 172.21.15.96:0/1519731088 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:20.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff77259c640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 0x7ff7741f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff772d9d640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff77415e510 0x7ff7740cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff771d9b640 1 -- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 msgr2=0x7ff7741f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff771d9b640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7740ccf60 0x7ff7741f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff771d9b640 1 -- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff77415e510 msgr2=0x7ff7740cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff771d9b640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff77415e510 0x7ff7740cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff771d9b640 1 -- 172.21.15.96:0/1519731088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7740b6630 con 0x7ff7740d0a70 2024-06-03T00:01:20.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.055+0000 7ff772d9d640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff77415e510 0x7ff7740cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.056+0000 7ff771d9b640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7740d0a70 0x7ff7740b53f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e8a0 tx=0x7ff75c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.056+0000 7ff76affd640 1 -- 172.21.15.96:0/1519731088 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c017070 con 0x7ff7740d0a70 2024-06-03T00:01:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.056+0000 7ff76affd640 1 -- 172.21.15.96:0/1519731088 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c00c940 con 0x7ff7740d0a70 2024-06-03T00:01:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.056+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7740c9bc0 con 0x7ff7740d0a70 2024-06-03T00:01:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.056+0000 7ff76affd640 1 -- 172.21.15.96:0/1519731088 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00cd30 con 0x7ff7740d0a70 2024-06-03T00:01:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.056+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7740b6b90 con 0x7ff7740d0a70 2024-06-03T00:01:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.056+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7740b6f70 con 0x7ff7740d0a70 2024-06-03T00:01:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.057+0000 7ff76affd640 1 -- 172.21.15.96:0/1519731088 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7ff75c01a070 con 0x7ff7740d0a70 2024-06-03T00:01:20.061 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.057+0000 7ff76affd640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7ff75406be30 0x7ff75406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.058+0000 7ff76affd640 1 -- 172.21.15.96:0/1519731088 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7ff75c08ae00 con 0x7ff7740d0a70 2024-06-03T00:01:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.058+0000 7ff77259c640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7ff75406be30 0x7ff75406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.058+0000 7ff76affd640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] conn(0x7ff754074760 0x7ff754076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.058+0000 7ff76affd640 1 -- 172.21.15.96:0/1519731088 --> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7540772b0 con 0x7ff754074760 2024-06-03T00:01:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.058+0000 7ff76affd640 1 -- 172.21.15.96:0/1519731088 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7ff75c08d500 con 0x7ff7740d0a70 2024-06-03T00:01:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.058+0000 7ff77259c640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7ff75406be30 0x7ff75406e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff764001ca0 tx=0x7ff764009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.058+0000 7ff772d9d640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] conn(0x7ff754074760 0x7ff754076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.058+0000 7ff772d9d640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] conn(0x7ff754074760 0x7ff754076be0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.059+0000 7ff76affd640 1 -- 172.21.15.96:0/1519731088 <== osd.6 v2:172.21.15.162:6800/1800327622 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7540772b0 con 0x7ff754074760 2024-06-03T00:01:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.072+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 --> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff7740683e0 con 0x7ff754074760 2024-06-03T00:01:20.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff76affd640 1 -- 172.21.15.96:0/1519731088 <== osd.6 v2:172.21.15.162:6800/1800327622 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff7740683e0 con 0x7ff754074760 2024-06-03T00:01:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-03T00:01:20.073 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-03T00:01:20.073 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-03T00:01:20.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] conn(0x7ff754074760 msgr2=0x7ff754076be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff778f34640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.162:6800/1800327622,v1:172.21.15.162:6801/1800327622] conn(0x7ff754074760 0x7ff754076be0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7ff75406be30 msgr2=0x7ff75406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff778f34640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7ff75406be30 0x7ff75406e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff764001ca0 tx=0x7ff764009040 comp rx=0 tx=0).stop 2024-06-03T00:01:20.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7740d0a70 msgr2=0x7ff7740b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff778f34640 1 --2- 172.21.15.96:0/1519731088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7740d0a70 0x7ff7740b53f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e8a0 tx=0x7ff75c00ed60 comp rx=0 tx=0).stop 2024-06-03T00:01:20.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff772d9d640 1 -- 172.21.15.96:0/1519731088 reap_dead start 2024-06-03T00:01:20.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 shutdown_connections 2024-06-03T00:01:20.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 >> 172.21.15.96:0/1519731088 conn(0x7ff7740d1d90 msgr2=0x7ff7740cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:20.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 shutdown_connections 2024-06-03T00:01:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.073+0000 7ff778f34640 1 -- 172.21.15.96:0/1519731088 wait complete. 2024-06-03T00:01:20.084 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-06-03T00:01:20.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.183+0000 7f85399c4640 1 Processor -- start 2024-06-03T00:01:20.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.183+0000 7f85399c4640 1 -- start start 2024-06-03T00:01:20.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.184+0000 7f85399c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8534161900 0x7f85340d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.184+0000 7f85399c4640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f85340b5510 0x7f85340d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.184+0000 7f85399c4640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85340d4a90 con 0x7f85340b4fa0 2024-06-03T00:01:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.184+0000 7f85399c4640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f85340cf5c0 con 0x7f85340b5510 2024-06-03T00:01:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.184+0000 7f85399c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f85340caf70 con 0x7f8534161900 2024-06-03T00:01:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.184+0000 7f85327fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f85340b5510 0x7f85340d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.184+0000 7f85327fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f85340b5510 0x7f85340d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51546/0 (socket says 172.21.15.96:51546) 2024-06-03T00:01:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.184+0000 7f85327fc640 1 -- 172.21.15.96:0/1041882009 learned_addr learned my addr 172.21.15.96:0/1041882009 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:20.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.184+0000 7f85337fe640 1 --1- 172.21.15.96:0/1041882009 >> v1:172.21.15.96:6789/0 conn(0x7f85340b4fa0 0x7f85340d1c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:41002/0 (socket says 172.21.15.96:41002) 2024-06-03T00:01:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f8532ffd640 1 --2- 172.21.15.96:0/1041882009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8534161900 0x7f85340d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f85327fc640 1 -- 172.21.15.96:0/1041882009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8534161900 msgr2=0x7f85340d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f85327fc640 1 --2- 172.21.15.96:0/1041882009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8534161900 0x7f85340d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f85327fc640 1 -- 172.21.15.96:0/1041882009 >> v1:172.21.15.96:6789/0 conn(0x7f85340b4fa0 legacy=0x7f85340d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f85327fc640 1 -- 172.21.15.96:0/1041882009 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85340d4d70 con 0x7f85340b5510 2024-06-03T00:01:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f8531ffb640 1 -- 172.21.15.96:0/1041882009 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275026576 0 0) 0x7f85340d4a90 con 0x7f85340b4fa0 2024-06-03T00:01:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f8532ffd640 1 --2- 172.21.15.96:0/1041882009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8534161900 0x7f85340d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:20.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f85327fc640 1 --2- 172.21.15.96:0/1041882009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85340b5510 0x7f85340d0f50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8528009870 tx=0x7f852802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597b4cd7f5f820d2 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f8531ffb640 1 -- 172.21.15.96:0/1041882009 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528037070 con 0x7f85340b5510 2024-06-03T00:01:20.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f8531ffb640 1 -- 172.21.15.96:0/1041882009 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8528032440 con 0x7f85340b5510 2024-06-03T00:01:20.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.185+0000 7f8531ffb640 1 -- 172.21.15.96:0/1041882009 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8528032810 con 0x7f85340b5510 2024-06-03T00:01:20.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.186+0000 7f85399c4640 1 -- 172.21.15.96:0/1041882009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85340b5510 msgr2=0x7f85340d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.186+0000 7f85399c4640 1 --2- 172.21.15.96:0/1041882009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85340b5510 0x7f85340d0f50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8528009870 tx=0x7f852802a1c0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.186+0000 7f85399c4640 1 -- 172.21.15.96:0/1041882009 shutdown_connections 2024-06-03T00:01:20.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.186+0000 7f85399c4640 1 --2- 172.21.15.96:0/1041882009 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f85340b5510 0x7f85340d0f50 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.186+0000 7f85399c4640 1 --2- 172.21.15.96:0/1041882009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8534161900 0x7f85340d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.186+0000 7f85399c4640 1 -- 172.21.15.96:0/1041882009 >> 172.21.15.96:0/1041882009 conn(0x7f853409d3b0 msgr2=0x7f85340d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.186+0000 7f85399c4640 1 -- 172.21.15.96:0/1041882009 shutdown_connections 2024-06-03T00:01:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.186+0000 7f85399c4640 1 -- 172.21.15.96:0/1041882009 wait complete. 2024-06-03T00:01:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.187+0000 7f85399c4640 1 Processor -- start 2024-06-03T00:01:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.187+0000 7f85399c4640 1 -- start start 2024-06-03T00:01:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.188+0000 7f85399c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85340b4fa0 0x7f85341f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.188+0000 7f85399c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85340b5510 0x7f853406d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.188+0000 7f85399c4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8534161900 0x7f853406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.188+0000 7f85399c4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f85340d4780 con 0x7f8534161900 2024-06-03T00:01:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.188+0000 7f85399c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85340cfae0 con 0x7f85340b5510 2024-06-03T00:01:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.188+0000 7f85399c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8534161ce0 con 0x7f85340b4fa0 2024-06-03T00:01:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.188+0000 7f85337fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8534161900 0x7f853406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.188+0000 7f85337fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8534161900 0x7f853406d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51554/0 (socket says 172.21.15.96:51554) 2024-06-03T00:01:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.188+0000 7f85337fe640 1 -- 172.21.15.96:0/690688505 learned_addr learned my addr 172.21.15.96:0/690688505 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f8532ffd640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85340b4fa0 0x7f85341f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f85337fe640 1 -- 172.21.15.96:0/690688505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85340b4fa0 msgr2=0x7f85341f11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f85337fe640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85340b4fa0 0x7f85341f11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f85337fe640 1 -- 172.21.15.96:0/690688505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85340b5510 msgr2=0x7f853406d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f85337fe640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85340b5510 0x7f853406d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f85337fe640 1 -- 172.21.15.96:0/690688505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85341f4210 con 0x7f8534161900 2024-06-03T00:01:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f8532ffd640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85340b4fa0 0x7f85341f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f85337fe640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8534161900 0x7f853406d5e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f852c00c7a0 tx=0x7f852c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f851bfff640 1 -- 172.21.15.96:0/690688505 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c018070 con 0x7f8534161900 2024-06-03T00:01:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f851bfff640 1 -- 172.21.15.96:0/690688505 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852c00a640 con 0x7f8534161900 2024-06-03T00:01:20.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f85399c4640 1 -- 172.21.15.96:0/690688505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85341f44f0 con 0x7f8534161900 2024-06-03T00:01:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f851bfff640 1 -- 172.21.15.96:0/690688505 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c00aab0 con 0x7f8534161900 2024-06-03T00:01:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.189+0000 7f85399c4640 1 -- 172.21.15.96:0/690688505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85341f4ab0 con 0x7f8534161900 2024-06-03T00:01:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.190+0000 7f85399c4640 1 -- 172.21.15.96:0/690688505 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85340683e0 con 0x7f8534161900 2024-06-03T00:01:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.190+0000 7f851bfff640 1 -- 172.21.15.96:0/690688505 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f852c01b070 con 0x7f8534161900 2024-06-03T00:01:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.191+0000 7f851bfff640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f852006be30 0x7f852006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.191+0000 7f851bfff640 1 -- 172.21.15.96:0/690688505 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f852c08a5d0 con 0x7f8534161900 2024-06-03T00:01:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.191+0000 7f8532ffd640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f852006be30 0x7f852006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.191+0000 7f8532ffd640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f852006be30 0x7f852006e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8524006fd0 tx=0x7f8524008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.195+0000 7f851bfff640 1 -- 172.21.15.96:0/690688505 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f852c058e50 con 0x7f8534161900 2024-06-03T00:01:20.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.368+0000 7f85399c4640 1 -- 172.21.15.96:0/690688505 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f85340d43d0 con 0x7f852006be30 2024-06-03T00:01:20.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.369+0000 7f851bfff640 1 -- 172.21.15.96:0/690688505 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f85340d43d0 con 0x7f852006be30 2024-06-03T00:01:20.369 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 6 to deep-scrub 2024-06-03T00:01:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 -- 172.21.15.96:0/690688505 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f852006be30 msgr2=0x7f852006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f852006be30 0x7f852006e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8524006fd0 tx=0x7f8524008040 comp rx=0 tx=0).stop 2024-06-03T00:01:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 -- 172.21.15.96:0/690688505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8534161900 msgr2=0x7f853406d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8534161900 0x7f853406d5e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f852c00c7a0 tx=0x7f852c00cc60 comp rx=0 tx=0).stop 2024-06-03T00:01:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 -- 172.21.15.96:0/690688505 shutdown_connections 2024-06-03T00:01:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f852006be30 0x7f852006e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8534161900 0x7f853406d5e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85340b5510 0x7f853406d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 --2- 172.21.15.96:0/690688505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85340b4fa0 0x7f85341f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 -- 172.21.15.96:0/690688505 >> 172.21.15.96:0/690688505 conn(0x7f853409d3b0 msgr2=0x7f853406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 -- 172.21.15.96:0/690688505 shutdown_connections 2024-06-03T00:01:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.371+0000 7f85399c4640 1 -- 172.21.15.96:0/690688505 wait complete. 2024-06-03T00:01:20.382 INFO:tasks.ceph:Scrubbing osd.7 2024-06-03T00:01:20.382 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-06-03T00:01:20.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.485+0000 7fda646f5640 1 Processor -- start 2024-06-03T00:01:20.485 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.485+0000 7fda646f5640 1 -- start start 2024-06-03T00:01:20.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda646f5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fda5c071240 0x7fda5c06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda646f5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fda5c0cbeb0 0x7fda5c0cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda646f5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5c145770 con 0x7fda5c145390 2024-06-03T00:01:20.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda646f5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7fda5c0ca3c0 con 0x7fda5c0cbeb0 2024-06-03T00:01:20.487 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda646f5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fda5c0ca660 con 0x7fda5c071240 2024-06-03T00:01:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda62c92640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fda5c0cbeb0 0x7fda5c0cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda62c92640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fda5c0cbeb0 0x7fda5c0cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51566/0 (socket says 172.21.15.96:51566) 2024-06-03T00:01:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda62c92640 1 -- 172.21.15.96:0/3999569 learned_addr learned my addr 172.21.15.96:0/3999569 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda61c90640 1 --2- 172.21.15.96:0/3999569 >> v2:172.21.15.162:3300/0 conn(0x7fda5c071240 0x7fda5c06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda62c92640 1 -- 172.21.15.96:0/3999569 >> v2:172.21.15.162:3300/0 conn(0x7fda5c071240 msgr2=0x7fda5c06d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda62c92640 1 --2- 172.21.15.96:0/3999569 >> v2:172.21.15.162:3300/0 conn(0x7fda5c071240 0x7fda5c06d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda62c92640 1 -- 172.21.15.96:0/3999569 >> v1:172.21.15.162:6789/0 conn(0x7fda5c145390 legacy=0x7fda5c06cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.486+0000 7fda62c92640 1 -- 172.21.15.96:0/3999569 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c0ca940 con 0x7fda5c0cbeb0 2024-06-03T00:01:20.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.487+0000 7fda62c92640 1 --2- 172.21.15.96:0/3999569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda5c0cbeb0 0x7fda5c0cc300 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0b2970 tx=0x7fda5402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4050c486ebeaeaf2 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.487+0000 7fda6148f640 1 -- 172.21.15.96:0/3999569 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54036070 con 0x7fda5c0cbeb0 2024-06-03T00:01:20.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.487+0000 7fda6148f640 1 -- 172.21.15.96:0/3999569 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda54031600 con 0x7fda5c0cbeb0 2024-06-03T00:01:20.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.487+0000 7fda6148f640 1 -- 172.21.15.96:0/3999569 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda540319d0 con 0x7fda5c0cbeb0 2024-06-03T00:01:20.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.487+0000 7fda646f5640 1 -- 172.21.15.96:0/3999569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda5c0cbeb0 msgr2=0x7fda5c0cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.487+0000 7fda646f5640 1 --2- 172.21.15.96:0/3999569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda5c0cbeb0 0x7fda5c0cc300 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0b2970 tx=0x7fda5402a730 comp rx=0 tx=0).stop 2024-06-03T00:01:20.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.488+0000 7fda646f5640 1 -- 172.21.15.96:0/3999569 shutdown_connections 2024-06-03T00:01:20.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.488+0000 7fda646f5640 1 --2- 172.21.15.96:0/3999569 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda5c0cbeb0 0x7fda5c0cc300 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.488+0000 7fda646f5640 1 --2- 172.21.15.96:0/3999569 >> v2:172.21.15.162:3300/0 conn(0x7fda5c071240 0x7fda5c06d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.493 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.488+0000 7fda646f5640 1 -- 172.21.15.96:0/3999569 >> 172.21.15.96:0/3999569 conn(0x7fda5c0b1a40 msgr2=0x7fda5c0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:20.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.488+0000 7fda646f5640 1 -- 172.21.15.96:0/3999569 shutdown_connections 2024-06-03T00:01:20.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.488+0000 7fda646f5640 1 -- 172.21.15.96:0/3999569 wait complete. 2024-06-03T00:01:20.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.489+0000 7fda646f5640 1 Processor -- start 2024-06-03T00:01:20.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.489+0000 7fda646f5640 1 -- start start 2024-06-03T00:01:20.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.489+0000 7fda646f5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c071240 0x7fda5c0b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda646f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5c0cbeb0 0x7fda5c135000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda646f5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda5c145390 0x7fda5c135540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda646f5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c0cb1e0 con 0x7fda5c145390 2024-06-03T00:01:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda646f5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c0caf00 con 0x7fda5c0cbeb0 2024-06-03T00:01:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda646f5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda5c06dbe0 con 0x7fda5c071240 2024-06-03T00:01:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda62c92640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda5c145390 0x7fda5c135540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda62c92640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda5c145390 0x7fda5c135540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51576/0 (socket says 172.21.15.96:51576) 2024-06-03T00:01:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda62c92640 1 -- 172.21.15.96:0/2339155883 learned_addr learned my addr 172.21.15.96:0/2339155883 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:20.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda62491640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c071240 0x7fda5c0b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda61c90640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5c0cbeb0 0x7fda5c135000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda62c92640 1 -- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c071240 msgr2=0x7fda5c0b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda62c92640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda5c071240 0x7fda5c0b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda62c92640 1 -- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5c0cbeb0 msgr2=0x7fda5c135000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda62c92640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5c0cbeb0 0x7fda5c135000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda62c92640 1 -- 172.21.15.96:0/2339155883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c15dda0 con 0x7fda5c145390 2024-06-03T00:01:20.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda61c90640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5c0cbeb0 0x7fda5c135000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:20.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda62c92640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda5c145390 0x7fda5c135540 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fda54009f40 tx=0x7fda54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda4effd640 1 -- 172.21.15.96:0/2339155883 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5403f020 con 0x7fda5c145390 2024-06-03T00:01:20.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda4effd640 1 -- 172.21.15.96:0/2339155883 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda54037040 con 0x7fda5c145390 2024-06-03T00:01:20.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5c09b180 con 0x7fda5c145390 2024-06-03T00:01:20.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda4effd640 1 -- 172.21.15.96:0/2339155883 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda54036070 con 0x7fda5c145390 2024-06-03T00:01:20.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.490+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5c0b32e0 con 0x7fda5c145390 2024-06-03T00:01:20.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.491+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda5c15e080 con 0x7fda5c145390 2024-06-03T00:01:20.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.492+0000 7fda4effd640 1 -- 172.21.15.96:0/2339155883 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7fda54042020 con 0x7fda5c145390 2024-06-03T00:01:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.492+0000 7fda4effd640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fda4006be30 0x7fda4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.493+0000 7fda4effd640 1 -- 172.21.15.96:0/2339155883 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7fda540ab730 con 0x7fda5c145390 2024-06-03T00:01:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.493+0000 7fda62491640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fda4006be30 0x7fda4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.493+0000 7fda4effd640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] conn(0x7fda40074760 0x7fda40076be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.493+0000 7fda4effd640 1 -- 172.21.15.96:0/2339155883 --> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda5403ae50 con 0x7fda40074760 2024-06-03T00:01:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.493+0000 7fda4effd640 1 -- 172.21.15.96:0/2339155883 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fda540b2050 con 0x7fda5c145390 2024-06-03T00:01:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.493+0000 7fda62491640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fda4006be30 0x7fda4006e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda50007fd0 tx=0x7fda50009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.493+0000 7fda61c90640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] conn(0x7fda40074760 0x7fda40076be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.493+0000 7fda61c90640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] conn(0x7fda40074760 0x7fda40076be0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.494+0000 7fda4effd640 1 -- 172.21.15.96:0/2339155883 <== osd.7 v2:172.21.15.162:6823/334757134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda5403ae50 con 0x7fda40074760 2024-06-03T00:01:20.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.508+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 --> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fda5c0683e0 con 0x7fda40074760 2024-06-03T00:01:20.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.508+0000 7fda4effd640 1 -- 172.21.15.96:0/2339155883 <== osd.7 v2:172.21.15.162:6823/334757134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fda5c0683e0 con 0x7fda40074760 2024-06-03T00:01:20.508 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-06-03T00:01:20.509 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-06-03T00:01:20.509 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-06-03T00:01:20.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.508+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] conn(0x7fda40074760 msgr2=0x7fda40076be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.508+0000 7fda646f5640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.162:6823/334757134,v1:172.21.15.162:6825/334757134] conn(0x7fda40074760 0x7fda40076be0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.509+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fda4006be30 msgr2=0x7fda4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.509+0000 7fda646f5640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7fda4006be30 0x7fda4006e2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda50007fd0 tx=0x7fda50009040 comp rx=0 tx=0).stop 2024-06-03T00:01:20.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.509+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda5c145390 msgr2=0x7fda5c135540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.509+0000 7fda646f5640 1 --2- 172.21.15.96:0/2339155883 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda5c145390 0x7fda5c135540 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fda54009f40 tx=0x7fda54004a40 comp rx=0 tx=0).stop 2024-06-03T00:01:20.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.509+0000 7fda62c92640 1 -- 172.21.15.96:0/2339155883 reap_dead start 2024-06-03T00:01:20.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.509+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 shutdown_connections 2024-06-03T00:01:20.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.509+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 >> 172.21.15.96:0/2339155883 conn(0x7fda5c0b1a40 msgr2=0x7fda5c0acd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:20.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.509+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 shutdown_connections 2024-06-03T00:01:20.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.509+0000 7fda646f5640 1 -- 172.21.15.96:0/2339155883 wait complete. 2024-06-03T00:01:20.519 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-06-03T00:01:20.619 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.619+0000 7f0d55c95640 1 Processor -- start 2024-06-03T00:01:20.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.619+0000 7f0d55c95640 1 -- start start 2024-06-03T00:01:20.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d55c95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d5015c150 0x7f0d500b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d55c95640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0d5015c530 0x7f0d500b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d55c95640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5006beb0 con 0x7f0d500d0380 2024-06-03T00:01:20.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d55c95640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5006b3c0 con 0x7f0d5015c530 2024-06-03T00:01:20.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d55c95640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0d500b00d0 con 0x7f0d5015c150 2024-06-03T00:01:20.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d4effd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0d5015c530 0x7f0d500b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d4effd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0d5015c530 0x7f0d500b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51586/0 (socket says 172.21.15.96:51586) 2024-06-03T00:01:20.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d4effd640 1 -- 172.21.15.96:0/3085937937 learned_addr learned my addr 172.21.15.96:0/3085937937 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:20.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d4f7fe640 1 --2- 172.21.15.96:0/3085937937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d5015c150 0x7f0d500b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d4effd640 1 -- 172.21.15.96:0/3085937937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d5015c150 msgr2=0x7f0d500b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:20.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d4effd640 1 --2- 172.21.15.96:0/3085937937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d5015c150 0x7f0d500b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d4effd640 1 -- 172.21.15.96:0/3085937937 >> v1:172.21.15.162:6789/0 conn(0x7f0d500d0380 legacy=0x7f0d500cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.620+0000 7f0d4effd640 1 -- 172.21.15.96:0/3085937937 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5006b610 con 0x7f0d5015c530 2024-06-03T00:01:20.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.621+0000 7f0d4effd640 1 --2- 172.21.15.96:0/3085937937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5015c530 0x7f0d500b6030 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009870 tx=0x7f0d4402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7235830f658a8e60 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.621+0000 7f0d4e7fc640 1 -- 172.21.15.96:0/3085937937 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44037070 con 0x7f0d5015c530 2024-06-03T00:01:20.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.621+0000 7f0d4e7fc640 1 -- 172.21.15.96:0/3085937937 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d44032440 con 0x7f0d5015c530 2024-06-03T00:01:20.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.621+0000 7f0d4e7fc640 1 -- 172.21.15.96:0/3085937937 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d44032810 con 0x7f0d5015c530 2024-06-03T00:01:20.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.622+0000 7f0d55c95640 1 -- 172.21.15.96:0/3085937937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5015c530 msgr2=0x7f0d500b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.622+0000 7f0d55c95640 1 --2- 172.21.15.96:0/3085937937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5015c530 0x7f0d500b6030 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009870 tx=0x7f0d4402a1c0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.622+0000 7f0d55c95640 1 -- 172.21.15.96:0/3085937937 shutdown_connections 2024-06-03T00:01:20.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.622+0000 7f0d55c95640 1 --2- 172.21.15.96:0/3085937937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5015c530 0x7f0d500b6030 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.622+0000 7f0d55c95640 1 --2- 172.21.15.96:0/3085937937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d5015c150 0x7f0d500b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.622+0000 7f0d55c95640 1 -- 172.21.15.96:0/3085937937 >> 172.21.15.96:0/3085937937 conn(0x7f0d500b1f80 msgr2=0x7f0d500b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.622+0000 7f0d55c95640 1 -- 172.21.15.96:0/3085937937 shutdown_connections 2024-06-03T00:01:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.622+0000 7f0d55c95640 1 -- 172.21.15.96:0/3085937937 wait complete. 2024-06-03T00:01:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.623+0000 7f0d55c95640 1 Processor -- start 2024-06-03T00:01:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.623+0000 7f0d55c95640 1 -- start start 2024-06-03T00:01:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d55c95640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500d0380 0x7f0d500c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d55c95640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d5015c150 0x7f0d5015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d55c95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d5015c530 0x7f0d5015ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d55c95640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500b18a0 con 0x7f0d500d0380 2024-06-03T00:01:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d55c95640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5006bbd0 con 0x7f0d5015c150 2024-06-03T00:01:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d55c95640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0d500b1a20 con 0x7f0d5015c530 2024-06-03T00:01:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500d0380 0x7f0d500c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500d0380 0x7f0d500c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51590/0 (socket says 172.21.15.96:51590) 2024-06-03T00:01:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4f7fe640 1 -- 172.21.15.96:0/297082598 learned_addr learned my addr 172.21.15.96:0/297082598 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4ffff640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d5015c530 0x7f0d5015ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4effd640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d5015c150 0x7f0d5015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4f7fe640 1 -- 172.21.15.96:0/297082598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d5015c530 msgr2=0x7f0d5015ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4f7fe640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d5015c530 0x7f0d5015ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4f7fe640 1 -- 172.21.15.96:0/297082598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d5015c150 msgr2=0x7f0d5015ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4f7fe640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d5015c150 0x7f0d5015ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4f7fe640 1 -- 172.21.15.96:0/297082598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5015f9a0 con 0x7f0d500d0380 2024-06-03T00:01:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.624+0000 7f0d4f7fe640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500d0380 0x7f0d500c86f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000d800 tx=0x7f0d4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.625+0000 7f0d37fff640 1 -- 172.21.15.96:0/297082598 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000b6c0 con 0x7f0d500d0380 2024-06-03T00:01:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.625+0000 7f0d37fff640 1 -- 172.21.15.96:0/297082598 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d40019070 con 0x7f0d500d0380 2024-06-03T00:01:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.625+0000 7f0d37fff640 1 -- 172.21.15.96:0/297082598 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000bac0 con 0x7f0d500d0380 2024-06-03T00:01:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.625+0000 7f0d55c95640 1 -- 172.21.15.96:0/297082598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5015f6c0 con 0x7f0d500d0380 2024-06-03T00:01:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.625+0000 7f0d55c95640 1 -- 172.21.15.96:0/297082598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d500c50b0 con 0x7f0d500d0380 2024-06-03T00:01:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.626+0000 7f0d55c95640 1 -- 172.21.15.96:0/297082598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d500683e0 con 0x7f0d500d0380 2024-06-03T00:01:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.626+0000 7f0d37fff640 1 -- 172.21.15.96:0/297082598 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f0d4000bc60 con 0x7f0d500d0380 2024-06-03T00:01:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.626+0000 7f0d37fff640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0d3c06be30 0x7f0d3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.626+0000 7f0d37fff640 1 -- 172.21.15.96:0/297082598 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f0d4008b4a0 con 0x7f0d500d0380 2024-06-03T00:01:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.627+0000 7f0d4effd640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0d3c06be30 0x7f0d3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.627+0000 7f0d4effd640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0d3c06be30 0x7f0d3c06e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d44034000 tx=0x7f0d4402e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.631+0000 7f0d37fff640 1 -- 172.21.15.96:0/297082598 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f0d40059d20 con 0x7f0d500d0380 2024-06-03T00:01:20.805 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.805+0000 7f0d55c95640 1 -- 172.21.15.96:0/297082598 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f0d500b26d0 con 0x7f0d3c06be30 2024-06-03T00:01:20.806 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.805+0000 7f0d37fff640 1 -- 172.21.15.96:0/297082598 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0d500b26d0 con 0x7f0d3c06be30 2024-06-03T00:01:20.806 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 7 to deep-scrub 2024-06-03T00:01:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.807+0000 7f0d55c95640 1 -- 172.21.15.96:0/297082598 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0d3c06be30 msgr2=0x7f0d3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.807+0000 7f0d55c95640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0d3c06be30 0x7f0d3c06e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d44034000 tx=0x7f0d4402e000 comp rx=0 tx=0).stop 2024-06-03T00:01:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.807+0000 7f0d55c95640 1 -- 172.21.15.96:0/297082598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500d0380 msgr2=0x7f0d500c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.807+0000 7f0d55c95640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500d0380 0x7f0d500c86f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000d800 tx=0x7f0d4000dcc0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.807+0000 7f0d55c95640 1 -- 172.21.15.96:0/297082598 shutdown_connections 2024-06-03T00:01:20.808 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.807+0000 7f0d55c95640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f0d3c06be30 0x7f0d3c06e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.807+0000 7f0d55c95640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d5015c530 0x7f0d5015ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.807+0000 7f0d55c95640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d5015c150 0x7f0d5015ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.807+0000 7f0d55c95640 1 --2- 172.21.15.96:0/297082598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500d0380 0x7f0d500c86f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.807+0000 7f0d55c95640 1 -- 172.21.15.96:0/297082598 >> 172.21.15.96:0/297082598 conn(0x7f0d500b1f80 msgr2=0x7f0d50072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:20.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.808+0000 7f0d55c95640 1 -- 172.21.15.96:0/297082598 shutdown_connections 2024-06-03T00:01:20.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.808+0000 7f0d55c95640 1 -- 172.21.15.96:0/297082598 wait complete. 2024-06-03T00:01:20.819 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-03T00:01:20.919 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.919+0000 7effa1a8c640 1 Processor -- start 2024-06-03T00:01:20.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.919+0000 7effa1a8c640 1 -- start start 2024-06-03T00:01:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7effa1a8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 0x7eff9c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7effa1a8c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7eff9c06eb50 0x7eff9c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7effa1a8c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7eff9c0cab60 0x7eff9c15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7effa1a8c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7eff9c06efb0 con 0x7eff9c0cab60 2024-06-03T00:01:20.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7effa1a8c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7eff9c155950 con 0x7eff9c06eb50 2024-06-03T00:01:20.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7effa1a8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7eff9c0cb2e0 con 0x7eff9c155570 2024-06-03T00:01:20.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7eff9c0cab60 0x7eff9c15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9bfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7eff9c0cab60 0x7eff9c15eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51604/0 (socket says 172.21.15.96:51604) 2024-06-03T00:01:20.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9bfff640 1 -- 172.21.15.96:0/1456215768 learned_addr learned my addr 172.21.15.96:0/1456215768 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:20.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9b7fe640 1 --2- 172.21.15.96:0/1456215768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 0x7eff9c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9affd640 1 --2- 172.21.15.96:0/1456215768 >> v2:172.21.15.162:3300/0 conn(0x7eff9c06eb50 0x7eff9c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9bfff640 1 -- 172.21.15.96:0/1456215768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 msgr2=0x7eff9c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:20.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9bfff640 1 --2- 172.21.15.96:0/1456215768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 0x7eff9c06e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9bfff640 1 -- 172.21.15.96:0/1456215768 >> v2:172.21.15.162:3300/0 conn(0x7eff9c06eb50 msgr2=0x7eff9c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9bfff640 1 --2- 172.21.15.96:0/1456215768 >> v2:172.21.15.162:3300/0 conn(0x7eff9c06eb50 0x7eff9c0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9bfff640 1 -- 172.21.15.96:0/1456215768 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c0cb5c0 con 0x7eff9c0cab60 2024-06-03T00:01:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9b7fe640 1 --2- 172.21.15.96:0/1456215768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 0x7eff9c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.920+0000 7eff9affd640 1 --2- 172.21.15.96:0/1456215768 >> v2:172.21.15.162:3300/0 conn(0x7eff9c06eb50 0x7eff9c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.921+0000 7eff9bfff640 1 --2- 172.21.15.96:0/1456215768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 0x7eff9c15eab0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7eff9c06ca30 tx=0x7eff9402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337c9ede27523e48 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.921+0000 7eff9a7fc640 1 -- 172.21.15.96:0/1456215768 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94036070 con 0x7eff9c0cab60 2024-06-03T00:01:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.921+0000 7eff9a7fc640 1 -- 172.21.15.96:0/1456215768 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff94031600 con 0x7eff9c0cab60 2024-06-03T00:01:20.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.921+0000 7eff9a7fc640 1 -- 172.21.15.96:0/1456215768 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940319d0 con 0x7eff9c0cab60 2024-06-03T00:01:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.922+0000 7effa1a8c640 1 -- 172.21.15.96:0/1456215768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 msgr2=0x7eff9c15eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.922+0000 7effa1a8c640 1 --2- 172.21.15.96:0/1456215768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 0x7eff9c15eab0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7eff9c06ca30 tx=0x7eff9402a6a0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.922+0000 7effa1a8c640 1 -- 172.21.15.96:0/1456215768 shutdown_connections 2024-06-03T00:01:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.922+0000 7effa1a8c640 1 --2- 172.21.15.96:0/1456215768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 0x7eff9c15eab0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.922+0000 7effa1a8c640 1 --2- 172.21.15.96:0/1456215768 >> v2:172.21.15.162:3300/0 conn(0x7eff9c06eb50 0x7eff9c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.922+0000 7effa1a8c640 1 --2- 172.21.15.96:0/1456215768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 0x7eff9c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.922+0000 7effa1a8c640 1 -- 172.21.15.96:0/1456215768 >> 172.21.15.96:0/1456215768 conn(0x7eff9c0cfc30 msgr2=0x7eff9c0d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:20.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.922+0000 7effa1a8c640 1 -- 172.21.15.96:0/1456215768 shutdown_connections 2024-06-03T00:01:20.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.922+0000 7effa1a8c640 1 -- 172.21.15.96:0/1456215768 wait complete. 2024-06-03T00:01:20.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.923+0000 7effa1a8c640 1 Processor -- start 2024-06-03T00:01:20.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.923+0000 7effa1a8c640 1 -- start start 2024-06-03T00:01:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7effa1a8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff9c06eb50 0x7eff9c1574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7effa1a8c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 0x7eff9c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7effa1a8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 0x7eff9c1f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7effa1a8c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c0caff0 con 0x7eff9c0cab60 2024-06-03T00:01:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7effa1a8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c071b00 con 0x7eff9c06eb50 2024-06-03T00:01:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7effa1a8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7eff9c0717d0 con 0x7eff9c155570 2024-06-03T00:01:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7eff9affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 0x7eff9c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7eff9affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 0x7eff9c157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51618/0 (socket says 172.21.15.96:51618) 2024-06-03T00:01:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7eff9affd640 1 -- 172.21.15.96:0/2118821718 learned_addr learned my addr 172.21.15.96:0/2118821718 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7eff9affd640 1 -- 172.21.15.96:0/2118821718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 msgr2=0x7eff9c1f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7eff9bfff640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 0x7eff9c1f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7eff9affd640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 0x7eff9c1f45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7eff9affd640 1 -- 172.21.15.96:0/2118821718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff9c06eb50 msgr2=0x7eff9c1574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:20.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7eff9affd640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff9c06eb50 0x7eff9c1574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.924+0000 7eff9affd640 1 -- 172.21.15.96:0/2118821718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c1561c0 con 0x7eff9c0cab60 2024-06-03T00:01:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.925+0000 7eff9affd640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 0x7eff9c157a00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7eff9000d800 tx=0x7eff9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.925+0000 7eff83fff640 1 -- 172.21.15.96:0/2118821718 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90018070 con 0x7eff9c0cab60 2024-06-03T00:01:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.925+0000 7eff83fff640 1 -- 172.21.15.96:0/2118821718 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff90004030 con 0x7eff9c0cab60 2024-06-03T00:01:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.925+0000 7effa1a8c640 1 -- 172.21.15.96:0/2118821718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9c1564a0 con 0x7eff9c0cab60 2024-06-03T00:01:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.925+0000 7eff83fff640 1 -- 172.21.15.96:0/2118821718 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90004400 con 0x7eff9c0cab60 2024-06-03T00:01:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.925+0000 7effa1a8c640 1 -- 172.21.15.96:0/2118821718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9c156a60 con 0x7eff9c0cab60 2024-06-03T00:01:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.926+0000 7effa1a8c640 1 -- 172.21.15.96:0/2118821718 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9c0683e0 con 0x7eff9c0cab60 2024-06-03T00:01:20.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.926+0000 7eff83fff640 1 -- 172.21.15.96:0/2118821718 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7eff900096a0 con 0x7eff9c0cab60 2024-06-03T00:01:20.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.927+0000 7eff83fff640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7eff8806be60 0x7eff8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:20.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.927+0000 7eff9b7fe640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7eff8806be60 0x7eff8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:20.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.927+0000 7eff83fff640 1 -- 172.21.15.96:0/2118821718 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7eff9008b340 con 0x7eff9c0cab60 2024-06-03T00:01:20.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.927+0000 7eff9b7fe640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7eff8806be60 0x7eff8806e320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff8c006fd0 tx=0x7eff8c008040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:20.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:20.931+0000 7eff83fff640 1 -- 172.21.15.96:0/2118821718 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7eff90059bc0 con 0x7eff9c0cab60 2024-06-03T00:01:21.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.102+0000 7effa1a8c640 1 -- 172.21.15.96:0/2118821718 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff9c15f680 con 0x7eff8806be60 2024-06-03T00:01:21.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.107+0000 7eff83fff640 1 -- 172.21.15.96:0/2118821718 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249118 (secure 0 0 0) 0x7eff9c15f680 con 0x7eff8806be60 2024-06-03T00:01:21.110 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-03T00:01:21.111 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-03T00:01:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 -- 172.21.15.96:0/2118821718 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7eff8806be60 msgr2=0x7eff8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7eff8806be60 0x7eff8806e320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff8c006fd0 tx=0x7eff8c008040 comp rx=0 tx=0).stop 2024-06-03T00:01:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 -- 172.21.15.96:0/2118821718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 msgr2=0x7eff9c157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 0x7eff9c157a00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7eff9000d800 tx=0x7eff9000dcc0 comp rx=0 tx=0).stop 2024-06-03T00:01:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 -- 172.21.15.96:0/2118821718 shutdown_connections 2024-06-03T00:01:21.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7eff8806be60 0x7eff8806e320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff9c155570 0x7eff9c1f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff9c0cab60 0x7eff9c157a00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 --2- 172.21.15.96:0/2118821718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff9c06eb50 0x7eff9c1574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 -- 172.21.15.96:0/2118821718 >> 172.21.15.96:0/2118821718 conn(0x7eff9c0cfc30 msgr2=0x7eff9c0b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 -- 172.21.15.96:0/2118821718 shutdown_connections 2024-06-03T00:01:21.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:21.110+0000 7effa1a8c640 1 -- 172.21.15.96:0/2118821718 wait complete. 2024-06-03T00:01:21.121 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-06-03T00:01:20.527676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594174,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":249,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":188,"ondisk_log_size":188,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319868,"kb_used_data":7976,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754654852,"statfs":{"total":773094113280,"available":772766568448,"internally_reserved":0,"allocated":8167424,"data_stored":4657516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002435"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.507110+0000","last_change":"2024-06-02T23:59:01.586938+0000","last_active":"2024-06-03T00:01:10.507110+0000","last_peered":"2024-06-03T00:01:10.507110+0000","last_clean":"2024-06-03T00:01:10.507110+0000","last_became_active":"2024-06-02T23:59:01.586669+0000","last_became_peered":"2024-06-02T23:59:01.586669+0000","last_unstale":"2024-06-03T00:01:10.507110+0000","last_undegraded":"2024-06-03T00:01:10.507110+0000","last_fullsized":"2024-06-03T00:01:10.507110+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781379+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-03T00:00:45.781379+0000","last_peered":"2024-06-03T00:00:45.781379+0000","last_clean":"2024-06-03T00:00:45.781379+0000","last_became_active":"2024-06-02T23:59:01.582687+0000","last_became_peered":"2024-06-02T23:59:01.582687+0000","last_unstale":"2024-06-03T00:00:45.781379+0000","last_undegraded":"2024-06-03T00:00:45.781379+0000","last_fullsized":"2024-06-03T00:00:45.781379+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:21:08.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.634843+0000","last_change":"2024-06-03T00:01:19.634883+0000","last_active":"2024-06-03T00:01:19.634843+0000","last_peered":"2024-06-03T00:01:19.634843+0000","last_clean":"2024-06-03T00:01:19.634843+0000","last_became_active":"2024-06-02T23:59:01.586006+0000","last_became_peered":"2024-06-02T23:59:01.586006+0000","last_unstale":"2024-06-03T00:01:19.634843+0000","last_undegraded":"2024-06-03T00:01:19.634843+0000","last_fullsized":"2024-06-03T00:01:19.634843+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:19.634722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:19.634722+0000","last_clean_scrub_stamp":"2024-06-03T00:01:19.634722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:33.809070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780728+0000","last_change":"2024-06-02T23:59:01.587310+0000","last_active":"2024-06-03T00:00:45.780728+0000","last_peered":"2024-06-03T00:00:45.780728+0000","last_clean":"2024-06-03T00:00:45.780728+0000","last_became_active":"2024-06-02T23:59:01.586761+0000","last_became_peered":"2024-06-02T23:59:01.586761+0000","last_unstale":"2024-06-03T00:00:45.780728+0000","last_undegraded":"2024-06-03T00:00:45.780728+0000","last_fullsized":"2024-06-03T00:00:45.780728+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:58:02.770214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776398+0000","last_change":"2024-06-02T23:59:01.583800+0000","last_active":"2024-06-03T00:00:45.776398+0000","last_peered":"2024-06-03T00:00:45.776398+0000","last_clean":"2024-06-03T00:00:45.776398+0000","last_became_active":"2024-06-02T23:59:01.581028+0000","last_became_peered":"2024-06-02T23:59:01.581028+0000","last_unstale":"2024-06-03T00:00:45.776398+0000","last_undegraded":"2024-06-03T00:00:45.776398+0000","last_fullsized":"2024-06-03T00:00:45.776398+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229027+0000","last_change":"2024-06-02T23:59:01.587296+0000","last_active":"2024-06-03T00:00:46.229027+0000","last_peered":"2024-06-03T00:00:46.229027+0000","last_clean":"2024-06-03T00:00:46.229027+0000","last_became_active":"2024-06-02T23:59:01.586996+0000","last_became_peered":"2024-06-02T23:59:01.586996+0000","last_unstale":"2024-06-03T00:00:46.229027+0000","last_undegraded":"2024-06-03T00:00:46.229027+0000","last_fullsized":"2024-06-03T00:00:46.229027+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:18.663645+0000","last_change":"2024-06-03T00:01:18.663664+0000","last_active":"2024-06-03T00:01:18.663645+0000","last_peered":"2024-06-03T00:01:18.663645+0000","last_clean":"2024-06-03T00:01:18.663645+0000","last_became_active":"2024-06-02T23:59:01.583488+0000","last_became_peered":"2024-06-02T23:59:01.583488+0000","last_unstale":"2024-06-03T00:01:18.663645+0000","last_undegraded":"2024-06-03T00:01:18.663645+0000","last_fullsized":"2024-06-03T00:01:18.663645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:18.663578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:18.663578+0000","last_clean_scrub_stamp":"2024-06-03T00:01:18.663578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:11.592237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773215+0000","last_change":"2024-06-02T23:59:01.588746+0000","last_active":"2024-06-03T00:00:45.773215+0000","last_peered":"2024-06-03T00:00:45.773215+0000","last_clean":"2024-06-03T00:00:45.773215+0000","last_became_active":"2024-06-02T23:59:01.588310+0000","last_became_peered":"2024-06-02T23:59:01.588310+0000","last_unstale":"2024-06-03T00:00:45.773215+0000","last_undegraded":"2024-06-03T00:00:45.773215+0000","last_fullsized":"2024-06-03T00:00:45.773215+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773550+0000","last_change":"2024-06-02T23:59:01.592959+0000","last_active":"2024-06-03T00:00:45.773550+0000","last_peered":"2024-06-03T00:00:45.773550+0000","last_clean":"2024-06-03T00:00:45.773550+0000","last_became_active":"2024-06-02T23:59:01.592704+0000","last_became_peered":"2024-06-02T23:59:01.592704+0000","last_unstale":"2024-06-03T00:00:45.773550+0000","last_undegraded":"2024-06-03T00:00:45.773550+0000","last_fullsized":"2024-06-03T00:00:45.773550+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228698+0000","last_change":"2024-06-02T23:59:01.589283+0000","last_active":"2024-06-03T00:00:46.228698+0000","last_peered":"2024-06-03T00:00:46.228698+0000","last_clean":"2024-06-03T00:00:46.228698+0000","last_became_active":"2024-06-02T23:59:01.588961+0000","last_became_peered":"2024-06-02T23:59:01.588961+0000","last_unstale":"2024-06-03T00:00:46.228698+0000","last_undegraded":"2024-06-03T00:00:46.228698+0000","last_fullsized":"2024-06-03T00:00:46.228698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229276+0000","last_change":"2024-06-02T23:59:01.583139+0000","last_active":"2024-06-03T00:00:46.229276+0000","last_peered":"2024-06-03T00:00:46.229276+0000","last_clean":"2024-06-03T00:00:46.229276+0000","last_became_active":"2024-06-02T23:59:01.582876+0000","last_became_peered":"2024-06-02T23:59:01.582876+0000","last_unstale":"2024-06-03T00:00:46.229276+0000","last_undegraded":"2024-06-03T00:00:46.229276+0000","last_fullsized":"2024-06-03T00:00:46.229276+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773347+0000","last_change":"2024-06-02T23:59:01.589336+0000","last_active":"2024-06-03T00:00:45.773347+0000","last_peered":"2024-06-03T00:00:45.773347+0000","last_clean":"2024-06-03T00:00:45.773347+0000","last_became_active":"2024-06-02T23:59:01.589067+0000","last_became_peered":"2024-06-02T23:59:01.589067+0000","last_unstale":"2024-06-03T00:00:45.773347+0000","last_undegraded":"2024-06-03T00:00:45.773347+0000","last_fullsized":"2024-06-03T00:00:45.773347+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228722+0000","last_change":"2024-06-02T23:59:01.591325+0000","last_active":"2024-06-03T00:00:46.228722+0000","last_peered":"2024-06-03T00:00:46.228722+0000","last_clean":"2024-06-03T00:00:46.228722+0000","last_became_active":"2024-06-02T23:59:01.590545+0000","last_became_peered":"2024-06-02T23:59:01.590545+0000","last_unstale":"2024-06-03T00:00:46.228722+0000","last_undegraded":"2024-06-03T00:00:46.228722+0000","last_fullsized":"2024-06-03T00:00:46.228722+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229942+0000","last_change":"2024-06-02T23:59:01.583413+0000","last_active":"2024-06-03T00:00:46.229942+0000","last_peered":"2024-06-03T00:00:46.229942+0000","last_clean":"2024-06-03T00:00:46.229942+0000","last_became_active":"2024-06-02T23:59:01.582568+0000","last_became_peered":"2024-06-02T23:59:01.582568+0000","last_unstale":"2024-06-03T00:00:46.229942+0000","last_undegraded":"2024-06-03T00:00:46.229942+0000","last_fullsized":"2024-06-03T00:00:46.229942+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780842+0000","last_change":"2024-06-02T23:59:01.591575+0000","last_active":"2024-06-03T00:00:45.780842+0000","last_peered":"2024-06-03T00:00:45.780842+0000","last_clean":"2024-06-03T00:00:45.780842+0000","last_became_active":"2024-06-02T23:59:01.591265+0000","last_became_peered":"2024-06-02T23:59:01.591265+0000","last_unstale":"2024-06-03T00:00:45.780842+0000","last_undegraded":"2024-06-03T00:00:45.780842+0000","last_fullsized":"2024-06-03T00:00:45.780842+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:50:15.459047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228698+0000","last_change":"2024-06-02T23:59:01.590700+0000","last_active":"2024-06-03T00:00:46.228698+0000","last_peered":"2024-06-03T00:00:46.228698+0000","last_clean":"2024-06-03T00:00:46.228698+0000","last_became_active":"2024-06-02T23:59:01.590445+0000","last_became_peered":"2024-06-02T23:59:01.590445+0000","last_unstale":"2024-06-03T00:00:46.228698+0000","last_undegraded":"2024-06-03T00:00:46.228698+0000","last_fullsized":"2024-06-03T00:00:46.228698+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230538+0000","last_change":"2024-06-02T23:59:01.587034+0000","last_active":"2024-06-03T00:00:46.230538+0000","last_peered":"2024-06-03T00:00:46.230538+0000","last_clean":"2024-06-03T00:00:46.230538+0000","last_became_active":"2024-06-02T23:59:01.586784+0000","last_became_peered":"2024-06-02T23:59:01.586784+0000","last_unstale":"2024-06-03T00:00:46.230538+0000","last_undegraded":"2024-06-03T00:00:46.230538+0000","last_fullsized":"2024-06-03T00:00:46.230538+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781431+0000","last_change":"2024-06-02T23:59:01.582969+0000","last_active":"2024-06-03T00:00:45.781431+0000","last_peered":"2024-06-03T00:00:45.781431+0000","last_clean":"2024-06-03T00:00:45.781431+0000","last_became_active":"2024-06-02T23:59:01.582680+0000","last_became_peered":"2024-06-02T23:59:01.582680+0000","last_unstale":"2024-06-03T00:00:45.781431+0000","last_undegraded":"2024-06-03T00:00:45.781431+0000","last_fullsized":"2024-06-03T00:00:45.781431+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:53:29.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:17.745331+0000","last_change":"2024-06-02T23:59:01.582684+0000","last_active":"2024-06-03T00:01:17.745331+0000","last_peered":"2024-06-03T00:01:17.745331+0000","last_clean":"2024-06-03T00:01:17.745331+0000","last_became_active":"2024-06-02T23:59:01.582422+0000","last_became_peered":"2024-06-02T23:59:01.582422+0000","last_unstale":"2024-06-03T00:01:17.745331+0000","last_undegraded":"2024-06-03T00:01:17.745331+0000","last_fullsized":"2024-06-03T00:01:17.745331+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.371031+0000","last_change":"2024-06-02T23:59:01.591052+0000","last_active":"2024-06-03T00:01:20.371031+0000","last_peered":"2024-06-03T00:01:20.371031+0000","last_clean":"2024-06-03T00:01:20.371031+0000","last_became_active":"2024-06-02T23:59:01.590601+0000","last_became_peered":"2024-06-02T23:59:01.590601+0000","last_unstale":"2024-06-03T00:01:20.371031+0000","last_undegraded":"2024-06-03T00:01:20.371031+0000","last_fullsized":"2024-06-03T00:01:20.371031+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.371032+0000","last_change":"2024-06-02T23:59:01.593871+0000","last_active":"2024-06-03T00:01:20.371032+0000","last_peered":"2024-06-03T00:01:20.371032+0000","last_clean":"2024-06-03T00:01:20.371032+0000","last_became_active":"2024-06-02T23:59:01.593596+0000","last_became_peered":"2024-06-02T23:59:01.593596+0000","last_unstale":"2024-06-03T00:01:20.371032+0000","last_undegraded":"2024-06-03T00:01:20.371032+0000","last_fullsized":"2024-06-03T00:01:20.371032+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.059984+0000","last_change":"2024-06-02T23:59:01.587899+0000","last_active":"2024-06-03T00:01:19.059984+0000","last_peered":"2024-06-03T00:01:19.059984+0000","last_clean":"2024-06-03T00:01:19.059984+0000","last_became_active":"2024-06-02T23:59:01.587641+0000","last_became_peered":"2024-06-02T23:59:01.587641+0000","last_unstale":"2024-06-03T00:01:19.059984+0000","last_undegraded":"2024-06-03T00:01:19.059984+0000","last_fullsized":"2024-06-03T00:01:19.059984+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:18.624063+0000","last_change":"2024-06-02T23:59:01.584645+0000","last_active":"2024-06-03T00:01:18.624063+0000","last_peered":"2024-06-03T00:01:18.624063+0000","last_clean":"2024-06-03T00:01:18.624063+0000","last_became_active":"2024-06-02T23:59:01.584358+0000","last_became_peered":"2024-06-02T23:59:01.584358+0000","last_unstale":"2024-06-03T00:01:18.624063+0000","last_undegraded":"2024-06-03T00:01:18.624063+0000","last_fullsized":"2024-06-03T00:01:18.624063+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.507682+0000","last_change":"2024-06-02T23:59:01.583175+0000","last_active":"2024-06-03T00:01:15.507682+0000","last_peered":"2024-06-03T00:01:15.507682+0000","last_clean":"2024-06-03T00:01:15.507682+0000","last_became_active":"2024-06-02T23:59:01.582904+0000","last_became_peered":"2024-06-02T23:59:01.582904+0000","last_unstale":"2024-06-03T00:01:15.507682+0000","last_undegraded":"2024-06-03T00:01:15.507682+0000","last_fullsized":"2024-06-03T00:01:15.507682+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.507760+0000","last_change":"2024-06-02T23:59:01.591616+0000","last_active":"2024-06-03T00:01:15.507760+0000","last_peered":"2024-06-03T00:01:15.507760+0000","last_clean":"2024-06-03T00:01:15.507760+0000","last_became_active":"2024-06-02T23:59:01.589760+0000","last_became_peered":"2024-06-02T23:59:01.589760+0000","last_unstale":"2024-06-03T00:01:15.507760+0000","last_undegraded":"2024-06-03T00:01:15.507760+0000","last_fullsized":"2024-06-03T00:01:15.507760+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.507351+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-03T00:01:15.507351+0000","last_peered":"2024-06-03T00:01:15.507351+0000","last_clean":"2024-06-03T00:01:15.507351+0000","last_became_active":"2024-06-02T23:59:01.585010+0000","last_became_peered":"2024-06-02T23:59:01.585010+0000","last_unstale":"2024-06-03T00:01:15.507351+0000","last_undegraded":"2024-06-03T00:01:15.507351+0000","last_fullsized":"2024-06-03T00:01:15.507351+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.507609+0000","last_change":"2024-06-02T23:59:01.593067+0000","last_active":"2024-06-03T00:01:15.507609+0000","last_peered":"2024-06-03T00:01:15.507609+0000","last_clean":"2024-06-03T00:01:15.507609+0000","last_became_active":"2024-06-02T23:59:01.592789+0000","last_became_peered":"2024-06-02T23:59:01.592789+0000","last_unstale":"2024-06-03T00:01:15.507609+0000","last_undegraded":"2024-06-03T00:01:15.507609+0000","last_fullsized":"2024-06-03T00:01:15.507609+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.509829+0000","last_change":"2024-06-02T23:59:01.591460+0000","last_active":"2024-06-03T00:01:15.509829+0000","last_peered":"2024-06-03T00:01:15.509829+0000","last_clean":"2024-06-03T00:01:15.509829+0000","last_became_active":"2024-06-02T23:59:01.590827+0000","last_became_peered":"2024-06-02T23:59:01.590827+0000","last_unstale":"2024-06-03T00:01:15.509829+0000","last_undegraded":"2024-06-03T00:01:15.509829+0000","last_fullsized":"2024-06-03T00:01:15.509829+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.507218+0000","last_change":"2024-06-02T23:59:01.589715+0000","last_active":"2024-06-03T00:01:10.507218+0000","last_peered":"2024-06-03T00:01:10.507218+0000","last_clean":"2024-06-03T00:01:10.507218+0000","last_became_active":"2024-06-02T23:59:01.589456+0000","last_became_peered":"2024-06-02T23:59:01.589456+0000","last_unstale":"2024-06-03T00:01:10.507218+0000","last_undegraded":"2024-06-03T00:01:10.507218+0000","last_fullsized":"2024-06-03T00:01:10.507218+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781075+0000","last_change":"2024-06-02T23:59:01.589048+0000","last_active":"2024-06-03T00:00:45.781075+0000","last_peered":"2024-06-03T00:00:45.781075+0000","last_clean":"2024-06-03T00:00:45.781075+0000","last_became_active":"2024-06-02T23:59:01.588773+0000","last_became_peered":"2024-06-02T23:59:01.588773+0000","last_unstale":"2024-06-03T00:00:45.781075+0000","last_undegraded":"2024-06-03T00:00:45.781075+0000","last_fullsized":"2024-06-03T00:00:45.781075+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:53:49.374637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.507170+0000","last_change":"2024-06-02T23:59:01.586433+0000","last_active":"2024-06-03T00:01:10.507170+0000","last_peered":"2024-06-03T00:01:10.507170+0000","last_clean":"2024-06-03T00:01:10.507170+0000","last_became_active":"2024-06-02T23:59:01.585466+0000","last_became_peered":"2024-06-02T23:59:01.585466+0000","last_unstale":"2024-06-03T00:01:10.507170+0000","last_undegraded":"2024-06-03T00:01:10.507170+0000","last_fullsized":"2024-06-03T00:01:10.507170+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.507931+0000","last_change":"2024-06-02T23:59:01.586007+0000","last_active":"2024-06-03T00:01:10.507931+0000","last_peered":"2024-06-03T00:01:10.507931+0000","last_clean":"2024-06-03T00:01:10.507931+0000","last_became_active":"2024-06-02T23:59:01.585721+0000","last_became_peered":"2024-06-02T23:59:01.585721+0000","last_unstale":"2024-06-03T00:01:10.507931+0000","last_undegraded":"2024-06-03T00:01:10.507931+0000","last_fullsized":"2024-06-03T00:01:10.507931+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780711+0000","last_change":"2024-06-02T23:59:01.582009+0000","last_active":"2024-06-03T00:00:45.780711+0000","last_peered":"2024-06-03T00:00:45.780711+0000","last_clean":"2024-06-03T00:00:45.780711+0000","last_became_active":"2024-06-02T23:59:01.581438+0000","last_became_peered":"2024-06-02T23:59:01.581438+0000","last_unstale":"2024-06-03T00:00:45.780711+0000","last_undegraded":"2024-06-03T00:00:45.780711+0000","last_fullsized":"2024-06-03T00:00:45.780711+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:41:58.350265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"69'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:05.508778+0000","last_change":"2024-06-02T23:59:00.647990+0000","last_active":"2024-06-03T00:01:05.508778+0000","last_peered":"2024-06-03T00:01:05.508778+0000","last_clean":"2024-06-03T00:01:05.508778+0000","last_became_active":"2024-06-02T23:59:00.647031+0000","last_became_peered":"2024-06-02T23:59:00.647031+0000","last_unstale":"2024-06-03T00:01:05.508778+0000","last_undegraded":"2024-06-03T00:01:05.508778+0000","last_fullsized":"2024-06-03T00:01:05.508778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228324+0000","last_change":"2024-06-02T23:59:01.587104+0000","last_active":"2024-06-03T00:00:46.228324+0000","last_peered":"2024-06-03T00:00:46.228324+0000","last_clean":"2024-06-03T00:00:46.228324+0000","last_became_active":"2024-06-02T23:59:01.586813+0000","last_became_peered":"2024-06-02T23:59:01.586813+0000","last_unstale":"2024-06-03T00:00:46.228324+0000","last_undegraded":"2024-06-03T00:00:46.228324+0000","last_fullsized":"2024-06-03T00:00:46.228324+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"69'1","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.509601+0000","last_change":"2024-06-03T00:01:19.509640+0000","last_active":"2024-06-03T00:01:19.509601+0000","last_peered":"2024-06-03T00:01:19.509601+0000","last_clean":"2024-06-03T00:01:19.509601+0000","last_became_active":"2024-06-02T23:59:00.638579+0000","last_became_peered":"2024-06-02T23:59:00.638579+0000","last_unstale":"2024-06-03T00:01:19.509601+0000","last_undegraded":"2024-06-03T00:01:19.509601+0000","last_fullsized":"2024-06-03T00:01:19.509601+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-06-03T00:01:19.509526+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-06-03T00:01:19.509526+0000","last_clean_scrub_stamp":"2024-06-03T00:01:19.509526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:36:26.071649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080681+0000","last_change":"2024-06-02T23:59:01.593795+0000","last_active":"2024-06-03T00:00:46.080681+0000","last_peered":"2024-06-03T00:00:46.080681+0000","last_clean":"2024-06-03T00:00:46.080681+0000","last_became_active":"2024-06-02T23:59:01.593506+0000","last_became_peered":"2024-06-02T23:59:01.593506+0000","last_unstale":"2024-06-03T00:00:46.080681+0000","last_undegraded":"2024-06-03T00:00:46.080681+0000","last_fullsized":"2024-06-03T00:00:46.080681+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"72'3","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.494607+0000","last_change":"2024-06-03T00:01:20.494632+0000","last_active":"2024-06-03T00:01:20.494607+0000","last_peered":"2024-06-03T00:01:20.494607+0000","last_clean":"2024-06-03T00:01:20.494607+0000","last_became_active":"2024-06-02T23:59:00.648667+0000","last_became_peered":"2024-06-02T23:59:00.648667+0000","last_unstale":"2024-06-03T00:01:20.494607+0000","last_undegraded":"2024-06-03T00:01:20.494607+0000","last_fullsized":"2024-06-03T00:01:20.494607+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-06-03T00:01:20.494541+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-06-03T00:01:20.494541+0000","last_clean_scrub_stamp":"2024-06-03T00:01:20.494541+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:32:05.928243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773220+0000","last_change":"2024-06-02T23:59:01.585466+0000","last_active":"2024-06-03T00:00:45.773220+0000","last_peered":"2024-06-03T00:00:45.773220+0000","last_clean":"2024-06-03T00:00:45.773220+0000","last_became_active":"2024-06-02T23:59:01.585127+0000","last_became_peered":"2024-06-02T23:59:01.585127+0000","last_unstale":"2024-06-03T00:00:45.773220+0000","last_undegraded":"2024-06-03T00:00:45.773220+0000","last_fullsized":"2024-06-03T00:00:45.773220+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"69'2","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228499+0000","last_change":"2024-06-02T23:59:00.642417+0000","last_active":"2024-06-03T00:00:46.228499+0000","last_peered":"2024-06-03T00:00:46.228499+0000","last_clean":"2024-06-03T00:00:46.228499+0000","last_became_active":"2024-06-02T23:59:00.642182+0000","last_became_peered":"2024-06-02T23:59:00.642182+0000","last_unstale":"2024-06-03T00:00:46.228499+0000","last_undegraded":"2024-06-03T00:00:46.228499+0000","last_fullsized":"2024-06-03T00:00:46.228499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.082826+0000","last_change":"2024-06-03T00:00:46.082184+0000","last_active":"2024-06-03T00:00:46.082826+0000","last_peered":"2024-06-03T00:00:46.082826+0000","last_clean":"2024-06-03T00:00:46.082826+0000","last_became_active":"2024-06-03T00:00:46.081627+0000","last_became_peered":"2024-06-03T00:00:46.081627+0000","last_unstale":"2024-06-03T00:00:46.082826+0000","last_undegraded":"2024-06-03T00:00:46.082826+0000","last_fullsized":"2024-06-03T00:00:46.082826+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"69'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229944+0000","last_change":"2024-06-02T23:59:00.641231+0000","last_active":"2024-06-03T00:00:46.229944+0000","last_peered":"2024-06-03T00:00:46.229944+0000","last_clean":"2024-06-03T00:00:46.229944+0000","last_became_active":"2024-06-02T23:59:00.640963+0000","last_became_peered":"2024-06-02T23:59:00.640963+0000","last_unstale":"2024-06-03T00:00:46.229944+0000","last_undegraded":"2024-06-03T00:00:46.229944+0000","last_fullsized":"2024-06-03T00:00:46.229944+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781190+0000","last_change":"2024-06-02T23:59:01.591548+0000","last_active":"2024-06-03T00:00:45.781190+0000","last_peered":"2024-06-03T00:00:45.781190+0000","last_clean":"2024-06-03T00:00:45.781190+0000","last_became_active":"2024-06-02T23:59:01.591198+0000","last_became_peered":"2024-06-02T23:59:01.591198+0000","last_unstale":"2024-06-03T00:00:45.781190+0000","last_undegraded":"2024-06-03T00:00:45.781190+0000","last_fullsized":"2024-06-03T00:00:45.781190+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:10:00.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"69'1","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776267+0000","last_change":"2024-06-02T23:59:00.649120+0000","last_active":"2024-06-03T00:00:45.776267+0000","last_peered":"2024-06-03T00:00:45.776267+0000","last_clean":"2024-06-03T00:00:45.776267+0000","last_became_active":"2024-06-02T23:59:00.648839+0000","last_became_peered":"2024-06-02T23:59:00.648839+0000","last_unstale":"2024-06-03T00:00:45.776267+0000","last_undegraded":"2024-06-03T00:00:45.776267+0000","last_fullsized":"2024-06-03T00:00:45.776267+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.773248+0000","last_change":"2024-06-02T23:59:01.585288+0000","last_active":"2024-06-03T00:00:45.773248+0000","last_peered":"2024-06-03T00:00:45.773248+0000","last_clean":"2024-06-03T00:00:45.773248+0000","last_became_active":"2024-06-02T23:59:01.584971+0000","last_became_peered":"2024-06-02T23:59:01.584971+0000","last_unstale":"2024-06-03T00:00:45.773248+0000","last_undegraded":"2024-06-03T00:00:45.773248+0000","last_fullsized":"2024-06-03T00:00:45.773248+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.080900+0000","last_change":"2024-06-02T23:59:00.648200+0000","last_active":"2024-06-03T00:00:46.080900+0000","last_peered":"2024-06-03T00:00:46.080900+0000","last_clean":"2024-06-03T00:00:46.080900+0000","last_became_active":"2024-06-02T23:59:00.647175+0000","last_became_peered":"2024-06-02T23:59:00.647175+0000","last_unstale":"2024-06-03T00:00:46.080900+0000","last_undegraded":"2024-06-03T00:00:46.080900+0000","last_fullsized":"2024-06-03T00:00:46.080900+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.081972+0000","last_change":"2024-06-03T00:00:46.081972+0000","last_active":"2024-06-03T00:00:46.081972+0000","last_peered":"2024-06-03T00:00:46.081972+0000","last_clean":"2024-06-03T00:00:46.081972+0000","last_became_active":"2024-06-03T00:00:46.081552+0000","last_became_peered":"2024-06-03T00:00:46.081552+0000","last_unstale":"2024-06-03T00:00:46.081972+0000","last_undegraded":"2024-06-03T00:00:46.081972+0000","last_fullsized":"2024-06-03T00:00:46.081972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:37:10.667194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.229644+0000","last_change":"2024-06-02T23:59:00.647400+0000","last_active":"2024-06-03T00:00:46.229644+0000","last_peered":"2024-06-03T00:00:46.229644+0000","last_clean":"2024-06-03T00:00:46.229644+0000","last_became_active":"2024-06-02T23:59:00.647210+0000","last_became_peered":"2024-06-02T23:59:00.647210+0000","last_unstale":"2024-06-03T00:00:46.229644+0000","last_undegraded":"2024-06-03T00:00:46.229644+0000","last_fullsized":"2024-06-03T00:00:46.229644+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776098+0000","last_change":"2024-06-02T23:59:01.587444+0000","last_active":"2024-06-03T00:00:45.776098+0000","last_peered":"2024-06-03T00:00:45.776098+0000","last_clean":"2024-06-03T00:00:45.776098+0000","last_became_active":"2024-06-02T23:59:01.587190+0000","last_became_peered":"2024-06-02T23:59:01.587190+0000","last_unstale":"2024-06-03T00:00:45.776098+0000","last_undegraded":"2024-06-03T00:00:45.776098+0000","last_fullsized":"2024-06-03T00:00:45.776098+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781643+0000","last_change":"2024-06-02T23:59:00.637111+0000","last_active":"2024-06-03T00:00:45.781643+0000","last_peered":"2024-06-03T00:00:45.781643+0000","last_clean":"2024-06-03T00:00:45.781643+0000","last_became_active":"2024-06-02T23:59:00.636815+0000","last_became_peered":"2024-06-02T23:59:00.636815+0000","last_unstale":"2024-06-03T00:00:45.781643+0000","last_undegraded":"2024-06-03T00:00:45.781643+0000","last_fullsized":"2024-06-03T00:00:45.781643+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:52:39.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228240+0000","last_change":"2024-06-02T23:59:01.585862+0000","last_active":"2024-06-03T00:00:46.228240+0000","last_peered":"2024-06-03T00:00:46.228240+0000","last_clean":"2024-06-03T00:00:46.228240+0000","last_became_active":"2024-06-02T23:59:01.585128+0000","last_became_peered":"2024-06-02T23:59:01.585128+0000","last_unstale":"2024-06-03T00:00:46.228240+0000","last_undegraded":"2024-06-03T00:00:46.228240+0000","last_fullsized":"2024-06-03T00:00:46.228240+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776590+0000","last_change":"2024-06-02T23:59:00.644991+0000","last_active":"2024-06-03T00:00:45.776590+0000","last_peered":"2024-06-03T00:00:45.776590+0000","last_clean":"2024-06-03T00:00:45.776590+0000","last_became_active":"2024-06-02T23:59:00.644759+0000","last_became_peered":"2024-06-02T23:59:00.644759+0000","last_unstale":"2024-06-03T00:00:45.776590+0000","last_undegraded":"2024-06-03T00:00:45.776590+0000","last_fullsized":"2024-06-03T00:00:45.776590+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230153+0000","last_change":"2024-06-02T23:59:01.590250+0000","last_active":"2024-06-03T00:00:46.230153+0000","last_peered":"2024-06-03T00:00:46.230153+0000","last_clean":"2024-06-03T00:00:46.230153+0000","last_became_active":"2024-06-02T23:59:01.589942+0000","last_became_peered":"2024-06-02T23:59:01.589942+0000","last_unstale":"2024-06-03T00:00:46.230153+0000","last_undegraded":"2024-06-03T00:00:46.230153+0000","last_fullsized":"2024-06-03T00:00:46.230153+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"69'3","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781520+0000","last_change":"2024-06-02T23:59:00.644405+0000","last_active":"2024-06-03T00:00:45.781520+0000","last_peered":"2024-06-03T00:00:45.781520+0000","last_clean":"2024-06-03T00:00:45.781520+0000","last_became_active":"2024-06-02T23:59:00.643978+0000","last_became_peered":"2024-06-02T23:59:00.643978+0000","last_unstale":"2024-06-03T00:00:45.781520+0000","last_undegraded":"2024-06-03T00:00:45.781520+0000","last_fullsized":"2024-06-03T00:00:45.781520+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:16:38.404329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.776491+0000","last_change":"2024-06-02T23:59:01.574661+0000","last_active":"2024-06-03T00:00:45.776491+0000","last_peered":"2024-06-03T00:00:45.776491+0000","last_clean":"2024-06-03T00:00:45.776491+0000","last_became_active":"2024-06-02T23:59:01.574347+0000","last_became_peered":"2024-06-02T23:59:01.574347+0000","last_unstale":"2024-06-03T00:00:45.776491+0000","last_undegraded":"2024-06-03T00:00:45.776491+0000","last_fullsized":"2024-06-03T00:00:45.776491+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"72'13","reported_seq":40,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.249861+0000","last_change":"2024-06-03T00:01:19.249861+0000","last_active":"2024-06-03T00:01:19.249861+0000","last_peered":"2024-06-03T00:01:19.249861+0000","last_clean":"2024-06-03T00:01:19.249861+0000","last_became_active":"2024-06-02T23:59:00.638716+0000","last_became_peered":"2024-06-02T23:59:00.638716+0000","last_unstale":"2024-06-03T00:01:19.249861+0000","last_undegraded":"2024-06-03T00:01:19.249861+0000","last_fullsized":"2024-06-03T00:01:19.249861+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'13","last_scrub_stamp":"2024-06-03T00:01:19.249772+0000","last_deep_scrub":"72'13","last_deep_scrub_stamp":"2024-06-03T00:01:19.249772+0000","last_clean_scrub_stamp":"2024-06-03T00:01:19.249772+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:53:06.120812+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.228381+0000","last_change":"2024-06-02T23:59:01.584960+0000","last_active":"2024-06-03T00:00:46.228381+0000","last_peered":"2024-06-03T00:00:46.228381+0000","last_clean":"2024-06-03T00:00:46.228381+0000","last_became_active":"2024-06-02T23:59:01.584575+0000","last_became_peered":"2024-06-02T23:59:01.584575+0000","last_unstale":"2024-06-03T00:00:46.228381+0000","last_undegraded":"2024-06-03T00:00:46.228381+0000","last_fullsized":"2024-06-03T00:00:46.228381+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"69'2","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:17.745171+0000","last_change":"2024-06-02T23:59:00.645893+0000","last_active":"2024-06-03T00:01:17.745171+0000","last_peered":"2024-06-03T00:01:17.745171+0000","last_clean":"2024-06-03T00:01:17.745171+0000","last_became_active":"2024-06-02T23:59:00.645639+0000","last_became_peered":"2024-06-02T23:59:00.645639+0000","last_unstale":"2024-06-03T00:01:17.745171+0000","last_undegraded":"2024-06-03T00:01:17.745171+0000","last_fullsized":"2024-06-03T00:01:17.745171+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:46.230260+0000","last_change":"2024-06-02T23:59:01.589530+0000","last_active":"2024-06-03T00:00:46.230260+0000","last_peered":"2024-06-03T00:00:46.230260+0000","last_clean":"2024-06-03T00:00:46.230260+0000","last_became_active":"2024-06-02T23:59:01.589024+0000","last_became_peered":"2024-06-02T23:59:01.589024+0000","last_unstale":"2024-06-03T00:00:46.230260+0000","last_undegraded":"2024-06-03T00:00:46.230260+0000","last_fullsized":"2024-06-03T00:00:46.230260+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.370730+0000","last_change":"2024-06-02T23:59:00.647783+0000","last_active":"2024-06-03T00:01:20.370730+0000","last_peered":"2024-06-03T00:01:20.370730+0000","last_clean":"2024-06-03T00:01:20.370730+0000","last_became_active":"2024-06-02T23:59:00.647500+0000","last_became_peered":"2024-06-02T23:59:00.647500+0000","last_unstale":"2024-06-03T00:01:20.370730+0000","last_undegraded":"2024-06-03T00:01:20.370730+0000","last_fullsized":"2024-06-03T00:01:20.370730+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:05.506517+0000","last_change":"2024-06-02T23:59:01.582611+0000","last_active":"2024-06-03T00:01:05.506517+0000","last_peered":"2024-06-03T00:01:05.506517+0000","last_clean":"2024-06-03T00:01:05.506517+0000","last_became_active":"2024-06-02T23:59:01.582343+0000","last_became_peered":"2024-06-02T23:59:01.582343+0000","last_unstale":"2024-06-03T00:01:05.506517+0000","last_undegraded":"2024-06-03T00:01:05.506517+0000","last_fullsized":"2024-06-03T00:01:05.506517+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781046+0000","last_change":"2024-06-02T23:59:00.648669+0000","last_active":"2024-06-03T00:00:45.781046+0000","last_peered":"2024-06-03T00:00:45.781046+0000","last_clean":"2024-06-03T00:00:45.781046+0000","last_became_active":"2024-06-02T23:59:00.647777+0000","last_became_peered":"2024-06-02T23:59:00.647777+0000","last_unstale":"2024-06-03T00:00:45.781046+0000","last_undegraded":"2024-06-03T00:00:45.781046+0000","last_fullsized":"2024-06-03T00:00:45.781046+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:05:23.931542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.507283+0000","last_change":"2024-06-02T23:59:01.593580+0000","last_active":"2024-06-03T00:01:10.507283+0000","last_peered":"2024-06-03T00:01:10.507283+0000","last_clean":"2024-06-03T00:01:10.507283+0000","last_became_active":"2024-06-02T23:59:01.593303+0000","last_became_peered":"2024-06-02T23:59:01.593303+0000","last_unstale":"2024-06-03T00:01:10.507283+0000","last_undegraded":"2024-06-03T00:01:10.507283+0000","last_fullsized":"2024-06-03T00:01:10.507283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"69'8","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.059713+0000","last_change":"2024-06-02T23:59:00.645230+0000","last_active":"2024-06-03T00:01:19.059713+0000","last_peered":"2024-06-03T00:01:19.059713+0000","last_clean":"2024-06-03T00:01:19.059713+0000","last_became_active":"2024-06-02T23:59:00.644964+0000","last_became_peered":"2024-06-02T23:59:00.644964+0000","last_unstale":"2024-06-03T00:01:19.059713+0000","last_undegraded":"2024-06-03T00:01:19.059713+0000","last_fullsized":"2024-06-03T00:01:19.059713+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:05.506458+0000","last_change":"2024-06-02T23:59:01.582894+0000","last_active":"2024-06-03T00:01:05.506458+0000","last_peered":"2024-06-03T00:01:05.506458+0000","last_clean":"2024-06-03T00:01:05.506458+0000","last_became_active":"2024-06-02T23:59:01.581160+0000","last_became_peered":"2024-06-02T23:59:01.581160+0000","last_unstale":"2024-06-03T00:01:05.506458+0000","last_undegraded":"2024-06-03T00:01:05.506458+0000","last_fullsized":"2024-06-03T00:01:05.506458+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"69'1","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.507774+0000","last_change":"2024-06-02T23:59:00.644263+0000","last_active":"2024-06-03T00:01:15.507774+0000","last_peered":"2024-06-03T00:01:15.507774+0000","last_clean":"2024-06-03T00:01:15.507774+0000","last_became_active":"2024-06-02T23:59:00.644014+0000","last_became_peered":"2024-06-02T23:59:00.644014+0000","last_unstale":"2024-06-03T00:01:15.507774+0000","last_undegraded":"2024-06-03T00:01:15.507774+0000","last_fullsized":"2024-06-03T00:01:15.507774+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.507051+0000","last_change":"2024-06-02T23:59:01.593089+0000","last_active":"2024-06-03T00:01:10.507051+0000","last_peered":"2024-06-03T00:01:10.507051+0000","last_clean":"2024-06-03T00:01:10.507051+0000","last_became_active":"2024-06-02T23:59:01.592800+0000","last_became_peered":"2024-06-02T23:59:01.592800+0000","last_unstale":"2024-06-03T00:01:10.507051+0000","last_undegraded":"2024-06-03T00:01:10.507051+0000","last_fullsized":"2024-06-03T00:01:10.507051+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"72'3","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.838862+0000","last_change":"2024-06-03T00:01:19.838910+0000","last_active":"2024-06-03T00:01:19.838862+0000","last_peered":"2024-06-03T00:01:19.838862+0000","last_clean":"2024-06-03T00:01:19.838862+0000","last_became_active":"2024-06-02T23:59:00.636161+0000","last_became_peered":"2024-06-02T23:59:00.636161+0000","last_unstale":"2024-06-03T00:01:19.838862+0000","last_undegraded":"2024-06-03T00:01:19.838862+0000","last_fullsized":"2024-06-03T00:01:19.838862+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-06-03T00:01:19.838748+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-06-03T00:01:19.838748+0000","last_clean_scrub_stamp":"2024-06-03T00:01:19.838748+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:21.409193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.509198+0000","last_change":"2024-06-02T23:59:01.588676+0000","last_active":"2024-06-03T00:01:10.509198+0000","last_peered":"2024-06-03T00:01:10.509198+0000","last_clean":"2024-06-03T00:01:10.509198+0000","last_became_active":"2024-06-02T23:59:01.588372+0000","last_became_peered":"2024-06-02T23:59:01.588372+0000","last_unstale":"2024-06-03T00:01:10.509198+0000","last_undegraded":"2024-06-03T00:01:10.509198+0000","last_fullsized":"2024-06-03T00:01:10.509198+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"69'1","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.509882+0000","last_change":"2024-06-02T23:59:00.646728+0000","last_active":"2024-06-03T00:01:15.509882+0000","last_peered":"2024-06-03T00:01:15.509882+0000","last_clean":"2024-06-03T00:01:15.509882+0000","last_became_active":"2024-06-02T23:59:00.646290+0000","last_became_peered":"2024-06-02T23:59:00.646290+0000","last_unstale":"2024-06-03T00:01:15.509882+0000","last_undegraded":"2024-06-03T00:01:15.509882+0000","last_fullsized":"2024-06-03T00:01:15.509882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.507082+0000","last_change":"2024-06-02T23:59:01.590261+0000","last_active":"2024-06-03T00:01:10.507082+0000","last_peered":"2024-06-03T00:01:10.507082+0000","last_clean":"2024-06-03T00:01:10.507082+0000","last_became_active":"2024-06-02T23:59:01.590016+0000","last_became_peered":"2024-06-02T23:59:01.590016+0000","last_unstale":"2024-06-03T00:01:10.507082+0000","last_undegraded":"2024-06-03T00:01:10.507082+0000","last_fullsized":"2024-06-03T00:01:10.507082+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.509846+0000","last_change":"2024-06-02T23:59:00.647565+0000","last_active":"2024-06-03T00:01:15.509846+0000","last_peered":"2024-06-03T00:01:15.509846+0000","last_clean":"2024-06-03T00:01:15.509846+0000","last_became_active":"2024-06-02T23:59:00.647144+0000","last_became_peered":"2024-06-02T23:59:00.647144+0000","last_unstale":"2024-06-03T00:01:15.509846+0000","last_undegraded":"2024-06-03T00:01:15.509846+0000","last_fullsized":"2024-06-03T00:01:15.509846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.507963+0000","last_change":"2024-06-02T23:59:01.579062+0000","last_active":"2024-06-03T00:01:10.507963+0000","last_peered":"2024-06-03T00:01:10.507963+0000","last_clean":"2024-06-03T00:01:10.507963+0000","last_became_active":"2024-06-02T23:59:01.578711+0000","last_became_peered":"2024-06-02T23:59:01.578711+0000","last_unstale":"2024-06-03T00:01:10.507963+0000","last_undegraded":"2024-06-03T00:01:10.507963+0000","last_fullsized":"2024-06-03T00:01:10.507963+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"72'3","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:18.498193+0000","last_change":"2024-06-03T00:01:18.498232+0000","last_active":"2024-06-03T00:01:18.498193+0000","last_peered":"2024-06-03T00:01:18.498193+0000","last_clean":"2024-06-03T00:01:18.498193+0000","last_became_active":"2024-06-02T23:59:00.637806+0000","last_became_peered":"2024-06-02T23:59:00.637806+0000","last_unstale":"2024-06-03T00:01:18.498193+0000","last_undegraded":"2024-06-03T00:01:18.498193+0000","last_fullsized":"2024-06-03T00:01:18.498193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-06-03T00:01:18.498127+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-06-03T00:01:18.498127+0000","last_clean_scrub_stamp":"2024-06-03T00:01:18.498127+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:54:57.991012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.509224+0000","last_change":"2024-06-02T23:59:01.591902+0000","last_active":"2024-06-03T00:01:10.509224+0000","last_peered":"2024-06-03T00:01:10.509224+0000","last_clean":"2024-06-03T00:01:10.509224+0000","last_became_active":"2024-06-02T23:59:01.590949+0000","last_became_peered":"2024-06-02T23:59:01.590949+0000","last_unstale":"2024-06-03T00:01:10.509224+0000","last_undegraded":"2024-06-03T00:01:10.509224+0000","last_fullsized":"2024-06-03T00:01:10.509224+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.266499+0000","last_change":"2024-06-03T00:01:20.266519+0000","last_active":"2024-06-03T00:01:20.266499+0000","last_peered":"2024-06-03T00:01:20.266499+0000","last_clean":"2024-06-03T00:01:20.266499+0000","last_became_active":"2024-06-02T23:59:00.639852+0000","last_became_peered":"2024-06-02T23:59:00.639852+0000","last_unstale":"2024-06-03T00:01:20.266499+0000","last_undegraded":"2024-06-03T00:01:20.266499+0000","last_fullsized":"2024-06-03T00:01:20.266499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:20.266432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:20.266432+0000","last_clean_scrub_stamp":"2024-06-03T00:01:20.266432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:44.529276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.507738+0000","last_change":"2024-06-02T23:59:01.588002+0000","last_active":"2024-06-03T00:01:15.507738+0000","last_peered":"2024-06-03T00:01:15.507738+0000","last_clean":"2024-06-03T00:01:15.507738+0000","last_became_active":"2024-06-02T23:59:01.587734+0000","last_became_peered":"2024-06-02T23:59:01.587734+0000","last_unstale":"2024-06-03T00:01:15.507738+0000","last_undegraded":"2024-06-03T00:01:15.507738+0000","last_fullsized":"2024-06-03T00:01:15.507738+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.507199+0000","last_change":"2024-06-02T23:59:00.643318+0000","last_active":"2024-06-03T00:01:10.507199+0000","last_peered":"2024-06-03T00:01:10.507199+0000","last_clean":"2024-06-03T00:01:10.507199+0000","last_became_active":"2024-06-02T23:59:00.643062+0000","last_became_peered":"2024-06-02T23:59:00.643062+0000","last_unstale":"2024-06-03T00:01:10.507199+0000","last_undegraded":"2024-06-03T00:01:10.507199+0000","last_fullsized":"2024-06-03T00:01:10.507199+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.507632+0000","last_change":"2024-06-02T23:59:01.586699+0000","last_active":"2024-06-03T00:01:15.507632+0000","last_peered":"2024-06-03T00:01:15.507632+0000","last_clean":"2024-06-03T00:01:15.507632+0000","last_became_active":"2024-06-02T23:59:01.586401+0000","last_became_peered":"2024-06-02T23:59:01.586401+0000","last_unstale":"2024-06-03T00:01:15.507632+0000","last_undegraded":"2024-06-03T00:01:15.507632+0000","last_fullsized":"2024-06-03T00:01:15.507632+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:18.867432+0000","last_change":"2024-06-03T00:01:18.867452+0000","last_active":"2024-06-03T00:01:18.867432+0000","last_peered":"2024-06-03T00:01:18.867432+0000","last_clean":"2024-06-03T00:01:18.867432+0000","last_became_active":"2024-06-02T23:59:00.635444+0000","last_became_peered":"2024-06-02T23:59:00.635444+0000","last_unstale":"2024-06-03T00:01:18.867432+0000","last_undegraded":"2024-06-03T00:01:18.867432+0000","last_fullsized":"2024-06-03T00:01:18.867432+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:18.867360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:18.867360+0000","last_clean_scrub_stamp":"2024-06-03T00:01:18.867360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:46:00.047867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.508399+0000","last_change":"2024-06-02T23:59:01.585521+0000","last_active":"2024-06-03T00:01:15.508399+0000","last_peered":"2024-06-03T00:01:15.508399+0000","last_clean":"2024-06-03T00:01:15.508399+0000","last_became_active":"2024-06-02T23:59:01.584978+0000","last_became_peered":"2024-06-02T23:59:01.584978+0000","last_unstale":"2024-06-03T00:01:15.508399+0000","last_undegraded":"2024-06-03T00:01:15.508399+0000","last_fullsized":"2024-06-03T00:01:15.508399+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"69'2","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.509255+0000","last_change":"2024-06-02T23:59:00.647401+0000","last_active":"2024-06-03T00:01:10.509255+0000","last_peered":"2024-06-03T00:01:10.509255+0000","last_clean":"2024-06-03T00:01:10.509255+0000","last_became_active":"2024-06-02T23:59:00.647038+0000","last_became_peered":"2024-06-02T23:59:00.647038+0000","last_unstale":"2024-06-03T00:01:10.509255+0000","last_undegraded":"2024-06-03T00:01:10.509255+0000","last_fullsized":"2024-06-03T00:01:10.509255+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.507566+0000","last_change":"2024-06-02T23:59:01.587184+0000","last_active":"2024-06-03T00:01:15.507566+0000","last_peered":"2024-06-03T00:01:15.507566+0000","last_clean":"2024-06-03T00:01:15.507566+0000","last_became_active":"2024-06-02T23:59:01.586774+0000","last_became_peered":"2024-06-02T23:59:01.586774+0000","last_unstale":"2024-06-03T00:01:15.507566+0000","last_undegraded":"2024-06-03T00:01:15.507566+0000","last_fullsized":"2024-06-03T00:01:15.507566+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.781361+0000","last_change":"2024-06-02T23:59:00.641736+0000","last_active":"2024-06-03T00:00:45.781361+0000","last_peered":"2024-06-03T00:00:45.781361+0000","last_clean":"2024-06-03T00:00:45.781361+0000","last_became_active":"2024-06-02T23:59:00.640889+0000","last_became_peered":"2024-06-02T23:59:00.640889+0000","last_unstale":"2024-06-03T00:00:45.781361+0000","last_undegraded":"2024-06-03T00:00:45.781361+0000","last_fullsized":"2024-06-03T00:00:45.781361+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:17:35.892006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.059830+0000","last_change":"2024-06-02T23:59:01.589758+0000","last_active":"2024-06-03T00:01:19.059830+0000","last_peered":"2024-06-03T00:01:19.059830+0000","last_clean":"2024-06-03T00:01:19.059830+0000","last_became_active":"2024-06-02T23:59:01.588438+0000","last_became_peered":"2024-06-02T23:59:01.588438+0000","last_unstale":"2024-06-03T00:01:19.059830+0000","last_undegraded":"2024-06-03T00:01:19.059830+0000","last_fullsized":"2024-06-03T00:01:19.059830+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:05.506621+0000","last_change":"2024-06-02T23:59:00.644933+0000","last_active":"2024-06-03T00:01:05.506621+0000","last_peered":"2024-06-03T00:01:05.506621+0000","last_clean":"2024-06-03T00:01:05.506621+0000","last_became_active":"2024-06-02T23:59:00.644680+0000","last_became_peered":"2024-06-02T23:59:00.644680+0000","last_unstale":"2024-06-03T00:01:05.506621+0000","last_undegraded":"2024-06-03T00:01:05.506621+0000","last_fullsized":"2024-06-03T00:01:05.506621+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:17.745201+0000","last_change":"2024-06-02T23:59:01.589967+0000","last_active":"2024-06-03T00:01:17.745201+0000","last_peered":"2024-06-03T00:01:17.745201+0000","last_clean":"2024-06-03T00:01:17.745201+0000","last_became_active":"2024-06-02T23:59:01.589146+0000","last_became_peered":"2024-06-02T23:59:01.589146+0000","last_unstale":"2024-06-03T00:01:17.745201+0000","last_undegraded":"2024-06-03T00:01:17.745201+0000","last_fullsized":"2024-06-03T00:01:17.745201+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:05.506502+0000","last_change":"2024-06-02T23:59:00.642493+0000","last_active":"2024-06-03T00:01:05.506502+0000","last_peered":"2024-06-03T00:01:05.506502+0000","last_clean":"2024-06-03T00:01:05.506502+0000","last_became_active":"2024-06-02T23:59:00.642225+0000","last_became_peered":"2024-06-02T23:59:00.642225+0000","last_unstale":"2024-06-03T00:01:05.506502+0000","last_undegraded":"2024-06-03T00:01:05.506502+0000","last_fullsized":"2024-06-03T00:01:05.506502+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.935075+0000","last_change":"2024-06-02T23:59:01.584170+0000","last_active":"2024-06-03T00:01:19.935075+0000","last_peered":"2024-06-03T00:01:19.935075+0000","last_clean":"2024-06-03T00:01:19.935075+0000","last_became_active":"2024-06-02T23:59:01.583901+0000","last_became_peered":"2024-06-02T23:59:01.583901+0000","last_unstale":"2024-06-03T00:01:19.935075+0000","last_undegraded":"2024-06-03T00:01:19.935075+0000","last_fullsized":"2024-06-03T00:01:19.935075+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:05.506487+0000","last_change":"2024-06-02T23:59:00.644379+0000","last_active":"2024-06-03T00:01:05.506487+0000","last_peered":"2024-06-03T00:01:05.506487+0000","last_clean":"2024-06-03T00:01:05.506487+0000","last_became_active":"2024-06-02T23:59:00.644115+0000","last_became_peered":"2024-06-02T23:59:00.644115+0000","last_unstale":"2024-06-03T00:01:05.506487+0000","last_undegraded":"2024-06-03T00:01:05.506487+0000","last_fullsized":"2024-06-03T00:01:05.506487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:17.745327+0000","last_change":"2024-06-02T23:59:01.587439+0000","last_active":"2024-06-03T00:01:17.745327+0000","last_peered":"2024-06-03T00:01:17.745327+0000","last_clean":"2024-06-03T00:01:17.745327+0000","last_became_active":"2024-06-02T23:59:01.587147+0000","last_became_peered":"2024-06-02T23:59:01.587147+0000","last_unstale":"2024-06-03T00:01:17.745327+0000","last_undegraded":"2024-06-03T00:01:17.745327+0000","last_fullsized":"2024-06-03T00:01:17.745327+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.820762+0000","last_change":"2024-06-03T00:01:19.820797+0000","last_active":"2024-06-03T00:01:19.820762+0000","last_peered":"2024-06-03T00:01:19.820762+0000","last_clean":"2024-06-03T00:01:19.820762+0000","last_became_active":"2024-06-02T23:59:00.643445+0000","last_became_peered":"2024-06-02T23:59:00.643445+0000","last_unstale":"2024-06-03T00:01:19.820762+0000","last_undegraded":"2024-06-03T00:01:19.820762+0000","last_fullsized":"2024-06-03T00:01:19.820762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:19.820672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:19.820672+0000","last_clean_scrub_stamp":"2024-06-03T00:01:19.820672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:58.610611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.059833+0000","last_change":"2024-06-02T23:59:01.583225+0000","last_active":"2024-06-03T00:01:19.059833+0000","last_peered":"2024-06-03T00:01:19.059833+0000","last_clean":"2024-06-03T00:01:19.059833+0000","last_became_active":"2024-06-02T23:59:01.582821+0000","last_became_peered":"2024-06-02T23:59:01.582821+0000","last_unstale":"2024-06-03T00:01:19.059833+0000","last_undegraded":"2024-06-03T00:01:19.059833+0000","last_fullsized":"2024-06-03T00:01:19.059833+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:00.506636+0000","last_change":"2024-06-02T23:59:00.644323+0000","last_active":"2024-06-03T00:01:00.506636+0000","last_peered":"2024-06-03T00:01:00.506636+0000","last_clean":"2024-06-03T00:01:00.506636+0000","last_became_active":"2024-06-02T23:59:00.643711+0000","last_became_peered":"2024-06-02T23:59:00.643711+0000","last_unstale":"2024-06-03T00:01:00.506636+0000","last_undegraded":"2024-06-03T00:01:00.506636+0000","last_fullsized":"2024-06-03T00:01:00.506636+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:15.509786+0000","last_change":"2024-06-02T23:59:01.587791+0000","last_active":"2024-06-03T00:01:15.509786+0000","last_peered":"2024-06-03T00:01:15.509786+0000","last_clean":"2024-06-03T00:01:15.509786+0000","last_became_active":"2024-06-02T23:59:01.587445+0000","last_became_peered":"2024-06-02T23:59:01.587445+0000","last_unstale":"2024-06-03T00:01:15.509786+0000","last_undegraded":"2024-06-03T00:01:15.509786+0000","last_fullsized":"2024-06-03T00:01:15.509786+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:59:00.616029+0000","last_clean_scrub_stamp":"2024-06-02T23:59:00.616029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"70'1","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:10.507267+0000","last_change":"2024-06-02T23:59:00.644532+0000","last_active":"2024-06-03T00:01:10.507267+0000","last_peered":"2024-06-03T00:01:10.507267+0000","last_clean":"2024-06-03T00:01:10.507267+0000","last_became_active":"2024-06-02T23:59:00.644293+0000","last_became_peered":"2024-06-02T23:59:00.644293+0000","last_unstale":"2024-06-03T00:01:10.507267+0000","last_undegraded":"2024-06-03T00:01:10.507267+0000","last_fullsized":"2024-06-03T00:01:10.507267+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:58:59.614390+0000","last_clean_scrub_stamp":"2024-06-02T23:58:59.614390+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"60'139","reported_seq":354,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:00:45.780839+0000","last_change":"2024-06-02T23:46:15.344722+0000","last_active":"2024-06-03T00:00:45.780839+0000","last_peered":"2024-06-03T00:00:45.780839+0000","last_clean":"2024-06-03T00:00:45.780839+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-03T00:00:45.780839+0000","last_undegraded":"2024-06-03T00:00:45.780839+0000","last_fullsized":"2024-06-03T00:00:45.780839+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T23:46:14.047555+0000","last_clean_scrub_stamp":"2024-06-02T23:46:14.047555+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:01:42.041810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":3806,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54820,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317020,"statfs":{"total":96636764160,"available":96580628480,"internally_reserved":0,"allocated":1466368,"data_stored":1024138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":434298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50068,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321772,"statfs":{"total":96636764160,"available":96585494528,"internally_reserved":0,"allocated":864256,"data_stored":433646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":434228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":880640,"data_stored":436676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54240,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317600,"statfs":{"total":96636764160,"available":96581222400,"internally_reserved":0,"allocated":876544,"data_stored":436654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575032,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":872448,"data_stored":433806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575031,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1466368,"data_stored":1024070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:01:21.127 INFO:tasks.ceph:pgid 8.3f last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.127 INFO:tasks.ceph:pgid 8.3e last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.128 INFO:tasks.ceph:pgid 8.3c last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.128 INFO:tasks.ceph:pgid 8.3b last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.128 INFO:tasks.ceph:pgid 8.3a last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.128 INFO:tasks.ceph:pgid 8.38 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.128 INFO:tasks.ceph:pgid 8.37 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.129 INFO:tasks.ceph:pgid 8.36 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.129 INFO:tasks.ceph:pgid 8.35 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.129 INFO:tasks.ceph:pgid 8.34 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.129 INFO:tasks.ceph:pgid 8.33 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.129 INFO:tasks.ceph:pgid 8.32 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.129 INFO:tasks.ceph:pgid 8.31 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.129 INFO:tasks.ceph:pgid 8.30 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.130 INFO:tasks.ceph:pgid 8.2f last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.130 INFO:tasks.ceph:pgid 8.2e last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.130 INFO:tasks.ceph:pgid 8.2d last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.130 INFO:tasks.ceph:pgid 8.2c last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.130 INFO:tasks.ceph:pgid 8.2b last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.130 INFO:tasks.ceph:pgid 8.2a last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.131 INFO:tasks.ceph:pgid 8.29 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.131 INFO:tasks.ceph:pgid 8.28 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.131 INFO:tasks.ceph:pgid 8.27 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.131 INFO:tasks.ceph:pgid 8.26 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.131 INFO:tasks.ceph:pgid 8.25 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.131 INFO:tasks.ceph:pgid 8.24 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.132 INFO:tasks.ceph:pgid 8.23 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.132 INFO:tasks.ceph:pgid 8.22 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.132 INFO:tasks.ceph:pgid 8.21 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.132 INFO:tasks.ceph:pgid 8.20 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.132 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.132 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.132 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.133 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.133 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.133 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.133 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.133 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.133 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.134 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.134 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.134 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.134 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.134 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.134 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.135 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.135 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.135 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.135 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.135 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.135 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.136 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.136 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.136 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.136 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.136 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.136 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.136 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.137 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.137 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.137 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.137 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.137 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.137 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.138 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.138 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.138 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.138 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.138 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.138 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.139 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.139 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.139 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.139 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.139 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.139 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.140 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.140 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.140 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.140 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.140 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.140 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.140 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.141 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.141 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-06-02T23:59:00.616029+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.141 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-06-02T23:58:59.614390+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=58, tm_sec=59, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.141 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-06-02T23:46:14.047555+0000 time.struct_time(tm_year=2024, tm_mon=6, tm_mday=2, tm_hour=23, tm_min=46, tm_sec=14, tm_wday=6, tm_yday=154, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=6, tm_mday=3, tm_hour=0, tm_min=1, tm_sec=16, tm_wday=0, tm_yday=155, tm_isdst=0) 2024-06-03T00:01:21.141 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-06-03T00:01:30.067 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-03T00:01:30.070 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-03T00:01:41.142 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-03T00:01:41.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.254+0000 7f5f6da1c640 1 Processor -- start 2024-06-03T00:01:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.254+0000 7f5f6da1c640 1 -- start start 2024-06-03T00:01:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.255+0000 7f5f6da1c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5f68161900 0x7f5f680d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.255+0000 7f5f6da1c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f680d2a60 con 0x7f5f680b4fa0 2024-06-03T00:01:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.255+0000 7f5f6da1c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f680d4a90 con 0x7f5f680b5510 2024-06-03T00:01:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.255+0000 7f5f6da1c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5f680cf5c0 con 0x7f5f68161900 2024-06-03T00:01:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.255+0000 7f5f677fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5f680b4fa0 0x7f5f680d2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33880/0 (socket says 172.21.15.96:33880) 2024-06-03T00:01:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.255+0000 7f5f677fe640 1 -- 172.21.15.96:0/1275042016 learned_addr learned my addr 172.21.15.96:0/1275042016 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-03T00:01:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f66ffd640 1 --2- 172.21.15.96:0/1275042016 >> v2:172.21.15.162:3300/0 conn(0x7f5f68161900 0x7f5f680d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 894463840 0 0) 0x7f5f680d2a60 con 0x7f5f680b4fa0 2024-06-03T00:01:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f50003520 con 0x7f5f680b4fa0 2024-06-03T00:01:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2051851395 0 0) 0x7f5f50003520 con 0x7f5f680b4fa0 2024-06-03T00:01:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 >> v2:172.21.15.162:3300/0 conn(0x7f5f68161900 msgr2=0x7f5f680d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 --2- 172.21.15.96:0/1275042016 >> v2:172.21.15.162:3300/0 conn(0x7f5f68161900 0x7f5f680d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 >> v1:172.21.15.162:6789/0 conn(0x7f5f680b5510 legacy=0x7f5f680d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f680d4d70 con 0x7f5f680b4fa0 2024-06-03T00:01:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f5f600019f0 con 0x7f5f680b4fa0 2024-06-03T00:01:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 >> v1:172.21.15.96:6789/0 conn(0x7f5f680b4fa0 legacy=0x7f5f680d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f500039b0 0x7f5f50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f50004800 0x7f5f50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5f680cf5c0 con 0x7f5f500051c0 2024-06-03T00:01:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5000c160 con 0x7f5f50004800 2024-06-03T00:01:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5000c360 con 0x7f5f500039b0 2024-06-03T00:01:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f677fe640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f667fc640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f50004800 0x7f5f50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f66ffd640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f500039b0 0x7f5f50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f677fe640 1 -- 172.21.15.96:0/1275042016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f500039b0 msgr2=0x7f5f50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f677fe640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f500039b0 0x7f5f50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f677fe640 1 -- 172.21.15.96:0/1275042016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f50004800 msgr2=0x7f5f50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.256+0000 7f5f677fe640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f50004800 0x7f5f50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.257+0000 7f5f677fe640 1 -- 172.21.15.96:0/1275042016 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f50003520 con 0x7f5f500051c0 2024-06-03T00:01:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.257+0000 7f5f667fc640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f50004800 0x7f5f50004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.257+0000 7f5f677fe640 1 -- 172.21.15.96:0/1275042016 reap_dead start 2024-06-03T00:01:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.257+0000 7f5f677fe640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f5000b9c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000a860 tx=0x7f5f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d57415f41b7b7e server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.257+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000a480 con 0x7f5f500051c0 2024-06-03T00:01:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.257+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f6002f070 con 0x7f5f500051c0 2024-06-03T00:01:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.257+0000 7f5f65ffb640 1 -- 172.21.15.96:0/1275042016 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f6002bcc0 con 0x7f5f500051c0 2024-06-03T00:01:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.258+0000 7f5f6da1c640 1 -- 172.21.15.96:0/1275042016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 msgr2=0x7f5f5000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.258+0000 7f5f6da1c640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f5000b9c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000a860 tx=0x7f5f50005830 comp rx=0 tx=0).stop 2024-06-03T00:01:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.258+0000 7f5f6da1c640 1 -- 172.21.15.96:0/1275042016 shutdown_connections 2024-06-03T00:01:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.258+0000 7f5f6da1c640 1 --2- 172.21.15.96:0/1275042016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f5000b9c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.258+0000 7f5f6da1c640 1 -- 172.21.15.96:0/1275042016 >> 172.21.15.96:0/1275042016 conn(0x7f5f6809d3b0 msgr2=0x7f5f680d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.258+0000 7f5f6da1c640 1 -- 172.21.15.96:0/1275042016 shutdown_connections 2024-06-03T00:01:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.258+0000 7f5f6da1c640 1 -- 172.21.15.96:0/1275042016 wait complete. 2024-06-03T00:01:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.259+0000 7f5f6da1c640 1 Processor -- start 2024-06-03T00:01:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.259+0000 7f5f6da1c640 1 -- start start 2024-06-03T00:01:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f6da1c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f68158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f6da1c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f680b0ca0 0x7f5f680b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f6da1c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f68159ee0 0x7f5f6815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f6da1c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f5f680cfae0 con 0x7f5f500051c0 2024-06-03T00:01:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f6da1c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f680caf70 con 0x7f5f68159ee0 2024-06-03T00:01:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f6da1c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f680d4780 con 0x7f5f680b0ca0 2024-06-03T00:01:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f66ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f68158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f66ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f68158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52018/0 (socket says 172.21.15.96:52018) 2024-06-03T00:01:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f66ffd640 1 -- 172.21.15.96:0/3818768773 learned_addr learned my addr 172.21.15.96:0/3818768773 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:41.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f667fc640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f680b0ca0 0x7f5f680b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f677fe640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f68159ee0 0x7f5f6815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f66ffd640 1 -- 172.21.15.96:0/3818768773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f680b0ca0 msgr2=0x7f5f680b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f66ffd640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f680b0ca0 0x7f5f680b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f66ffd640 1 -- 172.21.15.96:0/3818768773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f68159ee0 msgr2=0x7f5f6815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f66ffd640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f68159ee0 0x7f5f6815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f66ffd640 1 -- 172.21.15.96:0/3818768773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6815ac10 con 0x7f5f500051c0 2024-06-03T00:01:41.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.260+0000 7f5f677fe640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f68159ee0 0x7f5f6815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.261+0000 7f5f667fc640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f680b0ca0 0x7f5f680b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-03T00:01:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.261+0000 7f5f66ffd640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f68158100 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5f580115a0 tx=0x7f5f58011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.261+0000 7f5f4ffff640 1 -- 172.21.15.96:0/3818768773 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58015930 con 0x7f5f500051c0 2024-06-03T00:01:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.261+0000 7f5f4ffff640 1 -- 172.21.15.96:0/3818768773 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f58015ad0 con 0x7f5f500051c0 2024-06-03T00:01:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.261+0000 7f5f6da1c640 1 -- 172.21.15.96:0/3818768773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6815aef0 con 0x7f5f500051c0 2024-06-03T00:01:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.261+0000 7f5f4ffff640 1 -- 172.21.15.96:0/3818768773 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800f480 con 0x7f5f500051c0 2024-06-03T00:01:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.261+0000 7f5f6da1c640 1 -- 172.21.15.96:0/3818768773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6815b4b0 con 0x7f5f500051c0 2024-06-03T00:01:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.262+0000 7f5f6da1c640 1 -- 172.21.15.96:0/3818768773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f680683e0 con 0x7f5f500051c0 2024-06-03T00:01:41.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.262+0000 7f5f4ffff640 1 -- 172.21.15.96:0/3818768773 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f5f5800f620 con 0x7f5f500051c0 2024-06-03T00:01:41.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.263+0000 7f5f4ffff640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5f5406be60 0x7f5f5406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.263+0000 7f5f4ffff640 1 -- 172.21.15.96:0/3818768773 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f5f5808b8a0 con 0x7f5f500051c0 2024-06-03T00:01:41.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.263+0000 7f5f667fc640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5f5406be60 0x7f5f5406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.263+0000 7f5f667fc640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5f5406be60 0x7f5f5406e320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c000c00 tx=0x7f5f5c009040 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:41.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.267+0000 7f5f4ffff640 1 -- 172.21.15.96:0/3818768773 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f5f58019030 con 0x7f5f500051c0 2024-06-03T00:01:41.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.438+0000 7f5f6da1c640 1 -- 172.21.15.96:0/3818768773 --> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f680ce1e0 con 0x7f5f5406be60 2024-06-03T00:01:41.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.444+0000 7f5f4ffff640 1 -- 172.21.15.96:0/3818768773 <== mgr.5197 v2:172.21.15.96:6836/752549631 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251904 (secure 0 0 0) 0x7f5f680ce1e0 con 0x7f5f5406be60 2024-06-03T00:01:41.447 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-03T00:01:41.448 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-06-03T00:01:41.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 -- 172.21.15.96:0/3818768773 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5f5406be60 msgr2=0x7f5f5406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5f5406be60 0x7f5f5406e320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c000c00 tx=0x7f5f5c009040 comp rx=0 tx=0).stop 2024-06-03T00:01:41.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 -- 172.21.15.96:0/3818768773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 msgr2=0x7f5f68158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f68158100 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5f580115a0 tx=0x7f5f58011a60 comp rx=0 tx=0).stop 2024-06-03T00:01:41.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 -- 172.21.15.96:0/3818768773 shutdown_connections 2024-06-03T00:01:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f5f5406be60 0x7f5f5406e320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f68159ee0 0x7f5f6815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f680b0ca0 0x7f5f680b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 --2- 172.21.15.96:0/3818768773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f500051c0 0x7f5f68158100 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 -- 172.21.15.96:0/3818768773 >> 172.21.15.96:0/3818768773 conn(0x7f5f6809d3b0 msgr2=0x7f5f6815e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 -- 172.21.15.96:0/3818768773 shutdown_connections 2024-06-03T00:01:41.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.447+0000 7f5f6da1c640 1 -- 172.21.15.96:0/3818768773 wait complete. 2024-06-03T00:01:41.458 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-06-03T00:01:40.532365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594174,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":249,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319848,"kb_used_data":7976,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754654872,"statfs":{"total":773094113280,"available":772766588928,"internally_reserved":0,"allocated":8167424,"data_stored":4657516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:22.455400+0000","last_change":"2024-06-03T00:01:22.455425+0000","last_active":"2024-06-03T00:01:22.455400+0000","last_peered":"2024-06-03T00:01:22.455400+0000","last_clean":"2024-06-03T00:01:22.455400+0000","last_became_active":"2024-06-02T23:59:01.586669+0000","last_became_peered":"2024-06-02T23:59:01.586669+0000","last_unstale":"2024-06-03T00:01:22.455400+0000","last_undegraded":"2024-06-03T00:01:22.455400+0000","last_fullsized":"2024-06-03T00:01:22.455400+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:22.455314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:22.455314+0000","last_clean_scrub_stamp":"2024-06-03T00:01:22.455314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:30.955743+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:27.078794+0000","last_change":"2024-06-03T00:01:27.078833+0000","last_active":"2024-06-03T00:01:27.078794+0000","last_peered":"2024-06-03T00:01:27.078794+0000","last_clean":"2024-06-03T00:01:27.078794+0000","last_became_active":"2024-06-02T23:59:01.582687+0000","last_became_peered":"2024-06-02T23:59:01.582687+0000","last_unstale":"2024-06-03T00:01:27.078794+0000","last_undegraded":"2024-06-03T00:01:27.078794+0000","last_fullsized":"2024-06-03T00:01:27.078794+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:27.078654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:27.078654+0000","last_clean_scrub_stamp":"2024-06-03T00:01:27.078654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:14:17.516705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.634843+0000","last_change":"2024-06-03T00:01:19.634883+0000","last_active":"2024-06-03T00:01:19.634843+0000","last_peered":"2024-06-03T00:01:19.634843+0000","last_clean":"2024-06-03T00:01:19.634843+0000","last_became_active":"2024-06-02T23:59:01.586006+0000","last_became_peered":"2024-06-02T23:59:01.586006+0000","last_unstale":"2024-06-03T00:01:19.634843+0000","last_undegraded":"2024-06-03T00:01:19.634843+0000","last_fullsized":"2024-06-03T00:01:19.634843+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:19.634722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:19.634722+0000","last_clean_scrub_stamp":"2024-06-03T00:01:19.634722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:33.809070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:29.080997+0000","last_change":"2024-06-03T00:01:29.081042+0000","last_active":"2024-06-03T00:01:29.080997+0000","last_peered":"2024-06-03T00:01:29.080997+0000","last_clean":"2024-06-03T00:01:29.080997+0000","last_became_active":"2024-06-02T23:59:01.586761+0000","last_became_peered":"2024-06-02T23:59:01.586761+0000","last_unstale":"2024-06-03T00:01:29.080997+0000","last_undegraded":"2024-06-03T00:01:29.080997+0000","last_fullsized":"2024-06-03T00:01:29.080997+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:29.080901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:29.080901+0000","last_clean_scrub_stamp":"2024-06-03T00:01:29.080901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:26.087767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:23.802713+0000","last_change":"2024-06-03T00:01:23.802713+0000","last_active":"2024-06-03T00:01:23.802713+0000","last_peered":"2024-06-03T00:01:23.802713+0000","last_clean":"2024-06-03T00:01:23.802713+0000","last_became_active":"2024-06-02T23:59:01.581028+0000","last_became_peered":"2024-06-02T23:59:01.581028+0000","last_unstale":"2024-06-03T00:01:23.802713+0000","last_undegraded":"2024-06-03T00:01:23.802713+0000","last_fullsized":"2024-06-03T00:01:23.802713+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:23.802607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:23.802607+0000","last_clean_scrub_stamp":"2024-06-03T00:01:23.802607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:05:09.082444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:24.506529+0000","last_change":"2024-06-03T00:01:24.506529+0000","last_active":"2024-06-03T00:01:24.506529+0000","last_peered":"2024-06-03T00:01:24.506529+0000","last_clean":"2024-06-03T00:01:24.506529+0000","last_became_active":"2024-06-02T23:59:01.586996+0000","last_became_peered":"2024-06-02T23:59:01.586996+0000","last_unstale":"2024-06-03T00:01:24.506529+0000","last_undegraded":"2024-06-03T00:01:24.506529+0000","last_fullsized":"2024-06-03T00:01:24.506529+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:24.506420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:24.506420+0000","last_clean_scrub_stamp":"2024-06-03T00:01:24.506420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:52:39.349438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:18.663664+0000","last_change":"2024-06-03T00:01:18.663664+0000","last_active":"2024-06-03T00:01:18.663664+0000","last_peered":"2024-06-03T00:01:18.663664+0000","last_clean":"2024-06-03T00:01:18.663664+0000","last_became_active":"2024-06-02T23:59:01.583488+0000","last_became_peered":"2024-06-02T23:59:01.583488+0000","last_unstale":"2024-06-03T00:01:18.663664+0000","last_undegraded":"2024-06-03T00:01:18.663664+0000","last_fullsized":"2024-06-03T00:01:18.663664+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:18.663578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:18.663578+0000","last_clean_scrub_stamp":"2024-06-03T00:01:18.663578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:11.592237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:31.171120+0000","last_change":"2024-06-03T00:01:31.171120+0000","last_active":"2024-06-03T00:01:31.171120+0000","last_peered":"2024-06-03T00:01:31.171120+0000","last_clean":"2024-06-03T00:01:31.171120+0000","last_became_active":"2024-06-02T23:59:01.588310+0000","last_became_peered":"2024-06-02T23:59:01.588310+0000","last_unstale":"2024-06-03T00:01:31.171120+0000","last_undegraded":"2024-06-03T00:01:31.171120+0000","last_fullsized":"2024-06-03T00:01:31.171120+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:31.170955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:31.170955+0000","last_clean_scrub_stamp":"2024-06-03T00:01:31.170955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:38:20.007840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:34.117311+0000","last_change":"2024-06-03T00:01:34.117335+0000","last_active":"2024-06-03T00:01:34.117311+0000","last_peered":"2024-06-03T00:01:34.117311+0000","last_clean":"2024-06-03T00:01:34.117311+0000","last_became_active":"2024-06-02T23:59:01.592704+0000","last_became_peered":"2024-06-02T23:59:01.592704+0000","last_unstale":"2024-06-03T00:01:34.117311+0000","last_undegraded":"2024-06-03T00:01:34.117311+0000","last_fullsized":"2024-06-03T00:01:34.117311+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:34.117218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:34.117218+0000","last_clean_scrub_stamp":"2024-06-03T00:01:34.117218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:18:14.653106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:25.525599+0000","last_change":"2024-06-03T00:01:25.525599+0000","last_active":"2024-06-03T00:01:25.525599+0000","last_peered":"2024-06-03T00:01:25.525599+0000","last_clean":"2024-06-03T00:01:25.525599+0000","last_became_active":"2024-06-02T23:59:01.588961+0000","last_became_peered":"2024-06-02T23:59:01.588961+0000","last_unstale":"2024-06-03T00:01:25.525599+0000","last_undegraded":"2024-06-03T00:01:25.525599+0000","last_fullsized":"2024-06-03T00:01:25.525599+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:25.525468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:25.525468+0000","last_clean_scrub_stamp":"2024-06-03T00:01:25.525468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:12:25.010113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.858629+0000","last_change":"2024-06-03T00:01:20.858629+0000","last_active":"2024-06-03T00:01:20.858629+0000","last_peered":"2024-06-03T00:01:20.858629+0000","last_clean":"2024-06-03T00:01:20.858629+0000","last_became_active":"2024-06-02T23:59:01.582876+0000","last_became_peered":"2024-06-02T23:59:01.582876+0000","last_unstale":"2024-06-03T00:01:20.858629+0000","last_undegraded":"2024-06-03T00:01:20.858629+0000","last_fullsized":"2024-06-03T00:01:20.858629+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:20.858540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:20.858540+0000","last_clean_scrub_stamp":"2024-06-03T00:01:20.858540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:42:47.927798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:32.137048+0000","last_change":"2024-06-03T00:01:32.137074+0000","last_active":"2024-06-03T00:01:32.137048+0000","last_peered":"2024-06-03T00:01:32.137048+0000","last_clean":"2024-06-03T00:01:32.137048+0000","last_became_active":"2024-06-02T23:59:01.589067+0000","last_became_peered":"2024-06-02T23:59:01.589067+0000","last_unstale":"2024-06-03T00:01:32.137048+0000","last_undegraded":"2024-06-03T00:01:32.137048+0000","last_fullsized":"2024-06-03T00:01:32.137048+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:32.136915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:32.136915+0000","last_clean_scrub_stamp":"2024-06-03T00:01:32.136915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:37:56.024017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:28.546306+0000","last_change":"2024-06-03T00:01:28.546306+0000","last_active":"2024-06-03T00:01:28.546306+0000","last_peered":"2024-06-03T00:01:28.546306+0000","last_clean":"2024-06-03T00:01:28.546306+0000","last_became_active":"2024-06-02T23:59:01.590545+0000","last_became_peered":"2024-06-02T23:59:01.590545+0000","last_unstale":"2024-06-03T00:01:28.546306+0000","last_undegraded":"2024-06-03T00:01:28.546306+0000","last_fullsized":"2024-06-03T00:01:28.546306+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:28.546136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:28.546136+0000","last_clean_scrub_stamp":"2024-06-03T00:01:28.546136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:02:36.240969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:21.611539+0000","last_change":"2024-06-03T00:01:21.611539+0000","last_active":"2024-06-03T00:01:21.611539+0000","last_peered":"2024-06-03T00:01:21.611539+0000","last_clean":"2024-06-03T00:01:21.611539+0000","last_became_active":"2024-06-02T23:59:01.582568+0000","last_became_peered":"2024-06-02T23:59:01.582568+0000","last_unstale":"2024-06-03T00:01:21.611539+0000","last_undegraded":"2024-06-03T00:01:21.611539+0000","last_fullsized":"2024-06-03T00:01:21.611539+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:21.611440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:21.611440+0000","last_clean_scrub_stamp":"2024-06-03T00:01:21.611440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:42:09.991310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:32.099002+0000","last_change":"2024-06-03T00:01:32.099034+0000","last_active":"2024-06-03T00:01:32.099002+0000","last_peered":"2024-06-03T00:01:32.099002+0000","last_clean":"2024-06-03T00:01:32.099002+0000","last_became_active":"2024-06-02T23:59:01.591265+0000","last_became_peered":"2024-06-02T23:59:01.591265+0000","last_unstale":"2024-06-03T00:01:32.099002+0000","last_undegraded":"2024-06-03T00:01:32.099002+0000","last_fullsized":"2024-06-03T00:01:32.099002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:32.098913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:32.098913+0000","last_clean_scrub_stamp":"2024-06-03T00:01:32.098913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:56.361756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:27.510419+0000","last_change":"2024-06-03T00:01:27.510438+0000","last_active":"2024-06-03T00:01:27.510419+0000","last_peered":"2024-06-03T00:01:27.510419+0000","last_clean":"2024-06-03T00:01:27.510419+0000","last_became_active":"2024-06-02T23:59:01.590445+0000","last_became_peered":"2024-06-02T23:59:01.590445+0000","last_unstale":"2024-06-03T00:01:27.510419+0000","last_undegraded":"2024-06-03T00:01:27.510419+0000","last_fullsized":"2024-06-03T00:01:27.510419+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:27.510335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:27.510335+0000","last_clean_scrub_stamp":"2024-06-03T00:01:27.510335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:02:37.397209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:22.659716+0000","last_change":"2024-06-03T00:01:22.659716+0000","last_active":"2024-06-03T00:01:22.659716+0000","last_peered":"2024-06-03T00:01:22.659716+0000","last_clean":"2024-06-03T00:01:22.659716+0000","last_became_active":"2024-06-02T23:59:01.586784+0000","last_became_peered":"2024-06-02T23:59:01.586784+0000","last_unstale":"2024-06-03T00:01:22.659716+0000","last_undegraded":"2024-06-03T00:01:22.659716+0000","last_fullsized":"2024-06-03T00:01:22.659716+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:22.659609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:22.659609+0000","last_clean_scrub_stamp":"2024-06-03T00:01:22.659609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:04:15.845887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:28.101273+0000","last_change":"2024-06-03T00:01:28.101297+0000","last_active":"2024-06-03T00:01:28.101273+0000","last_peered":"2024-06-03T00:01:28.101273+0000","last_clean":"2024-06-03T00:01:28.101273+0000","last_became_active":"2024-06-02T23:59:01.582680+0000","last_became_peered":"2024-06-02T23:59:01.582680+0000","last_unstale":"2024-06-03T00:01:28.101273+0000","last_undegraded":"2024-06-03T00:01:28.101273+0000","last_fullsized":"2024-06-03T00:01:28.101273+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:28.101153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:28.101153+0000","last_clean_scrub_stamp":"2024-06-03T00:01:28.101153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:32:47.920058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:31.613896+0000","last_change":"2024-06-03T00:01:31.613917+0000","last_active":"2024-06-03T00:01:31.613896+0000","last_peered":"2024-06-03T00:01:31.613896+0000","last_clean":"2024-06-03T00:01:31.613896+0000","last_became_active":"2024-06-02T23:59:01.582422+0000","last_became_peered":"2024-06-02T23:59:01.582422+0000","last_unstale":"2024-06-03T00:01:31.613896+0000","last_undegraded":"2024-06-03T00:01:31.613896+0000","last_fullsized":"2024-06-03T00:01:31.613896+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:31.613800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:31.613800+0000","last_clean_scrub_stamp":"2024-06-03T00:01:31.613800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:12:01.332881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:28.035868+0000","last_change":"2024-06-03T00:01:28.035897+0000","last_active":"2024-06-03T00:01:28.035868+0000","last_peered":"2024-06-03T00:01:28.035868+0000","last_clean":"2024-06-03T00:01:28.035868+0000","last_became_active":"2024-06-02T23:59:01.590601+0000","last_became_peered":"2024-06-02T23:59:01.590601+0000","last_unstale":"2024-06-03T00:01:28.035868+0000","last_undegraded":"2024-06-03T00:01:28.035868+0000","last_fullsized":"2024-06-03T00:01:28.035868+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:28.035767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:28.035767+0000","last_clean_scrub_stamp":"2024-06-03T00:01:28.035767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:52.352919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:32.011262+0000","last_change":"2024-06-03T00:01:32.011283+0000","last_active":"2024-06-03T00:01:32.011262+0000","last_peered":"2024-06-03T00:01:32.011262+0000","last_clean":"2024-06-03T00:01:32.011262+0000","last_became_active":"2024-06-02T23:59:01.593596+0000","last_became_peered":"2024-06-02T23:59:01.593596+0000","last_unstale":"2024-06-03T00:01:32.011262+0000","last_undegraded":"2024-06-03T00:01:32.011262+0000","last_fullsized":"2024-06-03T00:01:32.011262+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:32.011191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:32.011191+0000","last_clean_scrub_stamp":"2024-06-03T00:01:32.011191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:12:31.495836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:30.170257+0000","last_change":"2024-06-03T00:01:30.170280+0000","last_active":"2024-06-03T00:01:30.170257+0000","last_peered":"2024-06-03T00:01:30.170257+0000","last_clean":"2024-06-03T00:01:30.170257+0000","last_became_active":"2024-06-02T23:59:01.587641+0000","last_became_peered":"2024-06-02T23:59:01.587641+0000","last_unstale":"2024-06-03T00:01:30.170257+0000","last_undegraded":"2024-06-03T00:01:30.170257+0000","last_fullsized":"2024-06-03T00:01:30.170257+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:30.170163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:30.170163+0000","last_clean_scrub_stamp":"2024-06-03T00:01:30.170163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:53:17.722302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:21.865732+0000","last_change":"2024-06-03T00:01:21.865782+0000","last_active":"2024-06-03T00:01:21.865732+0000","last_peered":"2024-06-03T00:01:21.865732+0000","last_clean":"2024-06-03T00:01:21.865732+0000","last_became_active":"2024-06-02T23:59:01.584358+0000","last_became_peered":"2024-06-02T23:59:01.584358+0000","last_unstale":"2024-06-03T00:01:21.865732+0000","last_undegraded":"2024-06-03T00:01:21.865732+0000","last_fullsized":"2024-06-03T00:01:21.865732+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:21.865622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:21.865622+0000","last_clean_scrub_stamp":"2024-06-03T00:01:21.865622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:32:39.620671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:23.683781+0000","last_change":"2024-06-03T00:01:23.683805+0000","last_active":"2024-06-03T00:01:23.683781+0000","last_peered":"2024-06-03T00:01:23.683781+0000","last_clean":"2024-06-03T00:01:23.683781+0000","last_became_active":"2024-06-02T23:59:01.582904+0000","last_became_peered":"2024-06-02T23:59:01.582904+0000","last_unstale":"2024-06-03T00:01:23.683781+0000","last_undegraded":"2024-06-03T00:01:23.683781+0000","last_fullsized":"2024-06-03T00:01:23.683781+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:23.683696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:23.683696+0000","last_clean_scrub_stamp":"2024-06-03T00:01:23.683696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:07.932729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:38.657313+0000","last_change":"2024-06-03T00:01:38.657352+0000","last_active":"2024-06-03T00:01:38.657313+0000","last_peered":"2024-06-03T00:01:38.657313+0000","last_clean":"2024-06-03T00:01:38.657313+0000","last_became_active":"2024-06-02T23:59:01.589760+0000","last_became_peered":"2024-06-02T23:59:01.589760+0000","last_unstale":"2024-06-03T00:01:38.657313+0000","last_undegraded":"2024-06-03T00:01:38.657313+0000","last_fullsized":"2024-06-03T00:01:38.657313+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:38.657210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:38.657210+0000","last_clean_scrub_stamp":"2024-06-03T00:01:38.657210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:56:30.278636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:29.175648+0000","last_change":"2024-06-03T00:01:29.175685+0000","last_active":"2024-06-03T00:01:29.175648+0000","last_peered":"2024-06-03T00:01:29.175648+0000","last_clean":"2024-06-03T00:01:29.175648+0000","last_became_active":"2024-06-02T23:59:01.585010+0000","last_became_peered":"2024-06-02T23:59:01.585010+0000","last_unstale":"2024-06-03T00:01:29.175648+0000","last_undegraded":"2024-06-03T00:01:29.175648+0000","last_fullsized":"2024-06-03T00:01:29.175648+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:29.175559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:29.175559+0000","last_clean_scrub_stamp":"2024-06-03T00:01:29.175559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:48:46.454922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:29.516585+0000","last_change":"2024-06-03T00:01:29.516629+0000","last_active":"2024-06-03T00:01:29.516585+0000","last_peered":"2024-06-03T00:01:29.516585+0000","last_clean":"2024-06-03T00:01:29.516585+0000","last_became_active":"2024-06-02T23:59:01.592789+0000","last_became_peered":"2024-06-02T23:59:01.592789+0000","last_unstale":"2024-06-03T00:01:29.516585+0000","last_undegraded":"2024-06-03T00:01:29.516585+0000","last_fullsized":"2024-06-03T00:01:29.516585+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:29.516487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:29.516487+0000","last_clean_scrub_stamp":"2024-06-03T00:01:29.516487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:13:06.580013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:29.039753+0000","last_change":"2024-06-03T00:01:29.039779+0000","last_active":"2024-06-03T00:01:29.039753+0000","last_peered":"2024-06-03T00:01:29.039753+0000","last_clean":"2024-06-03T00:01:29.039753+0000","last_became_active":"2024-06-02T23:59:01.590827+0000","last_became_peered":"2024-06-02T23:59:01.590827+0000","last_unstale":"2024-06-03T00:01:29.039753+0000","last_undegraded":"2024-06-03T00:01:29.039753+0000","last_fullsized":"2024-06-03T00:01:29.039753+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:29.039660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:29.039660+0000","last_clean_scrub_stamp":"2024-06-03T00:01:29.039660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:37.540089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:35.649238+0000","last_change":"2024-06-03T00:01:35.649264+0000","last_active":"2024-06-03T00:01:35.649238+0000","last_peered":"2024-06-03T00:01:35.649238+0000","last_clean":"2024-06-03T00:01:35.649238+0000","last_became_active":"2024-06-02T23:59:01.589456+0000","last_became_peered":"2024-06-02T23:59:01.589456+0000","last_unstale":"2024-06-03T00:01:35.649238+0000","last_undegraded":"2024-06-03T00:01:35.649238+0000","last_fullsized":"2024-06-03T00:01:35.649238+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:35.649142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:35.649142+0000","last_clean_scrub_stamp":"2024-06-03T00:01:35.649142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:35:20.382263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:30.102608+0000","last_change":"2024-06-03T00:01:30.102646+0000","last_active":"2024-06-03T00:01:30.102608+0000","last_peered":"2024-06-03T00:01:30.102608+0000","last_clean":"2024-06-03T00:01:30.102608+0000","last_became_active":"2024-06-02T23:59:01.588773+0000","last_became_peered":"2024-06-02T23:59:01.588773+0000","last_unstale":"2024-06-03T00:01:30.102608+0000","last_undegraded":"2024-06-03T00:01:30.102608+0000","last_fullsized":"2024-06-03T00:01:30.102608+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:30.102504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:30.102504+0000","last_clean_scrub_stamp":"2024-06-03T00:01:30.102504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:20.313320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.611840+0000","last_change":"2024-06-03T00:01:20.611858+0000","last_active":"2024-06-03T00:01:20.611840+0000","last_peered":"2024-06-03T00:01:20.611840+0000","last_clean":"2024-06-03T00:01:20.611840+0000","last_became_active":"2024-06-02T23:59:01.585466+0000","last_became_peered":"2024-06-02T23:59:01.585466+0000","last_unstale":"2024-06-03T00:01:20.611840+0000","last_undegraded":"2024-06-03T00:01:20.611840+0000","last_fullsized":"2024-06-03T00:01:20.611840+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:20.611765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:20.611765+0000","last_clean_scrub_stamp":"2024-06-03T00:01:20.611765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:23:28.937924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:27.446300+0000","last_change":"2024-06-03T00:01:27.446323+0000","last_active":"2024-06-03T00:01:27.446300+0000","last_peered":"2024-06-03T00:01:27.446300+0000","last_clean":"2024-06-03T00:01:27.446300+0000","last_became_active":"2024-06-02T23:59:01.585721+0000","last_became_peered":"2024-06-02T23:59:01.585721+0000","last_unstale":"2024-06-03T00:01:27.446300+0000","last_undegraded":"2024-06-03T00:01:27.446300+0000","last_fullsized":"2024-06-03T00:01:27.446300+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:27.446223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:27.446223+0000","last_clean_scrub_stamp":"2024-06-03T00:01:27.446223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:38:57.760196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:26.121006+0000","last_change":"2024-06-03T00:01:26.121050+0000","last_active":"2024-06-03T00:01:26.121006+0000","last_peered":"2024-06-03T00:01:26.121006+0000","last_clean":"2024-06-03T00:01:26.121006+0000","last_became_active":"2024-06-02T23:59:01.581438+0000","last_became_peered":"2024-06-02T23:59:01.581438+0000","last_unstale":"2024-06-03T00:01:26.121006+0000","last_undegraded":"2024-06-03T00:01:26.121006+0000","last_fullsized":"2024-06-03T00:01:26.121006+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:26.120920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:26.120920+0000","last_clean_scrub_stamp":"2024-06-03T00:01:26.120920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:10.369953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"72'6","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:25.039354+0000","last_change":"2024-06-03T00:01:25.039413+0000","last_active":"2024-06-03T00:01:25.039354+0000","last_peered":"2024-06-03T00:01:25.039354+0000","last_clean":"2024-06-03T00:01:25.039354+0000","last_became_active":"2024-06-02T23:59:00.647031+0000","last_became_peered":"2024-06-02T23:59:00.647031+0000","last_unstale":"2024-06-03T00:01:25.039354+0000","last_undegraded":"2024-06-03T00:01:25.039354+0000","last_fullsized":"2024-06-03T00:01:25.039354+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'6","last_scrub_stamp":"2024-06-03T00:01:25.039249+0000","last_deep_scrub":"72'6","last_deep_scrub_stamp":"2024-06-03T00:01:25.039249+0000","last_clean_scrub_stamp":"2024-06-03T00:01:25.039249+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:44:25.500302+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:28.489773+0000","last_change":"2024-06-03T00:01:28.489797+0000","last_active":"2024-06-03T00:01:28.489773+0000","last_peered":"2024-06-03T00:01:28.489773+0000","last_clean":"2024-06-03T00:01:28.489773+0000","last_became_active":"2024-06-02T23:59:01.586813+0000","last_became_peered":"2024-06-02T23:59:01.586813+0000","last_unstale":"2024-06-03T00:01:28.489773+0000","last_undegraded":"2024-06-03T00:01:28.489773+0000","last_fullsized":"2024-06-03T00:01:28.489773+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:28.489689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:28.489689+0000","last_clean_scrub_stamp":"2024-06-03T00:01:28.489689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:53:15.360728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"69'1","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.509601+0000","last_change":"2024-06-03T00:01:19.509640+0000","last_active":"2024-06-03T00:01:19.509601+0000","last_peered":"2024-06-03T00:01:19.509601+0000","last_clean":"2024-06-03T00:01:19.509601+0000","last_became_active":"2024-06-02T23:59:00.638579+0000","last_became_peered":"2024-06-02T23:59:00.638579+0000","last_unstale":"2024-06-03T00:01:19.509601+0000","last_undegraded":"2024-06-03T00:01:19.509601+0000","last_fullsized":"2024-06-03T00:01:19.509601+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-06-03T00:01:19.509526+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-06-03T00:01:19.509526+0000","last_clean_scrub_stamp":"2024-06-03T00:01:19.509526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:36:26.071649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:31.021458+0000","last_change":"2024-06-03T00:01:31.021479+0000","last_active":"2024-06-03T00:01:31.021458+0000","last_peered":"2024-06-03T00:01:31.021458+0000","last_clean":"2024-06-03T00:01:31.021458+0000","last_became_active":"2024-06-02T23:59:01.593506+0000","last_became_peered":"2024-06-02T23:59:01.593506+0000","last_unstale":"2024-06-03T00:01:31.021458+0000","last_undegraded":"2024-06-03T00:01:31.021458+0000","last_fullsized":"2024-06-03T00:01:31.021458+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:31.021389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:31.021389+0000","last_clean_scrub_stamp":"2024-06-03T00:01:31.021389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:52:45.864407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"72'3","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.494632+0000","last_change":"2024-06-03T00:01:20.494632+0000","last_active":"2024-06-03T00:01:20.494632+0000","last_peered":"2024-06-03T00:01:20.494632+0000","last_clean":"2024-06-03T00:01:20.494632+0000","last_became_active":"2024-06-02T23:59:00.648667+0000","last_became_peered":"2024-06-02T23:59:00.648667+0000","last_unstale":"2024-06-03T00:01:20.494632+0000","last_undegraded":"2024-06-03T00:01:20.494632+0000","last_fullsized":"2024-06-03T00:01:20.494632+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-06-03T00:01:20.494541+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-06-03T00:01:20.494541+0000","last_clean_scrub_stamp":"2024-06-03T00:01:20.494541+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:32:05.928243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:28.161384+0000","last_change":"2024-06-03T00:01:28.161442+0000","last_active":"2024-06-03T00:01:28.161384+0000","last_peered":"2024-06-03T00:01:28.161384+0000","last_clean":"2024-06-03T00:01:28.161384+0000","last_became_active":"2024-06-02T23:59:01.585127+0000","last_became_peered":"2024-06-02T23:59:01.585127+0000","last_unstale":"2024-06-03T00:01:28.161384+0000","last_undegraded":"2024-06-03T00:01:28.161384+0000","last_fullsized":"2024-06-03T00:01:28.161384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:28.161298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:28.161298+0000","last_clean_scrub_stamp":"2024-06-03T00:01:28.161298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:58:31.815470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"72'3","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.545703+0000","last_change":"2024-06-03T00:01:20.545703+0000","last_active":"2024-06-03T00:01:20.545703+0000","last_peered":"2024-06-03T00:01:20.545703+0000","last_clean":"2024-06-03T00:01:20.545703+0000","last_became_active":"2024-06-02T23:59:00.642182+0000","last_became_peered":"2024-06-02T23:59:00.642182+0000","last_unstale":"2024-06-03T00:01:20.545703+0000","last_undegraded":"2024-06-03T00:01:20.545703+0000","last_fullsized":"2024-06-03T00:01:20.545703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-06-03T00:01:20.545585+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-06-03T00:01:20.545585+0000","last_clean_scrub_stamp":"2024-06-03T00:01:20.545585+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:42:08.925455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:26.869785+0000","last_change":"2024-06-03T00:01:26.869807+0000","last_active":"2024-06-03T00:01:26.869785+0000","last_peered":"2024-06-03T00:01:26.869785+0000","last_clean":"2024-06-03T00:01:26.869785+0000","last_became_active":"2024-06-03T00:00:46.081627+0000","last_became_peered":"2024-06-03T00:00:46.081627+0000","last_unstale":"2024-06-03T00:01:26.869785+0000","last_undegraded":"2024-06-03T00:01:26.869785+0000","last_fullsized":"2024-06-03T00:01:26.869785+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:26.869711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:26.869711+0000","last_clean_scrub_stamp":"2024-06-03T00:01:26.869711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:00:29.023895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"69'1","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:24.657334+0000","last_change":"2024-06-03T00:01:24.657334+0000","last_active":"2024-06-03T00:01:24.657334+0000","last_peered":"2024-06-03T00:01:24.657334+0000","last_clean":"2024-06-03T00:01:24.657334+0000","last_became_active":"2024-06-02T23:59:00.640963+0000","last_became_peered":"2024-06-02T23:59:00.640963+0000","last_unstale":"2024-06-03T00:01:24.657334+0000","last_undegraded":"2024-06-03T00:01:24.657334+0000","last_fullsized":"2024-06-03T00:01:24.657334+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-06-03T00:01:24.657215+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-06-03T00:01:24.657215+0000","last_clean_scrub_stamp":"2024-06-03T00:01:24.657215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:59.658138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:31.055200+0000","last_change":"2024-06-03T00:01:31.055235+0000","last_active":"2024-06-03T00:01:31.055200+0000","last_peered":"2024-06-03T00:01:31.055200+0000","last_clean":"2024-06-03T00:01:31.055200+0000","last_became_active":"2024-06-02T23:59:01.591198+0000","last_became_peered":"2024-06-02T23:59:01.591198+0000","last_unstale":"2024-06-03T00:01:31.055200+0000","last_undegraded":"2024-06-03T00:01:31.055200+0000","last_fullsized":"2024-06-03T00:01:31.055200+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:31.055115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:31.055115+0000","last_clean_scrub_stamp":"2024-06-03T00:01:31.055115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:53:17.926154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"69'1","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:21.811444+0000","last_change":"2024-06-03T00:01:21.811444+0000","last_active":"2024-06-03T00:01:21.811444+0000","last_peered":"2024-06-03T00:01:21.811444+0000","last_clean":"2024-06-03T00:01:21.811444+0000","last_became_active":"2024-06-02T23:59:00.648839+0000","last_became_peered":"2024-06-02T23:59:00.648839+0000","last_unstale":"2024-06-03T00:01:21.811444+0000","last_undegraded":"2024-06-03T00:01:21.811444+0000","last_fullsized":"2024-06-03T00:01:21.811444+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"69'1","last_scrub_stamp":"2024-06-03T00:01:21.811327+0000","last_deep_scrub":"69'1","last_deep_scrub_stamp":"2024-06-03T00:01:21.811327+0000","last_clean_scrub_stamp":"2024-06-03T00:01:21.811327+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:07:46.128479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:27.112917+0000","last_change":"2024-06-03T00:01:27.112917+0000","last_active":"2024-06-03T00:01:27.112917+0000","last_peered":"2024-06-03T00:01:27.112917+0000","last_clean":"2024-06-03T00:01:27.112917+0000","last_became_active":"2024-06-02T23:59:01.584971+0000","last_became_peered":"2024-06-02T23:59:01.584971+0000","last_unstale":"2024-06-03T00:01:27.112917+0000","last_undegraded":"2024-06-03T00:01:27.112917+0000","last_fullsized":"2024-06-03T00:01:27.112917+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:27.112767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:27.112767+0000","last_clean_scrub_stamp":"2024-06-03T00:01:27.112767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:21:11.921511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:26.027642+0000","last_change":"2024-06-03T00:01:26.027684+0000","last_active":"2024-06-03T00:01:26.027642+0000","last_peered":"2024-06-03T00:01:26.027642+0000","last_clean":"2024-06-03T00:01:26.027642+0000","last_became_active":"2024-06-02T23:59:00.647175+0000","last_became_peered":"2024-06-02T23:59:00.647175+0000","last_unstale":"2024-06-03T00:01:26.027642+0000","last_undegraded":"2024-06-03T00:01:26.027642+0000","last_fullsized":"2024-06-03T00:01:26.027642+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:26.027541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:26.027541+0000","last_clean_scrub_stamp":"2024-06-03T00:01:26.027541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:20:02.305157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:33.082179+0000","last_change":"2024-06-03T00:01:33.082203+0000","last_active":"2024-06-03T00:01:33.082179+0000","last_peered":"2024-06-03T00:01:33.082179+0000","last_clean":"2024-06-03T00:01:33.082179+0000","last_became_active":"2024-06-03T00:00:46.081552+0000","last_became_peered":"2024-06-03T00:00:46.081552+0000","last_unstale":"2024-06-03T00:01:33.082179+0000","last_undegraded":"2024-06-03T00:01:33.082179+0000","last_fullsized":"2024-06-03T00:01:33.082179+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:33.082091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:33.082091+0000","last_clean_scrub_stamp":"2024-06-03T00:01:33.082091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:10:54.968952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:30.642056+0000","last_change":"2024-06-03T00:01:30.642085+0000","last_active":"2024-06-03T00:01:30.642056+0000","last_peered":"2024-06-03T00:01:30.642056+0000","last_clean":"2024-06-03T00:01:30.642056+0000","last_became_active":"2024-06-02T23:59:00.647210+0000","last_became_peered":"2024-06-02T23:59:00.647210+0000","last_unstale":"2024-06-03T00:01:30.642056+0000","last_undegraded":"2024-06-03T00:01:30.642056+0000","last_fullsized":"2024-06-03T00:01:30.642056+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:30.641952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:30.641952+0000","last_clean_scrub_stamp":"2024-06-03T00:01:30.641952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:54.904795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:24.848119+0000","last_change":"2024-06-03T00:01:24.848119+0000","last_active":"2024-06-03T00:01:24.848119+0000","last_peered":"2024-06-03T00:01:24.848119+0000","last_clean":"2024-06-03T00:01:24.848119+0000","last_became_active":"2024-06-02T23:59:01.587190+0000","last_became_peered":"2024-06-02T23:59:01.587190+0000","last_unstale":"2024-06-03T00:01:24.848119+0000","last_undegraded":"2024-06-03T00:01:24.848119+0000","last_fullsized":"2024-06-03T00:01:24.848119+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:24.847963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:24.847963+0000","last_clean_scrub_stamp":"2024-06-03T00:01:24.847963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:52:39.690981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:22.108709+0000","last_change":"2024-06-03T00:01:22.108709+0000","last_active":"2024-06-03T00:01:22.108709+0000","last_peered":"2024-06-03T00:01:22.108709+0000","last_clean":"2024-06-03T00:01:22.108709+0000","last_became_active":"2024-06-02T23:59:00.636815+0000","last_became_peered":"2024-06-02T23:59:00.636815+0000","last_unstale":"2024-06-03T00:01:22.108709+0000","last_undegraded":"2024-06-03T00:01:22.108709+0000","last_fullsized":"2024-06-03T00:01:22.108709+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:22.108595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:22.108595+0000","last_clean_scrub_stamp":"2024-06-03T00:01:22.108595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:27:36.282943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:26.440106+0000","last_change":"2024-06-03T00:01:26.440106+0000","last_active":"2024-06-03T00:01:26.440106+0000","last_peered":"2024-06-03T00:01:26.440106+0000","last_clean":"2024-06-03T00:01:26.440106+0000","last_became_active":"2024-06-02T23:59:01.585128+0000","last_became_peered":"2024-06-02T23:59:01.585128+0000","last_unstale":"2024-06-03T00:01:26.440106+0000","last_undegraded":"2024-06-03T00:01:26.440106+0000","last_fullsized":"2024-06-03T00:01:26.440106+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:26.439998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:26.439998+0000","last_clean_scrub_stamp":"2024-06-03T00:01:26.439998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:43:23.655458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.776731+0000","last_change":"2024-06-03T00:01:20.776731+0000","last_active":"2024-06-03T00:01:20.776731+0000","last_peered":"2024-06-03T00:01:20.776731+0000","last_clean":"2024-06-03T00:01:20.776731+0000","last_became_active":"2024-06-02T23:59:00.644759+0000","last_became_peered":"2024-06-02T23:59:00.644759+0000","last_unstale":"2024-06-03T00:01:20.776731+0000","last_undegraded":"2024-06-03T00:01:20.776731+0000","last_fullsized":"2024-06-03T00:01:20.776731+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:20.776589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:20.776589+0000","last_clean_scrub_stamp":"2024-06-03T00:01:20.776589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:36:37.518408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:37.656853+0000","last_change":"2024-06-03T00:01:37.656878+0000","last_active":"2024-06-03T00:01:37.656853+0000","last_peered":"2024-06-03T00:01:37.656853+0000","last_clean":"2024-06-03T00:01:37.656853+0000","last_became_active":"2024-06-02T23:59:01.589942+0000","last_became_peered":"2024-06-02T23:59:01.589942+0000","last_unstale":"2024-06-03T00:01:37.656853+0000","last_undegraded":"2024-06-03T00:01:37.656853+0000","last_fullsized":"2024-06-03T00:01:37.656853+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:37.656765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:37.656765+0000","last_clean_scrub_stamp":"2024-06-03T00:01:37.656765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T07:58:41.310937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"72'5","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:24.117681+0000","last_change":"2024-06-03T00:01:24.117681+0000","last_active":"2024-06-03T00:01:24.117681+0000","last_peered":"2024-06-03T00:01:24.117681+0000","last_clean":"2024-06-03T00:01:24.117681+0000","last_became_active":"2024-06-02T23:59:00.643978+0000","last_became_peered":"2024-06-02T23:59:00.643978+0000","last_unstale":"2024-06-03T00:01:24.117681+0000","last_undegraded":"2024-06-03T00:01:24.117681+0000","last_fullsized":"2024-06-03T00:01:24.117681+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'5","last_scrub_stamp":"2024-06-03T00:01:24.117556+0000","last_deep_scrub":"72'5","last_deep_scrub_stamp":"2024-06-03T00:01:24.117556+0000","last_clean_scrub_stamp":"2024-06-03T00:01:24.117556+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:23:43.445298+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:22.784992+0000","last_change":"2024-06-03T00:01:22.784992+0000","last_active":"2024-06-03T00:01:22.784992+0000","last_peered":"2024-06-03T00:01:22.784992+0000","last_clean":"2024-06-03T00:01:22.784992+0000","last_became_active":"2024-06-02T23:59:01.574347+0000","last_became_peered":"2024-06-02T23:59:01.574347+0000","last_unstale":"2024-06-03T00:01:22.784992+0000","last_undegraded":"2024-06-03T00:01:22.784992+0000","last_fullsized":"2024-06-03T00:01:22.784992+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:22.784871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:22.784871+0000","last_clean_scrub_stamp":"2024-06-03T00:01:22.784871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T10:44:31.285300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"72'13","reported_seq":40,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.249861+0000","last_change":"2024-06-03T00:01:19.249861+0000","last_active":"2024-06-03T00:01:19.249861+0000","last_peered":"2024-06-03T00:01:19.249861+0000","last_clean":"2024-06-03T00:01:19.249861+0000","last_became_active":"2024-06-02T23:59:00.638716+0000","last_became_peered":"2024-06-02T23:59:00.638716+0000","last_unstale":"2024-06-03T00:01:19.249861+0000","last_undegraded":"2024-06-03T00:01:19.249861+0000","last_fullsized":"2024-06-03T00:01:19.249861+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'13","last_scrub_stamp":"2024-06-03T00:01:19.249772+0000","last_deep_scrub":"72'13","last_deep_scrub_stamp":"2024-06-03T00:01:19.249772+0000","last_clean_scrub_stamp":"2024-06-03T00:01:19.249772+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:53:06.120812+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3008,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:24.531103+0000","last_change":"2024-06-03T00:01:24.531103+0000","last_active":"2024-06-03T00:01:24.531103+0000","last_peered":"2024-06-03T00:01:24.531103+0000","last_clean":"2024-06-03T00:01:24.531103+0000","last_became_active":"2024-06-02T23:59:01.584575+0000","last_became_peered":"2024-06-02T23:59:01.584575+0000","last_unstale":"2024-06-03T00:01:24.531103+0000","last_undegraded":"2024-06-03T00:01:24.531103+0000","last_fullsized":"2024-06-03T00:01:24.531103+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:24.530997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:24.530997+0000","last_clean_scrub_stamp":"2024-06-03T00:01:24.530997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:32:44.349902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"72'4","reported_seq":32,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:29.638319+0000","last_change":"2024-06-03T00:01:29.638351+0000","last_active":"2024-06-03T00:01:29.638319+0000","last_peered":"2024-06-03T00:01:29.638319+0000","last_clean":"2024-06-03T00:01:29.638319+0000","last_became_active":"2024-06-02T23:59:00.645639+0000","last_became_peered":"2024-06-02T23:59:00.645639+0000","last_unstale":"2024-06-03T00:01:29.638319+0000","last_undegraded":"2024-06-03T00:01:29.638319+0000","last_fullsized":"2024-06-03T00:01:29.638319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'4","last_scrub_stamp":"2024-06-03T00:01:29.638235+0000","last_deep_scrub":"72'4","last_deep_scrub_stamp":"2024-06-03T00:01:29.638235+0000","last_clean_scrub_stamp":"2024-06-03T00:01:29.638235+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:53:16.509274+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:34.600254+0000","last_change":"2024-06-03T00:01:34.600254+0000","last_active":"2024-06-03T00:01:34.600254+0000","last_peered":"2024-06-03T00:01:34.600254+0000","last_clean":"2024-06-03T00:01:34.600254+0000","last_became_active":"2024-06-02T23:59:01.589024+0000","last_became_peered":"2024-06-02T23:59:01.589024+0000","last_unstale":"2024-06-03T00:01:34.600254+0000","last_undegraded":"2024-06-03T00:01:34.600254+0000","last_fullsized":"2024-06-03T00:01:34.600254+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:34.600145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:34.600145+0000","last_clean_scrub_stamp":"2024-06-03T00:01:34.600145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:40:27.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:23.999045+0000","last_change":"2024-06-03T00:01:23.999076+0000","last_active":"2024-06-03T00:01:23.999045+0000","last_peered":"2024-06-03T00:01:23.999045+0000","last_clean":"2024-06-03T00:01:23.999045+0000","last_became_active":"2024-06-02T23:59:00.647500+0000","last_became_peered":"2024-06-02T23:59:00.647500+0000","last_unstale":"2024-06-03T00:01:23.999045+0000","last_undegraded":"2024-06-03T00:01:23.999045+0000","last_fullsized":"2024-06-03T00:01:23.999045+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:23.998935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:23.998935+0000","last_clean_scrub_stamp":"2024-06-03T00:01:23.998935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:12:01.921375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:24.204245+0000","last_change":"2024-06-03T00:01:24.204303+0000","last_active":"2024-06-03T00:01:24.204245+0000","last_peered":"2024-06-03T00:01:24.204245+0000","last_clean":"2024-06-03T00:01:24.204245+0000","last_became_active":"2024-06-02T23:59:01.582343+0000","last_became_peered":"2024-06-02T23:59:01.582343+0000","last_unstale":"2024-06-03T00:01:24.204245+0000","last_undegraded":"2024-06-03T00:01:24.204245+0000","last_fullsized":"2024-06-03T00:01:24.204245+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:24.204091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:24.204091+0000","last_clean_scrub_stamp":"2024-06-03T00:01:24.204091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:00:16.423660+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:25.073373+0000","last_change":"2024-06-03T00:01:25.073398+0000","last_active":"2024-06-03T00:01:25.073373+0000","last_peered":"2024-06-03T00:01:25.073373+0000","last_clean":"2024-06-03T00:01:25.073373+0000","last_became_active":"2024-06-02T23:59:00.647777+0000","last_became_peered":"2024-06-02T23:59:00.647777+0000","last_unstale":"2024-06-03T00:01:25.073373+0000","last_undegraded":"2024-06-03T00:01:25.073373+0000","last_fullsized":"2024-06-03T00:01:25.073373+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:25.073287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:25.073287+0000","last_clean_scrub_stamp":"2024-06-03T00:01:25.073287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:04:18.259565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:39.706101+0000","last_change":"2024-06-03T00:01:39.706126+0000","last_active":"2024-06-03T00:01:39.706101+0000","last_peered":"2024-06-03T00:01:39.706101+0000","last_clean":"2024-06-03T00:01:39.706101+0000","last_became_active":"2024-06-02T23:59:01.593303+0000","last_became_peered":"2024-06-02T23:59:01.593303+0000","last_unstale":"2024-06-03T00:01:39.706101+0000","last_undegraded":"2024-06-03T00:01:39.706101+0000","last_fullsized":"2024-06-03T00:01:39.706101+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:39.706009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:39.706009+0000","last_clean_scrub_stamp":"2024-06-03T00:01:39.706009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:42:00.185932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"72'12","reported_seq":39,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:23.251453+0000","last_change":"2024-06-03T00:01:23.251500+0000","last_active":"2024-06-03T00:01:23.251453+0000","last_peered":"2024-06-03T00:01:23.251453+0000","last_clean":"2024-06-03T00:01:23.251453+0000","last_became_active":"2024-06-02T23:59:00.644964+0000","last_became_peered":"2024-06-02T23:59:00.644964+0000","last_unstale":"2024-06-03T00:01:23.251453+0000","last_undegraded":"2024-06-03T00:01:23.251453+0000","last_fullsized":"2024-06-03T00:01:23.251453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'12","last_scrub_stamp":"2024-06-03T00:01:23.251368+0000","last_deep_scrub":"72'12","last_deep_scrub_stamp":"2024-06-03T00:01:23.251368+0000","last_clean_scrub_stamp":"2024-06-03T00:01:23.251368+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:38:07.144797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:25.170657+0000","last_change":"2024-06-03T00:01:25.170679+0000","last_active":"2024-06-03T00:01:25.170657+0000","last_peered":"2024-06-03T00:01:25.170657+0000","last_clean":"2024-06-03T00:01:25.170657+0000","last_became_active":"2024-06-02T23:59:01.581160+0000","last_became_peered":"2024-06-02T23:59:01.581160+0000","last_unstale":"2024-06-03T00:01:25.170657+0000","last_undegraded":"2024-06-03T00:01:25.170657+0000","last_fullsized":"2024-06-03T00:01:25.170657+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:25.170574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:25.170574+0000","last_clean_scrub_stamp":"2024-06-03T00:01:25.170574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:40:17.844851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"72'2","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:26.660012+0000","last_change":"2024-06-03T00:01:26.660060+0000","last_active":"2024-06-03T00:01:26.660012+0000","last_peered":"2024-06-03T00:01:26.660012+0000","last_clean":"2024-06-03T00:01:26.660012+0000","last_became_active":"2024-06-02T23:59:00.644014+0000","last_became_peered":"2024-06-02T23:59:00.644014+0000","last_unstale":"2024-06-03T00:01:26.660012+0000","last_undegraded":"2024-06-03T00:01:26.660012+0000","last_fullsized":"2024-06-03T00:01:26.660012+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-06-03T00:01:26.659900+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-06-03T00:01:26.659900+0000","last_clean_scrub_stamp":"2024-06-03T00:01:26.659900+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:13:23.666765+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:30.522225+0000","last_change":"2024-06-03T00:01:30.522257+0000","last_active":"2024-06-03T00:01:30.522225+0000","last_peered":"2024-06-03T00:01:30.522225+0000","last_clean":"2024-06-03T00:01:30.522225+0000","last_became_active":"2024-06-02T23:59:01.592800+0000","last_became_peered":"2024-06-02T23:59:01.592800+0000","last_unstale":"2024-06-03T00:01:30.522225+0000","last_undegraded":"2024-06-03T00:01:30.522225+0000","last_fullsized":"2024-06-03T00:01:30.522225+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:30.522113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:30.522113+0000","last_clean_scrub_stamp":"2024-06-03T00:01:30.522113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:25:02.501554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"72'3","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.838862+0000","last_change":"2024-06-03T00:01:19.838910+0000","last_active":"2024-06-03T00:01:19.838862+0000","last_peered":"2024-06-03T00:01:19.838862+0000","last_clean":"2024-06-03T00:01:19.838862+0000","last_became_active":"2024-06-02T23:59:00.636161+0000","last_became_peered":"2024-06-02T23:59:00.636161+0000","last_unstale":"2024-06-03T00:01:19.838862+0000","last_undegraded":"2024-06-03T00:01:19.838862+0000","last_fullsized":"2024-06-03T00:01:19.838862+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-06-03T00:01:19.838748+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-06-03T00:01:19.838748+0000","last_clean_scrub_stamp":"2024-06-03T00:01:19.838748+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:44:21.409193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:25.854201+0000","last_change":"2024-06-03T00:01:25.854244+0000","last_active":"2024-06-03T00:01:25.854201+0000","last_peered":"2024-06-03T00:01:25.854201+0000","last_clean":"2024-06-03T00:01:25.854201+0000","last_became_active":"2024-06-02T23:59:01.588372+0000","last_became_peered":"2024-06-02T23:59:01.588372+0000","last_unstale":"2024-06-03T00:01:25.854201+0000","last_undegraded":"2024-06-03T00:01:25.854201+0000","last_fullsized":"2024-06-03T00:01:25.854201+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:25.854053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:25.854053+0000","last_clean_scrub_stamp":"2024-06-03T00:01:25.854053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:12:25.338698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"72'2","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:21.012856+0000","last_change":"2024-06-03T00:01:21.012887+0000","last_active":"2024-06-03T00:01:21.012856+0000","last_peered":"2024-06-03T00:01:21.012856+0000","last_clean":"2024-06-03T00:01:21.012856+0000","last_became_active":"2024-06-02T23:59:00.646290+0000","last_became_peered":"2024-06-02T23:59:00.646290+0000","last_unstale":"2024-06-03T00:01:21.012856+0000","last_undegraded":"2024-06-03T00:01:21.012856+0000","last_fullsized":"2024-06-03T00:01:21.012856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-06-03T00:01:21.012763+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-06-03T00:01:21.012763+0000","last_clean_scrub_stamp":"2024-06-03T00:01:21.012763+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:03:28.745453+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:26.533418+0000","last_change":"2024-06-03T00:01:26.533461+0000","last_active":"2024-06-03T00:01:26.533418+0000","last_peered":"2024-06-03T00:01:26.533418+0000","last_clean":"2024-06-03T00:01:26.533418+0000","last_became_active":"2024-06-02T23:59:01.590016+0000","last_became_peered":"2024-06-02T23:59:01.590016+0000","last_unstale":"2024-06-03T00:01:26.533418+0000","last_undegraded":"2024-06-03T00:01:26.533418+0000","last_fullsized":"2024-06-03T00:01:26.533418+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:26.533291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:26.533291+0000","last_clean_scrub_stamp":"2024-06-03T00:01:26.533291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T03:23:34.340397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:22.980437+0000","last_change":"2024-06-03T00:01:22.980470+0000","last_active":"2024-06-03T00:01:22.980437+0000","last_peered":"2024-06-03T00:01:22.980437+0000","last_clean":"2024-06-03T00:01:22.980437+0000","last_became_active":"2024-06-02T23:59:00.647144+0000","last_became_peered":"2024-06-02T23:59:00.647144+0000","last_unstale":"2024-06-03T00:01:22.980437+0000","last_undegraded":"2024-06-03T00:01:22.980437+0000","last_fullsized":"2024-06-03T00:01:22.980437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:22.980320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:22.980320+0000","last_clean_scrub_stamp":"2024-06-03T00:01:22.980320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:29:33.258049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:22.552147+0000","last_change":"2024-06-03T00:01:22.552182+0000","last_active":"2024-06-03T00:01:22.552147+0000","last_peered":"2024-06-03T00:01:22.552147+0000","last_clean":"2024-06-03T00:01:22.552147+0000","last_became_active":"2024-06-02T23:59:01.578711+0000","last_became_peered":"2024-06-02T23:59:01.578711+0000","last_unstale":"2024-06-03T00:01:22.552147+0000","last_undegraded":"2024-06-03T00:01:22.552147+0000","last_fullsized":"2024-06-03T00:01:22.552147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:22.552060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:22.552060+0000","last_clean_scrub_stamp":"2024-06-03T00:01:22.552060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T00:48:34.876690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"72'3","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:18.498193+0000","last_change":"2024-06-03T00:01:18.498232+0000","last_active":"2024-06-03T00:01:18.498193+0000","last_peered":"2024-06-03T00:01:18.498193+0000","last_clean":"2024-06-03T00:01:18.498193+0000","last_became_active":"2024-06-02T23:59:00.637806+0000","last_became_peered":"2024-06-02T23:59:00.637806+0000","last_unstale":"2024-06-03T00:01:18.498193+0000","last_undegraded":"2024-06-03T00:01:18.498193+0000","last_fullsized":"2024-06-03T00:01:18.498193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-06-03T00:01:18.498127+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-06-03T00:01:18.498127+0000","last_clean_scrub_stamp":"2024-06-03T00:01:18.498127+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:54:57.991012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:30.003394+0000","last_change":"2024-06-03T00:01:30.003420+0000","last_active":"2024-06-03T00:01:30.003394+0000","last_peered":"2024-06-03T00:01:30.003394+0000","last_clean":"2024-06-03T00:01:30.003394+0000","last_became_active":"2024-06-02T23:59:01.590949+0000","last_became_peered":"2024-06-02T23:59:01.590949+0000","last_unstale":"2024-06-03T00:01:30.003394+0000","last_undegraded":"2024-06-03T00:01:30.003394+0000","last_fullsized":"2024-06-03T00:01:30.003394+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:30.003297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:30.003297+0000","last_clean_scrub_stamp":"2024-06-03T00:01:30.003297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:05:15.283134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:20.266499+0000","last_change":"2024-06-03T00:01:20.266519+0000","last_active":"2024-06-03T00:01:20.266499+0000","last_peered":"2024-06-03T00:01:20.266499+0000","last_clean":"2024-06-03T00:01:20.266499+0000","last_became_active":"2024-06-02T23:59:00.639852+0000","last_became_peered":"2024-06-02T23:59:00.639852+0000","last_unstale":"2024-06-03T00:01:20.266499+0000","last_undegraded":"2024-06-03T00:01:20.266499+0000","last_fullsized":"2024-06-03T00:01:20.266499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:20.266432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:20.266432+0000","last_clean_scrub_stamp":"2024-06-03T00:01:20.266432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:10:44.529276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:33.566484+0000","last_change":"2024-06-03T00:01:33.566507+0000","last_active":"2024-06-03T00:01:33.566484+0000","last_peered":"2024-06-03T00:01:33.566484+0000","last_clean":"2024-06-03T00:01:33.566484+0000","last_became_active":"2024-06-02T23:59:01.587734+0000","last_became_peered":"2024-06-02T23:59:01.587734+0000","last_unstale":"2024-06-03T00:01:33.566484+0000","last_undegraded":"2024-06-03T00:01:33.566484+0000","last_fullsized":"2024-06-03T00:01:33.566484+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:33.566365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:33.566365+0000","last_clean_scrub_stamp":"2024-06-03T00:01:33.566365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:00:25.785934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:25.662519+0000","last_change":"2024-06-03T00:01:25.662553+0000","last_active":"2024-06-03T00:01:25.662519+0000","last_peered":"2024-06-03T00:01:25.662519+0000","last_clean":"2024-06-03T00:01:25.662519+0000","last_became_active":"2024-06-02T23:59:00.643062+0000","last_became_peered":"2024-06-02T23:59:00.643062+0000","last_unstale":"2024-06-03T00:01:25.662519+0000","last_undegraded":"2024-06-03T00:01:25.662519+0000","last_fullsized":"2024-06-03T00:01:25.662519+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:25.662434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:25.662434+0000","last_clean_scrub_stamp":"2024-06-03T00:01:25.662434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:48:57.474194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:21.451792+0000","last_change":"2024-06-03T00:01:21.451833+0000","last_active":"2024-06-03T00:01:21.451792+0000","last_peered":"2024-06-03T00:01:21.451792+0000","last_clean":"2024-06-03T00:01:21.451792+0000","last_became_active":"2024-06-02T23:59:01.586401+0000","last_became_peered":"2024-06-02T23:59:01.586401+0000","last_unstale":"2024-06-03T00:01:21.451792+0000","last_undegraded":"2024-06-03T00:01:21.451792+0000","last_fullsized":"2024-06-03T00:01:21.451792+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:21.451712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:21.451712+0000","last_clean_scrub_stamp":"2024-06-03T00:01:21.451712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:25:11.184047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:18.867432+0000","last_change":"2024-06-03T00:01:18.867452+0000","last_active":"2024-06-03T00:01:18.867432+0000","last_peered":"2024-06-03T00:01:18.867432+0000","last_clean":"2024-06-03T00:01:18.867432+0000","last_became_active":"2024-06-02T23:59:00.635444+0000","last_became_peered":"2024-06-02T23:59:00.635444+0000","last_unstale":"2024-06-03T00:01:18.867432+0000","last_undegraded":"2024-06-03T00:01:18.867432+0000","last_fullsized":"2024-06-03T00:01:18.867432+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:18.867360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:18.867360+0000","last_clean_scrub_stamp":"2024-06-03T00:01:18.867360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:46:00.047867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:25.484081+0000","last_change":"2024-06-03T00:01:25.484112+0000","last_active":"2024-06-03T00:01:25.484081+0000","last_peered":"2024-06-03T00:01:25.484081+0000","last_clean":"2024-06-03T00:01:25.484081+0000","last_became_active":"2024-06-02T23:59:01.584978+0000","last_became_peered":"2024-06-02T23:59:01.584978+0000","last_unstale":"2024-06-03T00:01:25.484081+0000","last_undegraded":"2024-06-03T00:01:25.484081+0000","last_fullsized":"2024-06-03T00:01:25.484081+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:25.484000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:25.484000+0000","last_clean_scrub_stamp":"2024-06-03T00:01:25.484000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:05:55.756797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"72'3","reported_seq":31,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:21.995077+0000","last_change":"2024-06-03T00:01:21.995107+0000","last_active":"2024-06-03T00:01:21.995077+0000","last_peered":"2024-06-03T00:01:21.995077+0000","last_clean":"2024-06-03T00:01:21.995077+0000","last_became_active":"2024-06-02T23:59:00.647038+0000","last_became_peered":"2024-06-02T23:59:00.647038+0000","last_unstale":"2024-06-03T00:01:21.995077+0000","last_undegraded":"2024-06-03T00:01:21.995077+0000","last_fullsized":"2024-06-03T00:01:21.995077+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'3","last_scrub_stamp":"2024-06-03T00:01:21.994994+0000","last_deep_scrub":"72'3","last_deep_scrub_stamp":"2024-06-03T00:01:21.994994+0000","last_clean_scrub_stamp":"2024-06-03T00:01:21.994994+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:51:53.206385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:23.495493+0000","last_change":"2024-06-03T00:01:23.495534+0000","last_active":"2024-06-03T00:01:23.495493+0000","last_peered":"2024-06-03T00:01:23.495493+0000","last_clean":"2024-06-03T00:01:23.495493+0000","last_became_active":"2024-06-02T23:59:01.586774+0000","last_became_peered":"2024-06-02T23:59:01.586774+0000","last_unstale":"2024-06-03T00:01:23.495493+0000","last_undegraded":"2024-06-03T00:01:23.495493+0000","last_fullsized":"2024-06-03T00:01:23.495493+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:23.495399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:23.495399+0000","last_clean_scrub_stamp":"2024-06-03T00:01:23.495399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T04:58:59.390268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:23.078792+0000","last_change":"2024-06-03T00:01:23.078842+0000","last_active":"2024-06-03T00:01:23.078792+0000","last_peered":"2024-06-03T00:01:23.078792+0000","last_clean":"2024-06-03T00:01:23.078792+0000","last_became_active":"2024-06-02T23:59:00.640889+0000","last_became_peered":"2024-06-02T23:59:00.640889+0000","last_unstale":"2024-06-03T00:01:23.078792+0000","last_undegraded":"2024-06-03T00:01:23.078792+0000","last_fullsized":"2024-06-03T00:01:23.078792+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:23.078704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:23.078704+0000","last_clean_scrub_stamp":"2024-06-03T00:01:23.078704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:43:16.763744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:33.128882+0000","last_change":"2024-06-03T00:01:33.128905+0000","last_active":"2024-06-03T00:01:33.128882+0000","last_peered":"2024-06-03T00:01:33.128882+0000","last_clean":"2024-06-03T00:01:33.128882+0000","last_became_active":"2024-06-02T23:59:01.588438+0000","last_became_peered":"2024-06-02T23:59:01.588438+0000","last_unstale":"2024-06-03T00:01:33.128882+0000","last_undegraded":"2024-06-03T00:01:33.128882+0000","last_fullsized":"2024-06-03T00:01:33.128882+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:33.128755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:33.128755+0000","last_clean_scrub_stamp":"2024-06-03T00:01:33.128755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:52:02.138809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:28.663075+0000","last_change":"2024-06-03T00:01:28.663120+0000","last_active":"2024-06-03T00:01:28.663075+0000","last_peered":"2024-06-03T00:01:28.663075+0000","last_clean":"2024-06-03T00:01:28.663075+0000","last_became_active":"2024-06-02T23:59:00.644680+0000","last_became_peered":"2024-06-02T23:59:00.644680+0000","last_unstale":"2024-06-03T00:01:28.663075+0000","last_undegraded":"2024-06-03T00:01:28.663075+0000","last_fullsized":"2024-06-03T00:01:28.663075+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:28.662957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:28.662957+0000","last_clean_scrub_stamp":"2024-06-03T00:01:28.662957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:38:58.976931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:36.644669+0000","last_change":"2024-06-03T00:01:36.644694+0000","last_active":"2024-06-03T00:01:36.644669+0000","last_peered":"2024-06-03T00:01:36.644669+0000","last_clean":"2024-06-03T00:01:36.644669+0000","last_became_active":"2024-06-02T23:59:01.589146+0000","last_became_peered":"2024-06-02T23:59:01.589146+0000","last_unstale":"2024-06-03T00:01:36.644669+0000","last_undegraded":"2024-06-03T00:01:36.644669+0000","last_fullsized":"2024-06-03T00:01:36.644669+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:36.644585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:36.644585+0000","last_clean_scrub_stamp":"2024-06-03T00:01:36.644585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T05:21:21.453329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:21.258795+0000","last_change":"2024-06-03T00:01:21.258818+0000","last_active":"2024-06-03T00:01:21.258795+0000","last_peered":"2024-06-03T00:01:21.258795+0000","last_clean":"2024-06-03T00:01:21.258795+0000","last_became_active":"2024-06-02T23:59:00.642225+0000","last_became_peered":"2024-06-02T23:59:00.642225+0000","last_unstale":"2024-06-03T00:01:21.258795+0000","last_undegraded":"2024-06-03T00:01:21.258795+0000","last_fullsized":"2024-06-03T00:01:21.258795+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:21.258730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:21.258730+0000","last_clean_scrub_stamp":"2024-06-03T00:01:21.258730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:10:43.145591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:23.528834+0000","last_change":"2024-06-03T00:01:23.528872+0000","last_active":"2024-06-03T00:01:23.528834+0000","last_peered":"2024-06-03T00:01:23.528834+0000","last_clean":"2024-06-03T00:01:23.528834+0000","last_became_active":"2024-06-02T23:59:01.583901+0000","last_became_peered":"2024-06-02T23:59:01.583901+0000","last_unstale":"2024-06-03T00:01:23.528834+0000","last_undegraded":"2024-06-03T00:01:23.528834+0000","last_fullsized":"2024-06-03T00:01:23.528834+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:23.528749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:23.528749+0000","last_clean_scrub_stamp":"2024-06-03T00:01:23.528749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:48:58.529672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:22.217410+0000","last_change":"2024-06-03T00:01:22.217434+0000","last_active":"2024-06-03T00:01:22.217410+0000","last_peered":"2024-06-03T00:01:22.217410+0000","last_clean":"2024-06-03T00:01:22.217410+0000","last_became_active":"2024-06-02T23:59:00.644115+0000","last_became_peered":"2024-06-02T23:59:00.644115+0000","last_unstale":"2024-06-03T00:01:22.217410+0000","last_undegraded":"2024-06-03T00:01:22.217410+0000","last_fullsized":"2024-06-03T00:01:22.217410+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:22.217328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:22.217328+0000","last_clean_scrub_stamp":"2024-06-03T00:01:22.217328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T02:45:00.466834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:32.565014+0000","last_change":"2024-06-03T00:01:32.565039+0000","last_active":"2024-06-03T00:01:32.565014+0000","last_peered":"2024-06-03T00:01:32.565014+0000","last_clean":"2024-06-03T00:01:32.565014+0000","last_became_active":"2024-06-02T23:59:01.587147+0000","last_became_peered":"2024-06-02T23:59:01.587147+0000","last_unstale":"2024-06-03T00:01:32.565014+0000","last_undegraded":"2024-06-03T00:01:32.565014+0000","last_fullsized":"2024-06-03T00:01:32.565014+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:32.564911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:32.564911+0000","last_clean_scrub_stamp":"2024-06-03T00:01:32.564911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T11:10:04.784052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:19.820762+0000","last_change":"2024-06-03T00:01:19.820797+0000","last_active":"2024-06-03T00:01:19.820762+0000","last_peered":"2024-06-03T00:01:19.820762+0000","last_clean":"2024-06-03T00:01:19.820762+0000","last_became_active":"2024-06-02T23:59:00.643445+0000","last_became_peered":"2024-06-02T23:59:00.643445+0000","last_unstale":"2024-06-03T00:01:19.820762+0000","last_undegraded":"2024-06-03T00:01:19.820762+0000","last_fullsized":"2024-06-03T00:01:19.820762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:19.820672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:19.820672+0000","last_clean_scrub_stamp":"2024-06-03T00:01:19.820672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:18:58.610611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:26.149086+0000","last_change":"2024-06-03T00:01:26.149111+0000","last_active":"2024-06-03T00:01:26.149086+0000","last_peered":"2024-06-03T00:01:26.149086+0000","last_clean":"2024-06-03T00:01:26.149086+0000","last_became_active":"2024-06-02T23:59:01.582821+0000","last_became_peered":"2024-06-02T23:59:01.582821+0000","last_unstale":"2024-06-03T00:01:26.149086+0000","last_undegraded":"2024-06-03T00:01:26.149086+0000","last_fullsized":"2024-06-03T00:01:26.149086+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:26.148990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:26.148990+0000","last_clean_scrub_stamp":"2024-06-03T00:01:26.148990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T08:35:10.882111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":28,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:21.554726+0000","last_change":"2024-06-03T00:01:21.554782+0000","last_active":"2024-06-03T00:01:21.554726+0000","last_peered":"2024-06-03T00:01:21.554726+0000","last_clean":"2024-06-03T00:01:21.554726+0000","last_became_active":"2024-06-02T23:59:00.643711+0000","last_became_peered":"2024-06-02T23:59:00.643711+0000","last_unstale":"2024-06-03T00:01:21.554726+0000","last_undegraded":"2024-06-03T00:01:21.554726+0000","last_fullsized":"2024-06-03T00:01:21.554726+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:21.554601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:21.554601+0000","last_clean_scrub_stamp":"2024-06-03T00:01:21.554601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T01:06:42.096444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":26,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:27.070138+0000","last_change":"2024-06-03T00:01:27.070165+0000","last_active":"2024-06-03T00:01:27.070138+0000","last_peered":"2024-06-03T00:01:27.070138+0000","last_clean":"2024-06-03T00:01:27.070138+0000","last_became_active":"2024-06-02T23:59:01.587445+0000","last_became_peered":"2024-06-02T23:59:01.587445+0000","last_unstale":"2024-06-03T00:01:27.070138+0000","last_undegraded":"2024-06-03T00:01:27.070138+0000","last_fullsized":"2024-06-03T00:01:27.070138+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-03T00:01:27.070039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-03T00:01:27.070039+0000","last_clean_scrub_stamp":"2024-06-03T00:01:27.070039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T06:36:43.811857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"72'2","reported_seq":30,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:27.643778+0000","last_change":"2024-06-03T00:01:27.643816+0000","last_active":"2024-06-03T00:01:27.643778+0000","last_peered":"2024-06-03T00:01:27.643778+0000","last_clean":"2024-06-03T00:01:27.643778+0000","last_became_active":"2024-06-02T23:59:00.644293+0000","last_became_peered":"2024-06-02T23:59:00.644293+0000","last_unstale":"2024-06-03T00:01:27.643778+0000","last_undegraded":"2024-06-03T00:01:27.643778+0000","last_fullsized":"2024-06-03T00:01:27.643778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'2","last_scrub_stamp":"2024-06-03T00:01:27.643692+0000","last_deep_scrub":"72'2","last_deep_scrub_stamp":"2024-06-03T00:01:27.643692+0000","last_clean_scrub_stamp":"2024-06-03T00:01:27.643692+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:45:17.854507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"72'141","reported_seq":365,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-06-03T00:01:21.149131+0000","last_change":"2024-06-03T00:01:21.149177+0000","last_active":"2024-06-03T00:01:21.149131+0000","last_peered":"2024-06-03T00:01:21.149131+0000","last_clean":"2024-06-03T00:01:21.149131+0000","last_became_active":"2024-06-02T23:46:15.343751+0000","last_became_peered":"2024-06-02T23:46:15.343751+0000","last_unstale":"2024-06-03T00:01:21.149131+0000","last_undegraded":"2024-06-03T00:01:21.149131+0000","last_fullsized":"2024-06-03T00:01:21.149131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"72'141","last_scrub_stamp":"2024-06-03T00:01:21.149058+0000","last_deep_scrub":"72'141","last_deep_scrub_stamp":"2024-06-03T00:01:21.149058+0000","last_clean_scrub_stamp":"2024-06-03T00:01:21.149058+0000","objects_scrubbed":2,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-06-04T09:35:14.077717+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":3806,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54816,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317024,"statfs":{"total":96636764160,"available":96580632576,"internally_reserved":0,"allocated":1466368,"data_stored":1024138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":872448,"data_stored":434298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50068,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321772,"statfs":{"total":96636764160,"available":96585494528,"internally_reserved":0,"allocated":864256,"data_stored":433646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":868352,"data_stored":434228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":880640,"data_stored":436676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54240,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317600,"statfs":{"total":96636764160,"available":96581222400,"internally_reserved":0,"allocated":876544,"data_stored":436654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":872448,"data_stored":433806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575035,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1466368,"data_stored":1024070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-03T00:01:41.464 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-06-03T00:01:41.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.599+0000 7f45f0acd640 1 Processor -- start 2024-06-03T00:01:41.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.599+0000 7f45f0acd640 1 -- start start 2024-06-03T00:01:41.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45f0acd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec0b4b50 0x7f45ec0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45f0acd640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ec0cec60 con 0x7f45ec0d2630 2024-06-03T00:01:41.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45f0acd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ec0d1fd0 con 0x7f45ec0b4640 2024-06-03T00:01:41.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45f0acd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f45ec0d4ff0 con 0x7f45ec0b4b50 2024-06-03T00:01:41.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45ead9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f45ec0d2630 0x7f45ec0cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33882/0 (socket says 172.21.15.96:33882) 2024-06-03T00:01:41.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45ead9d640 1 -- 172.21.15.96:0/2525817811 learned_addr learned my addr 172.21.15.96:0/2525817811 (peer_addr_for_me v1:172.21.15.96:0/0) 2024-06-03T00:01:41.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287944998 0 0) 0x7f45ec0cec60 con 0x7f45ec0d2630 2024-06-03T00:01:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45d8003520 con 0x7f45ec0d2630 2024-06-03T00:01:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e3fff640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec0b4b50 0x7f45ec0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3327733986 0 0) 0x7f45d8003520 con 0x7f45ec0d2630 2024-06-03T00:01:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec0b4b50 msgr2=0x7f45ec0b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec0b4b50 0x7f45ec0b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 >> v1:172.21.15.162:6789/0 conn(0x7f45ec0b4640 legacy=0x7f45ec0b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec0d4d10 con 0x7f45ec0d2630 2024-06-03T00:01:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2835436029 0 0) 0x7f45e40019f0 con 0x7f45ec0d2630 2024-06-03T00:01:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 >> v1:172.21.15.96:6789/0 conn(0x7f45ec0d2630 legacy=0x7f45ec0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d80039e0 0x7f45d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 0x7f45d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec0b4b50 0x7f45d8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f45d800bac0 con 0x7f45d8004800 2024-06-03T00:01:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45d800bc70 con 0x7f45d80039e0 2024-06-03T00:01:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.600+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f45d800be70 con 0x7f45ec0b4b50 2024-06-03T00:01:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.601+0000 7f45e3fff640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 0x7f45d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.601+0000 7f45ea59c640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d80039e0 0x7f45d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.601+0000 7f45ead9d640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec0b4b50 0x7f45d8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.601+0000 7f45e3fff640 1 -- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec0b4b50 msgr2=0x7f45d8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.601+0000 7f45e3fff640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec0b4b50 0x7f45d8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.601+0000 7f45e3fff640 1 -- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d80039e0 msgr2=0x7f45d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.601+0000 7f45e3fff640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d80039e0 0x7f45d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.601+0000 7f45e3fff640 1 -- 172.21.15.96:0/2525817811 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d8003520 con 0x7f45d8004800 2024-06-03T00:01:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.601+0000 7f45ea59c640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45d80039e0 0x7f45d8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-03T00:01:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.601+0000 7f45e3fff640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 0x7f45d8004c80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009ac0 tx=0x7f45d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14579f4637d57466 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.602+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d4036070 con 0x7f45d8004800 2024-06-03T00:01:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.602+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d4031400 con 0x7f45d8004800 2024-06-03T00:01:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.602+0000 7f45e9d9b640 1 -- 172.21.15.96:0/2525817811 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d4009690 con 0x7f45d8004800 2024-06-03T00:01:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.602+0000 7f45f0acd640 1 -- 172.21.15.96:0/2525817811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 msgr2=0x7f45d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.602+0000 7f45f0acd640 1 --2- 172.21.15.96:0/2525817811 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 0x7f45d8004c80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009ac0 tx=0x7f45d8005830 comp rx=0 tx=0).stop 2024-06-03T00:01:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.602+0000 7f45ead9d640 1 -- 172.21.15.96:0/2525817811 reap_dead start 2024-06-03T00:01:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.602+0000 7f45f0acd640 1 -- 172.21.15.96:0/2525817811 shutdown_connections 2024-06-03T00:01:41.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.602+0000 7f45f0acd640 1 -- 172.21.15.96:0/2525817811 >> 172.21.15.96:0/2525817811 conn(0x7f45ec0d4050 msgr2=0x7f45ec0d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:41.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.602+0000 7f45f0acd640 1 -- 172.21.15.96:0/2525817811 shutdown_connections 2024-06-03T00:01:41.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.602+0000 7f45f0acd640 1 -- 172.21.15.96:0/2525817811 wait complete. 2024-06-03T00:01:41.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.603+0000 7f45f0acd640 1 Processor -- start 2024-06-03T00:01:41.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.604+0000 7f45f0acd640 1 -- start start 2024-06-03T00:01:41.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.604+0000 7f45f0acd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 0x7f45ec0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.604+0000 7f45f0acd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec15f970 0x7f45ec1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.604+0000 7f45f0acd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45ec0b8610 0x7f45ec0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.604+0000 7f45f0acd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec0b4fd0 con 0x7f45d8004800 2024-06-03T00:01:41.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.604+0000 7f45f0acd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec0d13b0 con 0x7f45ec0b8610 2024-06-03T00:01:41.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.604+0000 7f45f0acd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f45ec0b5150 con 0x7f45ec15f970 2024-06-03T00:01:41.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.604+0000 7f45ea59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 0x7f45ec0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.604+0000 7f45ea59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 0x7f45ec0b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52034/0 (socket says 172.21.15.96:52034) 2024-06-03T00:01:41.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.604+0000 7f45ea59c640 1 -- 172.21.15.96:0/566808471 learned_addr learned my addr 172.21.15.96:0/566808471 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:41.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45ea59c640 1 -- 172.21.15.96:0/566808471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec15f970 msgr2=0x7f45ec1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45ea59c640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec15f970 0x7f45ec1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45ea59c640 1 -- 172.21.15.96:0/566808471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45ec0b8610 msgr2=0x7f45ec0b8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45ea59c640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45ec0b8610 0x7f45ec0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45ea59c640 1 -- 172.21.15.96:0/566808471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec0b7130 con 0x7f45d8004800 2024-06-03T00:01:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45ea59c640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 0x7f45ec0b6bf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00e660 tx=0x7f45dc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45e2ffd640 1 -- 172.21.15.96:0/566808471 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0050d0 con 0x7f45d8004800 2024-06-03T00:01:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45e2ffd640 1 -- 172.21.15.96:0/566808471 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45dc018070 con 0x7f45d8004800 2024-06-03T00:01:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45f0acd640 1 -- 172.21.15.96:0/566808471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45ec0b73d0 con 0x7f45d8004800 2024-06-03T00:01:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45e2ffd640 1 -- 172.21.15.96:0/566808471 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0035f0 con 0x7f45d8004800 2024-06-03T00:01:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.605+0000 7f45f0acd640 1 -- 172.21.15.96:0/566808471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45ec0b7990 con 0x7f45d8004800 2024-06-03T00:01:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.606+0000 7f45f0acd640 1 -- 172.21.15.96:0/566808471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45ec0683e0 con 0x7f45d8004800 2024-06-03T00:01:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.606+0000 7f45e2ffd640 1 -- 172.21.15.96:0/566808471 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f45dc003790 con 0x7f45d8004800 2024-06-03T00:01:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.607+0000 7f45e2ffd640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f45cc06be30 0x7f45cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.607+0000 7f45e3fff640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f45cc06be30 0x7f45cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.607+0000 7f45e2ffd640 1 -- 172.21.15.96:0/566808471 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f45dc08acc0 con 0x7f45d8004800 2024-06-03T00:01:41.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.607+0000 7f45e3fff640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f45cc06be30 0x7f45cc06e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45d4033000 tx=0x7f45d402e000 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:41.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.611+0000 7f45e2ffd640 1 -- 172.21.15.96:0/566808471 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f45dc0594b0 con 0x7f45d8004800 2024-06-03T00:01:41.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.787+0000 7f45f0acd640 1 -- 172.21.15.96:0/566808471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f45ec0d2410 con 0x7f45d8004800 2024-06-03T00:01:41.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.791+0000 7f45e2ffd640 1 -- 172.21.15.96:0/566808471 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v17)=0 v17) ==== 123+0+0 (secure 0 0 0) 0x7f45dc058db0 con 0x7f45d8004800 2024-06-03T00:01:41.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.792+0000 7f45e2ffd640 1 -- 172.21.15.96:0/566808471 <== mon.0 v2:172.21.15.96:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f45dc08f070 con 0x7f45d8004800 2024-06-03T00:01:41.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 -- 172.21.15.96:0/566808471 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f45cc06be30 msgr2=0x7f45cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f45cc06be30 0x7f45cc06e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45d4033000 tx=0x7f45d402e000 comp rx=0 tx=0).stop 2024-06-03T00:01:41.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 -- 172.21.15.96:0/566808471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 msgr2=0x7f45ec0b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 0x7f45ec0b6bf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00e660 tx=0x7f45dc00eb20 comp rx=0 tx=0).stop 2024-06-03T00:01:41.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 -- 172.21.15.96:0/566808471 shutdown_connections 2024-06-03T00:01:41.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f45cc06be30 0x7f45cc06e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45ec0b8610 0x7f45ec0b8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45ec15f970 0x7f45ec1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 --2- 172.21.15.96:0/566808471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45d8004800 0x7f45ec0b6bf0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 -- 172.21.15.96:0/566808471 >> 172.21.15.96:0/566808471 conn(0x7f45ec0d4050 msgr2=0x7f45ec0cb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:41.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 -- 172.21.15.96:0/566808471 shutdown_connections 2024-06-03T00:01:41.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.793+0000 7f45f0acd640 1 -- 172.21.15.96:0/566808471 wait complete. 2024-06-03T00:01:41.805 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-03T00:01:41.805 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-03T00:01:41.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.904+0000 7f8a173d5640 1 Processor -- start 2024-06-03T00:01:41.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.904+0000 7f8a173d5640 1 -- start start 2024-06-03T00:01:41.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a173d5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8a10155570 0x7f8a1006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a173d5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a100cad30 0x7f8a10072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a173d5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a10155950 con 0x7f8a1006eb50 2024-06-03T00:01:41.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a173d5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 -- 0x7f8a100cb2e0 con 0x7f8a10155570 2024-06-03T00:01:41.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a173d5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a100cb5c0 con 0x7f8a100cad30 2024-06-03T00:01:41.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a15171640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8a10155570 0x7f8a1006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a15171640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8a10155570 0x7f8a1006e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52048/0 (socket says 172.21.15.96:52048) 2024-06-03T00:01:41.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a15171640 1 -- 172.21.15.96:0/2269024737 learned_addr learned my addr 172.21.15.96:0/2269024737 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:41.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a15972640 1 --2- 172.21.15.96:0/2269024737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a100cad30 0x7f8a10072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a15171640 1 -- 172.21.15.96:0/2269024737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a100cad30 msgr2=0x7f8a10072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-03T00:01:41.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a15171640 1 --2- 172.21.15.96:0/2269024737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a100cad30 0x7f8a10072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.905+0000 7f8a15171640 1 -- 172.21.15.96:0/2269024737 >> v1:172.21.15.162:6789/0 conn(0x7f8a1006eb50 legacy=0x7f8a100ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.906+0000 7f8a15171640 1 -- 172.21.15.96:0/2269024737 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a100cb8a0 con 0x7f8a10155570 2024-06-03T00:01:41.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.906+0000 7f8a15171640 1 --2- 172.21.15.96:0/2269024737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a10155570 0x7f8a1006e610 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009870 tx=0x7f8a0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabb0aa35085dc8e server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:41.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.906+0000 7f8a07fff640 1 -- 172.21.15.96:0/2269024737 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c037070 con 0x7f8a10155570 2024-06-03T00:01:41.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.906+0000 7f8a07fff640 1 -- 172.21.15.96:0/2269024737 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8a0c032440 con 0x7f8a10155570 2024-06-03T00:01:41.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.906+0000 7f8a07fff640 1 -- 172.21.15.96:0/2269024737 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c032830 con 0x7f8a10155570 2024-06-03T00:01:41.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.907+0000 7f8a173d5640 1 -- 172.21.15.96:0/2269024737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a10155570 msgr2=0x7f8a1006e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.907+0000 7f8a173d5640 1 --2- 172.21.15.96:0/2269024737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a10155570 0x7f8a1006e610 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009870 tx=0x7f8a0c02a270 comp rx=0 tx=0).stop 2024-06-03T00:01:41.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.907+0000 7f8a173d5640 1 -- 172.21.15.96:0/2269024737 shutdown_connections 2024-06-03T00:01:41.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.907+0000 7f8a173d5640 1 --2- 172.21.15.96:0/2269024737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a100cad30 0x7f8a10072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.907+0000 7f8a173d5640 1 --2- 172.21.15.96:0/2269024737 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a10155570 0x7f8a1006e610 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.907+0000 7f8a173d5640 1 -- 172.21.15.96:0/2269024737 >> 172.21.15.96:0/2269024737 conn(0x7f8a100cfc30 msgr2=0x7f8a100d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:41.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.907+0000 7f8a173d5640 1 -- 172.21.15.96:0/2269024737 shutdown_connections 2024-06-03T00:01:41.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.907+0000 7f8a173d5640 1 -- 172.21.15.96:0/2269024737 wait complete. 2024-06-03T00:01:41.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.908+0000 7f8a173d5640 1 Processor -- start 2024-06-03T00:01:41.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.908+0000 7f8a173d5640 1 -- start start 2024-06-03T00:01:41.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a173d5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a1006eb50 0x7f8a1014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a173d5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a100cad30 0x7f8a1015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a173d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a10155570 0x7f8a1015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a173d5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 -- 0x7f8a10072560 con 0x7f8a1006eb50 2024-06-03T00:01:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a173d5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a100717d0 con 0x7f8a10155570 2024-06-03T00:01:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a173d5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a100726e0 con 0x7f8a100cad30 2024-06-03T00:01:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a15171640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a1006eb50 0x7f8a1014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a15171640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a1006eb50 0x7f8a1014e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52056/0 (socket says 172.21.15.96:52056) 2024-06-03T00:01:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a15171640 1 -- 172.21.15.96:0/1961366205 learned_addr learned my addr 172.21.15.96:0/1961366205 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-06-03T00:01:41.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a15171640 1 -- 172.21.15.96:0/1961366205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a100cad30 msgr2=0x7f8a1015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a15171640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a100cad30 0x7f8a1015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a15171640 1 -- 172.21.15.96:0/1961366205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a10155570 msgr2=0x7f8a1015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:41.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a15171640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a10155570 0x7f8a1015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:41.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a15171640 1 -- 172.21.15.96:0/1961366205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1014e740 con 0x7f8a1006eb50 2024-06-03T00:01:41.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.909+0000 7f8a15171640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a1006eb50 0x7f8a1014e200 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c02a2b0 tx=0x7f8a0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:41.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.910+0000 7f8a05ffb640 1 -- 172.21.15.96:0/1961366205 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c037040 con 0x7f8a1006eb50 2024-06-03T00:01:41.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.910+0000 7f8a05ffb640 1 -- 172.21.15.96:0/1961366205 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8a0c042070 con 0x7f8a1006eb50 2024-06-03T00:01:41.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.910+0000 7f8a173d5640 1 -- 172.21.15.96:0/1961366205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1015d800 con 0x7f8a1006eb50 2024-06-03T00:01:41.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.910+0000 7f8a05ffb640 1 -- 172.21.15.96:0/1961366205 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c030bd0 con 0x7f8a1006eb50 2024-06-03T00:01:41.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.910+0000 7f8a173d5640 1 -- 172.21.15.96:0/1961366205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1015ddc0 con 0x7f8a1006eb50 2024-06-03T00:01:41.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.911+0000 7f8a173d5640 1 -- 172.21.15.96:0/1961366205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a100683e0 con 0x7f8a1006eb50 2024-06-03T00:01:41.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.911+0000 7f8a05ffb640 1 -- 172.21.15.96:0/1961366205 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) ==== 90498+0+0 (secure 0 0 0) 0x7f8a0c047460 con 0x7f8a1006eb50 2024-06-03T00:01:41.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.912+0000 7f8a05ffb640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f89f406be30 0x7f89f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-03T00:01:41.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.912+0000 7f8a05ffb640 1 -- 172.21.15.96:0/1961366205 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6159+0+0 (secure 0 0 0) 0x7f8a0c0abc00 con 0x7f8a1006eb50 2024-06-03T00:01:41.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.912+0000 7f8a14970640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f89f406be30 0x7f89f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-03T00:01:41.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.912+0000 7f8a14970640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f89f406be30 0x7f89f406e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a00000f60 tx=0x7f8a000079d0 comp rx=0 tx=0).ready entity=mgr.5197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-03T00:01:41.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:41.916+0000 7f8a05ffb640 1 -- 172.21.15.96:0/1961366205 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185294 (secure 0 0 0) 0x7f8a0c0b2080 con 0x7f8a1006eb50 2024-06-03T00:01:42.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.124+0000 7f8a173d5640 1 -- 172.21.15.96:0/1961366205 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a100cec70 con 0x7f8a1006eb50 2024-06-03T00:01:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.125+0000 7f8a05ffb640 1 -- 172.21.15.96:0/1961366205 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5187 (secure 0 0 0) 0x7f8a0c032e20 con 0x7f8a1006eb50 2024-06-03T00:01:42.125 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-06-03T00:01:42.125 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5072,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2232659491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2232659491},{"type":"v1","addr":"172.21.15.162:6835","nonce":2232659491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5344,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1347815459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1347815459},{"type":"v1","addr":"172.21.15.162:6833","nonce":1347815459}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6833/2486518149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":2486518149},{"type":"v1","addr":"172.21.15.96:6833","nonce":2486518149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-02T23:59:00.972277+0000","modified":"2024-06-02T23:59:03.921466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5739},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5739":{"gid":5739,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6835/2309601772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2309601772},{"type":"v1","addr":"172.21.15.96:6835","nonce":2309601772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5739,"qdb_cluster":[5739]},"id":3}]} 2024-06-03T00:01:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 25 2024-06-03T00:01:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 -- 172.21.15.96:0/1961366205 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f89f406be30 msgr2=0x7f89f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f89f406be30 0x7f89f406e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a00000f60 tx=0x7f8a000079d0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 -- 172.21.15.96:0/1961366205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a1006eb50 msgr2=0x7f8a1014e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-03T00:01:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a1006eb50 0x7f8a1014e200 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c02a2b0 tx=0x7f8a0c0046c0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 -- 172.21.15.96:0/1961366205 shutdown_connections 2024-06-03T00:01:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.96:6836/752549631,v1:172.21.15.96:6837/752549631] conn(0x7f89f406be30 0x7f89f406e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a10155570 0x7f8a1015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a100cad30 0x7f8a1015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 --2- 172.21.15.96:0/1961366205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a1006eb50 0x7f8a1014e200 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-03T00:01:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 -- 172.21.15.96:0/1961366205 >> 172.21.15.96:0/1961366205 conn(0x7f8a100cfc30 msgr2=0x7f8a100cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-03T00:01:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 -- 172.21.15.96:0/1961366205 shutdown_connections 2024-06-03T00:01:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-06-03T00:01:42.127+0000 7f8a173d5640 1 -- 172.21.15.96:0/1961366205 wait complete. 2024-06-03T00:01:42.138 DEBUG:tasks.cephfs.filesystem:already dead... 2024-06-03T00:01:42.138 INFO:teuthology.misc:Shutting down mds daemons... 2024-06-03T00:01:42.139 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-06-03T00:01:42.139 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.148 INFO:tasks.ceph.mds.a:Stopped 2024-06-03T00:01:42.148 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-06-03T00:01:42.148 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.197 INFO:tasks.ceph.mds.c:Stopped 2024-06-03T00:01:42.197 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-06-03T00:01:42.198 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.210 INFO:tasks.ceph.mds.b:Stopped 2024-06-03T00:01:42.210 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-06-03T00:01:42.210 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.261 INFO:tasks.ceph.mds.d:Stopped 2024-06-03T00:01:42.261 INFO:teuthology.misc:Shutting down osd daemons... 2024-06-03T00:01:42.262 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-06-03T00:01:42.262 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.293 INFO:tasks.ceph.osd.0:Stopped 2024-06-03T00:01:42.293 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-06-03T00:01:42.293 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.357 INFO:tasks.ceph.osd.1:Stopped 2024-06-03T00:01:42.357 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-06-03T00:01:42.357 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.431 INFO:tasks.ceph.osd.2:Stopped 2024-06-03T00:01:42.431 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-06-03T00:01:42.431 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.504 INFO:tasks.ceph.osd.3:Stopped 2024-06-03T00:01:42.505 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-06-03T00:01:42.505 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.543 INFO:tasks.ceph.osd.4:Stopped 2024-06-03T00:01:42.543 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-06-03T00:01:42.543 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.627 INFO:tasks.ceph.osd.5:Stopped 2024-06-03T00:01:42.628 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-06-03T00:01:42.628 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.697 INFO:tasks.ceph.osd.6:Stopped 2024-06-03T00:01:42.697 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-06-03T00:01:42.697 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.777 INFO:tasks.ceph.osd.7:Stopped 2024-06-03T00:01:42.777 INFO:teuthology.misc:Shutting down mgr daemons... 2024-06-03T00:01:42.777 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-06-03T00:01:42.778 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.809 INFO:tasks.ceph.mgr.y:Stopped 2024-06-03T00:01:42.809 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-06-03T00:01:42.809 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.847 INFO:tasks.ceph.mgr.x:Stopped 2024-06-03T00:01:42.847 INFO:teuthology.misc:Shutting down mon daemons... 2024-06-03T00:01:42.847 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-06-03T00:01:42.847 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.863 INFO:tasks.ceph.mon.a:Stopped 2024-06-03T00:01:42.864 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-06-03T00:01:42.864 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.900 INFO:tasks.ceph.mon.b:Stopped 2024-06-03T00:01:42.901 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-06-03T00:01:42.901 INFO:teuthology.orchestra.run:waiting for 300 2024-06-03T00:01:42.953 INFO:tasks.ceph.mon.c:Stopped 2024-06-03T00:01:42.954 INFO:tasks.ceph:Checking cluster log for badness... 2024-06-03T00:01:42.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-06-03T00:01:42.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi096.front.sepia.ceph.com 2024-06-03T00:01:42.996 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-06-03T00:01:43.291 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi096.front.sepia.ceph.com 2024-06-03T00:01:43.291 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-06-03T00:01:43.395 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi096.front.sepia.ceph.com 2024-06-03T00:01:43.395 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-06-03T00:01:43.486 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi096.front.sepia.ceph.com 2024-06-03T00:01:43.486 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-06-03T00:01:43.535 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2024-06-03T00:01:43.535 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-06-03T00:01:43.737 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi162.front.sepia.ceph.com 2024-06-03T00:01:43.737 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-06-03T00:01:43.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi162.front.sepia.ceph.com 2024-06-03T00:01:43.802 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-06-03T00:01:43.859 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2024-06-03T00:01:43.860 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-06-03T00:01:43.927 INFO:tasks.ceph:Archiving mon data... 2024-06-03T00:01:43.929 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687/data/mon.a.tgz 2024-06-03T00:01:43.929 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-06-03T00:01:43.945 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.eoP17hUGLx 2024-06-03T00:01:43.945 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eoP17hUGLx 2024-06-03T00:01:44.135 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.eoP17hUGLx 2024-06-03T00:01:44.218 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.eoP17hUGLx is 650KB 2024-06-03T00:01:44.317 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.eoP17hUGLx 2024-06-03T00:01:44.332 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687/data/mon.b.tgz 2024-06-03T00:01:44.332 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-06-03T00:01:44.350 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.50QNNaUOQy 2024-06-03T00:01:44.351 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.50QNNaUOQy 2024-06-03T00:01:44.575 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.50QNNaUOQy 2024-06-03T00:01:44.658 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.50QNNaUOQy is 661KB 2024-06-03T00:01:44.729 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.50QNNaUOQy 2024-06-03T00:01:44.744 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687/data/mon.c.tgz 2024-06-03T00:01:44.744 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-06-03T00:01:44.798 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.OdhMDYNdyy 2024-06-03T00:01:44.799 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.OdhMDYNdyy 2024-06-03T00:01:44.973 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.OdhMDYNdyy 2024-06-03T00:01:45.057 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.OdhMDYNdyy is 661KB 2024-06-03T00:01:45.160 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.OdhMDYNdyy 2024-06-03T00:01:45.175 INFO:tasks.ceph:Cleaning ceph cluster... 2024-06-03T00:01:45.175 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-03T00:01:45.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-06-03T00:01:45.263 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-03T00:01:45.295 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-06-03T00:01:45.295 INFO:tasks.ceph:Archiving crash dumps... 2024-06-03T00:01:45.297 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687/remote/smithi096/crash 2024-06-03T00:01:45.298 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-03T00:01:45.331 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687/remote/smithi162/crash 2024-06-03T00:01:45.332 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-06-03T00:01:45.359 INFO:tasks.ceph:Shutting down logrotate 2024-06-03T00:01:45.359 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-03T00:01:45.375 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-06-03T00:01:45.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-06-03T00:01:45.490 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-06-03T00:01:45.515 INFO:tasks.ceph:Compressing logs... 2024-06-03T00:01:45.515 DEBUG:teuthology.orchestra.run.smithi096:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-03T00:01:45.532 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-03T00:01:45.556 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58603.log 2024-06-03T00:01:45.596 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44733.log 2024-06-03T00:01:45.596 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-03T00:01:45.596 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.3.44733.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-03T00:01:45.596 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-06-03T00:01:45.597 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.audit.log: 88.0% -- replaced with /var/log/ceph/ceph-client.3.44733.log.gz 2024-06-03T00:01:45.597 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-06-03T00:01:45.597 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-06-03T00:01:45.597 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-06-03T00:01:45.597 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37827.log 2024-06-03T00:01:45.597 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-06-03T00:01:45.597 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37827.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-06-03T00:01:45.597 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37827.log.gz 2024-06-03T00:01:45.597 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.x.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-03T00:01:45.598 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37787.log 2024-06-03T00:01:45.598 INFO:teuthology.orchestra.run.smithi162.stderr: 93.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-03T00:01:45.598 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-06-03T00:01:45.598 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44282.log 2024-06-03T00:01:45.598 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37787.log.gz 2024-06-03T00:01:45.598 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.6.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-06-03T00:01:45.598 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37616.log 2024-06-03T00:01:45.598 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.44282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37867.log 2024-06-03T00:01:45.599 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.1.44282.log.gz 2024-06-03T00:01:45.599 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37616.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37616.log.gz 2024-06-03T00:01:45.599 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37696.log 2024-06-03T00:01:45.599 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37907.log 2024-06-03T00:01:45.599 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37867.log.gz 2024-06-03T00:01:45.599 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37696.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37696.log.gz 2024-06-03T00:01:45.599 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37656.log 2024-06-03T00:01:45.599 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37740.log 2024-06-03T00:01:45.600 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37907.log: /var/log/ceph/ceph-client.admin.37656.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37907.log.gz 2024-06-03T00:01:45.600 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37656.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-06-03T00:01:45.600 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-06-03T00:01:45.600 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37740.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37740.log.gz 2024-06-03T00:01:45.600 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-06-03T00:01:45.600 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-06-03T00:01:45.602 INFO:teuthology.orchestra.run.smithi162.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-06-03T00:01:45.609 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58464.log 2024-06-03T00:01:45.609 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46064.log 2024-06-03T00:01:45.609 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58603.log: /var/log/ceph/ceph-client.admin.58464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60052.log 2024-06-03T00:01:45.609 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58603.log.gz 2024-06-03T00:01:45.609 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58464.log.gz 2024-06-03T00:01:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57480.log 2024-06-03T00:01:45.610 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46064.log.gz 2024-06-03T00:01:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57723.log 2024-06-03T00:01:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57480.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60052.log.gz 2024-06-03T00:01:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52494.log 2024-06-03T00:01:45.610 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57480.log.gz 2024-06-03T00:01:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49756.log 2024-06-03T00:01:45.610 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57723.log.gz 2024-06-03T00:01:45.611 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52408.log 2024-06-03T00:01:45.611 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49756.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.52494.log.gz -5 2024-06-03T00:01:45.611 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47148.log 2024-06-03T00:01:45.611 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52408.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49756.log.gz 2024-06-03T00:01:45.611 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57294.log 2024-06-03T00:01:45.611 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52408.log.gz 2024-06-03T00:01:45.611 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48793.log 2024-06-03T00:01:45.611 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47148.log.gz 2024-06-03T00:01:45.612 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55365.log 2024-06-03T00:01:45.612 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57294.log.gz 2024-06-03T00:01:45.612 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49918.log 2024-06-03T00:01:45.612 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48793.log.gz 2024-06-03T00:01:45.612 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.55365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48625.log 2024-06-03T00:01:45.612 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55365.log.gz 2024-06-03T00:01:45.612 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60862.log 2024-06-03T00:01:45.612 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49918.log: /var/log/ceph/ceph-client.admin.48625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52219.log 2024-06-03T00:01:45.612 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49918.log.gz 2024-06-03T00:01:45.613 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48625.log.gz 2024-06-03T00:01:45.613 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44250.log 2024-06-03T00:01:45.613 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52219.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60862.log.gz 2024-06-03T00:01:45.613 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50182.log 2024-06-03T00:01:45.613 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52219.log.gz 2024-06-03T00:01:45.613 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46061.log 2024-06-03T00:01:45.613 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44250.log.gz 2024-06-03T00:01:45.613 INFO:teuthology.orchestra.run.smithi096.stderr:gzip/var/log/ceph/ceph-client.admin.50182.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49401.log 2024-06-03T00:01:45.614 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51522.log 2024-06-03T00:01:45.614 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50182.log.gz 2024-06-03T00:01:45.614 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49401.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46061.log.gz 2024-06-03T00:01:45.614 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44568.log 2024-06-03T00:01:45.614 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49401.log.gz 2024-06-03T00:01:45.614 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.51522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50056.log 2024-06-03T00:01:45.614 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44568.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51522.log.gz 2024-06-03T00:01:45.614 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44155.log 2024-06-03T00:01:45.615 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44568.log.gz 2024-06-03T00:01:45.615 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60400.log 2024-06-03T00:01:45.615 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50056.log.gz 2024-06-03T00:01:45.615 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45846.log 2024-06-03T00:01:45.615 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60400.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.44155.log.gz -5 2024-06-03T00:01:45.615 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.0.59434.log 2024-06-03T00:01:45.615 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60400.log.gz 2024-06-03T00:01:45.615 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47106.log 2024-06-03T00:01:45.615 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.59434.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45846.log.gz 2024-06-03T00:01:45.616 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51788.log 2024-06-03T00:01:45.616 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46742.log 2024-06-03T00:01:45.616 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47106.log.gz 2024-06-03T00:01:45.616 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.51788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57975.log 2024-06-03T00:01:45.616 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46742.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51788.log.gz 2024-06-03T00:01:45.616 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47022.log 2024-06-03T00:01:45.616 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46742.log.gz 2024-06-03T00:01:45.616 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49671.log 2024-06-03T00:01:45.617 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57975.log.gz 2024-06-03T00:01:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60010.log 2024-06-03T00:01:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49671.log: gzip -5 --verbose 89.2% -- -- replaced with /var/log/ceph/ceph-client.admin.47022.log.gz /var/log/ceph/ceph-client.admin.46056.log 2024-06-03T00:01:45.617 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-06-03T00:01:45.617 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49671.log.gz 2024-06-03T00:01:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60010.log: 94.8% -- replaced with /var/log/ceph/ceph-client.0.59434.log.gz 2024-06-03T00:01:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60094.log 2024-06-03T00:01:45.617 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60010.log.gz 2024-06-03T00:01:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50352.log 2024-06-03T00:01:45.618 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60094.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46056.log.gz 2024-06-03T00:01:45.618 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58729.log 2024-06-03T00:01:45.618 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60094.log.gz 2024-06-03T00:01:45.618 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60568.log 2024-06-03T00:01:45.618 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50352.log.gz 2024-06-03T00:01:45.618 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58212.log 2024-06-03T00:01:45.618 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58729.log.gz 2024-06-03T00:01:45.618 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53452.log 2024-06-03T00:01:45.619 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58212.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60568.log.gz 2024-06-03T00:01:45.619 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-06-03T00:01:45.619 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58212.log.gz 2024-06-03T00:01:45.619 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49569.log 2024-06-03T00:01:45.619 INFO:teuthology.orchestra.run.smithi096.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53452.log.gz 2024-06-03T00:01:45.619 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53578.log 2024-06-03T00:01:45.619 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58771.log 2024-06-03T00:01:45.619 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49569.log.gz 2024-06-03T00:01:45.619 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45717.log 2024-06-03T00:01:45.620 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53578.log.gz 2024-06-03T00:01:45.620 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52666.log 2024-06-03T00:01:45.620 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45717.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58771.log.gz 2024-06-03T00:01:45.620 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46065.log 2024-06-03T00:01:45.620 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45717.log.gz 2024-06-03T00:01:45.620 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56417.log 2024-06-03T00:01:45.620 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52666.log.gz 2024-06-03T00:01:45.620 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-06-03T00:01:45.621 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53368.log 2024-06-03T00:01:45.621 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.56417.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46065.log.gz 2024-06-03T00:01:45.621 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54253.log 2024-06-03T00:01:45.621 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56417.log.gz 2024-06-03T00:01:45.621 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53368.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-06-03T00:01:45.621 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53368.log.gz 2024-06-03T00:01:45.621 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57849.log 2024-06-03T00:01:45.621 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.54253.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47064.log 2024-06-03T00:01:45.622 INFO:teuthology.orchestra.run.smithi096.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54253.log.gz 2024-06-03T00:01:45.622 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47232.log 2024-06-03T00:01:45.622 INFO:teuthology.orchestra.run.smithi096.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57849.log.gz 2024-06-03T00:01:45.622 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49798.log 2024-06-03T00:01:45.622 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47064.log.gz 2024-06-03T00:01:45.622 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53620.log 2024-06-03T00:01:45.622 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46734.log 2024-06-03T00:01:45.622 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49798.log.gz 2024-06-03T00:01:45.623 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53620.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47232.log.gz 2024-06-03T00:01:45.623 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46397.log 2024-06-03T00:01:45.623 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53620.log.gz 2024-06-03T00:01:45.623 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44199.log 2024-06-03T00:01:45.623 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46734.log: /var/log/ceph/ceph-client.admin.46397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50013.log 2024-06-03T00:01:45.623 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46734.log.gz 2024-06-03T00:01:45.623 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46397.log.gz 2024-06-03T00:01:45.623 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57336.log 2024-06-03T00:01:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44199.log: /var/log/ceph/ceph-client.admin.50013.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.44199.log.gz -5 2024-06-03T00:01:45.624 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60778.log 2024-06-03T00:01:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57336.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50013.log.gz 2024-06-03T00:01:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47873.log 2024-06-03T00:01:45.624 INFO:teuthology.orchestra.run.smithi096.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57336.log.gz 2024-06-03T00:01:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51372.log 2024-06-03T00:01:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47873.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.60778.log.gz -5 2024-06-03T00:01:45.624 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59108.log 2024-06-03T00:01:45.625 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.51372.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47873.log.gz 2024-06-03T00:01:45.625 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45888.log 2024-06-03T00:01:45.625 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51372.log.gz 2024-06-03T00:01:45.625 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.59108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50805.log 2024-06-03T00:01:45.625 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57891.log 2024-06-03T00:01:45.625 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50805.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45888.log.gz 2024-06-03T00:01:45.625 INFO:teuthology.orchestra.run.smithi096.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.59108.log.gz 2024-06-03T00:01:45.626 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57046.log 2024-06-03T00:01:45.626 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50805.log.gz 2024-06-03T00:01:45.626 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46406.log 2024-06-03T00:01:45.626 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57891.log: /var/log/ceph/ceph-client.admin.57046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51464.log 2024-06-03T00:01:45.626 INFO:teuthology.orchestra.run.smithi096.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57891.log.gz 2024-06-03T00:01:45.626 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57046.log.gz 2024-06-03T00:01:45.626 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60274.log 2024-06-03T00:01:45.626 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46406.log.gz 2024-06-03T00:01:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.51464.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-06-03T00:01:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60274.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51464.log.gz 2024-06-03T00:01:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50549.log 2024-06-03T00:01:45.627 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60274.log.gz 2024-06-03T00:01:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44027.log 2024-06-03T00:01:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2024-06-03T00:01:45.627 INFO:teuthology.orchestra.run.smithi096.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50549.log.gz 2024-06-03T00:01:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57168.log 2024-06-03T00:01:45.628 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44027.log.gz 2024-06-03T00:01:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44526.log 2024-06-03T00:01:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46738.log: /var/log/ceph/ceph-client.admin.57168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45667.log 2024-06-03T00:01:45.628 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2024-06-03T00:01:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44526.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57168.log.gz 2024-06-03T00:01:45.628 INFO:teuthology.orchestra.run.smithi096.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-06-03T00:01:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44069.log 2024-06-03T00:01:45.628 INFO:teuthology.orchestra.run.smithi096.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44526.log.gz 2024-06-03T00:01:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60358.log 2024-06-03T00:01:45.629 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45667.log.gz 2024-06-03T00:01:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50679.log 2024-06-03T00:01:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46938.log 2024-06-03T00:01:45.629 INFO:teuthology.orchestra.run.smithi096.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44069.log.gz 2024-06-03T00:01:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50679.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60358.log.gz 2024-06-03T00:01:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44442.log 2024-06-03T00:01:45.629 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50679.log.gz 2024-06-03T00:01:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61007.log 2024-06-03T00:01:45.630 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46938.log.gz 2024-06-03T00:01:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44442.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-06-03T00:01:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.61007.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44442.log.gz 2024-06-03T00:01:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44400.log 2024-06-03T00:01:45.630 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61007.log.gz 2024-06-03T00:01:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50308.log 2024-06-03T00:01:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51414.log 2024-06-03T00:01:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50308.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44400.log.gz 2024-06-03T00:01:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52623.log 2024-06-03T00:01:45.631 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50308.log.gz 2024-06-03T00:01:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.51414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43945.log 2024-06-03T00:01:45.631 INFO:teuthology.orchestra.run.smithi096.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51414.log.gz 2024-06-03T00:01:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50763.log 2024-06-03T00:01:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52623.log: /var/log/ceph/ceph-client.admin.43945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60484.log 2024-06-03T00:01:45.631 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52623.log.gz 2024-06-03T00:01:45.631 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43945.log.gz 2024-06-03T00:01:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45498.log 2024-06-03T00:01:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52279.log 2024-06-03T00:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50763.log.gz 2024-06-03T00:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60484.log: /var/log/ceph/ceph-client.admin.45498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57670.log 2024-06-03T00:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60484.log.gz 2024-06-03T00:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2024-06-03T00:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57765.log 2024-06-03T00:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52279.log: /var/log/ceph/ceph-client.admin.57670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46401.log 2024-06-03T00:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52279.log.gz 2024-06-03T00:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57670.log.gz 2024-06-03T00:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57765.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-06-03T00:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57765.log.gz 2024-06-03T00:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.46401.log: -- /var/log/ceph/ceph-client.admin.55102.log 2024-06-03T00:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46404.log 2024-06-03T00:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46401.log.gz 2024-06-03T00:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.55102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59174.log 2024-06-03T00:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55102.log.gz 2024-06-03T00:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49971.log 2024-06-03T00:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45582.log 2024-06-03T00:01:45.634 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46404.log.gz 2024-06-03T00:01:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.59174.log: /var/log/ceph/ceph-client.admin.49971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53494.log 2024-06-03T00:01:45.634 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59174.log.gz 2024-06-03T00:01:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45582.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49971.log.gz 2024-06-03T00:01:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59836.log 2024-06-03T00:01:45.634 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45582.log.gz 2024-06-03T00:01:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53722.log 2024-06-03T00:01:45.634 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53494.log.gz 2024-06-03T00:01:45.635 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46389.log 2024-06-03T00:01:45.635 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.59836.log: /var/log/ceph/ceph-client.admin.53722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57252.log 2024-06-03T00:01:45.635 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59836.log.gz 2024-06-03T00:01:45.635 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46389.log: gzip -5 88.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.53722.log.gz /var/log/ceph/ceph-osd.1.log 2024-06-03T00:01:45.635 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-06-03T00:01:45.635 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46389.log.gz 2024-06-03T00:01:45.635 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57252.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-06-03T00:01:45.635 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44111.log 2024-06-03T00:01:45.636 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57252.log.gz 2024-06-03T00:01:45.636 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46980.log 2024-06-03T00:01:45.636 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60137.log 2024-06-03T00:01:45.636 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8%/var/log/ceph/ceph-client.admin.46980.log: -- replaced with /var/log/ceph/ceph-client.admin.44111.log.gz 2024-06-03T00:01:45.636 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-06-03T00:01:45.636 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46980.log.gz 2024-06-03T00:01:45.636 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49443.log 2024-06-03T00:01:45.636 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60137.log.gz 2024-06-03T00:01:45.637 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.0.log: -- /var/log/ceph/ceph-client.admin.49714.log 2024-06-03T00:01:45.637 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53326.log 2024-06-03T00:01:45.637 INFO:teuthology.orchestra.run.smithi096.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49443.log.gz 2024-06-03T00:01:45.637 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58358.log 2024-06-03T00:01:45.637 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53326.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49714.log.gz 2024-06-03T00:01:45.637 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53326.log.gz 2024-06-03T00:01:45.637 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51215.log 2024-06-03T00:01:45.637 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58358.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58358.log.gz 2024-06-03T00:01:45.637 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31478.log 2024-06-03T00:01:45.638 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48946.log 2024-06-03T00:01:45.638 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.51215.log: /var/log/ceph/ceph.tmp-client.admin.31478.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31478.log.gz 2024-06-03T00:01:45.655 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44484.log 2024-06-03T00:01:45.655 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48946.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48946.log.gz 2024-06-03T00:01:45.655 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46067.log 2024-06-03T00:01:45.655 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44484.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44484.log.gz 2024-06-03T00:01:45.655 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54017.log 2024-06-03T00:01:45.655 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46067.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46067.log.gz 2024-06-03T00:01:45.656 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49359.log 2024-06-03T00:01:45.656 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.54017.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54017.log.gz 2024-06-03T00:01:45.656 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37872.log 2024-06-03T00:01:45.656 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49359.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49359.log.gz 2024-06-03T00:01:45.656 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2024-06-03T00:01:45.656 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.37872.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37872.log.gz 2024-06-03T00:01:45.656 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37505.log 2024-06-03T00:01:45.656 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53536.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2024-06-03T00:01:45.656 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52537.log 2024-06-03T00:01:45.657 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.37505.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37505.log.gz 2024-06-03T00:01:45.657 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46640.log 2024-06-03T00:01:45.657 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52537.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52537.log.gz 2024-06-03T00:01:45.657 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46642.log 2024-06-03T00:01:45.657 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46640.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46640.log.gz 2024-06-03T00:01:45.657 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53284.log 2024-06-03T00:01:45.657 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46642.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46642.log.gz 2024-06-03T00:01:45.657 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58420.log 2024-06-03T00:01:45.658 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53284.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53284.log.gz 2024-06-03T00:01:45.658 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49140.log 2024-06-03T00:01:45.658 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58420.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58420.log.gz 2024-06-03T00:01:45.658 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56943.log 2024-06-03T00:01:45.658 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49140.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49140.log.gz 2024-06-03T00:01:45.658 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46405.log 2024-06-03T00:01:45.658 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.56943.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56943.log.gz 2024-06-03T00:01:45.658 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60190.log 2024-06-03T00:01:45.659 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46405.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46405.log.gz 2024-06-03T00:01:45.659 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49275.log 2024-06-03T00:01:45.659 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60190.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60190.log.gz 2024-06-03T00:01:45.659 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49198.log 2024-06-03T00:01:45.659 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49275.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49275.log.gz 2024-06-03T00:01:45.659 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48389.log 2024-06-03T00:01:45.659 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49198.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49198.log.gz 2024-06-03T00:01:45.659 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50721.log 2024-06-03T00:01:45.660 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48389.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48389.log.gz 2024-06-03T00:01:45.660 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-06-03T00:01:45.660 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50721.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50721.log.gz 2024-06-03T00:01:45.660 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51979.log 2024-06-03T00:01:45.663 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59066.log 2024-06-03T00:01:45.664 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.51979.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51979.log.gz 2024-06-03T00:01:45.677 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60526.log 2024-06-03T00:01:45.678 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.59066.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59066.log.gz 2024-06-03T00:01:45.691 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50595.log 2024-06-03T00:01:45.692 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60526.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60526.log.gz 2024-06-03T00:01:45.698 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.48267.log 2024-06-03T00:01:45.698 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50595.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50595.log.gz 2024-06-03T00:01:45.707 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52159.log 2024-06-03T00:01:45.707 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.2.48267.log: 88.7% -- replaced with /var/log/ceph/ceph-client.2.48267.log.gz 2024-06-03T00:01:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46741.log 2024-06-03T00:01:45.716 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52159.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52159.log.gz 2024-06-03T00:01:45.728 INFO:teuthology.orchestra.run.smithi096.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.51215.log.gz 2024-06-03T00:01:45.730 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52580.log 2024-06-03T00:01:45.731 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46741.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46741.log.gz 2024-06-03T00:01:45.731 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58940.log 2024-06-03T00:01:45.733 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52580.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52580.log.gz 2024-06-03T00:01:45.733 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45456.log 2024-06-03T00:01:45.733 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58940.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58940.log.gz 2024-06-03T00:01:45.733 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51598.log 2024-06-03T00:01:45.733 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45456.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45456.log.gz 2024-06-03T00:01:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58645.log 2024-06-03T00:01:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.51598.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51598.log.gz 2024-06-03T00:01:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59778.log 2024-06-03T00:01:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58645.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58645.log.gz 2024-06-03T00:01:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49485.log 2024-06-03T00:01:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.59778.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59778.log.gz 2024-06-03T00:01:45.739 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48888.log 2024-06-03T00:01:45.739 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49485.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49485.log.gz 2024-06-03T00:01:45.739 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43849.log 2024-06-03T00:01:45.739 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48888.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48888.log.gz 2024-06-03T00:01:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58561.log 2024-06-03T00:01:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43849.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43849.log.gz 2024-06-03T00:01:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55891.log 2024-06-03T00:01:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58561.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58561.log.gz 2024-06-03T00:01:45.747 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48541.log 2024-06-03T00:01:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.55891.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55891.log.gz 2024-06-03T00:01:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52365.log 2024-06-03T00:01:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48541.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48541.log.gz 2024-06-03T00:01:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44718.log 2024-06-03T00:01:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52365.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52365.log.gz 2024-06-03T00:01:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49024.log 2024-06-03T00:01:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44718.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44718.log.gz 2024-06-03T00:01:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58316.log 2024-06-03T00:01:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49024.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49024.log.gz 2024-06-03T00:01:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2024-06-03T00:01:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58316.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58316.log.gz 2024-06-03T00:01:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51848.log 2024-06-03T00:01:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45129.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2024-06-03T00:01:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59591.log 2024-06-03T00:01:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.51848.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51848.log.gz 2024-06-03T00:01:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59024.log 2024-06-03T00:01:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.59591.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59591.log.gz 2024-06-03T00:01:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56680.log 2024-06-03T00:01:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.59024.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59024.log.gz 2024-06-03T00:01:45.753 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49611.log 2024-06-03T00:01:45.754 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.56680.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56680.log.gz 2024-06-03T00:01:45.754 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60232.log 2024-06-03T00:01:45.754 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49611.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49611.log.gz 2024-06-03T00:01:45.754 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46069.log 2024-06-03T00:01:45.755 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60232.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60232.log.gz 2024-06-03T00:01:45.755 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57628.log 2024-06-03T00:01:45.755 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46069.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46069.log.gz 2024-06-03T00:01:45.756 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46068.log 2024-06-03T00:01:45.756 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57628.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57628.log.gz 2024-06-03T00:01:45.757 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49527.log 2024-06-03T00:01:45.757 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46068.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46068.log.gz 2024-06-03T00:01:45.758 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50396.log 2024-06-03T00:01:45.759 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49527.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49527.log.gz 2024-06-03T00:01:45.759 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45540.log 2024-06-03T00:01:45.760 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50396.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50396.log.gz 2024-06-03T00:01:45.760 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60965.log 2024-06-03T00:01:45.761 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45540.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45540.log.gz 2024-06-03T00:01:45.761 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57807.log 2024-06-03T00:01:45.762 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60965.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60965.log.gz 2024-06-03T00:01:45.762 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48751.log 2024-06-03T00:01:45.763 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57807.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57807.log.gz 2024-06-03T00:01:45.763 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46403.log 2024-06-03T00:01:45.764 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48751.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48751.log.gz 2024-06-03T00:01:45.764 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49066.log 2024-06-03T00:01:45.765 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46403.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46403.log.gz 2024-06-03T00:01:45.765 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53958.log 2024-06-03T00:01:45.766 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49066.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49066.log.gz 2024-06-03T00:01:45.766 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47751.log 2024-06-03T00:01:45.767 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53958.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53958.log.gz 2024-06-03T00:01:45.767 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53781.log 2024-06-03T00:01:45.768 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.47751.log: 88.7% -- replaced with /var/log/ceph/ceph-client.0.47751.log.gz 2024-06-03T00:01:45.769 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46641.log 2024-06-03T00:01:45.769 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53781.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53781.log.gz 2024-06-03T00:01:45.770 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44314.log 2024-06-03T00:01:45.771 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46641.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46641.log.gz 2024-06-03T00:01:45.771 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51919.log 2024-06-03T00:01:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44314.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44314.log.gz 2024-06-03T00:01:45.772 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48431.log 2024-06-03T00:01:45.773 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.51919.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51919.log.gz 2024-06-03T00:01:45.773 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52709.log 2024-06-03T00:01:45.774 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48431.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48431.log.gz 2024-06-03T00:01:45.774 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46070.log 2024-06-03T00:01:45.775 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52709.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52709.log.gz 2024-06-03T00:01:45.775 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60316.log 2024-06-03T00:01:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46070.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46070.log.gz 2024-06-03T00:01:45.776 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44358.log 2024-06-03T00:01:45.777 INFO:teuthology.orchestra.run.smithi162.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-06-03T00:01:45.778 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60316.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60316.log.gz 2024-06-03T00:01:45.778 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54194.log 2024-06-03T00:01:45.778 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44358.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44358.log.gz 2024-06-03T00:01:45.779 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58982.log 2024-06-03T00:01:45.779 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.54194.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54194.log.gz 2024-06-03T00:01:45.780 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60652.log 2024-06-03T00:01:45.780 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58982.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58982.log.gz 2024-06-03T00:01:45.781 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53410.log 2024-06-03T00:01:45.781 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60652.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60652.log.gz 2024-06-03T00:01:45.782 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53899.log 2024-06-03T00:01:45.782 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53410.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53410.log.gz 2024-06-03T00:01:45.783 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49317.log 2024-06-03T00:01:45.783 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53899.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53899.log.gz 2024-06-03T00:01:45.784 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58855.log 2024-06-03T00:01:45.785 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.49317.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49317.log.gz 2024-06-03T00:01:45.785 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53840.log 2024-06-03T00:01:45.786 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58855.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58855.log.gz 2024-06-03T00:01:45.786 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37789.log 2024-06-03T00:01:45.787 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53840.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53840.log.gz 2024-06-03T00:01:45.787 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57210.log 2024-06-03T00:01:45.788 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.37789.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37789.log.gz 2024-06-03T00:01:45.788 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50637.log 2024-06-03T00:01:45.789 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57210.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57210.log.gz 2024-06-03T00:01:45.789 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43745.log 2024-06-03T00:01:45.790 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50637.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50637.log.gz 2024-06-03T00:01:45.791 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46398.log 2024-06-03T00:01:45.791 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.43745.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43745.log.gz 2024-06-03T00:01:45.792 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60610.log 2024-06-03T00:01:45.792 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46398.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46398.log.gz 2024-06-03T00:01:45.793 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50266.log 2024-06-03T00:01:45.793 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60610.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60610.log.gz 2024-06-03T00:01:45.794 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46736.log 2024-06-03T00:01:45.794 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50266.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50266.log.gz 2024-06-03T00:01:45.795 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52039.log 2024-06-03T00:01:45.795 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.46736.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46736.log.gz 2024-06-03T00:01:45.796 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44652.log 2024-06-03T00:01:45.797 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52039.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52039.log.gz 2024-06-03T00:01:45.797 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58274.log 2024-06-03T00:01:45.798 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44652.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44652.log.gz 2024-06-03T00:01:45.799 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58112.log 2024-06-03T00:01:45.799 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58274.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58274.log.gz 2024-06-03T00:01:45.800 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54135.log 2024-06-03T00:01:45.800 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58112.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58112.log.gz 2024-06-03T00:01:45.800 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50098.log 2024-06-03T00:01:45.801 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.54135.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54135.log.gz 2024-06-03T00:01:45.801 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50847.log 2024-06-03T00:01:45.802 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50098.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50098.log.gz 2024-06-03T00:01:45.803 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54295.log 2024-06-03T00:01:45.803 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50847.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50847.log.gz 2024-06-03T00:01:45.804 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48583.log 2024-06-03T00:01:45.804 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.54295.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54295.log.gz 2024-06-03T00:01:45.805 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50955.log 2024-06-03T00:01:45.805 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48583.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48583.log.gz 2024-06-03T00:01:45.806 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53662.log 2024-06-03T00:01:45.806 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50955.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50955.log.gz 2024-06-03T00:01:45.807 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54076.log 2024-06-03T00:01:45.807 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.53662.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53662.log.gz 2024-06-03T00:01:45.808 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50140.log 2024-06-03T00:01:45.809 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.54076.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54076.log.gz 2024-06-03T00:01:45.809 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56154.log 2024-06-03T00:01:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50140.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50140.log.gz 2024-06-03T00:01:45.810 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60694.log 2024-06-03T00:01:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.56154.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56154.log.gz 2024-06-03T00:01:45.811 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50224.log 2024-06-03T00:01:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60694.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60694.log.gz 2024-06-03T00:01:45.812 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54558.log 2024-06-03T00:01:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50224.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50224.log.gz 2024-06-03T00:01:45.813 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58687.log 2024-06-03T00:01:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.54558.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54558.log.gz 2024-06-03T00:01:45.814 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52451.log 2024-06-03T00:01:45.815 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58687.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58687.log.gz 2024-06-03T00:01:45.815 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44610.log 2024-06-03T00:01:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52451.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52451.log.gz 2024-06-03T00:01:45.816 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-06-03T00:01:45.817 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.44610.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44610.log.gz 2024-06-03T00:01:45.818 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52099.log 2024-06-03T00:01:45.827 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54839.log 2024-06-03T00:01:45.827 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52099.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52099.log.gz 2024-06-03T00:01:45.838 INFO:teuthology.orchestra.run.smithi096.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-06-03T00:01:45.838 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45761.log 2024-06-03T00:01:45.838 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.54839.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54839.log.gz 2024-06-03T00:01:45.839 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50507.log 2024-06-03T00:01:45.839 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45761.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45761.log.gz 2024-06-03T00:01:45.840 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60442.log 2024-06-03T00:01:45.841 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50507.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50507.log.gz 2024-06-03T00:01:45.842 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52322.log 2024-06-03T00:01:45.842 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60442.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60442.log.gz 2024-06-03T00:01:45.844 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58017.log 2024-06-03T00:01:45.844 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.52322.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52322.log.gz 2024-06-03T00:01:45.845 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58813.log 2024-06-03T00:01:45.845 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58017.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58017.log.gz 2024-06-03T00:01:45.845 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47190.log 2024-06-03T00:01:45.846 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58813.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58813.log.gz 2024-06-03T00:01:45.846 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50889.log 2024-06-03T00:01:45.846 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47190.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47190.log.gz 2024-06-03T00:01:45.847 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45624.log 2024-06-03T00:01:45.847 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50889.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50889.log.gz 2024-06-03T00:01:45.848 INFO:teuthology.orchestra.run.smithi162.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-06-03T00:01:45.849 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57933.log 2024-06-03T00:01:45.850 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45624.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45624.log.gz 2024-06-03T00:01:45.850 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45320.log 2024-06-03T00:01:45.850 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57933.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57933.log.gz 2024-06-03T00:01:45.851 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58515.log 2024-06-03T00:01:45.851 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45320.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45320.log.gz 2024-06-03T00:01:45.851 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57420.log 2024-06-03T00:01:45.852 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58515.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58515.log.gz 2024-06-03T00:01:45.852 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60820.log 2024-06-03T00:01:45.853 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57420.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57420.log.gz 2024-06-03T00:01:45.853 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60925.log 2024-06-03T00:01:45.854 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60820.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60820.log.gz 2024-06-03T00:01:45.855 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45378.log 2024-06-03T00:01:45.855 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60925.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60925.log.gz 2024-06-03T00:01:45.855 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57378.log 2024-06-03T00:01:45.856 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45378.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45378.log.gz 2024-06-03T00:01:45.857 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47360.log 2024-06-03T00:01:45.857 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.57378.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57378.log.gz 2024-06-03T00:01:45.858 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58898.log 2024-06-03T00:01:45.858 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.47360.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47360.log.gz 2024-06-03T00:01:45.859 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48709.log 2024-06-03T00:01:45.859 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.58898.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58898.log.gz 2024-06-03T00:01:45.862 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45803.log 2024-06-03T00:01:45.862 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48709.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48709.log.gz 2024-06-03T00:01:45.863 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50465.log 2024-06-03T00:01:45.863 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.45803.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45803.log.gz 2024-06-03T00:01:45.863 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48667.log 2024-06-03T00:01:45.863 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.50465.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50465.log.gz 2024-06-03T00:01:45.864 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55628.log 2024-06-03T00:01:45.864 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.48667.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48667.log.gz 2024-06-03T00:01:45.864 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60736.log 2024-06-03T00:01:45.865 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.55628.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55628.log.gz 2024-06-03T00:01:45.866 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.60736.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60736.log.gz 2024-06-03T00:01:46.151 INFO:teuthology.orchestra.run.smithi096.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-06-03T00:01:46.354 INFO:teuthology.orchestra.run.smithi096.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-06-03T00:01:46.450 INFO:teuthology.orchestra.run.smithi096.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-06-03T00:01:46.778 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-06-03T00:01:46.865 INFO:teuthology.orchestra.run.smithi162.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-06-03T00:01:47.016 INFO:teuthology.orchestra.run.smithi096.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-06-03T00:01:47.084 INFO:teuthology.orchestra.run.smithi096.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-06-03T00:01:47.176 INFO:teuthology.orchestra.run.smithi096.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-06-03T00:01:47.417 INFO:teuthology.orchestra.run.smithi162.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-06-03T00:01:47.522 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-06-03T00:01:47.524 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-06-03T00:01:47.524 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m1.954s 2024-06-03T00:01:47.525 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m6.470s 2024-06-03T00:01:47.525 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.288s 2024-06-03T00:01:49.349 INFO:teuthology.orchestra.run.smithi096.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-06-03T00:01:49.351 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-06-03T00:01:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:real 0m3.806s 2024-06-03T00:01:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:user 0m10.301s 2024-06-03T00:01:49.352 INFO:teuthology.orchestra.run.smithi096.stderr:sys 0m0.508s 2024-06-03T00:01:49.352 INFO:tasks.ceph:Archiving logs... 2024-06-03T00:01:49.352 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687/remote/smithi096/log 2024-06-03T00:01:49.353 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-03T00:01:50.948 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687/remote/smithi162/log 2024-06-03T00:01:50.948 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-03T00:01:51.864 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-03T00:01:51.873 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-03T00:01:51.873 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-03T00:01:51.876 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-03T00:01:51.962 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-03T00:01:51.971 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-03T00:01:51.971 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-03T00:01:51.974 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-03T00:01:51.988 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2024-06-03T00:01:51.990 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-06-03T00:01:51.993 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-03T00:01:51.993 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2024-06-03T00:01:51.993 INFO:teuthology.orchestra.run.smithi096.stdout:^* hv01.front.sepia.ceph.com 3 7 377 44 +170us[ +170us] +/- 42ms 2024-06-03T00:01:51.993 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -887us[ -887us] +/- 64ms 2024-06-03T00:01:51.993 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 109 +648us[ +647us] +/- 62ms 2024-06-03T00:01:51.993 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-03T00:01:51.995 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-03T00:01:51.995 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-06-03T00:01:51.995 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 +175us[ +173us] +/- 42ms 2024-06-03T00:01:51.995 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -885us[ -887us] +/- 64ms 2024-06-03T00:01:51.996 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +634us[ +632us] +/- 63ms 2024-06-03T00:01:51.996 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-06-03T00:01:51.996 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-03T00:01:52.005 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-03T00:01:52.006 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-03T00:01:52.013 DEBUG:teuthology.orchestra.run.smithi096:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-03T00:01:52.111 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-03T00:01:52.180 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-03T00:01:52.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:01:52.211 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-03T00:01:52.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:01:52.240 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-03T00:01:52.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-03T00:01:52.259 INFO:teuthology.task.internal:Duration was 1342.590786 seconds 2024-06-03T00:01:52.260 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-03T00:01:52.269 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-03T00:01:52.270 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-03T00:01:52.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-03T00:01:52.311 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-03T00:01:52.321 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-03T00:01:52.672 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-03T00:01:52.673 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-06-03T00:01:52.673 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-03T00:01:52.736 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-06-03T00:01:52.736 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-03T00:01:52.765 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-03T00:01:52.765 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-03T00:01:52.778 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-03T00:01:52.832 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-03T00:01:52.832 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-03T00:01:52.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-03T00:01:52.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-03T00:01:52.988 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-03T00:01:52.989 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-03T00:01:53.014 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-03T00:01:53.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-03T00:01:53.050 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-03T00:01:53.056 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-03T00:01:53.077 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-06-03T00:01:53.103 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-06-03T00:01:53.116 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-03T00:01:53.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:01:53.144 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-03T00:01:53.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-03T00:01:53.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-03T00:01:53.183 INFO:teuthology.task.internal:Transferring archived files... 2024-06-03T00:01:53.183 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687/remote/smithi096 2024-06-03T00:01:53.183 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-03T00:01:53.220 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-02_21:24:02-fs-squid-distro-default-smithi/7738687/remote/smithi162 2024-06-03T00:01:53.220 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-03T00:01:53.265 INFO:teuthology.task.internal:Removing archive directory... 2024-06-03T00:01:53.266 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-03T00:01:53.269 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-03T00:01:53.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-03T00:01:53.317 INFO:teuthology.task.internal:Not uploading archives. 2024-06-03T00:01:53.317 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-03T00:01:53.327 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-03T00:01:53.330 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-03T00:01:53.332 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-03T00:01:53.345 INFO:teuthology.orchestra.run.smithi096.stdout: 265305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 3 00:01 /home/ubuntu/cephtest 2024-06-03T00:01:53.360 INFO:teuthology.orchestra.run.smithi162.stdout: 265624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 3 00:01 /home/ubuntu/cephtest 2024-06-03T00:01:53.362 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-03T00:01:53.372 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-03T00:01:53.394 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/snap-schedule} duration: 1342.5907859802246 failure_reason: 'Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=df5940f83f2d42c2b6013cb878d4387a status: fail success: false 2024-06-03T00:01:53.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-03T00:01:53.484 INFO:teuthology.run:FAIL